pub struct TransformerGeometry {
pub vocab_size: usize,
pub n_layer: usize,
pub d_model: usize,
pub n_head: usize,
pub d_inner: usize,
pub ctx_len: usize,
pub tie_embeddings: bool,
pub position_type: String,
pub qk_norm: bool,
pub norm_style: String,
}Expand description
Architectural geometry used to verify source/target compatibility for QPI1 priors.
Fields§
§vocab_size: usizeVocabulary token count.
n_layer: usizeNumber of physical transformer blocks.
d_model: usizeHidden state width.
n_head: usizeNumber of attention heads.
d_inner: usizeSwiGLU intermediate dimension.
ctx_len: usizeMaximum context window length.
tie_embeddings: boolWhether input and output embeddings share weights.
position_type: StringAttention positional mechanism ("rope" or "learned_relative").
qk_norm: boolWhether per-head QK RMSNorm is active.
norm_style: StringBlock normalization style ("peri" or "post").
Implementations§
Source§impl TransformerGeometry
impl TransformerGeometry
Sourcepub fn mismatch_excluding_n_layer(&self, other: &Self) -> Option<&'static str>
pub fn mismatch_excluding_n_layer(&self, other: &Self) -> Option<&'static str>
Compares all fields except n_layer, returning the first mismatched field name.
Trait Implementations§
Source§impl Clone for TransformerGeometry
impl Clone for TransformerGeometry
Source§impl Debug for TransformerGeometry
impl Debug for TransformerGeometry
Source§impl<'de> Deserialize<'de> for TransformerGeometry
impl<'de> Deserialize<'de> for TransformerGeometry
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for TransformerGeometry
Source§impl PartialEq for TransformerGeometry
impl PartialEq for TransformerGeometry
Source§impl Serialize for TransformerGeometry
impl Serialize for TransformerGeometry
impl StructuralPartialEq for TransformerGeometry
Auto Trait Implementations§
impl Freeze for TransformerGeometry
impl RefUnwindSafe for TransformerGeometry
impl Send for TransformerGeometry
impl Sync for TransformerGeometry
impl Unpin for TransformerGeometry
impl UnsafeUnpin for TransformerGeometry
impl UnwindSafe for TransformerGeometry
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more