Skip to main content

Transformer

Struct Transformer 

Source
pub struct Transformer { /* private fields */ }
Expand description

Neural Transformer language model matching nn.py.

Implementations§

Source§

impl Transformer

Source

pub fn new( config: &ModelConfig, device: &Device, rng: &mut DeterministicRng, ) -> Result<Self, CodecError>

Initializes a new Transformer with deterministic weights on device.

§Errors

Returns CodecError on invalid model configuration or tensor allocation error.

Source

pub fn from_prior( config: &ModelConfig, archive_path: impl AsRef<Path>, vocab_path: impl AsRef<Path>, seed: u64, device: &Device, rng: &mut DeterministicRng, ) -> Result<(Self, PriorLoadInfo), CodecError>

Constructs a Transformer and immediately loads a QPI1 prior archive.

For loop-untying priors (where every target block is copied from the archive), parameter buffers are allocated zeroed instead of sampling discarded normal initialization weights. For depth-growth priors (where unmapped layers retain random initialization), full deterministic initialization is performed via rng.

§Errors

Returns CodecError if reading, validating, or loading the prior archive fails.

Source

pub fn forward( &self, idx: &Tensor, output_slice: OutputSlice, mode: &mut ForwardMode<'_>, compute_dtype: DType, ) -> Result<Tensor, CodecError>

Runs a forward pass over token IDs idx ([batch, seq], U32), returning logits.

§Errors

Returns CodecError if tensor shapes, sequence lengths, or Candle operations fail.

Source

pub fn named_vars(&self) -> &[(String, Var)]

Returns all unique trainable (name, Var) pairs in canonical order.

Source

pub fn param_counts(&self) -> (usize, usize)

Returns (total_params, non_embedding_params).

Source

pub fn state_shapes(&self) -> BTreeMap<String, Vec<usize>>

Returns the expected parameter shape map matching PyTorch state_dict().

Source

pub fn state_sha256(&self) -> Result<String, CodecError>

Computes a deterministic SHA-256 digest over all parameter names, shapes, dtypes, and f32 bytes.

§Errors

Returns CodecError::Candle if reading parameter tensors from device fails.

Source

pub fn load_prior( &mut self, archive_path: impl AsRef<Path>, vocab_path: impl AsRef<Path>, seed: u64, ) -> Result<PriorLoadInfo, CodecError>

Loads and validates a QPI1 depth-growth or loop-untying prior archive.

§Errors

Returns CodecError if reading, validating, or transferring tensors fails.

Source

pub fn export_tensors( &self, out: &mut HashMap<String, Tensor>, ) -> Result<(), CodecError>

Exports all trainable parameters into out under "model.<name>" keys for safetensors checkpoints.

§Errors

Returns CodecError::Candle if converting tensors to contiguous CPU tensors fails.

Source

pub fn import_tensors( &mut self, tensors: &HashMap<String, Tensor>, ) -> Result<(), CodecError>

Restores trainable parameters from checkpoint tensors loaded by load_checkpoint.

§Errors

Returns CodecError if any expected parameter is missing or has an incompatible shape.

Source

pub fn weight_norm(&self) -> Result<f64, CodecError>

Computes global L2 parameter norm across all trainable parameters.

§Errors

Returns CodecError::Candle on tensor read failures.

Trait Implementations§

Source§

impl Debug for Transformer

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<T> ErasedDestructor for T
where T: 'static,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> Pointable for T

§

const ALIGN: usize

The alignment of pointer.
§

type Init = T

The type for initializers.
§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more