Skip to main content

Module linear

Module linear 

Source
Expand description

LittleBitLinear and compact 1-bit PackedLittleBitLinear modules.

Structs§

FactorBranch
One latent factorization branch (U, V, u1, u2, v1, v2).
LittleBitLinear
Sub-1-bit factorized linear layer matching upstream quantization.modules.LittleBitLinear.
PackedLittleBitLinear
Memory-compact 1-bit inference representation keeping U, V packed as i32 bitfields.

Enums§

Param
Parameter storage that supports both differentiable QAT training and frozen inference.

Constants§

FP16_MAX_SAFE
Maximum finite magnitude safely representable in IEEE-754 binary16 (f16).

Functions§

pow2_at_least
Compute the smallest power of two >= val (clamped to >= 1.0), matching the pow2_at_least helper from SamsungLabs/LittleBit Issue #24.
reconstruct_branch_matrix
Reconstruct dense approximated weight (out_features, in_features) from U and V factors for diagnostics and error evaluation.