Expand description
LittleBitLinear and compact 1-bit PackedLittleBitLinear modules.
Structs§
- Factor
Branch - One latent factorization branch
(U, V, u1, u2, v1, v2). - Little
BitLinear - Sub-1-bit factorized linear layer matching upstream
quantization.modules.LittleBitLinear. - Packed
Little BitLinear - Memory-compact 1-bit inference representation keeping
U,Vpacked asi32bitfields.
Enums§
- Param
- Parameter storage that supports both differentiable QAT training and frozen inference.
Constants§
- FP16_
MAX_ SAFE - Maximum finite magnitude safely representable in IEEE-754 binary16 (
f16).
Functions§
- pow2_
at_ least - Compute the smallest power of two
>= val(clamped to>= 1.0), matching thepow2_at_leasthelper fromSamsungLabs/LittleBitIssue #24. - reconstruct_
branch_ matrix - Reconstruct dense approximated weight
(out_features, in_features)fromUandVfactors for diagnostics and error evaluation.