Expand description
Dynamic LittleBit patching matching upstream quantization/utils/quant_util.py.
Structs§
- Patch
Policy - Pattern rules for per-layer rank scaling (
KV_PATTERN) and exclusion (lm_head). - Patch
Summary - Summary statistics emitted after applying LittleBit quantization patch across a model.
Functions§
- derive_
layer_ seed - Deterministic FNV-1a seed derivation from
base_seedand module name. - patch_
linear_ layer - Patch a named
LinearLayeraccording topolicyand updatesummary.