Skip to main content

Module patch

Module patch 

Source
Expand description

Dynamic LittleBit patching matching upstream quantization/utils/quant_util.py.

Structs§

PatchPolicy
Pattern rules for per-layer rank scaling (KV_PATTERN) and exclusion (lm_head).
PatchSummary
Summary statistics emitted after applying LittleBit quantization patch across a model.

Functions§

derive_layer_seed
Deterministic FNV-1a seed derivation from base_seed and module name.
patch_linear_layer
Patch a named LinearLayer according to policy and update summary.