pub struct LittleBitConfig {
pub quant_func: QuantFunc,
pub eff_bit: Option<f64>,
pub eff_bit_layers: Option<String>,
pub split_dim: usize,
pub residual: bool,
pub kv_factor: f64,
pub min_split_dim: usize,
pub quant_mod: String,
pub use_itq: bool,
pub itq_n_iter: usize,
}Expand description
Quantization configuration matching upstream littlebit_config.json.
Fields§
§quant_func: QuantFuncBinarization estimator ("STEBinary" or "SmoothSign").
eff_bit: Option<f64>Target average effective bits per weight (None falls back to split_dim).
eff_bit_layers: Option<String>Optional per-decoder-block effective bit overrides (e.g., "0-7,27:2.0;12:1.5").
split_dim: usizeFallback inner latent rank when eff_bit is omitted.
residual: boolWhether to include a second residual latent factorization branch.
kv_factor: f64Rank multiplier applied to attention k_proj and v_proj layers.
min_split_dim: usizeMinimum inner rank floor (must be positive; rounded in multiples of 8 when computed).
quant_mod: StringQuantized module identifier ("LittleBitLinear").
use_itq: boolOpt-in flag for LittleBit-2 Joint-ITQ initialization.
itq_n_iter: usizeNumber of Joint-ITQ iterations when use_itq is enabled.
Implementations§
Source§impl LittleBitConfig
impl LittleBitConfig
Sourcepub fn residual_mode(&self) -> ResidualMode
pub fn residual_mode(&self) -> ResidualMode
Return the residual factorization mode.
Sourcepub fn validate(&self) -> Result<()>
pub fn validate(&self) -> Result<()>
Validate hyperparameter invariants.
§Errors
Returns LittleBitError::InvalidConfig when any value is invalid or non-finite.
Sourcepub fn eff_bit_for_module(&self, module_name: &str) -> Result<Option<f64>>
pub fn eff_bit_for_module(&self, module_name: &str) -> Result<Option<f64>>
Resolve the effective bits target for module_name by applying matching
LittleBitConfig::eff_bit_layers overrides over LittleBitConfig::eff_bit.
§Errors
Returns LittleBitError::InvalidConfig if eff_bit_layers is malformed.
Sourcepub fn effective_for_module(&self, module_name: &str) -> Result<Self>
pub fn effective_for_module(&self, module_name: &str) -> Result<Self>
Return a config scoped to module_name, applying any per-block eff_bit_layers override.
§Errors
Returns LittleBitError::InvalidConfig if eff_bit_layers is malformed.
Sourcepub fn load_with_priority(
dir: &Path,
overrides: &LittleBitConfigOverrides,
) -> Result<Self>
pub fn load_with_priority( dir: &Path, overrides: &LittleBitConfigOverrides, ) -> Result<Self>
Load configuration using upstream priority:
- Explicit
overrides littlebit_config.jsonindirconfig.jsonfallback fields for legacy checkpointsLittleBitConfig::default
§Errors
Returns an error if a present config file cannot be read or parsed, or if the
resulting configuration fails LittleBitConfig::validate.
Trait Implementations§
Source§impl Clone for LittleBitConfig
impl Clone for LittleBitConfig
Source§impl Debug for LittleBitConfig
impl Debug for LittleBitConfig
Source§impl Default for LittleBitConfig
impl Default for LittleBitConfig
Source§impl<'de> Deserialize<'de> for LittleBitConfigwhere
LittleBitConfig: Default,
impl<'de> Deserialize<'de> for LittleBitConfigwhere
LittleBitConfig: Default,
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Source§impl PartialEq for LittleBitConfig
impl PartialEq for LittleBitConfig
Source§impl Serialize for LittleBitConfig
impl Serialize for LittleBitConfig
impl StructuralPartialEq for LittleBitConfig
Auto Trait Implementations§
impl Freeze for LittleBitConfig
impl RefUnwindSafe for LittleBitConfig
impl Send for LittleBitConfig
impl Sync for LittleBitConfig
impl Unpin for LittleBitConfig
impl UnsafeUnpin for LittleBitConfig
impl UnwindSafe for LittleBitConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
impl<T> ErasedDestructor for Twhere
T: 'static,
impl<T, U> Imply<T> for U
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more