Skip to main content

compute_eff_bits

Function compute_eff_bits 

Source
pub fn compute_eff_bits(
    in_features: usize,
    out_features: usize,
    split_dim: usize,
    residual: ResidualMode,
) -> f64
Expand description

Compute actual effective bits per weight for a layer geometry.

Matches LittleBitLinear._compute_eff_bits:

  • Single: (s * (a + b + 16) + 16 * (a + b)) / (a * b)
  • Dual: (s * 2 * (a + b + 16) + 32 * (a + b)) / (a * b)