pub struct CheckpointStats {
pub config: LittleBitConfig,
pub is_packed: bool,
pub tensor_count: usize,
pub quantized_layer_count: usize,
pub total_serialized_bytes: usize,
pub quantized_layers_bytes: usize,
pub dense_fp16_bytes: usize,
pub avg_eff_bits: f64,
pub compression_ratio_vs_fp16: f64,
pub layers: Vec<LayerInspection>,
}Expand description
Summary statistics for a LittleBit checkpoint directory.
Fields§
§config: LittleBitConfigResolved quantization config.
is_packed: boolWhether any tensor uses *_packed binary packing.
tensor_count: usizeNumber of tensors in checkpoint.
quantized_layer_count: usizeNumber of factorized LittleBitLinear layers found.
total_serialized_bytes: usizeTotal serialized tensor payload bytes across all shards.
quantized_layers_bytes: usizeTotal serialized bytes across all quantized layers.
dense_fp16_bytes: usizeEquivalent dense FP16 bytes across quantized layers.
avg_eff_bits: f64Weighted average effective bits per weight across all quantized layers.
compression_ratio_vs_fp16: f64Compression ratio (dense_fp16_bytes / quantized_layers_bytes).
layers: Vec<LayerInspection>Sorted per-layer inspection entries.
Trait Implementations§
Source§impl Clone for CheckpointStats
impl Clone for CheckpointStats
Source§impl Debug for CheckpointStats
impl Debug for CheckpointStats
Source§impl<'de> Deserialize<'de> for CheckpointStats
impl<'de> Deserialize<'de> for CheckpointStats
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for CheckpointStats
impl RefUnwindSafe for CheckpointStats
impl Send for CheckpointStats
impl Sync for CheckpointStats
impl Unpin for CheckpointStats
impl UnsafeUnpin for CheckpointStats
impl UnwindSafe for CheckpointStats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
impl<T> ErasedDestructor for Twhere
T: 'static,
impl<T, U> Imply<T> for U
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more