pub struct StreamingQuantizeReport {
pub patch_summary: PatchSummary,
pub shards_written: usize,
pub blocks_processed: usize,
pub passthrough_tensors: usize,
}Expand description
Summary report returned by stream_quantize_checkpoint.
Fields§
§patch_summary: PatchSummaryQuantization layer & bit-budget statistics across all processed blocks.
shards_written: usizeNumber of .safetensors output shards written.
blocks_processed: usizeNumber of decoder transformer blocks processed.
passthrough_tensors: usizeNumber of non-quantized passthrough tensors copied directly (embeddings, norms, router, head).
Trait Implementations§
Source§impl Clone for StreamingQuantizeReport
impl Clone for StreamingQuantizeReport
Auto Trait Implementations§
impl Freeze for StreamingQuantizeReport
impl RefUnwindSafe for StreamingQuantizeReport
impl Send for StreamingQuantizeReport
impl Sync for StreamingQuantizeReport
impl Unpin for StreamingQuantizeReport
impl UnsafeUnpin for StreamingQuantizeReport
impl UnwindSafe for StreamingQuantizeReport
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
impl<T, U> Imply<T> for U
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more