pub struct KdLossBreakdown {
pub total: Tensor,
pub kd_loss: f64,
pub l2l_loss: f64,
}Expand description
Scalar + differentiable breakdown returned by compute_kd_loss.
Fields§
§total: TensorDifferentiable total loss kd_loss + l2l_loss_scale * sum_l mse(student_l, teacher_l).
kd_loss: f64Detached logit KL-divergence scalar (kd_loss).
l2l_loss: f64Detached scaled layer-to-layer MSE scalar (l2l_loss).
Trait Implementations§
Auto Trait Implementations§
impl !RefUnwindSafe for KdLossBreakdown
impl !UnwindSafe for KdLossBreakdown
impl Freeze for KdLossBreakdown
impl Send for KdLossBreakdown
impl Sync for KdLossBreakdown
impl Unpin for KdLossBreakdown
impl UnsafeUnpin for KdLossBreakdown
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
impl<T, U> Imply<T> for U
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more