pub struct CosineWarmupScheduler { /* private fields */ }Expand description
Learning rate scheduler implementing linear warmup followed by cosine decay.
Implementations§
Source§impl CosineWarmupScheduler
impl CosineWarmupScheduler
Sourcepub fn new(
base_lr: f64,
total_steps: usize,
warmup_ratio: f64,
min_lr_ratio: f64,
) -> Self
pub fn new( base_lr: f64, total_steps: usize, warmup_ratio: f64, min_lr_ratio: f64, ) -> Self
Construct a scheduler from base LR, total optimizer steps, warmup ratio, and cos_min_ratio.
Sourcepub fn lr_at_step(&self, step: usize) -> f64
pub fn lr_at_step(&self, step: usize) -> f64
Compute the learning rate at optimizer step step (0-indexed).
Trait Implementations§
Source§impl Clone for CosineWarmupScheduler
impl Clone for CosineWarmupScheduler
impl Copy for CosineWarmupScheduler
Auto Trait Implementations§
impl Freeze for CosineWarmupScheduler
impl RefUnwindSafe for CosineWarmupScheduler
impl Send for CosineWarmupScheduler
impl Sync for CosineWarmupScheduler
impl Unpin for CosineWarmupScheduler
impl UnsafeUnpin for CosineWarmupScheduler
impl UnwindSafe for CosineWarmupScheduler
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
impl<T, U> Imply<T> for U
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more