Skip to main content

lr_at

Function lr_at 

Source
pub fn lr_at(
    step: usize,
    peak_lr: f64,
    min_lr: f64,
    warmup: usize,
    total_steps: usize,
) -> f64
Expand description

Linear warmup followed by cosine decay to min_lr.