Expand description
Cosine learning rate schedule with linear warmup (WarmupCosineLR).
Structsยง
- Cosine
Warmup Scheduler - Learning rate scheduler implementing linear warmup followed by cosine decay.
Cosine learning rate schedule with linear warmup (WarmupCosineLR).