Skip to main content

Module scheduler

Module scheduler 

Source
Expand description

Cosine learning rate schedule with linear warmup (WarmupCosineLR).

Structsยง

CosineWarmupScheduler
Learning rate scheduler implementing linear warmup followed by cosine decay.