Expand description
QAT Knowledge Distillation trainer (main.py & utils/kd_utils.py parity).
Structsยง
- KdTrainer
- Quantization-Aware Knowledge Distillation trainer matching
KDTrainerinutils/kd_utils.py. - Step
Metrics - Metrics logged for each optimizer step.
- Training
Config - Hyperparameters for
KdTrainer. - Training
Summary - Summary returned after
KdTrainer::traincompletes.