Expand description
Parser for upstream DeepSpeed configuration files (configs/zero*.json).
Structsยง
- Zero
Bf16 Config - BF16 section inside a DeepSpeed config JSON.
- Zero
Config - Single-node compatible representation of
configs/zero*.json. - Zero
Optimization Config - ZeRO optimization block inside a DeepSpeed config JSON.
- Zero
Scheduler Config - Scheduler block inside a DeepSpeed config JSON.
- Zero
Scheduler Params - Scheduler parameters inside a DeepSpeed config JSON.