Skip to main content

Module zero_config

Module zero_config 

Source
Expand description

Parser for upstream DeepSpeed configuration files (configs/zero*.json).

Structsยง

ZeroBf16Config
BF16 section inside a DeepSpeed config JSON.
ZeroConfig
Single-node compatible representation of configs/zero*.json.
ZeroOptimizationConfig
ZeRO optimization block inside a DeepSpeed config JSON.
ZeroSchedulerConfig
Scheduler block inside a DeepSpeed config JSON.
ZeroSchedulerParams
Scheduler parameters inside a DeepSpeed config JSON.