Skip to main content

Module hub

Module hub 

Source
Expand description

Hugging Face Hub integration and checkpoint packaging (quantization/hub.py parity).

Structs§

LittleBitModel
LittleBit quantized model wrapper supporting local persistence and Hugging Face Hub upload/download.
LoadOptions
Options controlling how a checkpoint or dense model is loaded from disk or Hub.
PushOptions
Options controlling Hub publication via LittleBitModel::push_to_hub.

Functions§

load_dense_model
Load a dense (unquantized) Hugging Face causal LM from a local directory or Hub repo ID.
resolve_model_dir
Resolve a local directory or download a model repository snapshot from Hugging Face Hub.