pub struct LoadOptions {
pub dtype: DType,
pub device: Device,
pub inference_mode: InferenceMode,
pub overrides: LittleBitConfigOverrides,
pub cache_dir: Option<PathBuf>,
pub token: Option<String>,
pub local_files_only: bool,
}Expand description
Options controlling how a checkpoint or dense model is loaded from disk or Hub.
Fields§
§dtype: DTypeTarget compute dtype (DType::BF16 or DType::F32).
device: DeviceTarget compute device (Device::Cpu, Metal, or CUDA).
inference_mode: InferenceModeUnpack binary weights into float matrices (Unpacked) or keep 1-bit packed (Packed).
overrides: LittleBitConfigOverridesExplicit CLI/API overrides applied with highest priority over config files.
cache_dir: Option<PathBuf>Optional custom Hugging Face cache directory.
token: Option<String>Optional Hugging Face API token.
local_files_only: boolUse only local cached files when resolving a Hub repo ID.
Trait Implementations§
Source§impl Clone for LoadOptions
impl Clone for LoadOptions
Source§impl Debug for LoadOptions
impl Debug for LoadOptions
Auto Trait Implementations§
impl Freeze for LoadOptions
impl RefUnwindSafe for LoadOptions
impl Send for LoadOptions
impl Sync for LoadOptions
impl Unpin for LoadOptions
impl UnsafeUnpin for LoadOptions
impl UnwindSafe for LoadOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
impl<T, U> Imply<T> for U
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more