pub struct OptimConfig {
pub lr: f64,
pub min_lr_ratio: f64,
pub warmup: usize,
pub clip: f64,
pub beta1: f64,
pub beta2: f64,
pub adam_eps: f64,
}Expand description
Online Adam optimizer hyperparameters.
Fields§
§lr: f64Peak learning rate.
min_lr_ratio: f64Cosine decay minimum ratio relative to lr.
warmup: usizeLinear warmup steps.
clip: f64Global gradient norm clipping threshold.
beta1: f64Adam beta1 (0.0 in v2).
beta2: f64Adam beta2 (0.9999 in v2).
adam_eps: f64Adam numerical stability epsilon (1e-9 in v2).
Implementations§
Trait Implementations§
Source§impl Clone for OptimConfig
impl Clone for OptimConfig
Source§impl Debug for OptimConfig
impl Debug for OptimConfig
Source§impl<'de> Deserialize<'de> for OptimConfig
impl<'de> Deserialize<'de> for OptimConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for OptimConfig
impl PartialEq for OptimConfig
Source§impl Serialize for OptimConfig
impl Serialize for OptimConfig
impl StructuralPartialEq for OptimConfig
Auto Trait Implementations§
impl Freeze for OptimConfig
impl RefUnwindSafe for OptimConfig
impl Send for OptimConfig
impl Sync for OptimConfig
impl Unpin for OptimConfig
impl UnsafeUnpin for OptimConfig
impl UnwindSafe for OptimConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more