pub struct RouterDispatch {
pub top_k_indices: Vec<Vec<usize>>,
pub top_k_weights: Vec<Vec<f32>>,
}Expand description
Sparse expert routing decision emitted by Gemma4Router.
Fields§
§top_k_indices: Vec<Vec<usize>>Selected expert indices per flattened token [num_tokens][top_k].
top_k_weights: Vec<Vec<f32>>Normalized & scaled routing weights per flattened token [num_tokens][top_k].
Trait Implementations§
Source§impl Clone for RouterDispatch
impl Clone for RouterDispatch
Auto Trait Implementations§
impl Freeze for RouterDispatch
impl RefUnwindSafe for RouterDispatch
impl Send for RouterDispatch
impl Sync for RouterDispatch
impl Unpin for RouterDispatch
impl UnsafeUnpin for RouterDispatch
impl UnwindSafe for RouterDispatch
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
impl<T, U> Imply<T> for U
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more