Skip to main content

read_tokens_be16

Function read_tokens_be16 

Source
pub fn read_tokens_be16(
    path: impl AsRef<Path>,
) -> Result<Vec<u16>, PreprocessError>
Expand description

Reads big-endian u16 token IDs from path.

ยงErrors

Returns PreprocessError::OddTokenStreamLength or PreprocessError::Io.