Skip to main content

tokenizer_cache_key

Function tokenizer_cache_key 

Source
pub fn tokenizer_cache_key(tokenizer_descriptor: &str) -> String
Expand description

Compute 7-character SHA-256 hex cache key from tokenizer config metadata, matching hashlib.sha256(hash_key.encode()).hexdigest()[:7].