OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of GemmaTokenizer.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of GemmaTokenizer.