Feature
Which tokens does a hybrid model predict better?
Amy Reed · 25 June 2026
Token analyses of Olmo 3 and Olmo Hybrid show hybrids predict meaning-bearing tokens better than transformers. Transformers retain an edge on verbatim copying.
Analyses of Olmo 3 and Olmo Hybrid reveal that hybrid models handle meaning bearing and context dependent tokens more effectively than transformers. Transformers still perform better when the task involves verbatim copying of content. This distinction emerges from detailed token level evaluations.