Skip to content
Feature

Which tokens does a hybrid model predict better?

Amy Reed · 25 June 2026

Token analyses of Olmo 3 and Olmo Hybrid show hybrids predict meaning-bearing tokens better than transformers. Transformers retain an edge on verbatim copying.

Analyses of Olmo 3 and Olmo Hybrid reveal that hybrid models handle meaning bearing and context dependent tokens more effectively than transformers. Transformers still perform better when the task involves verbatim copying of content. This distinction emerges from detailed token level evaluations.

Keep reading, free

Join the My AI Guide email to read the full story, what it means for you and the sources. One email every Monday.

One email every Monday. We will send a quick confirm first, so we know it is really you. Privacy Policy.