Feature
ByteDance's "iLLaDA" is a diffusion language model that keeps up with Qwen2.5
Amy Reed · 27 June 2026
Researchers from Renmin University and ByteDance released iLLaDA, an 8B diffusion language model. It matches Qwen2.5 at base level but lags after fine-tuning.
Researchers from Renmin University and ByteDance released iLLaDA, an 8B diffusion language model that generates text differently than standard approaches in ChatGPT. It matches Qwen2.5 performance at the base level before any fine-tuning steps. Developers and Vibe Builders can now access this alternative generation…