Together AI announces FlashAttention-4, up to 1.3× faster than cuDNN on Blackwell

FlashAttention-4 represents a significant incremental gain for infrastructure efficiency. By outperforming cuDNN on Blackwell hardware, it provides a clear path to lower compute costs and faster iteration cycles for anyone training large transformer models. The performance delta is meaningful enough to justify immediate testing in production environments where attention bottlenecks currently limit throughput.

Operators should prioritize integrating this update into existing PyTorch workflows to capture the 1.3x speedup. While the gains are specific to Blackwell architecture, the optimization of attention mechanisms is a fundamental improvement for model scalability. Focus on benchmarking your specific workloads against cuDNN to verify these results before committing to a full migration of your training stack.