Feature
FlashAttention-4 Achieves 1.3x Speedup over cuDNN on NVIDIA Blackwell
Amy Reed · 12 May 2026
Together AI released FlashAttention-4. It delivers up to 1.3x faster performance than cuDNN on NVIDIA Blackwell GPUs.
Together AI released FlashAttention-4. It achieves up to 1.3× faster performance than cuDNN on NVIDIA Blackwell GPUs. This update targets attention kernel optimizations for transformer models.