Alibaba + Nanjing Univ Claim 9.36X Faster Million-Token Prefill vs FlashAttention-2

Alibaba and Nanjing University researchers claim a 9.36X speedup for million-token prefill in long-context LLM inference, significantly outperforming FlashAttention-2. This breakthrough addresses the dominant latency bottleneck in processing large prompts, where attention computation typically scales quadratically.