Elastic Threshold Attention enables hardware-accelerated long-context decoding with end-to-end trainable contextual sparsity
Read the original at arxiv.org→arXiv:2609.20888v1 Announce Type: new Abstract: Massive KV caches can cause severe memory-bandwidth bottlenecks during long-context decoding. Sparse attention methods mitigate this via selective loading, but that...
Original headline: "Elastic Threshold Attention: Learned Contextual Sparsity for Long-Context Decoding"
Coverage timeline
- Sep 21, 04:00 UTC arXiv cs.LG lead source Elastic Threshold Attention: Learned Contextual Sparsity for Long-Context Decoding
- Sep 22, 04:00 UTC arXiv cs.AI RBS-Attention: Radius-Bounded Sparse Prefill for Long-Context Large Language Models