#llm efficiency

RBS-Attention: Radius-Bounded Sparse Prefill for Long-ContextNEW⭐8

RBS-Attention is a training-free sparse prefill method that fixes mean dilution in long-context LLM inference, delivering up to 5.97× faster time-to-first-token...