#subquadratic attention
Subquadratic Attention: 1 AI articles covering subquadratic attention news, analysis, and research
Articles
Zyphra AI Introduces Zyphra Hierarchical Attention (ZHA): A PathNEW⭐8
Zyphra's Hierarchical Attention (ZHA) adds a tree-structured indexer for true subquadratic sparse attention, matching dense performance while attending to ~1% o...