#zha

Zyphra AI Introduces Zyphra Hierarchical Attention (ZHA): A PathNEW⭐8

Zyphra's Hierarchical Attention (ZHA) adds a tree-structured indexer for true subquadratic sparse attention, matching dense performance while attending to ~1% o...