#inference acceleration

Inference Acceleration: 1 AI articles covering inference acceleration news, analysis, and research

Articles

Polymathic AI and Princeton Release FlashMap: A Flow-Map Drafter

Polymathic AI and Princeton Release FlashMap: A Flow-Map DrafterNEW⭐8

πŸ“… 1ε°ζ—Άε‰πŸ‘ 10 views

FlashMap, a flow-map speculative decoding drafter from Polymathic AI and Princeton, drafts 16-token blocks in one pass for up to 6.14x faster, lossless LLM deco...