#llm decoding

Polymathic AI and Princeton Release FlashMap: A Flow-Map DrafterNEW⭐8

FlashMap, a flow-map speculative decoding drafter from Polymathic AI and Princeton, drafts 16-token blocks in one pass for up to 6.14x faster, lossless LLM deco...