#speculative decoding
Speculative Decoding: 11 AI articles covering speculative decoding news, analysis, and research
Articles
DFlash Speculative Decoding Drafts Whole Token Blocks in⭐8
DFlash speculative decoding drafts entire token blocks in parallel, achieving up to 15x higher throughput on NVIDIA Blackwell GPUs.