#distributed llm inference

X-CoSD: Communication-Efficient Cross-Vocabulary Collaborative Speculative DecodingNEW⭐8

X-CoSD enables lossless, communication-efficient collaborative speculative decoding across heterogeneous SLM–LLM vocabularies, improving token generation speed ...