#collaborative inference
Collaborative Inference: 1 AI articles covering collaborative inference news, analysis, and research
Articles
X-CoSD: Communication-Efficient Cross-Vocabulary Collaborative Speculative DecodingNEW⭐8
X-CoSD enables lossless, communication-efficient collaborative speculative decoding across heterogeneous SLM–LLM vocabularies, improving token generation speed ...