Cohere Releases Rerank 5 With Passage-Level Context Focus and Calibrated Scores

Cohere AI has released Rerank 5, a new reranker family available in Pro and Fast tiers. Cohere Rerank 5 is a retrieval model that reorders search results before they reach an LLM. It introduces two developer features: Context Focus, which returns the relevant passages inside each document, and calibrated relevance scores. For RAG and agent builders, the takeaway is straightforward: send fewer, better tokens to the LLM.

TL;DR

• Size: Parameter count not disclosed. 32K token context window. Two tiers: rerank-v5.0-pro and rerank-v5.0-fast.
• Deployment: Hosted API, Model Vault, Microsoft Foundry, Amazon SageMaker, or private VPC and on-prem. Cohere benchmarks speed on a single NVIDIA A100. No open weights or quantized builds.
• Performance: Pro ranks first on 39 of 46 composite datasets in Cohere's own evaluation.
• Best result: Pro scores 82.2 on BRIGHT (RCP-nDCG@10), 5.8 points above Voyage AI Rerank 3.
• Trade-off: Pro median latency is 11.7 s per 96-document request, versus 4.1 s for Fast.

What Is New in Cohere Rerank 5?

Rerank 5 ships as two models. Pro targets ranking quality on reasoning-heavy queries and long, domain-specific documents. Fast targets low latency and high throughput for agents running many searches.

via MarkTechPost