Cohere's new reranker speeds up RAG by 3x

If you are running enterprise search or RAG pipelines, reranking is often the secret sauce for relevance, but it frequently comes with a nasty latency penalty.

Cohere launched Rerank 3 Nimble, the newest addition to its popular foundation model reranking lineup.

Triple the speed for enterprise RAG

According to Cohere, Rerank 3 Nimble was built specifically to supercharge enterprise search and RAG workflows.

The model delivers roughly three times the speed of Rerank 3 while maintaining a high level of accuracy.

For now, availability is limited: the company noted that Rerank 3 Nimble is offered exclusively on Amazon SageMaker.

Why it matters

We think this is a very practical release targeting production pain points.

RAG architectures live and die by response times. While rerankers dramatically boost search precision, they are notorious latency bottlenecks when processing lots of retrieved passages. Tripling the throughput without gutting accuracy is exactly what teams with strict latency budgets need.

That said, keeping it locked to Amazon SageMaker means developers running on other clouds or on-prem setups will have to wait or jump through hoops to test it out.