BACK_TO_FEEDAICRIER_2
ColQwen3.5-v3 release tops ViDoRe leaderboard
OPEN_SOURCE ↗
REDDIT · REDDIT// 24d agoMODEL RELEASE

ColQwen3.5-v3 release tops ViDoRe leaderboard

ColQwen3.5-4.5B-v3 is Athrael Soju’s latest visual document retrieval model, and it now claims the top average spot on ViDoRe V3 while using roughly half the parameters, about 13x fewer embedding dimensions, and about half the memory of the previous leader. The release also comes with a public eval trail and a case study that explains the optimization process behind the jump.

// ANALYSIS

Strong result, but the real story is efficiency, not raw accuracy. This looks like a benchmark win that matters because it makes a high-performing retrieval model meaningfully cheaper to deploy.

  • The headline number is 75.67 mean on MTEB ViDoRe V3, with a smaller 4.5B model and 320-dim embeddings, which is a very practical tradeoff for document retrieval stacks.
  • V3 only nudges past V2 on English @5, so the author’s own read is persuasive: the big breakthrough was the earlier jump in V2, not a dramatic V3 leap.
  • The public optimization trail is unusually transparent for a model release, which makes the leaderboard claim feel more credible than the usual one-off “SOTA” post.
  • Official support in `colpali-engine` and `vLLM` matters here, because retrieval models are only useful if they are easy to serve.
  • This is a strong fit for teams building vision-RAG or document search systems, where memory footprint and embedding width often matter as much as benchmark rank.
// TAGS
colqwen3-5-4-5b-v3embeddingbenchmarkopen-sourcemultimodalsearch

DISCOVERED

24d ago

2026-03-18

PUBLISHED

24d ago

2026-03-18

RELEVANCE

10/ 10

AUTHOR

madkimchi