RAG News

This feed includes only recent releases, roughly from the last 12 months, not the full historical archive. That is why a long-established product may have only a few news items.

3 news

RAG
Sentence Transformers: training multi-vector models (ColBERT-style)

Fine-tuning guide for MultiVectorEncoder (v6.0): unsupervised checkpoints adapt to a new domain better than off-the-shelf models, and CachedMultiVectorMultipleNegativesRankingLoss decouples batch size from GPU memory. Fine-tuning mLateOn-medical achieved 0.9139 NDCG@10 (+0.062 over the best general-purpose retriever), with training taking 14.5 hours on a single RTX 3090.

late-interaction retrieval is more accurate than dense embeddings on top of ES, but costs more in index size (~40x space) Elasticsearch →
RAG
Papers with Code: hybrid search across 110k+ papers via HF Inference/Jobs/Buckets

A production RAG infrastructure example: PostgreSQL full-text plus semantic search with Qwen3-Embedding-0.6B (256-dimensional Matryoshka vectors), corpus embedding in batches on HF Jobs (L4, about 75 articles/sec), Storage Buckets as a versioned layer between compute and the database, and merging via Reciprocal Rank Fusion with a lexical-only fallback on timeout.

here batch jobs are used instead of streaming - offline reindexing, not a real-time pipeline Apache Kafka →
RAG
Sentence Transformers v6.0: multi-vector (late interaction) encoders

The new MultiVectorEncoder class brings ColBERT-like late interaction on top of dense/sparse models, already in the library. It is more precise on nuances (token-to-token MaxSim instead of compressing into a single vector), but the index is orders of magnitude heavier: 311.5 MB vs 7.5 MB dense on 4,874 Natural Questions passages. 40+ open checkpoints (LateOn, mLateOn, ColBERT, ColPali) are available on HF Hub.

Discuss RAG News

Send via: