Our new X account is live! Follow @wizwand_team for updates

Reranking on MS MARCO (dev)

41.4MRR@10

RocketQAv2-reranker + HybRank

Updated 3d ago

Evaluation Results

Method
RocketQAv2-reranker + HybRank 2023.05	41.4	70.37	86.68	-	-	-	-	-
RocketQAv2-reranker 2023.05	41.4	-	-	-	-	-	-	-
RocketQAv2-reranker 2023.05	41.15	69.99	86.55	-	-	-	-	-
RocketQAv2-reranker 2023.05	41.15	-	-	-	-	-	-	-
RocketQA-reranker + HybRank 2023.05	40.98	70.4	86.55	-	-	-	-	-
RocketQA-reranker 2023.05	40.98	-	-	-	-	-	-	-
RocketQA-reranker 2023.05	40.51	69.81	86.46	-	-	-	-	-
RocketQA-reranker 2023.05	40.51	-	-	-	-	-	-	-
RocketQAv2-retriever + HybRank 2023.05	38.74	68.12	85.96	-	-	-	-	-
RocketQAv2-retriever 2023.05	38.74	-	-	-	-	-	-	-
TCT-ColBERT-v2 + HybRank 2023.05	37.55	66.39	84.97	-	-	-	-	-
TCT-ColBERT-v2 2023.05	37.55	-	-	-	-	-	-	-
RocketQAv2-retriever 2023.05	37.28	65.72	84.04	-	-	-	-	-
RocketQAv2-retriever 2023.05	37.28	-	-	-	-	-	-	-
RocketQA-retriever + HybRank 2023.05	36.97	65.67	84.91	-	-	-	-	-
RocketQA-retriever 2023.05	36.97	-	-	-	-	-	-	-
ANCE + HybRank 2023.05	36.44	64.63	82.79	-	-	-	-	-
ANCE 2023.05	36.44	-	-	-	-	-	-	-
TAS-B + HybRank 2023.05	36.38	65.77	84.71	-	-	-	-	-
TAS-B 2023.05	36.38	-	-	-	-	-	-	-
DistilBERT-KD + HybRank 2023.05	36.24	64.4	82.02	-	-	-	-	-
DistilBERT-KD 2023.05	36.24	-	-	-	-	-	-	-
TCT-ColBERT-v1 + HybRank 2023.05	36.23	64.96	83.44	-	-	-	-	-
TCT-ColBERT-v1 2023.05	36.23	-	-	-	-	-	-	-
TCT-ColBERT-v2 2023.05	35.85	63.64	83.31	-	-	-	-	-
TCT-ColBERT-v2 2023.05	35.85	-	-	-	-	-	-	-
RocketQA-retriever 2023.05	35.77	64.01	83.41	-	-	-	-	-
RocketQA-retriever 2023.05	35.77	-	-	-	-	-	-	-
TAS-B 2023.05	34.44	62.94	83.44	-	-	-	-	-
TAS-B 2023.05	34.44	-	-	-	-	-	-	-
TCT-ColBERT-v1 2023.05	33.49	60.46	80.67	-	-	-	-	-
TCT-ColBERT-v1 2023.05	33.49	-	-	-	-	-	-	-
ANCE 2023.05	33.01	59.44	80.1	-	-	-	-	-
ANCE 2023.05	33.01	-	-	-	-	-	-	-
DistilBERT-KD 2023.05	32.5	58.77	79.24	-	-	-	-	-
DistilBERT-KD 2023.05	32.5	-	-	-	-	-	-	-
ColBERT-v2 2026.01	0.397	-	-	-	-	-	-	-
ColBERT (sum-max) 2026.01	0.384	-	-	-	-	-	-	44.3
SPLADE + CoCondenser-EnsembleDistil 2026.01	0.38	-	-	-	-	-	-	-
SPLADE + CoCondenser-SelfDistil 2026.01	0.375	-	-	-	-	-	-	-
FastLane 2026.01	0.372	-	-	-	-	-	-	43
SPLADE + EnsembleDistil 2026.01	0.369	-	-	-	-	-	-	-
SPLADE + SelfDistil 2026.01	0.368	-	-	-	-	-	-	-
ColBERT (end-to-end) 2026.01	0.36	-	-	-	-	-	-	40
SPLADE + DistilMSE 2026.01	0.358	-	-	-	-	-	-	-
ColBERT (re-rank) 2026.01	0.348	-	-	-	-	-	-	-
RoBERTa-base + Exhaustive Negatives 2026.01	0.345	-	-	-	-	-	-	-
Dual-encoder BERT (6-layer) 2026.01	0.344	-	-	-	-	-	-	40.4
SPLADE (simple training) 2026.01	0.342	-	-	-	-	-	-	-
RepCONC 2026.01	0.34	-	-	-	-	-	-	-
RoBERTa-base + DyNNIBAL 2026.01	0.334	-	-	-	-	-	-	-
RoBERTa-base + Stochastic Negatives 2026.01	0.331	-	-	-	-	-	-	-
RoBERTa-base + Negative Cache 2026.01	0.331	-	-	-	-	-	-	-
ANCE 2026.01	0.33	-	-	-	-	-	-	38.8
RoBERTa-base + Uniform Negatives 2026.01	0.305	-	-	-	-	-	-	-
CCSA 2026.01	0.289	-	-	-	-	-	-	-
HNSW 2026.01	0.289	-	-	-	-	-	-	-
DSI (Atomic Docid + Doc2Query + Base Model) 2026.01	0.26	-	-	-	-	-	-	32.28
DeepCT 2026.01	0.243	-	-	-	-	-	-	29.6
RoBERTa-base + In-batch Negatives 2026.01	0.242	-	-	-	-	-	-	-
cpt-text XL 2026.01	0.227	-	-	-	-	-	-	-
cpt-text L 2026.01	0.215	-	-	-	-	-	-	-
doc2query 2026.01	0.215	-	-	-	-	-	-	-
DSI (Naive String Docid + Doc2Query + XL Model) 2026.01	0.21	-	-	-	-	-	-	-
docTTTTquery 2026.01	0.2077	-	-	-	-	-	-	-
cpt-text M 2026.01	0.206	-	-	-	-	-	-	-
DSI (Semantic String Docid + Doc2Query + XL Model) 2026.01	0.203	-	-	-	-	-	-	27.86
cpt-text S 2026.01	0.199	-	-	-	-	-	-	-
BM25 (Anserini) 2026.01	0.187	-	-	-	-	-	-	-
BM25 (official) 2026.01	0.167	-	-	-	-	-	-	22.8
DSI (Naive String Docid + Doc2Query + XXL Model) 2026.01	0.165	-	-	-	-	-	-	-
TRLM-Ba 2024.12	-	-	-	28.4	18.54	27.22	70.29	61.49
TRLM-FoBa (Reverse) 2024.12	-	-	-	24.9	17.38	23.85	65.85	58.84
TRLM-FoBa (Forward) 2024.12	-	-	-	21.16	15.58	20.25	59.08	55.46
TRLM-Fo 2024.12	-	-	-	20.37	14.9	19.45	56.39	54.46
Forward Baseline 2024.12	-	-	-	21.05	13.82	18.42	47.81	53
Backward Baseline 2024.12	-	-	-	16.8	14.04	15.99	53.13	52.07
DPR 2026.01	-	-	-	-	-	-	-	17.7
SGPT-CE-2.7B 2026.01	-	-	-	-	-	-	-	27.8
SGPT-CE-6.1B 2026.01	-	-	-	-	-	-	-	29
SGPT-BE-5.8B 2026.01	-	-	-	-	-	-	-	39.9
SPARTA 2026.01	-	-	-	-	-	-	-	35.1
docT5query 2026.01	-	-	-	-	-	-	-	33.8
TAS-B 2026.01	-	-	-	-	-	-	-	40.8
GenQ 2026.01	-	-	-	-	-	-	-	40.8
BM25 + CE 2026.01	-	-	-	-	-	-	-	41.3