Text Ranking on BEIR Out-of-Domain (Aggregate)

56.2Average Score (BEIR OOD)

TSARankLLM

Updated 23d ago

Evaluation Results

Method
TSARankLLM 2023.11	56.2	55.6	27.7	50	83.7	44.9	76.4	39.4	58.7	82.9	19.2	78	83.3	30.2
MonoT5 2023.11	54.6	28.8	28	47.8	85	51.4	75.9	38.4	63.3	84.1	19.7	77.7	79.5	30
TSARankLLM 2023.11	54.5	55.1	23.6	45.4	82.3	42	75.4	37.9	57.6	82.3	18.7	76.3	81.7	29.7
RankT5 2023.11	53.7	33	21.5	44.2	83.2	44.5	71	38.1	61.4	83.1	18.1	75	80.7	44
TSARankLLM 2023.11	53.7	53.3	22.3	44.5	83.6	40	75.6	37.3	56.1	82.9	18.1	77.1	78.9	28.2
MonoT5 2023.11	53.1	30.2	25.9	43.5	82.8	44.6	73.6	38.4	60.8	85.4	19.1	75.5	82.3	28.5
ModernBERT-VT 2026.04	52.4	-	-	-	-	-	-	-	-	-	-	-	-	-
SPLADE-v3 2026.04	52	-	-	-	-	-	-	-	-	-	-	-	-	-
Co-SelfDistil 2026.04	51.2	-	-	-	-	-	-	-	-	-	-	-	-	-
ESPLADE 2026.04	51.2	-	-	-	-	-	-	-	-	-	-	-	-	-
Co-EnsembleDistil 2026.04	50.9	-	-	-	-	-	-	-	-	-	-	-	-	-
BERT (Splade) 2026.04	50.6	-	-	-	-	-	-	-	-	-	-	-	-	-
MonoBERT 2023.11	50.5	51.5	24.9	43.5	81.3	36.8	73.5	36.9	56.8	71.5	15.7	72	65	27.7
BERT (Splade) + further MLM 2026.04	50.5	-	-	-	-	-	-	-	-	-	-	-	-	-
ColBERTv2 2026.04	50	-	-	-	-	-	-	-	-	-	-	-	-	-
MonoT5 2023.11	49.3	13.2	24.5	42	80.2	41.4	69.5	35.7	56.7	82.3	16.5	73.6	77.8	27.7
BM25 2023.11	48.3	39.7	16.5	31.8	65.1	23.6	63.3	33.8	30.6	78.9	14.9	67.9	59.5	44.2
ModernBERT (Splade) 2026.04	47.7	-	-	-	-	-	-	-	-	-	-	-	-	-
ModernBERT (Splade) + further MLM 2026.04	47.5	-	-	-	-	-	-	-	-	-	-	-	-	-
ModernBERT (Splade) + lowercase input 2026.04	46.8	-	-	-	-	-	-	-	-	-	-	-	-	-
ModernBERT (dense) 2026.04	44.2	-	-	-	-	-	-	-	-	-	-	-	-	-
uniCOIL 2026.04	44.1	-	-	-	-	-	-	-	-	-	-	-	-	-
BM25 2026.04	43.7	-	-	-	-	-	-	-	-	-	-	-	-	-
BERT (dense) 2026.04	42.1	-	-	-	-	-	-	-	-	-	-	-	-	-
CoCondenser 2026.04	42	-	-	-	-	-	-	-	-	-	-	-	-	-
DeepImpact 2026.04	41.5	-	-	-	-	-	-	-	-	-	-	-	-	-
DPR 2026.04	37.5	-	-	-	-	-	-	-	-	-	-	-	-	-