Share your thoughts, 1 month free Claude Pro on usSee more

Re-ranking on BEIR (test)

59.3NQ

QRhead+ReAttn

Updated 1mo ago

Evaluation Results

Method	Links
QRhead+ReAttn 2026.02		59.3	78.2	36	40.4	76.8	20.2	86.4	25.3	38.6	52.5	47	50.9
QRhead 2026.02		58.6	77.5	35.3	39.1	76.2	19.4	85.3	23.9	37.2	51.4	46.2	50
MSMARCO-MiniLM 2026.02		55.8	74.3	35.2	35.1	68.5	17.5	80.4	25.5	45.3	47.9	43	48
QRhead+ReAttn 2026.02		55.6	77.6	36.6	36.2	75.3	19.5	84.3	25.6	38	49.8	46	49.3
BGE-Reranker-base 2026.02		55.2	66.4	31	31.7	70.8	15.7	88.6	36.5	42.5	39.9	37	46.8
QRhead 2026.02		54.9	77.4	35.1	35.1	74.7	18.3	83.7	24.5	36	49.7	45.1	48.6
ICR+ReAttn 2026.02		54.4	73.5	35	35.9	76.2	19.3	86.1	25.7	37.5	49.3	45.1	49.3
ICR 2026.02		54	73.3	34.8	35.6	75.5	19	85.8	24.8	36.9	49	44.5	48.5
RankGPTBubble 2026.02		53.7	75.5	34.3	31.4	69.3	17.4	67.5	23.8	42.9	47.8	46.2	46.3
GTR-T5-base 2026.02		51.4	74.8	32.5	34.7	62.1	15.8	72.9	26.8	37.1	46.1	42.8	45.2
QRhead+ReAttn 2026.02		50.7	68.6	34.2	30.3	71.9	16.6	81.5	21.3	37.4	44.8	41	45.3
QRhead 2026.02		49.9	67.7	33.1	29.2	71	15.3	80.7	20.1	35.7	43.7	39.8	44.2
ICR+ReAttn 2026.02		49.8	72.5	34.4	32.5	74.1	17.5	83	24.5	36.8	47.7	45.4	47.3
ICR 2026.02		49.2	72.3	33.8	31.8	73.3	17.4	82.6	24.2	34.7	47.2	44.7	46.5
Contriever 2026.02		44.6	67.5	32.8	28.4	67.1	18.9	64.2	28	39.5	45.7	41.7	43.5
ICR+ReAttn 2026.02		44	67	33.9	28.1	72.2	17.8	80	20.9	36.6	43.6	41.2	44
ICR 2026.02		43.1	66.1	32.7	27	71.1	16.4	79.2	19.6	35.3	43	40	43
RankGPTBubble 2026.02		42.7	70.5	34.1	29.5	69.3	16.6	70.5	19.7	37.1	46.4	43.6	43.6
RankGPTBubble 2026.02		33.2	61.8	32	22.4	66.1	14.8	65.8	17.1	34.8	40.5	40.2	39
BM25 2026.02		30.5	59.5	32.2	23.6	67.9	14.9	65.1	16.5	31.8	40.7	39.5	38.4
RankGPTw/o 2026.02		30	59.5	32.2	23.6	67.9	14.9	65.9	17.1	31.8	40.7	39.5	38.5
RankGPTw/o 2026.02		30	59.5	32.2	23.6	67.9	14.9	65.9	16.8	31.8	40.7	39.5	38.4
RankGPTw/o 2026.02		30	59.5	32.2	23.6	67.9	14.9	65.9	16.8	31.8	40.7	39.5	38.4