Share your thoughts, 1 month free Claude Pro on usSee more

Reranking on BEIR (NDCG@10)

65.11NDCG@10 (Avg)

Qwen3-Reranker-8B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3-Reranker-8B 2026.06		65.11	82.92	49.63	52.49	56.07	94.96	59.72	84.24	46.84	41.71	77.13	89.88	28.97	81.85
Qwen3-Reranker-4B 2026.06		63.5	79.85	49.92	49.94	54.59	94.46	56.69	83.68	44.47	41.57	74.03	88.4	27.14	80.73
KaLM-Reranker-V1-L 2026.06		62.87	74.39	38.56	53.05	50.87	92.86	62.63	84.1	46.13	41.99	75.72	91	24.88	81.12
mxbai-rerank-large-v2 2026.06		60.32	71.43	46.54	45.9	49.74	93.74	50.75	82.66	47.65	37.59	70.77	89.56	16.99	80.86
KaLM-Reranker-V1-S 2026.06		60.01	67.48	41.01	48.36	46.64	92.46	55.32	82.64	43.79	40.69	71.41	90.48	21.88	78.02
Qwen3-Reranker-0.6B 2026.06		59.36	73.13	48.84	47.21	49.43	93.45	47.99	81.19	42.35	39.32	64.04	84.12	22.15	78.46
mxbai-rerank-base-v2 2026.06		58.18	63.41	43.38	45.79	48.97	92.71	46.43	81.45	46.79	38.3	66.83	88.14	14.93	79.16
KaLM-Reranker-V1-N 2026.06		57.41	64.22	36.2	45.62	46.1	91.34	48.14	81.29	43.3	37.56	65.7	89.52	20.55	76.84
gte-reranker-base 2026.06		56.77	58.44	47.04	39.21	47.31	94.25	45.35	81.48	45.44	36.61	65.58	81.83	17.74	77.71
jina-reranker-v2 2026.06		56.26	51.59	34.4	40.85	49.03	92.35	46.1	79.73	47.71	37.12	67.16	87.8	20.01	77.5
bge-reranker-v2-m3 2026.06		55.15	41.73	37.41	39.09	47.77	90.15	45.07	82.62	47.79	34.54	69.25	89.14	18.04	74.35
bge-reranker-v2-gemma 2026.06		54.49	69.34	29.6	37.28	43.02	82.87	47.21	82.09	45.38	28.59	68.8	86.64	18.86	68.66
KaLM-Embedding-V2.5 2026.06		53.78	59.6	32.53	45.54	42.62	83.72	46.99	70.74	40.15	36.95	57.53	88.88	19.88	73.98
bge-reranker-large 2026.06		51.86	28.47	41.51	38.89	48.76	93.01	41.41	83.12	46.96	34.14	52.46	73.84	17.23	74.41