Share your thoughts, 1 month free Claude Pro on usSee more

Document Reranking on BEIR (Custom Metrics Set)

80.87SF

ProRank

Updated 10d ago

Evaluation Results

Method	Links
ProRank 2025.06		80.87	37.06	80.01	67.97	44.41	89.26	45.63	32.06	17.83	89.86	37.12	79.66	41.75	61.43	57.49
ProRank 2025.06		79.76	35.9	77.7	67.89	42.25	88.95	40.97	28	17.66	89.87	36.4	79.23	35.62	59.95	55.73
bge-gemma 2025.06		78.11	38.35	78.13	54.6	41.03	89.23	44.27	32.93	19.66	84.39	31.55	80.21	41.83	60.95	55.37
ProRank 2025.06		77.15	37.1	79.06	57.82	41.09	88.61	44.66	34.58	17.02	88.55	33.02	79.14	41.25	58.89	55.57
cohere 2025.06		76.58	34.65	79.5	59.9	43.4	87.12	45.12	37.2	18.7	86.2	30.1	77.3	40.6	59.09	55.39
voyage 2025.06		76.25	35.5	79.9	61.5	46.7	87.6	43.5	28.44	18.2	85.8	21.4	78.02	41.57	59.12	54.54
ProRank 2025.06		76.16	37.78	77.21	59.21	40.51	87.51	42.93	31.35	17.6	88.77	31.98	78.51	37.26	56.89	54.55
MonoT5 2025.06		76.1	37.8	79.6	42.5	46.5	-	44.5	30.7	19.3	-	25.4	-	-	-	-
mxbai 2025.06		74.83	39.03	85.33	12.06	40.46	73.9	44.66	35.56	18.89	78.92	23.92	70.85	36.31	55.69	49.32
bge-m3 2025.06		74.5	35.89	77.74	51.98	39.5	89.02	44.05	35.14	14.91	83.45	29.19	79.5	41.73	58.56	53.94
RankLlama 2025.06		72.7	28.1	80.8	49.3	44.1	-	44.9	39.2	18.1	-	24.5	-	-	-	-
RankLlama 2025.06		71.1	27	80.2	54.4	42.1	-	43.7	41.4	16.6	-	23.2	-	-	-	-
BM25 2025.06		67.89	33.75	59.47	29.99	23.61	78.86	31.8	44.22	14.91	65.13	16.51	63.3	22.84	30.55	41.63