Share your thoughts, 1 month free Claude Pro on usSee more

Information Retrieval on MAIR 20% labeled query-document pairs

48.55Avg MAP@100

ERA

Updated 1mo ago

Evaluation Results

Method
ERA 2026.04	48.55	52.56	57.8	66.99	47.64	27.14	49.26
ERA 2026.04	48.55	52.56	57.8	66.99	47.64	27.14	49.26
Zero-shot 2026.04	47.08	50.76	56.21	63.82	47.24	28.38	47.02
Zero-shot 2026.04	47.08	50.76	56.21	63.82	47.24	28.38	47.02
ERA 2026.04	41.88	43.6	53.62	58.77	40.68	22.07	42.17
ERA 2026.04	41.88	43.6	53.62	58.77	40.68	22.07	42.17
ERA 2026.04	41.76	43.02	51.63	57.08	36.79	22.44	43.63
ERA 2026.04	41.76	43.02	51.63	57.08	36.79	22.44	43.63
Zero-shot 2026.04	39.97	42.48	52.62	55.83	39.11	21.88	39.21
Zero-shot 2026.04	39.97	42.48	52.62	55.83	39.11	21.88	39.21
Zero-shot 2026.04	37.51	38.16	44.07	53.21	31.26	21.05	39.86
Zero-shot 2026.04	37.51	38.16	44.07	53.21	31.26	21.05	39.86
Emb. Adapter 2026.04	36.45	36.72	47.69	52.14	35.39	16.64	37.5
Embedding Adapter 2026.04	36.45	36.72	47.69	52.14	35.39	16.64	37.5
ERA 2026.04	35.8	36.43	42.58	52.5	32.07	17.81	37.97
ERA 2026.04	35.8	36.43	42.58	52.5	32.07	17.81	37.97
ERA 2026.04	33.29	35.28	35.05	56.08	34.7	14.6	35.03
ERA 2026.04	33.29	35.28	35.05	56.08	34.7	14.6	35.03
Emb. Adapter 2026.04	29.9	28.59	43.32	46.57	27.99	13.51	29.5
Embedding Adapter 2026.04	29.9	28.59	43.32	46.57	27.99	13.51	29.5
Zero-shot 2026.04	28.97	30.25	36.35	46.19	27.65	14.12	29.07
Zero-shot 2026.04	28.97	30.25	36.35	46.19	27.65	14.12	29.07
Emb. Adapter 2026.04	28.11	27.69	32.66	40.4	21.73	15.83	30.52
Embedding Adapter 2026.04	28.11	27.69	32.66	40.4	21.73	15.83	30.52
Zero-shot 2026.04	26.93	30.23	29.99	47.8	30.66	11.83	26.39
Zero-shot 2026.04	26.93	30.23	29.99	47.8	30.66	11.83	26.39
Emb. Adapter 2026.04	22.04	19.19	29.29	33.8	20.66	11.96	22.56
Embedding Adapter 2026.04	22.04	19.19	29.29	33.8	20.66	11.96	22.56
Emb. Adapter 2026.04	19.31	17.34	25.66	37.17	21.29	7.43	18.91
Embedding Adapter 2026.04	19.31	17.34	25.66	37.17	21.29	7.43	18.91