Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Question Answering on M2RAG

42.95B-1 Score

Ours-top3

Updated 1mo ago

Evaluation Results

Method
Ours-top3 2026.04	42.95	33.38	27.6	24.14	61.24	35.89	57.91	264.78
Ours-top1 2026.04	41.84	33.26	27.43	24	61.34	36.7	58.86	260.78
top3 2026.04	40.67	31.39	26.08	23.07	56.56	33.37	54.09	247.13
jinarerank-top3 2026.04	40.46	31.61	26.29	23.41	56.34	34.17	54.05	248.63
jinarerank-top1 2026.04	39.16	30.79	25.33	22.34	58.29	33.35	55.7	243.65
top1 2026.04	38.12	29.88	24.57	21.56	56.64	33.07	53.81	236.08
Ours-top3 2026.04	37.89	33.16	30.21	27.71	52.66	41.01	50.22	278.43
Ours-top1 2026.04	37.28	32.41	29.24	26.69	51.41	40.11	49.19	268.74
jinarerank-top3 2026.04	36.19	31.37	28.32	25.78	50.08	38.37	47.44	259.41
jinarerank-top1 2026.04	35.94	30.97	27.73	25.1	49.47	37.4	46.97	254.57
top1 2026.04	35.73	30.77	27.51	24.86	49.17	37.44	46.28	251.26
top3 2026.04	35.73	30.81	27.65	24.9	49.81	37.83	46.93	250.52
top0 2026.04	34.85	30	27.04	24.49	48.36	37	45.61	250.82
Ours-top3 2026.04	34.26	28.42	25.04	22.25	51.44	36.57	49.33	219.21
top0 2026.04	33.88	27.39	23.15	20.2	48.31	30.52	46.25	206.42
Ours-top1 2026.04	33.69	27.7	24.45	21.97	50.9	36.01	48.89	215.17
Ours-top3 2026.04	33.37	28.11	24.79	22.02	47.94	36.03	44.73	218.62
Ours-top1 2026.04	32.5	27.49	24.4	21.85	47.85	35.22	44.17	211.24
jinarerank-top1 2026.04	30.76	25.73	22.51	19.7	45.23	33.56	41.39	179.37
top3 2026.04	30.67	25.45	22.14	19.55	45.04	32.63	41.42	185.94
jinarerank-top3 2026.04	30.57	25.17	21.29	18.53	47.66	33.21	44.42	166.41
top1 2026.04	30.04	25.15	22.16	19.9	43.43	32.11	40.43	183.07
jinarerank-top3 2026.04	29.89	25.19	22.16	19.68	45.41	33.5	41.39	174.55
top3 2026.04	29.57	24.12	20.32	17.84	46.52	31.99	43.66	156.1
jinarerank-top1 2026.04	28.93	23.36	19.49	16.82	46.79	30.7	44.1	154.62
top1 2026.04	27.14	21.57	17.61	14.83	45.19	28.93	41.47	123.89
top0 2026.04	25.41	20.64	17.61	14.91	39.3	27.78	34.97	105.33
top0 2026.04	25.34	19.78	16.75	14.44	38.82	26.67	34.92	114.24