Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on HotPotQA (F1 and AR)

51.72F1 Score

MS-PoE

Updated 1mo ago

Evaluation Results

Method
MS-PoE 2026.06	51.72	42.95
MS-PoE 2026.06	51.72	42.95
UMGP-RAG 2026.06	51.33	42.75
UMGP-RAG 2026.06	51.33	42.75
UMGP-RAG 2026.06	50.68	42
UMGP-RAG 2026.06	50.68	42
UMGP-RAG 2026.06	50.34	42.16
MS-PoE 2026.06	50.01	41.23
MS-PoE 2026.06	50.01	41.23
RAG 2026.06	49.91	41.32
RAG 2026.06	49.91	41.32
Hybrid 2026.06	49.86	41.75
Hybrid 2026.06	49.86	41.75
MS-PoE 2026.06	49.48	40.73
UMGP-RAG 2026.06	49.19	40.71
RAG 2026.06	49.13	40.48
RAG 2026.06	49.13	40.48
RAG 2026.06	48.83	40.41
UMG-RAG 2026.06	48.27	40.18
UMG-RAG 2026.06	48.27	40.18
LongRAG 2026.06	47.99	39.84
LongRAG 2026.06	47.99	39.84
RAG 2026.06	47.98	39.66
RAG 2026.06	47.98	39.66
Hybrid 2026.06	47.75	39.75
LongRAG 2026.06	47.65	39.61
LongRAG 2026.06	47.65	39.61
UMG-RAG 2026.06	47.52	39.29
UMG-RAG 2026.06	47.52	39.29
UMG-RAG 2026.06	47.49	39.57
Hybrid 2026.06	47.09	39.04
Hybrid 2026.06	47.09	39.04
LongLLMLingua 2026.06	47.06	38.07
LongLLMLingua 2026.06	46.68	37.71
LongLLMLingua 2026.06	46.68	37.71
LongRAG 2026.06	46.58	38.45
LongLLMLingua 2026.06	46.44	37.38
LongLLMLingua 2026.06	46.44	37.38
Hybrid 2026.06	46.26	38.37
MS-PoE 2026.06	46.22	38.05
UMG-RAG 2026.06	46.22	38.2
PINE 2026.06	46.21	39.8
RAG 2026.06	46.13	38.5
RAG 2026.06	46.13	37.98
LongLLMLingua 2026.06	46.03	36.93
LongRAG 2026.06	45.24	37.48
PINE 2026.06	44.63	40.27
PINE 2026.06	44.63	40.27
UMGP-RAG 2026.06	44.6	36.55
UMGP-RAG 2026.06	44.6	36.55
UMGP-RAG 2026.06	44.53	36.45
PINE 2026.06	44.42	37.87
PINE 2026.06	44.09	39.41
PINE 2026.06	44.09	39.41
REPLUG 2026.06	43.43	34.11
REPLUG 2026.06	43.43	34.11
Summarized RAG 2026.06	43.15	35.46
Summarized RAG 2026.06	43.15	35.46
REPLUG 2026.06	42.87	33.62
REPLUG 2026.06	42.87	33.62
Hybrid 2026.06	42.45	34.79
Hybrid 2026.06	42.45	34.79
UMG-RAG 2026.06	42.23	34.7
UMG-RAG 2026.06	42.23	34.7
UMG-RAG 2026.06	41.63	34.16
Summarized RAG 2026.06	41.09	33.66
Summarized RAG 2026.06	41.09	33.66
Hybrid 2026.06	40.81	33.11
REPLUG 2026.06	40.75	32.52
Summarized RAG 2026.06	39.76	32.61
REPLUG 2026.06	39.41	31.5
Summarized RAG 2026.06	38.56	31.61
LongLLMLingua 2026.06	30.21	23.62
LongLLMLingua 2026.06	30.21	23.62
MS-PoE 2026.06	28.6	23.39
MS-PoE 2026.06	28.6	23.39
LongLLMLingua 2026.06	28.33	22.71
RAG 2026.06	28.03	22.79
RAG 2026.06	28.03	22.79
LongRAG 2026.06	26.25	21.04
LongRAG 2026.06	26.25	21.04
MS-PoE 2026.06	26.12	21.12
RAG 2026.06	25.99	20.87
REPLUG 2026.06	25.6	19.84
REPLUG 2026.06	25.6	19.84
PINE 2026.06	25.57	21.8
PINE 2026.06	25.57	21.8
Summarized RAG 2026.06	24.69	20.25
Summarized RAG 2026.06	24.69	20.25
PINE 2026.06	24.24	20.39
LongRAG 2026.06	22.99	18.61
Summarized RAG 2026.06	22.75	18.64
REPLUG 2026.06	17.98	14.66