Share your thoughts, 1 month free Claude Pro on usSee more

Multi-hop Question Answering on HotpotQA (EM, LLM Judge)

80LLM Judge Score

INSES + Router

Updated 23h ago

Evaluation Results

Method
INSES + Router 2026.03	80	68	-
Naïve RAG 2026.03	77	67	-
LightRAG 2026.03	77	67	-
SiReRAG 2026.03	75	61	-
MemGraphRAG 2026.05	71.6	-	67.2
Naïve RAG 2026.03	71	62	-
ConRAG 2026.05	70.4	-	68.4
RAPTOR 2026.03	70	68	-
Youtu-GraphRAG 2026.05	69.1	-	67.4
GFM-RAG 2026.05	67.7	-	64.1
LinearRAG 2026.05	67.3	-	65.3
HippoRAG2 2026.05	67.2	-	65.2
M2R 2026.04	65.98	44.11	-
E^2GraphRAG 2026.05	65.7	-	63.1
LogicRAG 2026.05	65.6	-	55.8
ReSearch 2026.04	63.62	43.52	-
ConRAG 2026.05	63.5	-	63
HyDE 2026.03	63	57	-
GraphRAG 2026.03	63	43	-
LogicRAG 2026.05	62.6	-	54.8
LogicRAG 2026.05	62.4	-	60.7
KGP 2026.05	62.1	-	62.7
LightRAG 2026.05	62	-	61.4
HippoRAG2 2026.05	61.9	-	56.7
COFT 2026.04	61.71	41.08	-
HippoRAG 2026.05	61.4	-	58.4
GraphRAG 2026.03	61	47	-
RAPTOR 2026.05	61	-	57
Retrieval 2026.05	60.3	-	58.5
SURE 2026.04	60.16	39.56	-
Retrieval 2026.05	58.9	-	55.4
RAPTOR 2026.05	57.8	-	48.1
LightRAG 2026.05	57.7	-	47.8
KGP 2026.05	57.1	-	46.4
GLM-4 2026.03	57	51	-
M2R 2026.04	56.46	38.7	-
HippoRAG2 2026.05	55.9	-	54.1
ReSearch 2026.04	55.7	38.78	-
HippoRAG 2026.05	55.6	-	53.7
HippoRAG 2026.05	55.3	-	54.1
Vanilla RAG (Top-5) 2026.05	53.9	-	44.1
Vanilla RAG (Top-3) 2026.05	53.1	-	43.2
Iter-RetGen 2026.04	52.22	34.36	-
IRCoT 2026.04	52.06	30.33	-
Vanilla RAG (Top-5) 2026.05	52	-	51.1
SURE 2026.04	51.23	35.44	-
COFT 2026.04	50.88	36.17	-
Retrieval 2026.05	50.4	-	48.8
Naive RAG 2026.04	49.59	31.9	-
LinearRAG 2026.05	49.1	-	50.1
GLM-4 2026.03	49	41	-
Vanilla RAG (Top-1) 2026.05	48.6	-	38.4
Vanilla RAG (Top-3) 2026.05	48.3	-	47.6
IRCoT 2026.03	48	37	-
LinearRAG 2026.05	46.1	-	45.7
GraphRAG 2026.05	45.2	-	39.6
LazyGraphRAG 2026.05	43.8	-	52.7
MS-GraphRAG 2026.05	43.5	-	51.6
GPT-3.5-Turbo 2026.05	42.5	-	32.7
Iter-RetGen 2026.04	42.22	24.63	-
G-retriever 2026.05	41.8	-	44
G-Retriever 2026.05	40.9	-	28.5
IRCoT 2026.04	40.6	23.63	-
GPT-4o-mini 2026.05	39.7	-	38.1
Vanilla RAG (Top-1) 2026.05	38.1	-	39.2
Naive RAG 2026.04	37.23	21.04	-
Zero-shot 2026.05	36.3	-	38.7
Naive Generation 2026.04	30.64	19.18	-
Zero-shot 2026.05	30.6	-	31.5
Llama3-8B 2026.05	28.2	-	30.8
Naive Generation 2026.04	18.45	12.05	-
Llama3-13B 2026.05	17	-	24.9