Our new X account is live! Follow @wizwand_team for updates

Multi-hop Question Answering on 2WikiMHQA

85.56F1 Score

CRAFT7B

Updated 2d ago

Evaluation Results

Method
CRAFT7B 2026.02	85.56	79.7	89.9
CRAFT_7B 2026.02	84.57	78.72	94.8
GPT-5-mini 2026.02	81.01	70.55	95.95
GPT-5-mini 2026.02	80.64	69.95	94
Gemini-2.5-Flash 2026.02	79.31	70.2	94.2
Gemini-2.5-Flash 2026.02	79.18	70.15	94.3
Deepseek-V3.2 2026.02	79.02	69.65	97.15
Qwen3-30B 2026.02	78.35	69.95	88.25
Deepseek-V3.2 2026.02	77.67	68.7	96.5
Qwen3-4B 2026.02	72.63	63.2	82.05
Qwen2.5-7B 2026.02	71.32	62.65	78.95
Qwen2.5-7B 2026.02	67.73	59.25	78.3
Qwen2.5-7B 2026.02	66.72	57.7	76.85
Qwen3-30B 2026.02	66.24	56.3	90.35
Qwen2.5-7B 2026.02	65.68	56.05	77.2
CRAFT_3B 2026.02	64.75	56.5	76.1
Qwen3-4B 2026.02	64.16	53.85	86.6
CRAFT3B 2026.02	63.17	54.7	78.9
Qwen2.5-3B 2026.02	61.39	52.05	72.25
Qwen2.5-3B 2026.02	58.12	49.5	66.45
Qwen2.5-3B 2026.02	52.51	43.35	57.95
CRAFT1.5B 2026.02	52.4	45.45	38.78
CRAFT_1.5B 2026.02	52.05	44.7	47.85
Qwen2.5-1.5B 2026.02	41.97	34.8	34.65
Qwen2.5-3B 2026.02	38.8	30.55	45.25
Qwen2.5-1.5B 2026.02	34.14	27.7	38.05
CRAFT0.5B 2026.02	28.79	22.65	15.9
CRAFT_0.5B 2026.02	28.46	22.85	1.85
Qwen2.5-1.5B 2026.02	21.53	15.5	18.15
RAG-Rerank 2026.01	19.43	-	-
HyDE-Rerank 2026.01	19.3	-	-
FullKV 2026.01	18.52	-	-
BM25 2026.01	17.8	-	-
S3-Hybrid 2026.01	17.56	-	-
Qwen2.5-1.5B 2026.02	16.08	10.4	9.1
S3-Pure 2026.01	14.99	-	-
HyDE-Rerank 2026.01	14.62	-	-
RAG-Rerank 2026.01	14.61	-	-
S3-Hybrid 2026.01	14.52	-	-
RAG-Rerank 2026.01	14.5	-	-
HyDE-Rerank 2026.01	14.46	-	-
BM25 2026.01	14.35	-	-
FullKV 2026.01	14.2	-	-
BM25 2026.01	13.89	-	-
FullKV 2026.01	13.76	-	-
S3-Pure 2026.01	13.15	-	-
S3-Hybrid 2026.01	13.02	-	-
S3-Pure 2026.01	12.43	-	-
Qwen2.5-0.5B 2026.02	9.93	6	1.55
RAG-Dense 2026.01	7.91	-	-
RAG-Dense 2026.01	7.71	-	-
RAG-Dense 2026.01	7.19	-	-
Qwen2.5-0.5B 2026.02	5.13	1.9	2.25
Qwen2.5-0.5B 2026.02	4.72	2.85	0.68
Qwen2.5-0.5B 2026.02	2.75	1.05	1.2