Share your thoughts, 1 month free Claude Pro on usSee more

Multi-hop QA on HotpotQA (HpQA) Wiki18 index (test)

59.1Pass@4

Gemma3-12B

Updated 1mo ago

Evaluation Results

Method	Links
Gemma3-12B 2026.06		59.1
Qwen3-8B 2026.06		57
Gemma3-12B 2026.06		54.9
Qwen3-4B 2026.06		53.2
Qwen3-8B 2026.06		50.4
Gemma3-4B 2026.06		49.2
Qwen3-1.7B 2026.06		43.8
Qwen3-1.7B 2026.06		42.9
Qwen3-4B 2026.06		41.9
Gemma3-4B 2026.06		40