Multi-hop Question Answering on FRAMES (Accuracy)

86Accuracy

Coverage Anchor

Updated 1mo ago

Evaluation Results

Method	Links
Coverage Anchor 2026.03		86
PAR2-RAG 2026.03		85.8
Qwen3-30B-A3B-Thinking-2507 + Data Recipe for Long-Context RL 2026.06		85.8
Qwen3-30B-A3B-Thinking-2507 + KeyChain-15K 2026.06		85.07
Iterative Chain 2026.03		83.4
ReAct 2026.03		83.3
Qwen3-4B-Thinking-2507 + Data Recipe for Long-Context RL 2026.06		82.52
Qwen3-4B-Thinking-2507 + KeyChain-15K 2026.06		82.4
Qwen3-30B-A3B-Thinking-2507 + DocQA-RL-1.6K 2026.06		81.55
PAR2-RAG 2026.03		81.1
Qwen3-8B-128K + KeyChain-15K 2026.06		80.22
Qwen3-30B-A3B-Thinking-2507 2026.06		79.37
Iterative Chain 2026.03		78.8
Qwen3-4B-Thinking-2507 + DocQA-RL-1.6K 2026.06		78.28
IdleSpec 2026.05		78
Qwen3-8B-128K + Data Recipe for Long-Context RL 2026.06		77.67
Qwen3-4B-Thinking-2507 2026.06		77.55
Coverage Anchor 2026.03		77.4
Sequential Revision 2026.05		76.7
IRCoT 2026.03		75.4
Qwen3-8B-128K 2026.06		74.76
ReAct 2026.03		74.5
CoT 2026.03		74.5
Vanilla 2026.05		74
Direct Inference 2026.03		73.9
Sleep-time Compute 2026.05		72.7
IRCoT 2026.03		72.6
Qwen3-8B-128K + DocQA-RL-1.6K 2026.06		71.36
IdleSpec 2026.05		65.3
CoT 2026.03		63.1
Vanilla 2026.05		57.3
IdleSpec 2026.05		56
Sequential Revision 2026.05		56
Sequential Revision 2026.05		53.3
Sleep-time Compute 2026.05		50.7
gemini-2.5-flash 2026.01		50
Vanilla 2026.05		50
Sleep-time Compute 2026.05		50
gemini-2.0-flash 2026.01		45.9
SAGE 2026.01		32.3
Direct Inference 2026.03		29.4
Search-R1 2026.01		26.2
Musique-trained Agent 2026.01		25
SAGE 2026.01		23.8
Musique-trained Agent 2026.01		21.5
Search-R1 2026.01		13.3