Multi-hop Reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
MuSiQue	GPT-4o-0806	EM53	41	1mo ago
StrategyQA	OpenMath2-Llama3.1-70B*	Accuracy95.6	36	1mo ago
LoCoMo	GAM	F1 Score35.88	28	3d ago
MuSiQue	AoT	Accuracy39.6	27	10d ago
2WikiMQA IRCoT 500 samples (test)	ActiShade	ACC52.8	27	1mo ago
HotpotQA IRCoT (500 samples) (test)	ActiShade	ACC54.6	27	1mo ago
MuSiQue IRCoT 500 samples (test)	ActiShade	ACC25.59	27	1mo ago
2WikiMHQA	CoT-UQ	AUROC0.7002	26	1mo ago
HotpotQA	CoT-UQ	AUROC67.19	26	1mo ago
HotpotQA	CoT2-Meta	Accuracy90.4	20	16d ago
TriviaQA	Prompt-R1	Exact Match (EM)70.31	17	25d ago
RULER QA	Qwen2.5-14B-1M-LongRLVR	Accuracy (32K Context)95.4	17	1mo ago
CommaQA-E compositional	ChatGPT (SKiC)	Exact Match80.8	15	1mo ago
CommaQA-E (test)	ChatGPT (SKiC)	Exact Match70	15	1mo ago
MuSiQue	CoT	Relative Cost1	14	10d ago
HotpotQA	CoT	Relative Cost1	14	10d ago
MultiHopRAG	Qwen2.5-OpAmp-72B	EM89.6	11	1mo ago
WebQSP	KG-Reasoner	Hits@193.15	10	3d ago
CWQ		Hits@182.2	10	3d ago
2WikiMultihopQA	Prompt-R1	Exact Match (EM)48.44	10	1mo ago
MuSR		Accuracy43.12	10	1mo ago
QASPER	MergeRAG-Sym	EM15	7	25d ago
MuSiQue	MergeRAG-Asym	Exact Match (EM)24	7	25d ago
LongBench MuSiQue and WikiMultiHopQA	MGRS	F1 Score69.9	7	1mo ago
MultiHopRAG Average 1.0 (test)	UniAI-GraphRAG	Relevancy64.47	4	22d ago

Showing 25 of 34 rows