End-to-end Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
MultiHopRAG (test val)	SetR-CoT & IRI	Accuracy47.14	20	1mo ago
MuSiQue (test val)	SetR-CoT & IRI	EM10.79	20	1mo ago
2WikiMultiHopQA (test val)	SetR-CoT & IRI	EM35.44	20	1mo ago
HotpotQA (test val)	SetR-Selection only	EM36.68	20	1mo ago
MultiHop-RAG overall	DPP Base, w/o P-Adapter	Exact Match50.61	12	12d ago
MultiHop-RAG 4-hop	DPP Base, w/o P-Adapter	Exact Match74.21	12	12d ago
MultiHop-RAG 3-hop	ScalDPP	Exact Match48.38	12	12d ago
MultiHop-RAG 2-hop	DPP Base, w/o P-Adapter	Exact Match45.09	12	12d ago
HotpotQA official Wikipedia paragraphs	HopRetriever	EM67.1	9	1mo ago
MMCoQA (test)	LILaC (w/ MM-Embed)	EM36.31	7	1mo ago
MultimodalQA (test)	LILaC (w/ MM-Embed)	EM44.57	7	1mo ago
InfoVQA (test)	LILaC (w/ MM-Embed)	EM60.91	7	1mo ago
MP-DocVQA (test)	LILaC (w/ MM-Embed)	EM65.48	7	1mo ago
AGORA (test)	Base ColBERT / DPO Mistral	Relevancy74.7	6	23d ago
OTT-QA	ARM	Accuracy0.317	6	1mo ago
Bird	ARM	Accuracy20.6	6	1mo ago
MCP-Bench	TURA	Accuracy (Human)87.5	4	1mo ago
InfoSeek 25-sample perturbed subset		Rotation52	4	1mo ago
HotpotQA ANCE	ACQO	MAP@1049.6	3	1mo ago
3+ hop challenge questions (official Wikipedia paragraphs)	IRRR	EM32.5	3	1mo ago

Showing 20 of 20 rows