End-to-end Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
FinSlides	SlideAgent	Overall Score85.5	25	1mo ago
TechSlides	SlideAgent	Overall Score70.9	25	1mo ago
MultiHopRAG (test val)	SetR-CoT & IRI	Accuracy47.14	20	3mo ago
MuSiQue (test val)	SetR-CoT & IRI	EM10.79	20	3mo ago
2WikiMultiHopQA (test val)	SetR-CoT & IRI	EM35.44	20	3mo ago
HotpotQA (test val)	SetR-Selection only	EM36.68	20	3mo ago
MultiHop-RAG overall	DPP Base, w/o P-Adapter	Exact Match50.61	12	1mo ago
MultiHop-RAG 4-hop	DPP Base, w/o P-Adapter	Exact Match74.21	12	1mo ago
MultiHop-RAG 3-hop	ScalDPP	Exact Match48.38	12	1mo ago
MultiHop-RAG 2-hop	DPP Base, w/o P-Adapter	Exact Match45.09	12	1mo ago
MuSiQue (test)	INTRA	EM14	9	26d ago
HotPotQA (test)	INTRA	EM0.464	9	26d ago
DoRA IBM Granite retriever (test)	DoRA SFT	Token F1 Score57.52	9	1mo ago
DoRA full (test)	DoRA SFT	Token F1 Score56.53	9	1mo ago
HotpotQA official Wikipedia paragraphs	HopRetriever	EM67.1	9	3mo ago
MMCoQA (test)	LILaC (w/ MM-Embed)	EM36.31	7	3mo ago
MultimodalQA (test)	LILaC (w/ MM-Embed)	EM44.57	7	3mo ago
InfoVQA (test)	LILaC (w/ MM-Embed)	EM60.91	7	3mo ago
MP-DocVQA (test)	LILaC (w/ MM-Embed)	EM65.48	7	3mo ago
AGORA (test)	Base ColBERT / DPO Mistral	Relevancy74.7	6	2mo ago
OTT-QA	ARM	Accuracy0.317	6	3mo ago
Bird	ARM	Accuracy20.6	6	3mo ago
MCP-Bench	TURA	Accuracy (Human)87.5	4	2mo ago
InfoSeek 25-sample perturbed subset		Rotation52	4	3mo ago
HotpotQA ANCE	ACQO	MAP@1049.6	3	3mo ago

Showing 25 of 26 rows