SOTA Single-hop Question Answering benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
PopQA	HierSearch	EM61.6	104	29d ago
TriviaQA	Dep-Search	EM72	81	29d ago
LoCoMo	ShardMemo	F10.6408	53	1mo ago
NQ	Tree-GRPO	Exact Match (EM)51.7	44	1mo ago
TriviaQA (test)	InfoReasoner-3B	Accuracy63.4	38	1mo ago
Single-hop QA Average	MemPO	F1 Score59.61	35	1mo ago
Natural Questions (NQ) (test)	SE-Search-3B	EM47.5	33	1mo ago
Trivia	Tree-GRPO	Exact Match68.1	30	1mo ago
LoCoMo Single-Hop (test)		F137.9	24	1mo ago
MFQA en 16k	DCS	Overall Score23.76	22	1mo ago
Qasper	Llama-3-8B-Instruct	Score44.79	22	1mo ago
NarrativeQA	DCS	Score23.89	22	1mo ago
MFQA en	Llama-3-8B-Instruct with DCS	Score45.83	22	1mo ago
PopQA (test)	InfoReasoner-3B	Accuracy44.2	21	1mo ago
NQ (Natural Questions) (test)	InfoReasoner-3B	Accuracy45.3	21	1mo ago
SQuAD		F1 Score86.8	21	1mo ago
NQ (Natural Questions) in-domain (test)	ARPO	EM31.45	20	1mo ago
Factrecall en	LM-infinite	Score31.36	17	1mo ago
Loogle SD	DCS	Score45.1	17	1mo ago
Natural Questions	Amber	Accuracy47.8	15	1mo ago
PopQA 2018 Wikipedia dump (dev)	MR-Search	Accuracy47.2	14	1mo ago
TriviaQA 2018 Wikipedia dump (dev)	MR-Search	Accuracy66.6	14	1mo ago
NQ (Natural Questions) 2018 Wikipedia dump (dev)	MR-Search	Accuracy50.2	14	1mo ago
Single-Hop QA NQ, TriviaQA, PopQA	SLEA-RL	NQ Score48.5	13	29d ago
Complex-TR ODQA 1.0 (test)	FiD-PIT + Refine	Set Accuracy49	13	1mo ago

Showing 25 of 36 rows