SOTA Open-domain Question Answering benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
TriviaQA (test)	RFiD-large	Exact Match72.6	80	3d ago
TriviaQA	RA-ISF	EM76.1	62	3d ago
TriviaQA open (test)	FiD-large++	EM73.3	59	3d ago
WebQuestions (WebQ) (test)	UnitK-QA	Exact Match (EM)57.8	55	3d ago
LoCoMo	ShardMemo	F10.4013	53	3d ago
Natural Questions (NQ)	Fusion-in-Decoder	Exact Match (EM)51.4	46	3d ago
TriviaQA	Stable-RAG	SubEM74.01	40	3d ago
NaturalQuestions (NQ)	Stable-RAG	SubEM52.88	40	3d ago
SQUAD Open (test)	IDRQA	Exact Match56.6	39	3d ago
WebQuestions (WQ) Open-QA (test)	EMDR2	Exact Match48.7	38	3d ago
WQ (test)	ECoRAG	EM33.71	37	3d ago
NaturalQ-Open (test)	ATLAS	EM60.4	37	3d ago
WebQuestions (test)	gemma-2-9b-it	Accuracy59.15	36	3d ago
NQ (Natural Questions)	FiD-large	EM51.4	33	3d ago
Quasar-T (test)	Cluster-Former	F1 Score63.9	33	3d ago
SQuAD Open-domain 1.1 (test)	IRRR	Exact Match (EM)61.8	30	3d ago
TriviaQA (TQA) (test)	Fusion-in-Decoder	Accuracy77.1	26	3d ago
CuratedTREC (test)		Exact Match (EM)55.3	26	3d ago
Natural Questions (NQ) (dev)	PAQ + FiE	Exact Match53	25	3d ago
LoCoMo Open-Domain (test)		F1 Score15.12	24	3d ago
NQ (test)	ECoRAG	EM44.38	22	3d ago
NQ-Open		Accuracy29	20	3d ago
NQ	EJ-Full	EM42.3	20	2d ago
WebQuestions	PoG	Hits@184.6	19	3d ago
Natural Questions	GPT-3 175B	Macro EM11.4	19	2d ago

Showing 25 of 124 rows