Open-domain Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
LoCoMo	ShardMemo	F10.4013	111	7d ago
TriviaQA	RA-ISF	EM76.1	88	4d ago
Natural Questions (NQ)	DeepSeek-v3	Exact Match (EM)60.7	82	19d ago
TriviaQA (test)	RFiD-large	Exact Match72.6	80	3mo ago
NQ	RetroLLM (Ours)	Accuracy61.6	74	4d ago
HotpotQA	LOVER (sum)	Accuracy83.8	73	4d ago
TriviaQA open (test)	FiD-large++	EM73.3	59	22d ago
MusiQue out-of-domain	UR2	F135.8	57	1mo ago
2WikiMultiHopQA in-domain	UR2	F1 Score62.6	57	1mo ago
HotpotQA in-domain	Search-R1	F1 Score72.4	57	1mo ago
WebQuestions (WebQ) (test)	UnitK-QA	Exact Match (EM)57.8	55	3mo ago
MS-MARCO		Accuracy91	48	1mo ago
TriviaQA	Stable-RAG	SubEM74.01	40	3mo ago
NaturalQuestions (NQ)	Stable-RAG	SubEM52.88	40	3mo ago
NQ (test)	ECoRAG	EM44.38	39	4d ago
SQUAD Open (test)	IDRQA	Exact Match56.6	39	3mo ago
WebQuestions (WQ) Open-QA (test)	EMDR2	Exact Match48.7	38	3mo ago
WQ (test)	ECoRAG	EM33.71	37	3mo ago
NaturalQ-Open (test)	ATLAS	EM60.4	37	3mo ago
WebQuestions (test)	gemma-2-9b-it	Accuracy59.15	36	3mo ago
NQ (Natural Questions)	FiD-large	EM51.4	33	3mo ago
Quasar-T (test)	Cluster-Former	F1 Score63.9	33	3mo ago
SQuAD Open-domain 1.1 (test)	IRRR	Exact Match (EM)61.8	30	3mo ago
TriviaQA (TQA)	UR-RAG	Accuracy0.4177	28	2mo ago
TriviaQA (TQA) (test)	Fusion-in-Decoder	Accuracy77.1	26	3mo ago

Showing 25 of 163 rows