Open-domain Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
LoCoMo	ShardMemo	F10.4013	111	2mo ago
HotpotQA	LOVER (sum)	Accuracy83.8	103	1mo ago
TriviaQA	RA-ISF	EM76.1	88	1mo ago
Natural Questions (NQ)	DeepSeek-v3	Exact Match (EM)60.7	82	2mo ago
TriviaQA (test)	RFiD-large	Exact Match72.6	80	4mo ago
MS-MARCO		Accuracy91	78	1mo ago
NQ	RetroLLM (Ours)	Accuracy61.6	74	1mo ago
TriviaQA open (test)	FiD-large++	EM73.3	59	2mo ago
MusiQue out-of-domain	UR2	F135.8	57	2mo ago
2WikiMultiHopQA in-domain	UR2	F1 Score62.6	57	2mo ago
HotpotQA in-domain	Search-R1	F1 Score72.4	57	2mo ago
WebQuestions (WebQ) (test)	UnitK-QA	Exact Match (EM)57.8	55	4mo ago
Natural Questions (NQ) (test)		Accuracy58.15	44	1mo ago
TriviaQA	Stable-RAG	SubEM74.01	40	4mo ago
NaturalQuestions (NQ)	Stable-RAG	SubEM52.88	40	4mo ago
NQ (test)	ECoRAG	EM44.38	39	1mo ago
SQUAD Open (test)	IDRQA	Exact Match56.6	39	4mo ago
WebQuestions (WQ) Open-QA (test)	EMDR2	Exact Match48.7	38	4mo ago
WQ (test)	ECoRAG	EM33.71	37	4mo ago
NaturalQ-Open (test)	ATLAS	EM60.4	37	4mo ago
WebQuestions (test)	gemma-2-9b-it	Accuracy59.15	36	4mo ago
NQ (Natural Questions)	FiD-large	EM51.4	33	4mo ago
Quasar-T (test)	Cluster-Former	F1 Score63.9	33	4mo ago
Natural Questions	UMGP-RAG	F1 Score52.2	31	1mo ago
SQuAD Open-domain 1.1 (test)	IRRR	Exact Match (EM)61.8	30	4mo ago

Showing 25 of 171 rows