Extractive Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
SQuAD 2.0	ModernALBERT-large	F1 Score92.9	34	1mo ago
HotpotQA MRQA	LinkBERT	F1 Score80.8	22	1mo ago
SearchQA MRQA	Splinter	F1 Score83	22	1mo ago
NewsQA MRQA	LinkBERT	F172.6	22	1mo ago
Natural Questions MRQA	LinkBERT	F1 Score81	22	1mo ago
TriviaQA MRQA	LinkBERT	F1 Score78.2	22	1mo ago
MRQA	SpanBERT	NewsQA Score73.6	19	1mo ago
SQuAD MRQA 2019	Splinter	F1 Score92.2	16	1mo ago
Amazon (test)	SWEP	EM62.42	16	1mo ago
Reddit (test)	SWEP	EM65.93	16	1mo ago
BioASQ (test)	SWEP	EM47.27	16	1mo ago
NYT (test)	SWEP	EM78.11	16	1mo ago
Wiki (test)	SWEP	EM78.6	16	1mo ago
SQuAD 20% coverage	QA	F199.04	14	1mo ago
Molweni (test)	ELECTRA-our	EM58.13	14	1mo ago
NewsQA	OLTQA	F1 Score59.7	14	1mo ago
TextbookQA MRQA	Splinter	F1 Score54.5	12	1mo ago
BioASQ MRQA	Splinter	F1 Score91	12	1mo ago
Five Extractive QA datasets aggregated		Calibration Score (C)0.91	10	1mo ago
QUOREF (dev)	CorefRoBERTa_LARGE	EM74.94	10	1mo ago
ChAII (test)	MuCoT (SQuAD + Dravidian + Contrastive)	Jaccard Score (Overall)53	8	1mo ago
PIAF 1.2	Pantagruel-B	QA F155.5	7	1mo ago
MLQA Chinese (test)	GRASP LoRA Merge + pruning	BERTScore F171.28	7	1mo ago
MLQA Arabic (test)	GRASP LoRA Merge + pruning	BERTScore F186.18	7	1mo ago
TriviaQA 50% coverage	QA+E	F1 Score74.37	7	1mo ago

Showing 25 of 38 rows