Extractive Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
SQuAD 2.0	ModernALBERT-large	F1 Score92.9	34	4mo ago
HotpotQA MRQA	LinkBERT	F1 Score80.8	22	4mo ago
SearchQA MRQA	Splinter	F1 Score83	22	4mo ago
NewsQA MRQA	LinkBERT	F172.6	22	4mo ago
Natural Questions MRQA	LinkBERT	F1 Score81	22	4mo ago
TriviaQA MRQA	LinkBERT	F1 Score78.2	22	4mo ago
Molweni (test)	iLoRA	EM60.57	21	1mo ago
MRQA	SpanBERT	NewsQA Score73.6	19	4mo ago
SQuAD MRQA 2019	Splinter	F1 Score92.2	16	4mo ago
Amazon (test)	SWEP	EM62.42	16	4mo ago
Reddit (test)	SWEP	EM65.93	16	4mo ago
BioASQ (test)	SWEP	EM47.27	16	4mo ago
NYT (test)	SWEP	EM78.11	16	4mo ago
Wiki (test)	SWEP	EM78.6	16	4mo ago
SQuAD 20% coverage	QA	F199.04	14	4mo ago
NewsQA	OLTQA	F1 Score59.7	14	4mo ago
TextbookQA MRQA	Splinter	F1 Score54.5	12	4mo ago
BioASQ MRQA	Splinter	F1 Score91	12	4mo ago
Five Extractive QA datasets aggregated		Calibration Score (C)0.91	10	4mo ago
QUOREF (dev)	CorefRoBERTa_LARGE	EM74.94	10	4mo ago
PQuAD	IHUBERT	EM75.981	8	1mo ago
ParsiNLU-RC	IHUBERT	EM27.3684	8	1mo ago
ChAII (test)	MuCoT (SQuAD + Dravidian + Contrastive)	Jaccard Score (Overall)53	8	4mo ago
PIAF 1.2	Pantagruel-B	QA F155.5	7	4mo ago
MLQA Chinese (test)	GRASP LoRA Merge + pruning	BERTScore F171.28	7	4mo ago

Showing 25 of 42 rows