Machine Reading Comprehension

Benchmarks

Dataset Name	SOTA Method	Metric
RACE (test)		RACE Accuracy (Medium)95.4	111	4mo ago
SQuAD	Expanded Vocab	EM89.9	58	4mo ago
SQuAD 2.0 (dev)	Retro-Reader	EM88.8	57	4mo ago
SQuAD 2.0 (test)	Retro-Reader	EM89.6	51	4mo ago
Molweni (test)		EM64.3	49	4mo ago
SQuAD 1.1 (dev)	Ours	EM89.71	48	4mo ago
SQuAD 1.1 (test)	XLNet	EM89.898	46	4mo ago
Daily Mail (test)	GA Reader	Accuracy80.9	46	4mo ago
DRCD (test)	MacBERT-large	EM91.7	45	4mo ago
DRCD (dev)	LERT	EM91.6	45	4mo ago
RACE		RACE Overall Accuracy94.5	38	4mo ago
Daily Mail (val)	GA Reader	Accuracy81.5	36	4mo ago
CMRC 2018 (dev)	PERT	EM72.2	34	4mo ago
CMRC Simplified Chinese 2018 (Challenge)	PERT	EM32.3	30	4mo ago
CMRC Simplified Chinese 2018 (test)	PERT	EM76.8	27	4mo ago
Belebele Target language		MRC Score55.78	24	4mo ago
DREAM (test)		Accuracy91.8	23	4mo ago
QA-Feedback (test)	LCO-KLD	Relevance44.9	22	4mo ago
DREAM (dev)	POI-Net	Accuracy90	21	4mo ago
CMRC 2018 (test)	ChineseBERT	EM78.05	21	4mo ago
BELEBELE 5 Unseen Languages		BELE Score85	20	1mo ago
BELEBELE 8 Seen Languages		BELE Score81.8	20	1mo ago
CMRC Simplified Chinese 2018 (dev)	PERT	EM72.2	18	4mo ago
Belebele Source language en	AdaLoRA	MRC Score89.8	16	4mo ago
CJRC (test)	ChineseBERT	EM67	15	4mo ago

Showing 25 of 83 rows