Machine Reading Comprehension

Benchmarks

Dataset Name	SOTA Method	Metric
RACE (test)		RACE Accuracy (Medium)95.4	111	3d ago
SQuAD	Expanded Vocab	EM89.9	58	3d ago
SQuAD 2.0 (dev)	Retro-Reader	EM88.8	57	3d ago
SQuAD 2.0 (test)	Retro-Reader	EM89.6	51	3d ago
Molweni (test)		EM64.3	49	3d ago
SQuAD 1.1 (dev)	Ours	EM89.71	48	3d ago
SQuAD 1.1 (test)	XLNet	EM89.898	46	3d ago
Daily Mail (test)	GA Reader	Accuracy80.9	46	3d ago
DRCD (test)	MacBERT-large	EM91.7	45	3d ago
DRCD (dev)	LERT	EM91.6	45	3d ago
RACE		RACE Overall Accuracy94.5	38	3d ago
Daily Mail (val)	GA Reader	Accuracy81.5	36	3d ago
CMRC 2018 (dev)	PERT	EM72.2	34	3d ago
CMRC Simplified Chinese 2018 (Challenge)	PERT	EM32.3	30	3d ago
CMRC Simplified Chinese 2018 (test)	PERT	EM76.8	27	3d ago
DREAM (test)		Accuracy91.8	23	3d ago
DREAM (dev)	POI-Net	Accuracy90	21	3d ago
CMRC 2018 (test)	ChineseBERT	EM78.05	21	3d ago
CMRC Simplified Chinese 2018 (dev)	PERT	EM72.2	18	3d ago
Belebele Target language		MRC Score49.2	16	3d ago
Belebele Source language en	AdaLoRA	MRC Score89.8	16	3d ago
CJRC (test)	ChineseBERT	EM67	15	3d ago
CJRC (dev)	ChineseBERT	EM66.5	15	3d ago
BELEBELE Indonesian	CLO	Accuracy (Target Language)67.1	13	3d ago
RACE Full (test)	BiAttention (MRU) Ensemble	Accuracy53.3	13	3d ago

Showing 25 of 77 rows