Machine Reading Comprehension

Benchmarks

Dataset Name	SOTA Method	Metric
RACE (test)		RACE Accuracy (Medium)95.4	111	3mo ago
SQuAD	Expanded Vocab	EM89.9	58	3mo ago
SQuAD 2.0 (dev)	Retro-Reader	EM88.8	57	3mo ago
SQuAD 2.0 (test)	Retro-Reader	EM89.6	51	3mo ago
Molweni (test)		EM64.3	49	3mo ago
SQuAD 1.1 (dev)	Ours	EM89.71	48	3mo ago
SQuAD 1.1 (test)	XLNet	EM89.898	46	3mo ago
Daily Mail (test)	GA Reader	Accuracy80.9	46	3mo ago
DRCD (test)	MacBERT-large	EM91.7	45	3mo ago
DRCD (dev)	LERT	EM91.6	45	3mo ago
RACE		RACE Overall Accuracy94.5	38	3mo ago
Daily Mail (val)	GA Reader	Accuracy81.5	36	3mo ago
CMRC 2018 (dev)	PERT	EM72.2	34	3mo ago
CMRC Simplified Chinese 2018 (Challenge)	PERT	EM32.3	30	3mo ago
CMRC Simplified Chinese 2018 (test)	PERT	EM76.8	27	3mo ago
Belebele Target language		MRC Score55.78	24	2mo ago
DREAM (test)		Accuracy91.8	23	3mo ago
QA-Feedback (test)	LCO-KLD	Relevance44.9	22	3mo ago
DREAM (dev)	POI-Net	Accuracy90	21	3mo ago
CMRC 2018 (test)	ChineseBERT	EM78.05	21	3mo ago
CMRC Simplified Chinese 2018 (dev)	PERT	EM72.2	18	3mo ago
Belebele Source language en	AdaLoRA	MRC Score89.8	16	3mo ago
CJRC (test)	ChineseBERT	EM67	15	3mo ago
CJRC (dev)	ChineseBERT	EM66.5	15	3mo ago
KorQuAD 1.0 (dev)	KOMBO_Jamo	Exact Match (EM)77.47	13	1mo ago

Showing 25 of 80 rows