Machine Reading Comprehension

Benchmarks

Dataset Name	SOTA Method	Metric
RACE (test)		RACE Accuracy (Medium)95.4	111	1mo ago
SQuAD	Expanded Vocab	EM89.9	58	1mo ago
SQuAD 2.0 (dev)	Retro-Reader	EM88.8	57	1mo ago
SQuAD 2.0 (test)	Retro-Reader	EM89.6	51	1mo ago
Molweni (test)		EM64.3	49	1mo ago
SQuAD 1.1 (dev)	Ours	EM89.71	48	1mo ago
SQuAD 1.1 (test)	XLNet	EM89.898	46	1mo ago
Daily Mail (test)	GA Reader	Accuracy80.9	46	1mo ago
DRCD (test)	MacBERT-large	EM91.7	45	1mo ago
DRCD (dev)	LERT	EM91.6	45	1mo ago
RACE		RACE Overall Accuracy94.5	38	1mo ago
Daily Mail (val)	GA Reader	Accuracy81.5	36	1mo ago
CMRC 2018 (dev)	PERT	EM72.2	34	1mo ago
CMRC Simplified Chinese 2018 (Challenge)	PERT	EM32.3	30	1mo ago
CMRC Simplified Chinese 2018 (test)	PERT	EM76.8	27	1mo ago
Belebele Target language		MRC Score55.78	24	25d ago
DREAM (test)		Accuracy91.8	23	1mo ago
QA-Feedback (test)	LCO-KLD	Relevance44.9	22	1mo ago
DREAM (dev)	POI-Net	Accuracy90	21	1mo ago
CMRC 2018 (test)	ChineseBERT	EM78.05	21	1mo ago
CMRC Simplified Chinese 2018 (dev)	PERT	EM72.2	18	1mo ago
Belebele Source language en	AdaLoRA	MRC Score89.8	16	1mo ago
CJRC (test)	ChineseBERT	EM67	15	1mo ago
CJRC (dev)	ChineseBERT	EM66.5	15	1mo ago
BELEBELE Indonesian	CLO	Accuracy (Target Language)67.1	13	1mo ago

Showing 25 of 78 rows