Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CMRC

Benchmarks

Task NameDataset NameSOTA ResultTrend
Machine Reading ComprehensionCMRC 2018 (dev)
EM72.2
34
Machine Reading ComprehensionCMRC Simplified Chinese 2018 (Challenge)
EM32.3
30
Machine Reading ComprehensionCMRC Simplified Chinese 2018 (test)
EM76.8
27
Machine Reading ComprehensionCMRC 2018 (test)
EM78.05
21
Machine Reading ComprehensionCMRC Simplified Chinese 2018 (dev)
EM72.2
18
Question AnsweringCMRC syntactically perturbed 2018
F1 Score85.9
17
Machine Reading ComprehensionCMRC 2018 (Challenge)
EM32.3
11
Machine Reading ComprehensionCMRC
EM88.4
6
Showing 8 of 8 rows