Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Machine Reading Comprehension on CMRC
Loading...
96.71
F1 Score
C-DPO
87.3292
89.7646
92.2
94.6354
Sep 10, 2024
Nov 11, 2024
Jan 13, 2025
Mar 17, 2025
May 19, 2025
Jul 21, 2025
Sep 22, 2025
F1 Score
EM
Updated 2mo ago
Evaluation Results
Method
Method
Links
F1 Score
EM
C-DPO
Size=70B, Evaluation P...
2024.09
96.71
-
C-SFT
Size=70B, Evaluation P...
2024.09
96.52
-
Token-Opt Trans.
Training Setting=CMRC-...
2025.09
93.6
88.4
C-DPO
Size=8B, Evaluation Pr...
2024.09
93.48
-
Basic Trans.
Training Setting=CMRC-...
2025.09
92.7
87.7
C-SFT
Size=8B, Evaluation Pr...
2024.09
92.26
-
Llama-3 Instruct
Size=70B, Evaluation P...
2024.09
91.21
-
Expanded Vocab
Training Setting=CMRC-...
2025.09
91.1
81.3
Hybrid Trans.
Training Setting=CMRC-...
2025.09
90.2
83.1
Base Llama2
Training Setting=CMRC-...
2025.09
89.5
77.2
UROMAN
Training Setting=CMRC-...
2025.09
88.3
79.6
Llama-3 Instruct
Size=8B, Evaluation Pr...
2024.09
87.69
-
Feedback
Search any
task
Search any
task