C3
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Reading Comprehension | C3 | Accuracy93.5 | 89 | |
| Understanding | C3 | Score68.94 | 20 | |
| Reading Comprehension | C3 (test) | Accuracy77.38 | 16 | |
| Chinese Reading Comprehension | C3 | Score57.97 | 10 | |
| Chinese Reasoning | C3 | Accuracy96.88 | 8 | |
| Multi-choice Question Answering | C3 | Accuracy44.6 | 8 | |
| Spoken Dialogue Evaluation | C3 ZH | Phonetic Error9.19 | 7 | |
| Spoken Dialogue Evaluation | C3 EN | Phonetic Score48.28 | 7 | |
| Directness | C3 news community level post-cutoff (test) | Win Percentage61 | 6 | |
| Camera pose estimation | C3 | Angular Recall @ 5°65.91 | 5 | |
| Correspondence Estimation | C3 clean | PCK @ 1%20.42 | 5 | |
| Reading Comprehension | C3 | EM83.1 | 3 |
Showing 12 of 12 rows