C-Eval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Chinese Language Understanding | C-Eval | Accuracy92.5 | 68 | |
| General Knowledge Assessment | C-Eval | Accuracy92.5 | 46 | |
| Knowledge Evaluation | C-Eval (test) | Natural Sciences Score93.02 | 36 | |
| Language Understanding | C-Eval | C-Eval Score87.7 | 29 | |
| Multi-level multi-discipline evaluation | C-Eval | Accuracy81.4 | 28 | |
| Comprehensive Chinese Evaluation | C-Eval | Accuracy89 | 22 | |
| Knowledge | C-Eval | C-Eval Knowledge Accuracy0.6824 | 18 | |
| General Language Understanding | C-Eval (val) | Accuracy78.68 | 18 | |
| Knowledge | C-EVAL | Score88.12 | 17 | |
| General Knowledge Evaluation | C-Eval (val) | Accuracy34.32 | 15 | |
| Chinese Language Knowledge and Reasoning | C-Eval | Overall Score78.5 | 14 | |
| Comprehensive Examination | C-Eval (test) | Accuracy71.5 | 14 | |
| C-Eval | C-Eval | Accuracy42.79 | 13 | |
| Chinese General Knowledge Question Answering | C-Eval | Accuracy91.82 | 13 | |
| General Knowledge Evaluation | C-Eval (test) | Accuracy71.8 | 13 | |
| Chinese Language Evaluation | C-Eval (val) | C-Eval 0-shot Score83 | 12 | |
| General Knowledge | C-Eval 1.0 (val) | Accuracy78.68 | 12 | |
| Knowledge-intensive reasoning | C-Eval | Score90.2 | 7 | |
| Chinese Language Understanding | C-Eval (test) | Accuracy86 | 7 | |
| General Knowledge | C-Eval | Score47.62 | 6 | |
| Question Answering | C-Eval | Accuracy82.7 | 6 | |
| Chinese Language Understanding | C-Eval | Exact Match91.8 | 6 | |
| Exam | C-Eval | Accuracy83.28 | 4 | |
| Language Understanding | C-Eval | Exact Match92.5 | 4 | |
| Reasoning | C-Eval (val) | Acc (Normalized)26.15 | 3 |
Showing 25 of 29 rows