KMMLU
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge | KMMLU | Knowledge EM77.9 | 9 | |
| Text Question Answering | KMMLU-Redux | Accuracy51.8 | 8 | |
| Text Question Answering | KMMLU-Pro | Accuracy46.85 | 8 | |
| Knowledge | KMMLU-Pro | Score70.9 | 7 | |
| General Knowledge Evaluation | KMMLU | Accuracy55.23 | 5 | |
| Korean Language Understanding | KMMLU-Pro | Accuracy73 | 5 | |
| Text-to-Text | KMMLU Korean | Score75.2 | 4 | |
| General Language Understanding | KMMLU-Pro | Score64 | 4 | |
| General Language Understanding | KMMLU | Overall Score73 | 4 | |
| Knowledge | KMMLU Redux | Score75.9 | 3 | |
| Knowledge | KMMLU | Score0.787 | 3 |
Showing 11 of 11 rows