| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Reasoning | LiveBench Reasoning | Accuracy92 | 80 | |
| Code Generation | LiveBench | Avg@842.9 | 22 | |
| Coding | LiveBench | Accuracy40.23 | 15 | |
| Mathematical Reasoning | LiveBench Math (test) | Score51.95 | 5 | |
| Examination | LiveBench 2024-11-25 | Score70.79 | 5 | |
| General Tasks | LiveBench 0831 | Accuracy0.57 | 5 |