MTBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM-as-a-Judge | MTbench (test) | StdDev2.24 | 45 | |
| General Capability | MTBench | MTBench Score9.14 | 43 | |
| Multi-turn Dialogue | MTBench101 | Score9.03 | 33 | |
| Helpfulness Evaluation | MTBench | Helpfulness9.35 | 18 | |
| Multi-modal Instruction Following | MM MTBench | Overall Score84.9 | 18 | |
| Temperature Forecasting | MTBench Temperature Forecasting (14-day) | MSE5.026 | 17 | |
| Stock Price Forecasting | MTBench Stock Price Forecasting (30-day) | MAE1.122 | 17 | |
| Stock Price Forecasting | MTBench Stock Price Forecasting 7-day | MAE0.788 | 17 | |
| Pair-wise comparison | MTBench Human | Accuracy88.9 | 16 | |
| Math Tutoring | MTBench MathTutorBench OOD | Score (Sc)8.29 | 13 | |
| Trend Prediction | MTBench Weather (Long) | Past Accuracy93.496 | 10 | |
| Trend Prediction | MTBench Weather Short | Past Trend Prediction Score93.877 | 10 | |
| Trend Prediction | MTBench Finance Long | 3-way Accuracy62.671 | 10 | |
| Trend Prediction | MTBench Finance Short | 3-way Score66.849 | 10 | |
| Time Series Forecasting | MTBench Weather Long | MSE11.823 | 10 | |
| Time Series Forecasting | MTBench Weather Short | MSE10.02 | 10 | |
| Time Series Forecasting | MTBench Finance (Long) | MAPE3.531 | 10 | |
| Time Series Forecasting | MTBench Finance Short | MAPE2.545 | 10 | |
| Weather Indicator Prediction | MTBench Weather Indicator | Max MSE10.898 | 9 | |
| Weather Forecasting | MTBench 7-day weather forecast | MSE10.719 | 9 | |
| Question Answering | MTBench Weather | Accuracy71.7 | 9 | |
| Question Answering | MTBench Finance | Accuracy91.3 | 9 | |
| Regression | MTBench Weather | MAE3.523 | 9 | |
| Regression | MTBench Finance | MAE0.814 | 9 | |
| Classification | MTBench Weather | Accuracy55.7 | 9 |
Showing 25 of 36 rows