Arena
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Instruction Following | Arena Hard | Win Rate94.9 | 77 | |
| Conversational versatility | Arena-Hard | Win Rate61.16 | 20 | |
| Open-ended Generation | Arena-Hard | Score84.6 | 14 | |
| Technical problem-solving | Arena Hard | Win Rate52.3 | 10 | |
| Alignment | Arena-Hard | Score48.1 | 5 | |
| Alignment | Arena-Hard | Hard Prompt Gemini Score70.4 | 4 | |
| Human Preference Evaluation | Arena Creative Writing | Win Rate23.4 | 3 |
Showing 7 of 7 rows