EuroEval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Natural Language Understanding | EuroEval French | EuroEval Score52.2 | 18 | |
| Natural Language Understanding | EuroEval Spanish | EuroEval Score51.8 | 18 | |
| Natural Language Understanding | EuroEval English | EuroEval Score56.8 | 18 | |
| Natural Language Understanding | EuroEval German | EuroEval Score0.1 | 18 | |
| Sentiment Analysis | EuroEval 34 | MCI (%pt.)22.93 | 16 | |
| Transfer Performance Prediction | EuroEval (test) | Mean Spearman Correlation21.9 | 16 | |
| Natural Language Understanding | EuroEval Dutch | EuroEval Dutch Score68 | 14 | |
| Natural Language Understanding | EuroEval Italian | EuroEval Score54.3 | 14 | |
| Natural Language Understanding | EuroEval Danish | EuroEval Score65 | 14 | |
| Cross-lingual NLP evaluation | EuroEval Swedish (held-out) | EuroEval Score52.8 | 4 | |
| Cross-lingual NLP evaluation | EuroEval Portuguese (held-out) | EuroEval Portuguese Score47.4 | 4 | |
| Cross-lingual NLP evaluation | EuroEval Norwegian (held-out) | EuroEval Score54.3 | 4 |
Showing 12 of 12 rows