MTG
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Music Tagging | MTG Global Top50 MARBLE benchmark (test) | ROC AUC83.2 | 15 | |
| Music Tagging | MTG Global Genre MARBLE benchmark (test) | ROC AUC86.3 | 15 | |
| Music Tagging | MTG Global MoodTheme MARBLE (test) | ROC AUC77.2 | 15 | |
| Instrument Classification | MTG MARBLE Global Instrument (test) | ROC78.4 | 15 | |
| Code Generation | MTG (test) | BLEU61.4 | 9 | |
| Music Captioning | MTG-eval-Cap 1.0 (test) | BLEU Score0.278 | 5 | |
| Story Completion | MTG Story Completion (test) | ROUGE-L (ES)31.2 | 3 | |
| MTG Gameplay | MTG Mono-Red Aggro in-distribution opponent pool | Win Rate70.6 | 2 | |
| MTG Gameplay | MTG Domain Ramp (in-distribution opponent pool) | Win Rate20.6 | 2 | |
| MTG Gameplay | MTG Dimir Midrange (in-distribution opponent pool) | Win Rate52.2 | 2 | |
| MTG Gameplay | MTG Boros Convoke (in-distribution opponent pool) | Win Rate57.2 | 2 | |
| MTG Gameplay | MTG Azorius Control (in-distribution opponent pool) | Win Rate25.6 | 2 |
Showing 12 of 12 rows