MTG
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | MTG (test) | BLEU61.4 | 9 | |
| Music Captioning | MTG-eval-Cap 1.0 (test) | BLEU Score0.278 | 5 | |
| Story Completion | MTG Story Completion (test) | ROUGE-L (ES)31.2 | 3 | |
| MTG Gameplay | MTG Mono-Red Aggro in-distribution opponent pool | Win Rate70.6 | 2 | |
| MTG Gameplay | MTG Domain Ramp (in-distribution opponent pool) | Win Rate20.6 | 2 | |
| MTG Gameplay | MTG Dimir Midrange (in-distribution opponent pool) | Win Rate52.2 | 2 | |
| MTG Gameplay | MTG Boros Convoke (in-distribution opponent pool) | Win Rate57.2 | 2 | |
| MTG Gameplay | MTG Azorius Control (in-distribution opponent pool) | Win Rate25.6 | 2 |
Showing 8 of 8 rows