SMAC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-Agent Reinforcement Learning | SMAC v2 (test) | Win Rate (Protoss 5 Units)84 | 20 | |
| Multi-Agent Reinforcement Learning | SMAC Avg. v1 | Normalized Win Rate1.006 | 18 | |
| Multi-Agent Reinforcement Learning | SMAC 6h* v1 | Normalized Win Rate104.9 | 18 | |
| Multi-Agent Reinforcement Learning | SMAC 3s5z v1 | Normalized Win Rate99.4 | 18 | |
| Multi-Agent Reinforcement Learning | SMAC 2s3z v1 | Normalized Win Rate100.2 | 18 | |
| Multi-Agent Reinforcement Learning | SMAC 3m v1 | Normalized Win Rate100.9 | 18 | |
| Multi-Agent Reinforcement Learning | SMAC maps | 5m_vs_6m Score59 | 18 | |
| Multi-Agent Reinforcement Learning | SMAC 2m1z | State Entropy0.038 | 12 | |
| Multi-Agent Cooperative Control | SMAC 3m v1 (train) | Win Rate100 | 12 | |
| Multi-Agent Reinforcement Learning | SMAC corridor (test) | Average Score20 | 12 | |
| Multi-Agent Reinforcement Learning | SMAC 6h_vs_8z (test) | Average Score19.4 | 12 | |
| Decision Inference | SMAC | Accuracy76.4 | 11 | |
| Multi-Agent Reinforcement Learning | SMAC 1c3s5z (test) | Test Win Rate100 | 10 | |
| Multi-Agent Reinforcement Learning | SMAC corridor v1 (test) | Win Rate100 | 9 | |
| Multi-Agent Reinforcement Learning | SMAC 3s5z_vs_3s6z v1 (test) | Win Rate96.8 | 9 | |
| Multi-Agent Reinforcement Learning | SMAC 2s_vs_1sc v1 (test) | Win Rate100 | 9 | |
| Multi-Agent Reinforcement Learning | SMAC | Training Speed1 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC Super Hard (test) | 6h_vs_8z Win Rate83.92 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC corridor Super Hard (test) | Average Score20 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC 27m_vs_30m Super Hard (test) | Averaged Score19.71 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC MMM2 Super Hard (test) | Averaged Score20.9 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC 3s5z_vs_3s6z Super Hard (test) | Averaged Score20.94 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC 6h_vs_8z Super Hard (test) | Averaged Score19.4 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC 3s5z_vs_3s6z (test) | Test Win Rate20.94 | 8 | |
| Multi-Agent Reinforcement Learning | SMAC 3s5z (test) | Test Win Rate97 | 8 |
Showing 25 of 127 rows