Magpie
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-agent Sequential Communication | MAGPIE | Privacy Score88 | 10 | |
| Idioms | MAGPIE | AUROC98.8 | 8 | |
| LLM Routing | Magpie Out-of-Domain | LPM Score63.53 | 7 | |
| LLM Routing | Magpie Out-of-Domain | AUROC74.08 | 7 | |
| Multi-agent latent communication privacy and utility | MAGPIE Graph | Privacy80 | 5 | |
| Multi-agent latent communication privacy and utility | MAGPIE Hierarchical | Privacy82 | 5 | |
| Magnetic Indoor Localization | MagPie Loomis building | MAE1.07 | 4 | |
| Magnetic Indoor Localization | MagPie Talbot building | MAE0.64 | 4 | |
| Magnetic Indoor Localization | MagPie CSL building | MAE0.21 | 4 |
Showing 9 of 9 rows