MP
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Time Series Classification | MP8 | Accuracy68.57 | 21 | |
| De Novo Generation | MP-20 | Structural Validity1 | 21 | |
| Material generation | MP-20 (test) | SUN Rate8.21 | 19 | |
| Stable structure prediction | MP-20 | Match Rate77.93 | 15 | |
| De-novo generation | MP-20 metastable-MS convention Ehull <= 0.10 eV/atom MP-2020-corrected (test) | MS76.6 | 14 | |
| Category-Agnostic Pose Estimation | MP-100 (test) | Split 1 Performance94.24 | 14 | |
| Category-agnostic Pose Estimation | MP-100 (split1-5) | Split 1 Performance97.01 | 14 | |
| Crystal generation | MP-20 evaluated with eq-V2, E_hull < 0.0 (test) | Stability15.4 | 13 | |
| Crystal Structure Prediction | MP-20 July 2021 (test) | MR78.34 | 13 | |
| Crystal Generation | MP-20 | S Score77.7 | 12 | |
| Human Activity Recognition | MP50 | Accuracy74.34 | 11 | |
| Time Series Classification | MP50 HAR | Accuracy74.34 | 10 | |
| Crystal generation | MP-20 evaluated with CHGNet, E_hull < 0.0 (test) | Stability19.8 | 8 | |
| Atom type generation | MP-20 | Compositional Accuracy90.23 | 7 | |
| Material Generation (Formation Energy) | MP-20 (test) | Eform-0.99 | 6 | |
| Material Property Optimization (Formation Energy) | MP-20 | Eform-0.99 | 6 | |
| Crystal Structure Generation | MP-20 | Match Rate77.85 | 6 | |
| Property Prediction | MP | MAE1.58 | 5 | |
| ab initio generation | MP-20 | Structural Validity100 | 5 | |
| Category-Agnostic Pose Estimation | MP-100 (Leave-One-Out) | Accuracy (Human Body)73.82 | 4 | |
| Geolocation | MP16-pro Extremely Difficult | Unknown Rate50 | 2 | |
| General Knowledge | MP | Winrate48 | 1 | |
| Category-Agnostic Pose Estimation | MP-100 | Metric- | 0 |
Showing 23 of 23 rows