SPHERE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Named Entity Recognition | SPHERE | CS NER Score80.47 | 12 | |
| Black-box Optimization | Sphere d=20 | Objective Value (Median)0.0032 | 9 | |
| Classification | Sphere (test) | Accuracy100 | 9 | |
| Heat Equation Solving | Sphere analytic GT | NRMSE0 | 6 | |
| Relation Extraction | SPHERE Material Science | Hierarchical F181.91 | 5 | |
| Relation Extraction | SPHERE Biology | Rel+ F1 (Hierarchical)82.53 | 5 | |
| Relation Extraction | SPHERE Physics | Hierarchical Relation F176.93 | 5 | |
| Relation Extraction | SPHERE Computer Science | Rel+ F1 (Hierarchical)77.4 | 5 | |
| Relation Extraction | SPHERE Mat. Sci. 1.0 (test) | F1 (Hierarchical)69.92 | 3 | |
| Relation Extraction | SPHERE Comp. Sci. 1.0 (test) | Rel+ F1 (Hierarchical)59.36 | 3 | |
| Pose Graph Optimization | Sphere | Objective Value1.687 | 2 | |
| Sub-pixel Localization | SPHERE SHINE-F150 (test) | RMSE (Position Error)0.11 | 2 | |
| Flux Estimation | SPHERE SHINE-F150 (test) | ARE (Flux Error)51 | 2 | |
| Function Optimization | 20D Sphere Coarse threshold | Convergence Rate0 | 1 | |
| Position Prediction | Sphere Simple | Improvement8.6 | 1 |
Showing 15 of 15 rows