SPOT
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inverse Dynamics Identification | Spot (test) | NMSE4.2 | 20 | |
| Inverse Dynamics Identification | Spot (train) | NMSE5.9 | 20 | |
| Odometry | Spot SlopeStair | Absolute Pose Error (Translation) [m]2.359 | 16 | |
| Odometry | Spot Downstair | APE Translation (m)3.916 | 14 | |
| Odometry | Spot CorriLoop | APE Trans (m)1.198 | 14 | |
| Odometry | Spot BiCorridor | Absolute Pose Error (Translation) [m]1.425 | 14 | |
| Odometry | Spot Atrium | APE (m)0.816 | 14 | |
| Deformable object simulation | SPOT (test) | RMSE0.061 | 12 | |
| Odometry Estimation | Spot Dataset UPSTAIR sequence | APE (Translation) [m]1.496 | 10 | |
| Navigation | Spot Environment 1 (E1) | Effort (E1)6.86 | 9 | |
| Odometry | Spot Upstair | APE Translation1.496 | 9 | |
| Odometry | Spot Overpass | APE Translational Error (m)1.526 | 9 | |
| Odometry | Spot BridgeLoop | APE (Translation) [m]1.19 | 9 | |
| 2D Segmentation | Spot All Environments | mIoU36.35 | 7 | |
| 2.5D Segmentation | Spot Environment 1 | mIoU53.57 | 7 | |
| 3D Scanning | Spot Scale 1.0 (test) | Coverage97 | 6 | |
| Ergodic trajectory optimization | Spot | Vs0.122 | 6 | |
| Odometry Estimation | Spot Dataset QUAD sequence | APE (trans) [m]7.35 | 5 | |
| Next-CCTV Prediction | SPOT CARLA-based simulator | CCTV Top-1 Acc70 | 5 | |
| Trajectory Prediction | SPOT CARLA-based simulator | FDE(X) (m)3.16 | 5 | |
| Distributed systems optimization | Spot S | Performance Score51.7 | 4 | |
| Distributed systems optimization | Spot-M | Performance Score72.4 | 4 | |
| Odometry | Spot Average | APE Translational Error (m)2.523 | 4 | |
| Odometry | Spot Tunnel | APE (trans, m)3.523 | 4 | |
| Odometry | Spot Quad | APE Trans (m)3.18 | 4 |
Showing 25 of 28 rows