EgoExo4D
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Proficiency estimation | EgoExo4D Ego+Exos view | Top-1 Accuracy48.2 | 21 | |
| Proficiency estimation | EgoExo4D Exos view | Top-1 Accuracy46.6 | 21 | |
| Proficiency estimation | EgoExo4D Ego view | Top-1 Accuracy47.3 | 21 | |
| Egocentric Human Activity Recognition | EgoExo4D | Accuracy @184.92 | 19 | |
| Hand Pose Estimation | EgoExo4D 1.0 (test) | PA-MPJPE (mm)13.04 | 13 | |
| Fine-grained Keystep Recognition | EgoExo4D v2 (val) | Ego Accuracy42.62 | 11 | |
| Fine-grained Keystep Recognition | EgoExo4D v1 (val) | Ego Accuracy44.85 | 11 | |
| IMU-to-Text Retrieval | EgoExo4D Zero-shot | R@12 | 10 | |
| Exo-to-Ego Correspondence | EgoExo4D (test) | mIoU65.77 | 10 | |
| Ego-to-Exo Correspondence | EgoExo4D (test) | IoU54.98 | 10 | |
| Egocentric Gaze Estimation | EgoExo4D (OOD Participant) | F1 Score71.1 | 10 | |
| Human Activity Recognition | EgoExo4D | Accuracy30.2 | 9 | |
| Text-to-IMU Retrieval | EgoExo4D Zero-shot | R@13 | 8 | |
| Human and Scene Reconstruction | EgoExo4D | Temporal Error (TE)1.38 | 7 | |
| Egocentric Gaze Estimation | EgoExo4D IDD (online evaluation) | F1 Score70.58 | 7 | |
| Human Mesh Recovery | EgoExo4D (test) | W-MPJPE0.51 | 6 | |
| Hand Trajectory Forecasting | EgoExo4D | ADE0.267 | 5 | |
| 3D Hand Mesh Reconstruction | EgoExo4D Bimanual Setting | P-MPJPE7.5 | 5 | |
| 3D Hand Mesh Reconstruction | EgoExo4D General Setting | MPJPE21.1 | 5 | |
| Egocentric Gaze Estimation | EgoExo4D (OOD Site) | F1 Score69.56 | 5 | |
| Egocentric Gaze Estimation | EgoExo4D (IID) | F1 Score70.58 | 5 | |
| Human and Scene Reconstruction | EgoExo4D 1.0 (test) | s-TE0.34 | 5 | |
| Streaming Narration | EgoExo4D v1 (test) | MACs13.21 | 4 | |
| Hand Pose Forecasting | EgoExo4D | MPJPE0.076 | 4 | |
| 3D Human Pose Estimation | EgoExo4D | W-MPJPE0.26 | 4 |
Showing 25 of 28 rows