Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Ego-Exo4D

Benchmarks

Task NameDataset NameSOTA ResultTrend
Proficiency EstimationEgo-Exo4D
Bouldering Proficiency Score65.41
16
Cross-view Instance SegmentationEgo-Exo4D Exo-to-Ego
IoU68
15
Cross-view Instance SegmentationEgo-Exo4D Ego-to-Exo
IoU67.7
15
Relative camera pose estimationEgo-Exo4D (val)
Rotation Only AUC@538.54
13
Expert Demonstration RetrievalEgo-Exo4D 1.0 (test)
Recall@5022.5
13
Expert Commentary GenerationEgo-Exo4D 1.0 (test)
BLEU-445.8
13
Exo-to-Ego object correspondenceEgo-Exo4D Correspondences v2 (test)
IoU49.6
11
Ego-to-Exo object correspondenceEgo-Exo4D Correspondences v2 (test)
IoU46.3
11
Cross-view Object CorrespondenceEgo-Exo4D v2 (test)
Ego Query IoU42.57
11
Egocentric Text RetrievalEgo-Exo4D
Physical iv Top-1 Accuracy56.1
8
Multi-view video understandingEgo-Exo4D Demonstrator Proficiency
Accuracy44.2
7
Exo-to-Ego Video GenerationEgo-Exo4D Cooking
PSNR14.3897
5
Exo-to-Ego Video GenerationEgo-Exo4D Bike
PSNR15.6301
5
Exo-to-Ego Video GenerationEgo-Exo4D Health
PSNR16.7139
5
Instructional Streaming Video GenerationEgo-Exo4D KeyStep (val)
Average Score0.361
5
4D Hand Motion ReconstructionEgo-Exo4D
Jerk5.26
5
Motion EditingEgo-Exo4D Basketball and Soccer (test)
Mikan Pose Improvement (P)6.18
4
Keystep RecognitionEgo-Exo4D
Recall Accuracy32.37
4
Exocentric-to-Egocentric TranslationEgo-Exo4D (unseen actions)
FID61.231
4
Image-Conditioned Video EditingEgo-Exo4D (test)
Motion Consistency0.69
4
CorrespondenceEgo-Exo4D Exo-view (test)
IoU43.8
4
CorrespondenceEgo-Exo4D Ego-view (test)
IoU1,460
4
Keystep LocalizationEgo-Exo4D
Rank@1 Accuracy (IoU=0.3)34.68
3
CorrespondenceEgo-Exo4D Exo-view (val)
IoU9.6
1
CorrespondenceEgo-Exo4D Ego-view (val)
IoU0.079
1
Showing 25 of 25 rows