Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EgoSchema

Benchmarks

Task NameDataset NameSOTA ResultTrend
Video Question AnsweringEgoSchema (Full)
Accuracy75
241
Video UnderstandingEgoSchema
EgoSchema Score69.4
185
Video Question AnsweringEgoSchema
Accuracy82.2
161
Video Question AnsweringEgoSchema subset
Accuracy81
124
Video Question-AnsweringEgoSchema (test)
Accuracy77.9
90
Long-form Video UnderstandingEgoSchema
Accuracy72.2
67
Multiple Choice Video Question AnsweringEgoSchema
Accuracy72.2
61
Video UnderstandingEgoSchema (test)
Accuracy77.9
55
Video Question AnsweringEgoSchema 500-question subset
Accuracy71.2
50
Egocentric Video UnderstandingEgoSchema
Score61.4
42
Egocentric Video UnderstandingEgoSchema (test)
Accuracy75.6
28
Video Question AnsweringEgoSchema 5031 videos (test)
Top-1 Accuracy62.4
26
Multi-choice Video Question AnsweringEgoSchema (test)
Accuracy72.2
26
Long-form Egocentric Video UnderstandingEgoSchema
Accuracy78.2
25
Egocentric Video UnderstandingEgoSchema
EgoSchema Score61.2
24
Long-form Video Question AnsweringEgoSchema
Accuracy77.9
24
Video reasoningEgoSchema (test)
Accuracy69.4
23
Offline Video UnderstandingEgoSchema v1 (test)
Accuracy72.2
22
Question AnsweringEgoSchema
Accuracy58.4
22
Video Question AnsweringEgoSchema 3 min (test)
Accuracy66.2
18
Egocentric Video UnderstandingEgoSchema Subset 2023
Accuracy72.2
17
Multiple-Choice Video QAEgoSchema latest (test)
Accuracy72.2
17
Long Video Question AnsweringEgoSchema (full set)
Accuracy55.6
17
Video Question AnsweringEgoSchema (official)
Accuracy76.2
16
Long Video UnderstandingEgoSchema (val)
Accuracy77.2
16
Showing 25 of 45 rows