Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VideoMMMU

Benchmarks

Task NameDataset NameSOTA ResultTrend
Video Question AnsweringVideoMMMU
Accuracy74.9
124
Video Multimodal UnderstandingVideoMMMU
Accuracy79.4
47
Video UnderstandingVideoMMMU
Accuracy61.2
32
Open World Video UnderstandingVideoMMMU
Average Accuracy71.2
19
Professional-level Knowledge AcquisitionVideoMMMU
Accuracy83.6
13
Long Video ReasoningVideoMMMU
Overall Score61.2
8
Multimodal Video UnderstandingVideoMMMU
Overall Score61.2
7
Knowledge AcquisitionVideoMMMU
Delta Knowledge17.2
5
Showing 8 of 8 rows