Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NExT-QA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Video Question AnsweringNExT-QA (test)
Accuracy86.3
204
Video Question AnsweringNExT-QA (val)
Overall Acc88.4
176
Video Question AnsweringNExT-QA Multi-choice
Accuracy84.5
114
Video Question AnsweringNEXT-QA
Overall Accuracy85.5
105
Video Question AnsweringNExT-QA Main Dataset
Accuracy0.796
48
Video Question AnsweringNExT-QA ATPhard
Overall Accuracy71.2
33
Video Question AnsweringNext-QA v1 (test)
Overall Acc73.8
24
General video understandingNExT-QA
Accuracy86.3
21
Video UnderstandingNExT-QA
MC Score80.2
19
Multi-choice Video Question AnsweringNExT-QA
Overall Accuracy83.2
19
Video Question AnsweringNExT-QA zero-shot
Accuracy0.845
17
Video Question AnsweringNExT-QA Hard Split (val)
Causal Accuracy51.8
14
Visual Question AnsweringNExT-QA Novel Comp. (test)
AP43.05
11
Visual Question AnsweringNExT-QA Standard (test)
AP42.43
11
Temporal VQANext-QA ATP
Accuracy27.6
10
Continual Video Question AnsweringNExT-QA (test)
Accuracy64.75
9
Video Question AnsweringNExT-QA v1 (val)
Accuracy73.8
9
General Video UnderstandingNexT-QA (test)
Accuracy83.8
8
Video Question AnsweringNExT-QA 5-180s (test)
Accuracy80.54
8
Video Question AnsweringNExT-QA zero-shot (test)
Temporal Score63.1
7
Video QANExT-QA
Accuracy79.7
7
Multiple-Choice Video Question AnsweringNExT-QA (val)
Accuracy69.2
6
Video Question AnsweringNExT-QA ATP-hard (val)
Acc@C (Causal)48.65
6
Video Question AnsweringNEXT-QA open-form generation
WUPS34.3
5
Video Question AnsweringNExT-QA original (test)
Temporal Score67
4
Showing 25 of 30 rows