Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NExT-QA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Video Question AnsweringNExT-QA (test)
Accuracy86.3
204
Video Question AnsweringNExT-QA (val)
Overall Acc88.4
176
Video Question AnsweringNExT-QA Multi-choice
Accuracy84.5
114
Video Question AnsweringNEXT-QA
Overall Accuracy85.5
105
Video Question AnsweringNExT-QA Main Dataset
Accuracy0.796
48
Video Question AnsweringNExT-QA ATPhard
Overall Accuracy71.2
33
Video Question AnsweringNext-QA v1 (test)
Overall Acc73.8
24
Video UnderstandingNExT-QA
MC Score80.2
19
Multi-choice Video Question AnsweringNExT-QA
Overall Accuracy83.2
19
Video Question AnsweringNExT-QA Hard Split (val)
Causal Accuracy51.8
14
Temporal VQANext-QA ATP
Accuracy27.6
10
Continual Video Question AnsweringNExT-QA (test)
Accuracy64.75
9
Video Question AnsweringNExT-QA v1 (val)
Accuracy73.8
9
Video Question AnsweringNExT-QA zero-shot (test)
Temporal Score63.1
7
Video Question AnsweringNExT-QA zero-shot
Accuracy0.636
7
Video QANExT-QA
Accuracy79.7
7
Multiple-Choice Video Question AnsweringNExT-QA (val)
Accuracy69.2
6
Video Question AnsweringNExT-QA ATP-hard (val)
Acc@C (Causal)48.65
6
Video Question AnsweringNEXT-QA open-form generation
WUPS34.3
5
Video Question AnsweringNExT-QA original (test)
Temporal Score67
4
Video Question AnsweringNExT-QA de-biased set
Temporal Reasoning Score60.8
4
Temporal and Causal ReasoningNEXT-QA (test)
WUPS30.3
4
Video Question AnsweringNExT-QA Hard Split - Causal
Accuracy56.4
3
Video Question AnsweringNExT-QA Hard Split - Temporal
Accuracy49.8
3
Showing 24 of 24 rows