Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

NExT-QA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Video Question AnsweringNExT-QA (test)
Accuracy86.3
204
Video Question AnsweringNExT-QA (val)
Overall Acc88.4
176
Video Question AnsweringNEXT-QA
Overall Accuracy85.5
105
Video Question AnsweringNExT-QA Multi-choice
Accuracy83.2
102
Video Question AnsweringNExT-QA Main Dataset
Accuracy0.796
48
Video Question AnsweringNExT-QA ATPhard
Overall Accuracy58.4
27
Video Question AnsweringNext-QA v1 (test)
Overall Acc73.8
24
Video Question AnsweringNExT-QA Hard Split (val)
Causal Accuracy51.8
14
Multi-choice Video Question AnsweringNExT-QA
Descriptive Accuracy72.7
12
Temporal VQANext-QA ATP
Accuracy27.6
10
Video Question AnsweringNExT-QA v1 (val)
Accuracy73.8
9
Video Question AnsweringNExT-QA zero-shot (test)
Temporal Score63.1
7
Video Question AnsweringNExT-QA zero-shot
Accuracy0.636
7
Multiple-Choice Video Question AnsweringNExT-QA (val)
Accuracy69.2
6
Video Question AnsweringNExT-QA ATP-hard (val)
Acc@C (Causal)48.65
6
Video Question AnsweringNEXT-QA open-form generation
WUPS34.3
5
Video Question AnsweringNExT-QA original (test)
Temporal Score67
4
Video Question AnsweringNExT-QA de-biased set
Temporal Reasoning Score60.8
4
Temporal and Causal ReasoningNEXT-QA (test)
WUPS30.3
4
Video Question AnsweringNExT-QA Hard Split - Causal
Accuracy56.4
3
Video Question AnsweringNExT-QA Hard Split - Temporal
Accuracy49.8
3
Video QANExT-QA
Accuracy38.3
2
Showing 22 of 22 rows