Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

IntentQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multiple Choice VideoQAIntentQA
Accuracy68
41
Video Question AnsweringIntentQA
Accuracy (All)88.6
35
Video Question AnsweringIntentQA (test)
Top-1 Accuracy79
22
Multiple-choice Video Question AnsweringIntentQA (test)
Accuracy66.9
17
Video Question AnsweringIntentQA (val)
Accuracy86.6
9
Intent Understanding (INT)IntentQA
LLM-Judge Accuracy48.6
7
Intent Question AnsweringIntentQA (test)
Accuracy67.1
6
Video Question AnsweringIntentQA original (test)
Temporal Accuracy66.1
4
Video Question AnsweringIntentQA (de-biased set)
Temporal Score61
4
Showing 9 of 9 rows