TempCompass
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Temporal Video Understanding | TempCompass | Accuracy83.7 | 160 | |
| Video Understanding | TempCompass MCQ (test) | Accuracy82.8 | 55 | |
| Video Reasoning | TempCompass | Score86.7 | 46 | |
| General Video Understanding | TempCompass | Accuracy97.3 | 43 | |
| Temporal Reasoning | TempCompass | Accuracy74.4 | 33 | |
| Video Question Answering | TempCompass | Multi-Choice Accuracy76.9 | 28 | |
| Temporal Spatial Reasoning | TempCompass | Average Accuracy76.8 | 17 | |
| Video General Understanding | TempCompass | Score73.8 | 13 | |
| Short Video Question Answering | TempCompass | MC Accuracy76 | 12 | |
| Video VQA | TempCompass | Score79 | 7 | |
| General Video Understanding | TempCompass (test) | Accuracy69.7 | 7 | |
| Video Question Answering | TempCompass MC | Accuracy77.9 | 5 | |
| Open-ended Video Question Answering | TempCompass | Accuracy66.1 | 4 | |
| Video Understanding | TempCompass | Score76.76 | 3 | |
| Video Understanding | TempCompass Y/N | Score (%)74.36 | 3 | |
| Video Understanding | TempCompass MC | Score72.53 | 3 | |
| Multiple Choice Video Question Answering | TempCompass multi-choice QA | Accuracy71.5 | 3 | |
| Short Video Captioning | TempCompass | Captioning Accuracy65.3 | 2 |
Showing 18 of 18 rows