TempCompass
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Temporal Video Understanding | TempCompass | Accuracy83.7 | 141 | |
| Video Understanding | TempCompass MCQ (test) | Accuracy82.8 | 55 | |
| Temporal Reasoning | TempCompass | Accuracy74.4 | 33 | |
| Video Question Answering | TempCompass | Multi-Choice Accuracy76.9 | 28 | |
| Temporal Spatial Reasoning | TempCompass | Average Accuracy76.8 | 17 | |
| Video Reasoning | TempCompass | Score73.3 | 15 | |
| Short Video Question Answering | TempCompass | MC Accuracy76 | 12 | |
| General Video Understanding | TempCompass (test) | Accuracy69.7 | 7 | |
| Video Question Answering | TempCompass MC | Accuracy77.9 | 5 | |
| Open-ended Video Question Answering | TempCompass | Accuracy66.1 | 4 | |
| Multiple Choice Video Question Answering | TempCompass multi-choice QA | Accuracy71.5 | 3 | |
| Short Video Captioning | TempCompass | Captioning Accuracy65.3 | 2 |
Showing 12 of 12 rows