TempCompass
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Temporal Video Understanding | TempCompass | Average Score88 | 68 | |
| Video Understanding | TempCompass MCQ (test) | Accuracy82.8 | 55 | |
| Temporal Reasoning | TempCompass | Accuracy74.4 | 33 | |
| Temporal Spatial Reasoning | TempCompass | Average Accuracy76.8 | 17 | |
| Short Video Question Answering | TempCompass | MC Accuracy76 | 12 | |
| Video Question Answering | TempCompass | Multi-Choice Accuracy76.9 | 5 | |
| Open-ended Video Question Answering | TempCompass | Accuracy66.1 | 4 | |
| Short Video Captioning | TempCompass | Captioning Accuracy65.3 | 2 |
Showing 8 of 8 rows