EgoSchema
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Video Question Answering | EgoSchema (Full) | Accuracy77.3 | 256 | |
| Video Question Answering | EgoSchema | Accuracy82.2 | 194 | |
| Video Understanding | EgoSchema | EgoSchema Score69.4 | 185 | |
| Video Question Answering | EgoSchema subset | Accuracy81 | 124 | |
| Video Question-Answering | EgoSchema (test) | Accuracy77.9 | 90 | |
| Long-form Video Understanding | EgoSchema | Accuracy72.2 | 69 | |
| Multiple Choice Video Question Answering | EgoSchema | Accuracy72.2 | 61 | |
| Video Understanding | EgoSchema (test) | Accuracy77.9 | 55 | |
| Video Question Answering | EgoSchema 500-question subset | Accuracy71.2 | 50 | |
| Egocentric Video Understanding | EgoSchema | Score61.4 | 42 | |
| Long Video Understanding | EgoSchema (val) | Accuracy88.2 | 39 | |
| Egocentric Video Understanding | EgoSchema (test) | Accuracy75.6 | 28 | |
| Video Question Answering | EgoSchema 5031 videos (test) | Top-1 Accuracy62.4 | 26 | |
| Multi-choice Video Question Answering | EgoSchema (test) | Accuracy72.2 | 26 | |
| Long-form Egocentric Video Understanding | EgoSchema | Accuracy78.2 | 25 | |
| Egocentric Video Understanding | EgoSchema | EgoSchema Score61.2 | 24 | |
| Long-form Video Question Answering | EgoSchema | Accuracy77.9 | 24 | |
| Video reasoning | EgoSchema (test) | Accuracy69.4 | 23 | |
| Offline Video Understanding | EgoSchema v1 (test) | Accuracy72.2 | 22 | |
| Question Answering | EgoSchema | Accuracy58.4 | 22 | |
| Video Question Answering | EgoSchema 3 min (test) | Accuracy66.2 | 18 | |
| Egocentric Video Understanding | EgoSchema Subset 2023 | Accuracy72.2 | 17 | |
| Multiple-Choice Video QA | EgoSchema latest (test) | Accuracy72.2 | 17 | |
| Long Video Question Answering | EgoSchema (full set) | Accuracy55.6 | 17 | |
| Video Question Answering | EgoSchema Sub. | Accuracy79.4 | 16 |
Showing 25 of 48 rows