LVBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Long Video Understanding | LVBench | Accuracy77 | 218 | |
| Video Question-Answering | LVBench | Accuracy84.1 | 108 | |
| Video Understanding | LVBench | Average Score73.5 | 75 | |
| Long-video understanding | LVBench (test) | LVBench Score71.8 | 43 | |
| Video Question Answering | LVBench | Overall Score60.7 | 38 | |
| Long-Form Video Understanding | LVBench | Overall Score49.4 | 35 | |
| General Video Understanding | LVBench | Accuracy53.8 | 34 | |
| Extremely long-video understanding | LVBench | Score78.7 | 25 | |
| Video Reasoning | LVBench | LVBench Score43.3 | 24 | |
| Video Understanding | LVBench (test) | Accuracy77 | 21 | |
| Long-Video Question Answering | LVBench | All Score58 | 16 | |
| Video Question Answering | LVBench (val) | Score51 | 16 | |
| Video Understanding | LVbench | MAT12.12 | 16 | |
| Long Video Understanding | LVBench (val) | Score58.7 | 15 | |
| Video Question Answering | LVBench (test) | Accuracy48.9 | 14 | |
| Exocentric Video Understanding | LVBench | Score56.5 | 13 | |
| Long-video Understanding | LVBench 1.0 (test) | Overall Score48.4 | 13 | |
| Long Video Understanding | LVBench 30-90 min | Accuracy69.2 | 13 | |
| Long Video Understanding | LVBench Overall 2024 | Accuracy48.9 | 12 | |
| Long Video Understanding | LVBench 4101s | Accuracy58 | 12 | |
| Long-Video Understanding | LVBench 30m~2h | Score56.6 | 12 | |
| Long-form Video Understanding | LVBench w/o sub (test) | Accuracy74.2 | 11 | |
| Long-form video understanding and instruction following | LVBench (test) | Accuracy78.4 | 11 | |
| Long Video Understanding | LVBench 30~120 min | Accuracy43.6 | 9 | |
| Long Video Understanding | LVBench | Average Context Length (tokens)68,478.1 | 8 |
Showing 25 of 31 rows