LVBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Long Video Understanding | LVBench | Accuracy77 | 267 | |
| Video Question-Answering | LVBench | Accuracy84.1 | 108 | |
| Video Understanding | LVBench | Overall Accuracy102.8 | 95 | |
| Long-Form Video Understanding | LVBench | Overall Score94.4 | 77 | |
| Long-video understanding | LVBench (test) | LVBench Score71.8 | 43 | |
| General Video Understanding | LVBench | Accuracy53.8 | 42 | |
| Video Question Answering | LVBench | Overall Score60.7 | 38 | |
| Extremely long-video understanding | LVBench | Score78.7 | 35 | |
| Long-Video Question Answering | LVBench | All Score74.2 | 31 | |
| Video Understanding | LVBench (test) | Accuracy77 | 26 | |
| Video Reasoning | LVBench | LVBench Score43.3 | 24 | |
| Video Question Answering | LVBench (val) | Score51 | 16 | |
| Video Understanding | LVbench | MAT12.12 | 16 | |
| Long-video understanding | LVBench | Accuracy50.1 | 15 | |
| Long Video Understanding | LVBench (val) | Score58.7 | 15 | |
| Video Question Answering | LVBench (test) | Accuracy48.9 | 14 | |
| Exocentric Video Understanding | LVBench | Score56.5 | 13 | |
| Long-video Understanding | LVBench 1.0 (test) | Overall Score48.4 | 13 | |
| Long Video Understanding | LVBench 30-90 min | Accuracy69.2 | 13 | |
| Long Video Understanding | LVBench Overall 2024 | Accuracy48.9 | 12 | |
| Long Video Understanding | LVBench 4101s | Accuracy58 | 12 | |
| Long-Video Understanding | LVBench 30m~2h | Score56.6 | 12 | |
| Multimodal Understanding | LVBench | Accuracy58.6 | 11 | |
| Video Question Answering | LVBench | P@140.3 | 11 | |
| Video Question Answering | LVBench Avg | Average Accuracy52.5 | 11 |
Showing 25 of 39 rows