CVBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Self-evaluation | CVBench | AUROC0.747 | 36 | |
| Vision | CVBench | CVBench Score81.5 | 23 | |
| Visual Perception | CVBench 2D | Score79.09 | 22 | |
| Vision Understanding | CVBench-2D | Accuracy77.76 | 22 | |
| Computer Vision Benchmarking | CVBench | Accuracy83 | 19 | |
| Spatial Reasoning | CVBench | 2D Relationship Score96.31 | 15 | |
| Visual Perception | CVBench 3D | Score89.1 | 13 | |
| Visual Reasoning | CVBench | Score76.9 | 12 | |
| Spatial Reasoning | CVBench | Count Score70.6 | 12 | |
| Vision-Language Reasoning | CVBench | Accuracy86.16 | 12 | |
| Multimodal Understanding | CVBench | Accuracy64.25 | 11 | |
| Perception | CVBench (test) | Accuracy87.6 | 11 | |
| Video Understanding | CVBench 83 (test) | Average Score69.1 | 10 | |
| Spatial Understanding | CVBench-3D | Overall Score83.1 | 9 | |
| Spatial Understanding | CVBench-2D | Overall Score79.4 | 9 | |
| Multiple-choice Question Answering | CVBench | Accuracy79.3 | 8 | |
| Image VQA | CVBench | Score75.5 | 7 | |
| 3D Task | CVBench | Accuracy84.52 | 7 | |
| Visual Question Answering | CVBench 3D | Accuracy87 | 7 | |
| Visual Question Answering | CVBench 2D | Accuracy77.7 | 7 | |
| General Image-Text Understanding | CVBench | Accuracy86.32 | 6 | |
| Visual Perception | CVBench | 2D Score76.6 | 5 | |
| Spatial reasoning | CVBench | Score57.3 | 4 | |
| Complex Reasoning | cvbench | Accuracy54.9 | 4 | |
| 2D Vision Reasoning | CVBench 2D | Accuracy58.5 | 4 |
Showing 25 of 27 rows