SeedBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Understanding | SEEDBench2 Plus | Accuracy76.86 | 74 | |
| Comprehensive Evaluation | SeedBench (all) | Score76.8 | 19 | |
| Complex Scene Reasoning | SEEDBench | Accuracy (All)77.03 | 17 | |
| Visual Perception | SeedBench-2-Plus | Accuracy72 | 15 | |
| Multidisciplinary Knowledge | SeedBench | Score76.4 | 15 | |
| Multimodal Understanding | SeedBench image | Score76.7 | 12 | |
| Visual Question Answering | SeedBench Avg | Accuracy77.96 | 11 | |
| Multi-discipline Video Understanding | SeedBench video | Accuracy62.1 | 11 | |
| Multimodal Understanding | SeedBench-2 | Score81 | 10 | |
| Short-answer Visual Question Answering | SEEDBench2+ | Accuracy68.7 | 9 | |
| Visual Question Answering | SEEDBench | BD-Rate-23.78 | 8 | |
| Multimodal Evaluation | SeedBench (all) | Score61.82 | 8 | |
| VLM evaluation | SEEDBench | BD-S Score12.88 | 6 | |
| General image understanding | SEEDBench | Score72.67 | 4 | |
| Multimodal Understanding | SeedBench | SeedBench Accuracy38.7 | 3 |
Showing 15 of 15 rows