BLINK
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Perception | BLINK | Accuracy75.9 | 255 | |
| Visual Reasoning | BLINK | Accuracy85.2 | 116 | |
| Visual Perception and Reasoning | BLINK | Accuracy85.69 | 70 | |
| Visual Reasoning | BLINK | Jigsaw Accuracy99 | 57 | |
| Spatial Reasoning | BLINK | Spa. Score93 | 57 | |
| Multi-image visual reasoning | BLINK | Accuracy69.1 | 51 | |
| Visual Perception | BLINK (val) | Validation Score95.67 | 44 | |
| Adversarial Attack | BLINK | Attack Success Rate (ASR)87.65 | 37 | |
| Multimodal Reasoning | BLINK | Accuracy69.86 | 33 | |
| Visual Question Answering | BLINK (val) | Accuracy73.7 | 29 | |
| General Multimodal Understanding | BLINK | Accuracy73.5 | 29 | |
| Spatial Reasoning | BLINK | Score69.1 | 29 | |
| Visual Understanding | BLINK | Accuracy69.86 | 28 | |
| Visual Grounding | BLINK | Accuracy64.49 | 27 | |
| Visual Question Answering | BLINK | Accuracy66.1 | 27 | |
| Utility Prediction Routing | Blink | OpenAI Score98.53 | 26 | |
| Multi-image visual perception | BLINK | Accuracy62.8 | 26 | |
| Spatial Understanding | BLINK (val) | Spatial Relation90.9 | 23 | |
| Visual Reasoning | BLINK-J | Accuracy88 | 23 | |
| Multi-image Understanding | BLINK (val) | Score68 | 23 | |
| Interleaved Image Multimodal Understanding | BLINK | Score66.3 | 22 | |
| Multimodal Perception | BLINK | Accuracy64.95 | 21 | |
| Multi-image reasoning | BLINK (val) | Accuracy52.6 | 21 | |
| Low-level Visual Reasoning | BLINK | Accuracy72.3 | 19 | |
| Visual Perception | Blink 41 (val) | Score87.4 | 19 |
Showing 25 of 89 rows