| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| OKVQA | PaLM-E(562B) | Accuracy0.661 | 52 | 3d ago | |
| OKVQA (val) | SMoLA-PaLI-X_FT (Specialist) | Accuracy66.7 | 27 | 2d ago | |
| OK-VQA v1.0 (test) | Ours + MCAN | Accuracy61.2 | 15 | 3d ago | |
| Knowledge Benchmarks | JARVIS | Average Score48.2 | 12 | 3d ago | |
| A-OKVQA (val) | BLIP VQAv2 + SelTDA | Accuracy68.9 | 8 | 3d ago | |
| A-OKVQA (test) | BLIP VQAv2 | Accuracy59.5 | 7 | 3d ago | |
| OKVQA M2KR | PaLM-E | VQA Score0.661 | 6 | 3d ago | |
| INFOSEEK (Overall) | MMhops-R1 | Accuracy33.2 | 5 | 3d ago | |
| INFOSEEK (Unseen Entity) | MMhops-R1 | Accuracy32.6 | 4 | 3d ago | |
| INFOSEEK Unseen Question | MMhops-R1 | Accuracy33.8 | 4 | 3d ago | |
| E-VQA M2KR | RA-VQAv2 w/ PreFLMR | BEM54.45 | 3 | 3d ago | |
| Infoseek M2KR | RA-VQAv2 w/ PreFLMR | Accuracy30.65 | 3 | 3d ago | |
| E-VQA (test) | LamRA | Accuracy56.2 | 2 | 3d ago | |
| Infoseek (test) | RA-VQAv2 w/ PreFLMR | Accuracy30.7 | 2 | 3d ago | |
| OKVQA (test) | LamRA | Accuracy64.3 | 2 | 3d ago |
