Our new X account is live! Follow @wizwand_team for updates

Visual Question Answering on VQA v2 (test-dev)

86Overall Accuracy

PaLI-X

Updated 2d ago

Evaluation Results

Method
PaLI-X 2023.05	86	-	-	-	-	-
PaLI-X 2023.10	86	-	-	-	-	-
PaLI-X 2023.12	86	-	-	-	-	-
SOTA [7] 2023.12	86	-	-	-	-	-
SMoLA-PaLI-X_FT (Specialist) 2023.12	85.7	-	-	-	-	-
PerceptionGPT 2023.11	85.1	-	-	-	-	-
PaLI-3 2023.10	85	-	-	-	-	-
Emu2-Chat 2023.11	84.9	-	-	-	-	-
PaLI 2023.03	84.3	-	-	-	-	-
PaLI-17B 2022.09	84.3	-	-	-	-	-
PaLI 2023.05	84.3	-	-	-	-	-
PaLI-17B 2023.10	84.3	-	-	-	-	-
PaLI 2023.03	84.3	-	-	-	-	-
PaLI-17B 2024.03	84.3	-	-	-	-	-
PaLI-17B 2024.03	84.3	-	-	-	-	-
BEiT-3 2022.09	84.2	-	-	-	-	-
BEiT-3 2023.05	84.2	-	-	-	-	-
BEIT-3 2023.05	84.2	-	-	-	-	-
BEIT-3 2023.10	84.2	-	-	-	-	-
BEiT-3 2023.01	84.2	-	-	-	-	-
BEIT-3 2024.03	84.2	-	-	-	-	-
BEIT-3 2024.03	84.2	-	-	-	-	-
BEIT-3 2023.01	84.19	-	-	-	-	-
BEIT-3 2022.08	84	-	-	-	-	-
MM1-Chat 2024.05	83.7	-	-	-	-	-
LLaVA-NeXT 2024.05	83.7	-	-	-	-	-
Shikra 2023.11	83.3	-	-	-	-	-
PaLI-15B 2022.09	82.9	-	-	-	-	-
Bunny-8B 2024.02	82.9	-	-	-	-	-
LLaVA-NeXT 2024.05	82.8	-	-	-	-	-
MM1-Chat 2024.05	82.8	-	-	-	-	-
VILA1.5-13B 2024.02	82.8	-	-	-	-	-
LLaVA-NeXT-13B 2024.02	82.8	-	-	-	-	-
MM1-7B-Chat 2024.02	82.8	-	-	-	-	-
VLMO 2024.03	82.8	-	-	-	-	-
VLMO 2024.03	82.8	-	-	-	-	-
ONE-PEACE 2023.05	82.6	-	-	-	-	-
CoCa 2022.05	82.3	-	-	-	-	-
CoCa 2022.08	82.3	-	-	-	-	-
CoCa 2022.06	82.3	-	-	-	-	-
CoCa 2022.09	82.3	-	-	-	-	-
CoCa 2023.05	82.3	-	-	-	-	-
CoCa 2023.05	82.3	-	-	-	-	-
CoCa 2023.01	82.3	-	-	-	-	-
CoCa 2023.10	82.3	-	-	-	-	-
CoCa 2023.01	82.3	-	-	-	-	-
CoCa 2023.03	82.3	-	-	-	-	-
CogVLM-Chat 2023.11	82.3	-	-	-	-	-
CoCa 2022.05	82.3	-	-	-	-	-
BLIP-2 2023.05	82.2	-	-	-	-	-
BLIP-2 ViT-g OPT6.7B 2023.01	82.19	-	-	-	-	-
Bunny-4B 2024.02	82.1	-	-	-	-	-
OFA 2022.02	82	-	-	-	-	-
Flamingo 2022.04	82	-	-	-	-	-
Flamingo 2022.04	82	-	-	-	-	-
Flamingo 2023.03	82	-	-	-	-	-
OFA 2022.09	82	-	-	-	-	-
Flamingo 2022.09	82	-	-	-	-	-
OFA 2023.05	82	-	-	-	-	-
Flamingo 2023.05	82	-	-	-	-	-
OFA 2023.05	82	-	-	-	-	-
Flamingo 2023.05	82	-	-	-	-	-
OFA 2023.01	82	-	-	-	-	-
Flamingo80B 2023.01	82	-	-	-	-	-
OFA 2023.10	82	-	-	-	-	-
Flamingo 2023.10	82	-	-	-	-	-
MM1-3B-Chat 2024.02	82	-	-	-	-	-
Flamingo 2022.05	82	-	-	-	-	-
X2-VLM_large 2022.11	81.9	-	-	-	-	-
LLaVA-NeXT-7B 2024.02	81.8	-	-	-	-	-
GIT2 2022.09	81.74	-	-	-	-	-
GIT2 2023.05	81.74	-	-	-	-	-
GIT2 2023.10	81.74	-	-	-	-	-
GIT2 2022.05	81.74	-	-	-	-	-
GIT-2 2023.03	81.7	-	-	-	-	-
BLIP-2 ViT-g OPT2.7B 2023.01	81.59	-	-	-	-	-
BLIP-2 ViT-g FlanT5xL 2023.01	81.55	-	-	-	-	-
Imp-v1.5-4B-Phi3 2024.02	81.5	-	-	-	-	-
PaLI-3B 2022.09	81.4	-	-	-	-	-
SotA 2022.04	81.3	-	-	-	-	-
Unrestricted SotA (Yan et al.) 2022.04	81.3	-	-	-	-	-
Mipha-3B 2024.02	81.3	-	-	-	-	-
mPlug 2022.05	81.27	-	-	-	-	-
Idefics2 2024.05	81.2	-	-	-	-	-
Idefics2 2024.02	81.2	-	-	-	-	-
ShareGPT4V-13B 2024.02	81	-	-	-	-	-
Idefics2 2024.05	80.8	-	-	-	-	-
SPHINX-2k 2023.11	80.7	-	-	-	-	-
LVIS-INSTRUCT4V-13B 2024.02	80.7	-	-	-	-	-
PaLM-E-84B 2023.03	80.5	-	-	-	-	-
X2-VLM_large 2022.11	80.5	-	-	-	-	-
X-FMbase 2023.01	80.5	-	-	-	-	-
X-FM 2023.01	80.5	-	-	-	-	-
LLaVA-1.5 Vicuna-13B w/ EasyGen 2023.10	80.5	-	-	-	-	-
X2-VLM_base 2022.11	80.4	-	-	-	-	-
X2-VLMbase 2023.01	80.4	-	-	-	-	-
X2-VLM 2023.01	80.4	-	-	-	-	-
VILA1.5-3B 2024.02	80.4	-	-	-	-	-
METER-CoSwinHUGE 2021.11	80.33	-	-	-	-	-
OFALarge 2022.02	80.3	-	-	-	-	-

Showing 100 of 671 rows