Our new X account is live! Follow @wizwand_team for updates

Visual Question Answering on VQA-CP v2 (test)

61.91Overall Accuracy

D-VQA

Updated 2d ago

Evaluation Results

Method
D-VQA 2022.08	61.91	88.93	52.32	50.39	-
MUTANT 2022.08	61.72	88.9	49.68	50.78	-
KDDAug 2022.08	60.24	86.13	55.08	48.08	-
CSS + IntroD 2022.08	60.17	89.17	46.91	48.62	-
GenB 2022.08	59.15	88.03	40.05	49.25	-
CSS 2022.08	58.95	84.37	49.42	48.21	-
LMH+CSS 2021.04	58.95	-	-	-	-
CSS* 2021.07	58.21	83.65	40.73	48.14	8.81
SSL 2022.08	57.59	86.53	29.87	50.03	-
GGE 2022.08	57.32	87.04	27.75	49.59	-
GGE-DQ-tog 2021.07	57.32	87.04	27.75	49.59	15.27
GGE-DQ-iter 2021.07	57.12	87.35	26.16	49.77	16.44
RandImg 2022.08	55.37	83.89	41.6	44.2	-
RandImg 2021.04	55.37	-	-	-	-
CF-VQA(SUM) + IntroD 2022.08	55.17	90.79	17.92	46.73	-
CF-VQA(SUM) 2022.08	55.05	90.61	21.5	45.61	-
CF-VQA(Sum) 2021.07	54.95	90.56	21.88	45.36	-
MFE 2021.07	54.55	74.03	49.16	45.82	-
LMH + RMFE 2021.04	54.55	-	-	-	-
CF-VQA(Sum) 2021.07	53.69	91.25	12.8	45.23	-
CF-VQA(SUM) 2022.08	53.55	91.15	13.03	44.97	-
LMH 2021.07	52.73	72.95	31.9	47.79	10.6
LMH 2022.08	52.45	69.81	44.46	45.54	-
Learned Mixin +H 2019.09	52.05	-	-	-	-
LMH 2021.04	52.05	-	-	-	-
VGQE 2022.08	50.11	66.35	27.08	46.77	-
GVQE* 2021.07	50.11	66.35	27.08	46.77	-
UpDn+SCR 2019.05	49.45	72.36	10.93	48.02	-
SCR 2022.08	49.45	72.36	10.93	48.02	-
SCR* 2021.07	49.45	72.36	10.93	48.02	-
UpDn+SCR 2019.05	49.17	71.55	10.72	47.49	-
DLR 2022.08	48.87	70.99	18.72	45.57	-
DLP 2021.07	48.87	70.99	18.72	45.57	-
LM 2021.07	48.78	70.37	14.24	46.42	11.33
VGQE 2022.08	48.75	-	-	-	-
GVQE* 2021.07	48.75	-	-	-	-
Learned Mixin 2019.09	48.69	-	-	-	-
ESR 2021.04	48.5	-	-	-	-
UpDn+SCR 2019.05	48.47	70.41	10.42	47.29	-
UpDn+HINT 2019.05	47.7	70	10.7	46.3	-
HINT* 2021.07	47.5	67.21	10.67	46.8	10.34
RUBi 2019.06	47.11	68.65	20.28	43.18	-
RUBi 2021.07	47.11	68.65	20.28	43.18	-
HINT 2022.08	46.73	67.27	10.61	45.88	-
NSM 2019.07	45.8	-	-	-	-
RUBi 2021.07	45.42	63.03	11.91	44.33	6.27
RUBi 2022.08	44.23	67.05	17.48	39.61	-
RUBi 2021.04	44.23	-	-	-	-
Grand and Belinkov 2019.09	42.33	-	-	-	-
CVL 2022.08	42.12	45.72	12.45	48.34	-
Q-type Balanced Sampling 2019.06	42.11	61.55	11.26	40.39	-
UpDn+AdvReg. 2019.05	41.2	65.5	15.5	35.5	-
Ramakrishnan et al. 2019.09	41.17	-	-	-	-
UpDn + Q-Adv + DoE 2019.06	41.17	65.49	15.48	35.48	-
AReg 2022.08	41.17	65.49	15.48	35.48	-
AdvReg. 2021.07	41.17	65.49	15.48	35.48	-
CSS* 2021.07	41.16	43.96	12.78	47.48	8.23
REGAT 2019.07	40.42	-	-	-	-
Balanced Sampling 2019.06	40.38	57.99	10.07	39.23	-
Reweight 2019.09	40.06	-	-	-	-
UpDn 2022.08	39.94	42.46	11.93	45.09	-
Bias Product 2019.09	39.93	-	-	-	-
UpDn 2021.07	39.89	43.01	12.07	45.82	3.91
UpDn 2019.06	39.74	42.27	11.93	46.05	-
UpDown 2021.04	39.74	-	-	-	-
UpDn 2019.05	39.7	42.7	11.9	46.1	-
MuRel 2019.02	39.54	42.85	13.17	45.04	-
MuRel 2019.07	39.54	-	-	-	-
MuRel 2019.06	39.54	42.85	13.17	45.04	-
LfF 2021.04	39.49	-	-	-	-
BAN 2019.07	39.31	-	-	-	-
BAN 2019.06	39.31	-	-	-	-
RAMEN 2019.07	39.21	-	-	-	-
RAMEN 2019.06	39.21	-	-	-	-
None 2019.09	39.18	-	-	-	-
BLOCK 2021.04	38.69	-	-	-	-
UpDn+AttAlign 2019.05	38.5	42.5	11.4	43.8	-
Baseline architecture 2019.06	38.46	42.85	12.81	43.2	-
S-MRL 2022.08	38.46	42.85	12.81	43.2	-
S-MRL 2021.07	38.46	42.85	12.81	43.2	-
Attention 2019.02	38.04	41.56	12.19	43.29	-
UpDn 2019.06	38.01	-	-	-	-
GVQA 2018.08	31.3	57.99	13.68	22.14	-
GVQA 2019.02	31.3	57.99	13.68	22.14	-
GVQA 2019.07	31.3	-	-	-	-
GVQA 2019.05	31.3	58	13.7	22.1	-
GVQA 2022.08	31.3	57.99	13.68	22.14	-
GVQA 2021.07	31.3	57.99	13.68	22.14	-
HAN 2019.02	28.65	52.25	13.79	20.33	-
HAN 2019.07	28.65	-	-	-	-
HAN+pairwise 2018.08	28.23	41.23	11.4	25.98	-
Pairwise 2018.08	28.06	44.1	13.2	23.71	-
sum 2018.08	27.96	43.23	12.09	24.29	-
HAN+sum 2018.08	27.94	41.35	11.93	25.27	-
HAN+sum 2018.08	27.8	40.74	11.29	25.52	-
SAN+pos 2018.08	27.77	40.73	11.31	25.47	-
HAN+pairwise 2018.08	27.45	40.91	11.48	24.75	-
HAN+sum 2018.08	27.43	41.05	11.38	24.68	-
HAN+sum 2018.08	26.99	40.53	11.38	24.15	-
HAN+pairwise 2018.08	26.81	41.24	10.87	23.61	-

Showing 100 of 109 rows