Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on COCO-QA (test)

78.35WUPS (IoU=0.9)

A+C+Selected-K-LSTM

Updated 22d ago

Evaluation Results

Method
A+C+Selected-K-LSTM 2016.03	78.35	70.98	92.87	-	-	-	-	-	-	-	-
Att+Cap+Know-LSTM 2016.03	77.14	69.73	92.5	-	-	-	-	-	-	-	-
Att+Cap-LSTM 2016.03	76.2	69.02	92.38	-	-	-	-	-	-	-	-
Dual-MFA 2017.11	76.15	-	92.29	66.49	68.86	51.32	65.89	58.92	-	-	-
HieCoAtt 2017.11	75.1	-	92	65.4	68	51	62.9	58.8	-	-	-
Cap+Know-LSTM 2016.03	73.31	64.31	90.01	-	-	-	-	-	-	-	-
QRU 2017.11	72.58	-	91.62	62.5	65.06	46.9	60.5	56.99	-	-	-
Att+Know-LSTM 2016.03	72.22	63.07	90.84	-	-	-	-	-	-	-	-
SAN(2, CNN) 2015.11	71.6	61.6	90.9	-	-	-	-	-	-	-	-
Yang et al. 2016.03	71.6	61.6	90.9	-	-	-	-	-	-	-	-
SAN 2017.11	71.6	-	90.9	61.6	65.4	48.6	57.9	54	-	-	-
Att-LSTM 2016.03	71.15	61.38	91.58	-	-	-	-	-	-	-	-
SAN(2, LSTM) 2015.11	71	61	90.7	-	-	-	-	-	-	-	-
DPPnet 2015.11	70.84	61.19	90.61	-	-	-	-	-	-	-	-
Noh et al. 2016.03	70.84	61.19	90.61	-	-	-	-	-	-	-	-
DDPnet 2017.11	70.84	-	90.61	61.16	-	-	-	-	-	-	-
SAN(1, CNN) 2015.11	70.6	60.7	90.5	-	-	-	-	-	-	-	-
SAN(1, LSTM) 2015.11	69.6	59.6	90.1	-	-	-	-	-	-	-	-
IMG-CNN 2017.11	68.5	-	89.67	58.4	-	-	-	-	-	-	-
Chen et al. 2016.03	68.44	58.1	89.85	-	-	-	-	-	-	-	-
Ensemble 2015.11	67.9	57.84	89.52	-	-	-	-	-	-	-	-
FULL 2015.05	67.9	57.84	89.52	-	-	-	-	-	-	-	-
VggNet+ft-LSTM 2016.03	67.32	58.34	89.13	-	-	-	-	-	-	-	-
IMG+BOW 2015.11	66.8	55.9	89	-	-	-	-	-	-	-	-
IMG+BOW 2015.11	66.78	55.92	88.99	-	-	-	-	-	-	-	-
IMG+BOW 2015.05	66.78	55.92	88.99	-	-	-	-	-	-	-	-
VIS+BOW 2016.03	66.78	55.92	88.99	-	-	-	-	-	-	-	-
IMG-CNN 2015.11	65.4	55	88.6	-	-	-	-	-	-	-	-
ConvQA 2015.11	65.36	54.95	88.58	-	-	-	-	-	-	-	-
Ma et al. 2016.03	65.36	54.95	88.58	-	-	-	-	-	-	-	-
2VIS+BLSTM 2015.11	65.34	55.09	88.64	-	-	-	-	-	-	-	-
2-VIS+BLSTM 2015.05	65.34	55.09	88.64	-	-	-	-	-	-	-	-
2-VIS+BLSTM 2016.03	65.34	55.09	88.64	-	-	-	-	-	-	-	-
2VIS+BLSTM 2017.11	65.34	-	88.64	55.09	58.17	44.79	49.53	47.34	-	-	-
2-VIS+BLSTM 2015.11	65.3	55.1	88.6	-	-	-	-	-	-	-	-
VIS+LSTM 2015.05	63.91	53.31	88.25	-	-	-	-	-	-	-	-
VIS+LSTM 2016.03	63.91	53.31	88.25	-	-	-	-	-	-	-	-
VIS+LSTM 2015.11	63.9	53.3	88.3	-	-	-	-	-	-	-	-
VggNet-LSTM 2016.03	60.37	50.73	87.48	-	-	-	-	-	-	-	-
IMG+PRIOR 2015.05	60.2	44.66	86.24	-	-	-	-	-	-	-	-
IMG 2015.05	58.64	43.02	85.85	-	-	-	-	-	-	-	-
IMG 2015.11	58.6	43	85.9	-	-	-	-	-	-	-	-
K-NN 2015.05	56.98	44.96	85.57	-	-	-	-	-	-	-	-
BOW 2015.05	48.54	37.52	82.78	-	-	-	-	-	-	-	-
BOW 2015.11	48.5	37.5	82.8	-	-	-	-	-	-	-	-
LSTM 2015.11	47.6	36.8	82.3	-	-	-	-	-	-	-	-
LSTM 2015.05	47.58	36.76	82.34	-	-	-	-	-	-	-	-
CNN 2015.11	44.3	32.7	80.9	-	-	-	-	-	-	-	-
GUESS 2015.05	18.37	7.3	74.13	-	-	-	-	-	-	-	-
GUESS 2016.03	17.42	6.65	73.44	-	-	-	-	-	-	-	-
GUESS 2015.11	17.4	6.7	73.4	-	-	-	-	-	-	-	-
2VIS+BLSTM 2018.05	-	-	-	55.09	58.17	44.79	49.53	47.34	-	-	-
IMG-CNN 2018.05	-	-	-	58.4	-	-	-	-	-	-	-
DDPnet 2018.05	-	-	-	61.16	-	-	-	-	-	-	-
SAN 2018.05	-	-	-	61.6	65.4	48.6	57.9	54	-	-	-
AMA 2018.05	-	-	-	61.38	63.92	51.83	57.29	54.84	-	-	-
QRU 2018.05	-	-	-	62.5	65.06	46.9	60.5	56.99	-	-	-
RelAtt 2018.05	-	-	-	65.15	67.5	48.81	62.64	58.37	-	-	-
LoRS 2026.03	-	-	-	-	-	-	-	-	10.8	33	39.9
Ours 2026.03	-	-	-	-	-	-	-	-	16.3	38.9	47.4