Share your thoughts, 1 month free Claude Pro on usSee more

Visual Dialog on VisDial v0.9 (test)

64.1MRR

NMN

Updated 1mo ago

Evaluation Results

Method
NMN 2019.09	64.1	50.9	80.1	88.8	4.45
CoAtt-GAN 2017.11	63.98	50.29	80.71	88.81	4.47
PDUN 2019.09	63.4	49.2	81	90.5	4.03
ACE 2019.09	62.9	49	80.5	89.3	4.32
HCIAE-NP-ATT 2017.11	62.22	48.48	78.75	87.59	4.81
HCIAE 2019.09	62.2	48.4	78.7	87.5	4.81
AMEM 2019.09	62.2	48.5	78.6	87.4	4.85
SF-I 2019.09	62	48.1	78.6	87.5	4.79
AMEM 2017.11	61.6	47.74	78.04	86.84	4.99
MN-QIH-D 2016.11	59.65	45.55	76.22	85.37	5.46
MN 2017.11	59.65	45.55	76.22	85.37	5.46
MN 2019.09	59.6	45.5	76.2	85.3	5.46
ECE 2019.09	59	44.3	76.1	85.9	5.51
HREA-QIH-D 2016.11	58.68	44.82	74.81	84.36	5.66
HREA 2017.11	58.68	44.82	74.81	84.36	5.66
HRE 2019.09	58.6	44.8	74.8	84.3	5.65
MN-QH-D 2016.11	58.49	44.03	75.26	84.49	5.68
HRE-QIH-D 2016.11	58.46	44.67	74.5	84.22	5.72
HRE 2017.11	58.46	44.67	74.5	84.22	5.72
LF-QIH-D 2016.11	58.07	43.82	74.68	84.07	5.78
LF 2017.11	58.07	43.82	74.68	84.07	5.78
LF 2019.09	58	43.8	74.6	84	5.78
HieCoAtt-QI-D 2016.11	57.88	43.51	74.49	83.96	5.84
HieCoAtt-QI 2017.11	57.88	43.51	74.49	83.96	5.84
SAN-QI-D 2016.11	57.64	43.44	74.26	83.72	5.88
SAN-QI 2017.11	57.64	43.44	74.26	83.72	5.88
LF-QI-D 2016.11	57.59	43.33	74.27	83.68	5.87
HRE-QH-D 2016.11	56.95	42.7	73.25	82.97	6.11
LF-QH-D 2016.11	55.78	41.75	71.45	80.94	6.74
CoAtt-GAN 2017.11	55.78	46.1	65.69	71.74	14.43
LF-Q-D 2016.11	55.08	41.24	70.45	79.83	7.08
CoAtt-GAN 2017.11	55.06	45.56	65.16	71.07	15.3
CoAtt-GAN 2017.11	54.15	44.52	64.17	70.31	16.28
CoAtt-G-MLE 2017.11	54.11	44.32	63.82	69.75	16.47
HCIAE 2017.11	53.86	44.06	63.55	69.24	16.01
MN-QIH-G 2016.11	52.59	42.29	62.85	68.88	17.06
Memory Network (MN) 2017.11	52.59	42.29	62.85	68.88	17.06
HREA-QIH-G 2016.11	52.42	42.28	62.33	68.17	16.79
HREA 2017.11	52.42	42.28	62.33	68.17	16.79
HRE-QIH-G 2016.11	52.37	42.29	62.18	67.92	17.07
HRE 2017.11	52.37	42.29	62.18	67.92	17.07
LF-QI-G 2016.11	52.04	42.04	61.65	67.66	16.84
LF-QIH-G 2016.11	51.99	41.83	61.78	67.59	17.07
Late Fusion (LF) 2017.11	51.99	41.83	61.78	67.59	17.07
MN-QH-G 2016.11	51.15	40.42	61.57	67.44	17.74
HRE-QH-G 2016.11	51.02	40.15	61.59	67.36	17.47
LF-QH-G 2016.11	50.55	39.73	60.86	66.68	17.78
LF-Q-G 2016.11	50.48	39.78	60.58	66.33	17.89
NN-Q 2016.11	45.7	35.93	54.07	60.26	18.93
NN-QI 2016.11	42.74	33.13	50.83	58.69	19.62
NN 2017.11	42.74	33.13	50.83	58.69	19.62
VisDial-GNN 2019.04	41.26	27.15	56.47	71.97	8.86
SF-QIH 2019.04	40.6	26.76	55.17	70.39	9.32
VisDial-GNN 2019.04	40.25	26.08	55.3	70.83	9.24
VisDial-GNN 2019.04	39.77	25.69	54.52	70.33	9.38
Answer prior 2016.11	37.35	23.55	48.52	53.23	26.5
Answer Prior 2017.11	37.35	23.55	48.52	53.23	26.5
SF-QI 2019.04	30.21	17.38	42.32	57.16	14.03