Our new X account is live! Follow @wizwand_team for updates

Visual Dialog on VisDial 1.0 (val)

0.6951MRR

GST (Student)

Updated 4d ago

Evaluation Results

Method
GST (Student) 2022.05	0.6951	-	-	-	-	65.92
BLIP 2022.01	0.6941	56.44	85.9	93.3	3.2	-
BLIP 2022.05	0.6941	-	-	-	-	-
VD-ViLBERT† 2022.01	0.691	55.88	85.5	93.29	3.25	-
UTC 2022.05	0.6858	55.48	85.38	93.2	3.28	0.6322
VD-BERT 2022.01	0.6744	54.02	83.96	92.33	3.53	-
VDBERT 2022.05	0.6744	54.02	83.96	92.33	3.53	0.6322
VisDial-BERT 2022.05	0.6717	53.42	84.41	92.62	3.41	0.6096
ReDAN 2019.11	0.6421	50.6	81.39	90.26	4.05	0.5932
ReDAN 2022.05	0.6421	50.6	81.39	90.26	4.05	0.5932
HCIAE 2019.11	0.6296	48.94	80.5	89.66	4.24	0.5775
HCIAE 2022.05	0.6296	48.94	80.5	89.66	4.24	0.5775
CoAtt 2019.11	0.6291	48.86	80.41	89.83	4.21	0.5772
CoAtt 2022.05	0.6291	48.86	80.41	89.83	4.21	0.5772
LTMI 2019.11	0.6232	48.94	78.65	87.88	4.86	0.6272
LTMI 2022.05	0.6232	48.94	78.65	87.88	4.86	0.6272
ACE 2019.09	0.62	47	82.4	92.3	3.81	0.53
PDUN 2019.09	0.62	47.3	82.5	92.6	3.68	0.54
NMN 2019.09	0.61	47.5	78.1	88.8	4.4	0.54
MN 2019.11	0.6042	46.09	78.14	88.05	4.63	0.5513
MN 2022.05	0.6042	46.09	78.14	88.05	4.63	0.5513
ECE 2019.09	0.58	43.6	75.4	85.3	5.36	0.49
MN 2019.09	0.56	42.4	74	84.3	5.59	0.47
LF 2019.09	0.55	40.9	72.4	82.8	5.95	0.45
HRE 2019.09	0.54	39.9	70.4	81.5	6.41	0.45
V²Dial 2025.03	0.532	46.1	59.3	65.7	-	0.531
Student 2022.05	0.5319	43.08	64.09	71.51	14.34	0.6547
UTC 2022.05	0.5222	42.56	62.4	69.51	15.67	0.6386
UTC 2022.05	0.5222	42.56	62.4	69.51	15.67	0.6386
LTMI-LG 2025.03	0.513	41.3	61.6	69	-	0.632
GOG 2025.03	0.513	41.2	61.8	-	-	0.626
MITVG 2022.05	0.5114	41.03	61.25	68.49	14.37	0.6147
V²Dial 2025.03	0.509	45.4	54.7	61.1	-	0.54
LTMI 2019.11	0.5074	40.44	61.61	69.71	14.93	0.6358
LTMI 2022.05	0.5074	40.44	61.61	69.71	14.93	0.6358
LTMI 2022.05	0.5074	40.44	61.61	69.71	14.93	0.6358
LTMI 2025.03	0.507	40.4	61.6	69.7	-	0.635
UTC 2025.03	0.506	41.3	59.8	69.4	-	0.61
DAM 2022.05	0.5051	40.53	60.84	67.94	16.65	0.6093
DMRM 2022.05	0.5016	40.15	60.02	67.21	15.19	-
KBGN 2022.05	0.5005	40.4	60.11	66.82	17.54	0.6042
ReDAN 2019.11	0.5002	40.27	59.93	66.78	17.4	0.6047
ReDAN 2022.05	0.5002	40.27	59.93	66.78	17.4	0.6047
ReDAN 2022.05	0.5002	40.27	59.93	66.78	17.4	0.6047
CoAtt 2019.11	0.4964	40.09	59.37	65.92	17.86	0.5924
CoAtt 2022.05	0.4964	40.09	59.37	65.92	17.86	0.5924
CoAtt 2022.05	0.4964	40.09	59.37	65.92	17.86	0.5924
HCIAE 2019.11	0.4907	39.72	58.23	64.73	18.43	0.597
HCIAE 2022.05	0.4907	39.72	58.23	64.73	18.43	0.597
HCIAE 2022.05	0.4907	39.72	58.23	64.73	18.43	0.597
Primary 2022.05	0.4901	38.54	59.82	66.94	16.6	-
MN 2022.05	0.4799	38.18	57.54	64.32	18.6	0.5186
MN 2019.11	0.4783	38.01	57.49	64.08	18.76	0.5699
MN 2022.05	0.4783	38.01	57.49	64.08	18.76	0.5699
MST-MIXER 2025.03	0.477	42.2	51.6	57.8	-	0.525
V²Dial 2025.03	0.327	22.1	41.2	48.1	-	0.32
V²Dial 2025.03	0.269	20	30.2	39.3	-	0.333
ESPER 2025.03	0.257	14.6	-	-	-	0.223
Champagne 2025.03	0.255	-	-	-	-	0.196
VideoChat2 2025.03	0.223	12.7	29	39.9	-	0.309
FROMAGE 2025.03	0.22	17.6	20.1	25.1	-	0.165
MST-MIXER 2025.03	0.219	18.2	22.1	25.7	-	0.246
MOE-LLAVA 2025.03	0.207	10.6	25.4	36.4	-	0.267
Video-ChatGPT 2025.03	0.181	10	22.5	31.5	-	0.248
MiniGPT-video 2025.03	0.146	7.4	17.4	26.5	-	0.232
Champagne/CC 2025.03	-	-	-	66.3	-	0.625