Share your thoughts, 1 month free Claude Pro on usSee more

Image Captioning on NoCaps (test)

124.8CIDEr

GIT2

Updated 29d ago

Evaluation Results

Method
GIT2 2022.09	124.8	-	-	-	-	-	-	-	-	-	-
GIT2 2023.05	124.8	-	-	-	-	-	-	-	-	-	-
GIT2 2023.05	124.8	-	-	-	-	-	-	-	-	-	-
PaLI 2022.09	124.4	-	-	-	-	-	-	-	-	-	-
PaLI 2023.05	124.4	-	-	-	-	-	-	-	-	-	-
PaLI 2023.05	124.4	-	-	-	-	-	-	-	-	-	-
PaLI-X 2023.05	124.3	-	-	-	-	-	-	-	-	-	-
PaLI-X 2023.05	124.3	-	-	-	-	-	-	-	-	-	-
GIT 2022.09	123.4	-	-	-	-	-	-	-	-	-	-
GIT 2023.05	123.4	-	-	-	-	-	-	-	-	-	-
CoCa 2022.09	120.6	-	-	-	-	-	-	-	-	-	-
CoCa 2023.05	120.6	-	-	-	-	-	-	-	-	-	-
LEMON 2022.09	114.3	-	-	-	-	-	-	-	-	-	-
SimVLM 2022.09	110.3	-	-	-	-	-	-	-	-	-	-
SimVLM 2023.05	110.3	-	-	-	-	-	-	-	-	-	-
LLaVA-1.5-7B 2026.06	105.61	-	-	-	-	-	-	-	-	-	-
ALVTS 2026.06	104.5	-	-	-	-	-	-	-	-	-	-
DART 2026.06	103.84	-	-	-	-	-	-	-	-	-	-
PDrop 2026.06	103.76	-	-	-	-	-	-	-	-	-	-
DART 2026.06	102.86	-	-	-	-	-	-	-	-	-	-
ALVTS 2026.06	102.3	-	-	-	-	-	-	-	-	-	-
FastV 2026.06	102.26	-	-	-	-	-	-	-	-	-	-
DART 2026.06	97.7	-	-	-	-	-	-	-	-	-	-
ALVTS 2026.06	97.6	-	-	-	-	-	-	-	-	-	-
FastV 2026.06	97.06	-	-	-	-	-	-	-	-	-	-
PDrop 2026.06	97.01	-	-	-	-	-	-	-	-	-	-
PDrop 2026.06	85.45	-	-	-	-	-	-	-	-	-	-
FastV 2026.06	79.01	-	-	-	-	-	-	-	-	-	-
VISE 2026.06	35.95	-	-	-	-	-	-	-	-	34.41	50.74
VisionZero-RW 2026.06	35.12	-	-	-	-	-	-	-	-	34.29	50.69
VISE 2026.06	34.98	-	-	-	-	-	-	-	-	30.31	48.66
VISE 2026.06	34.97	-	-	-	-	-	-	-	-	29.6	48.86
VISE 2026.06	34.25	-	-	-	-	-	-	-	-	28.6	48.69
VisionZero-RW 2026.06	33.87	-	-	-	-	-	-	-	-	30.27	48.59
VisionZero (Chart) 2026.06	33.14	-	-	-	-	-	-	-	-	34.1	50.66
VisionZero (CLEVR) 2026.06	32.41	-	-	-	-	-	-	-	-	34.02	50.61
iReasoner 2026.06	31.68	-	-	-	-	-	-	-	-	33.97	50.53
VisionZero (Chart) 2026.06	31.47	-	-	-	-	-	-	-	-	30.22	48.53
VisionZero (CLEVR) 2026.06	29.92	-	-	-	-	-	-	-	-	30.14	48.44
VisPlay 2026.06	28.62	-	-	-	-	-	-	-	-	33.51	50.09
VisionZero-RW 2026.06	28.61	-	-	-	-	-	-	-	-	29.15	46.09
iReasoner 2026.06	28.44	-	-	-	-	-	-	-	-	30.09	48.21
VisionZero (Chart) 2026.06	28.12	-	-	-	-	-	-	-	-	29.22	46.13
EvoLMM 2026.06	28.03	-	-	-	-	-	-	-	-	33.44	50.28
Base 2026.06	27.74	-	-	-	-	-	-	-	-	33.38	50.02
VisionZero (CLEVR) 2026.06	27.05	-	-	-	-	-	-	-	-	28.71	45.74
VTW 2026.06	26.66	-	-	-	-	-	-	-	-	-	-
VisPlay 2026.06	26.41	-	-	-	-	-	-	-	-	29.98	47.96
iReasoner 2026.06	25.52	-	-	-	-	-	-	-	-	28.73	45.78
VisPlay 2026.06	25.46	-	-	-	-	-	-	-	-	29.1	45.72
EvoLMM 2026.06	25.36	-	-	-	-	-	-	-	-	28.61	45.73
EvoLMM 2026.06	24.89	-	-	-	-	-	-	-	-	29.95	48.31
Base 2026.06	24.46	-	-	-	-	-	-	-	-	29.91	47.82
VisionZero-RW 2026.06	22.61	-	-	-	-	-	-	-	-	28.24	46.12
Base 2026.06	22.36	-	-	-	-	-	-	-	-	28.91	45.95
VisionZero (Chart) 2026.06	20.19	-	-	-	-	-	-	-	-	26.74	44.33
VisionZero (CLEVR) 2026.06	20.16	-	-	-	-	-	-	-	-	28.01	44.23
Base 2026.06	19.52	-	-	-	-	-	-	-	-	27.36	45.08
VisPlay 2026.06	19.14	-	-	-	-	-	-	-	-	27.83	45.43
iReasoner 2026.06	18.81	-	-	-	-	-	-	-	-	26.75	45.96
EvoLMM 2026.06	18.75	-	-	-	-	-	-	-	-	26.72	45.86
VTW 2026.06	6.06	-	-	-	-	-	-	-	-	-	-
VTW 2026.06	5.76	-	-	-	-	-	-	-	-	-	-
UpDown+ 2021.01	-	76	11.8	74.2	11.5	66.7	9.7	73.1	11.2	-	-
OSCAR_B 2021.01	-	81.3	11.9	79.6	11.9	73.6	10.6	78.8	11.7	-	-
OSCAR_L 2021.01	-	84.8	12.1	82.1	11.5	73.8	9.7	80.9	11.3	-	-
Human 2021.01	-	80.6	15	84.6	14.7	91.6	14.2	85.3	14.6	-	-
VIVO 2021.01	-	89	12.9	87.8	12.6	80.1	11.1	86.6	12.4	-	-
VinVL 2021.01	-	93.8	13.3	89	12.8	66.1	10.9	85.5	12.5	-	-
VinVL+VIVO 2021.01	-	98	13.6	95.2	13.4	78	11.5	92.5	13.1	-	-
Human 2021.11	-	80.6	15	84.6	14.7	91.6	14.2	85.3	14.6	-	-
SimVLMbase 2021.11	-	-	-	-	-	-	-	94.8	13.1	-	-
SimVLMlarge 2021.11	-	-	-	-	-	-	-	108.5	14.2	-	-
SimVLMhuge 2021.11	-	109	14.6	110.8	14.6	109.5	13.9	110.3	14.5	-	-
LEMONlarge 2021.11	-	111.2	15.6	112.3	15.2	105	13.6	110.9	15	-	-
LEMONhuge 2021.11	-	112.8	15.2	115.5	15.1	110.1	13.7	114.3	14.9	-	-
VinVL 2022.05	-	-	-	-	-	-	-	103.7	14.4	-	-
SimVLM 2022.05	-	-	-	-	-	-	-	110.3	14.5	-	-
LEMON 2022.05	-	-	-	-	-	-	-	114.3	14.9	-	-
CoCa 2022.05	-	-	-	-	-	-	-	120.6	15.5	-	-
UpDown 2022.09	-	76	11.8	74.2	11.5	66.7	9.7	73.1	11.2	-	-
Oscar 2022.09	-	81.3	11.9	79.6	11.9	73.6	10.6	78.8	11.7	-	-
Oscar 2022.09	-	84.8	12.1	82.1	11.5	73.8	9.7	80.9	11.3	-	-
Oscar + VIVO 2022.09	-	89	12.9	87.8	12.6	80.1	11.1	86.6	12.4	-	-
VinVL 2022.09	-	93.8	13.3	89	12.7	66.1	10.9	85.5	12.5	-	-
VinVL + VIVO 2022.09	-	94.5	13.1	90.9	12.9	77.9	11.3	88.3	12.6	-	-
Human 2022.09	-	80.6	15	84.6	14.7	91.6	14.2	85.3	14.6	-	-
P2C 2022.09	-	101.7	15	95.7	14.4	82.5	12.2	93.5	14.1	-	-
OSCAR-Large 2022.09	-	84.8	-	82.1	-	73.8	-	80.9	-	-	-
CaMEL 2022.09	-	88.1	-	79.1	-	54.6	-	75.9	-	-	-
ClipCap 2022.09	-	74.5	-	65.6	-	47.1	-	63.4	-	-	-
SMALLCAP 2022.09	-	83.3	-	77.1	-	65	-	75.8	-	-	-
SMALLCAP 2022.09	-	87.9	-	84.6	-	84.4	-	85	-	-	-
Human 2023.11	-	-	-	-	-	91.6	-	85.3	-	-	-
VinVL 2023.11	-	-	-	-	-	78	-	92.5	-	-	-
SimVLM 2023.11	-	-	-	-	-	109.5	-	110.3	-	-	-
CoCa 2023.11	-	-	-	-	-	-	-	120.6	-	-	-
LEMON 2023.11	-	-	-	-	-	110.1	-	114.3	-	-	-
Prismer 2023.11	-	-	-	-	-	-	-	110.8	-	-	-
UniversalCap 2023.11	-	-	-	-	-	114.3	-	119.3	-	-	-

Showing 100 of 124 rows