Share your thoughts, 1 month free Claude Pro on usSee more

Video Captioning on VATEX (test)

84.2CIDEr

Flamingo

Updated 9d ago

Evaluation Results

Method
Flamingo 2022.04	84.2	-	-	-	-	-	-	-	-	-	-	-
Flamingo 2022.04	84.2	-	-	-	-	-	-	-	-	-	-	-
SotA 2022.04	81.4	-	-	-	-	-	-	-	-	-	-	-
Unrestricted SotA (VIOLET) 2022.04	81.4	-	-	-	-	-	-	-	-	-	-	-
Restricted SotA+ (VIOLET) 2022.04	76.3	-	-	-	-	-	-	-	-	-	-	-
Flamingo 2022.04	65.1	-	-	-	-	-	-	-	-	-	-	-
Flamingo 2022.04	65.1	-	-	-	-	-	-	-	-	-	-	-
Flamingo-80B 2022.05	62.8	-	-	-	-	-	-	-	-	-	-	-
CLIP-DCD 2021.11	62.4	-	-	-	-	36.8	25.1	52.2	-	-	-	-
CLIP-Base 2021.11	60.9	-	-	-	-	36.8	24.8	51.9	-	-	-	-
L_ITG + L_alignment 2023.07	60.9	-	-	-	-	30.9	-	-	-	49.1	-	-
MGCMP 2021.11	57.6	-	-	-	-	34.2	23.5	50.3	-	-	-	-
OpenBook 2021.11	57.5	-	-	-	-	33.9	23.7	50.2	-	-	-	-
NSA 2021.11	57.1	-	-	-	-	31	22.7	49	-	-	-	-
Flamingo-3B 2022.05	57.1	-	-	-	-	-	-	-	-	-	-	-
L_ITG 2023.07	56.6	-	-	-	-	29.3	-	-	-	48.2	-	-
ORG-TRL 2021.11	49.7	-	-	-	-	32.1	22.2	48.9	-	-	-	-
ORG-TRL 2023.07	49.7	-	-	-	-	32.1	-	-	-	48.9	-	-
VATEX 2021.11	45.1	-	-	-	-	28.4	21.7	47	-	-	-	-
ABMamba 2026.04	44.4	-	-	-	-	28.6	22.2	-	-	47.7	73.4	41.8
mPLUG 2022.05	42	-	-	-	-	-	-	-	-	-	-	-
Flamingo-3B 2024.05	40.1	-	-	-	-	-	-	-	-	-	-	-
Flamingo-9B 2024.05	39.5	-	-	-	-	-	-	-	-	-	-	-
LLaVA-OneVision 2026.04	39.2	-	-	-	-	17.6	21.2	-	-	41.5	60.6	42
VidIL 2022.05	38.9	-	-	-	-	23.2	20.6	44.2	75.3	-	-	-
Video-LLaVA 2026.04	37.7	-	-	-	-	24.5	19.6	-	-	44.9	67.3	40.8
BLIP 2022.05	37.4	-	-	-	-	-	-	-	-	-	-	-
VideoLLaMA3 2026.04	36.9	-	-	-	-	17.5	24	-	-	42.2	56.8	43
VidIL 2022.05	36.7	-	-	-	-	22.2	20	43.6	33.3	-	-	-
UniVL 2022.05	35.6	-	-	-	-	23.7	22.7	39.3	106.2	-	-	-
UniVL 2022.05	33.4	-	-	-	-	22.8	22.3	38.6	70.2	-	-	-
InternVL2.5 2026.04	33.2	-	-	-	-	16.5	17.2	-	-	35.8	58.3	41.4
TOPA-Llama2-13B 2024.05	32	-	-	-	-	-	-	-	-	-	-	-
VideoPrism-B w/ PaLM-2-8B 2024.05	31.7	-	-	-	-	-	-	-	-	-	-	-
TOPA-Llama2-7B 2024.05	31	-	-	-	-	-	-	-	-	-	-	-
BLIP_cap 2022.05	28.9	-	-	-	-	20.7	17.4	41.5	22.8	-	-	-
VideoPrism-B w/ PaLM-2-1B 2024.05	24.2	-	-	-	-	-	-	-	-	-	-	-
NITS-VC 2023.07	24	-	-	-	-	20	-	-	-	42	-	-
VideoCoCa-g 2024.05	22.8	-	-	-	-	-	-	-	-	-	-	-
BLIP 2022.05	20.7	-	-	-	-	13.5	15.4	39.5	23.9	-	-	-
DeCap 2024.05	18.7	-	-	-	-	-	-	-	-	-	-	-
Gemini-1.5-Pro 2026.04	14.2	-	-	-	-	4.5	8.9	-	-	19.3	22.8	39.2
Video-ChatGPT 2026.04	9.9	-	-	-	-	2.4	10.6	-	-	25	14.8	39.4
UniVL 2022.05	3.4	-	-	-	-	2.7	10.2	17.7	26	-	-	-
UniVL 2022.05	2.1	-	-	-	-	1.7	8	15.7	13.3	-	-	-
COSA (1.2B) 2023.06	0.965	-	-	-	-	0.437	-	-	-	-	-	-
VALOR-L 2023.06	0.958	-	-	-	-	0.456	-	-	-	-	-	-
GIT2 2023.06	0.945	-	-	-	-	0.427	-	-	-	-	-	-
GIT 2023.06	0.915	-	-	-	-	0.416	-	-	-	-	-	-
COSA-L 2023.06	0.844	-	-	-	-	0.454	-	-	-	-	-	-
VideoCoCa 2023.09	0.778	-	-	-	-	0.397	-	-	-	0.545	-	-
COSA-B 2023.06	0.744	-	-	-	-	0.414	-	-	-	-	-	-
SwinBERT 2023.09	0.73	-	-	-	-	0.387	0.262	-	-	0.532	-	-
COSA-B 2023.06	0.726	-	-	-	-	0.405	-	-	-	-	-	-
CoCap 2023.09	0.648	-	-	-	-	0.358	0.253	-	-	0.52	-	-
CoCap 2023.09	0.527	-	-	-	-	0.314	0.232	-	-	0.494	-	-
Support-set 2023.09	0.512	-	-	-	-	0.328	0.244	-	-	0.491	-	-
ORG-TRL 2023.09	0.497	-	-	-	-	0.321	0.222	-	-	0.489	-	-
VATEX 2023.09	0.451	-	-	-	-	0.284	0.217	-	-	0.47	-	-
NITS-VC 2023.09	0.24	-	-	-	-	0.2	0.18	-	-	0.42	-	-
ORG-TRL 2021.11	0.185	0.751	0.539	0.606	0.527	-	-	-	-	-	-	-
GT 2021.11	0.178	0.937	0.581	0.639	0.498	-	-	-	-	-	-	-
Top-Down 2021.11	0.173	0.73	0.53	0.591	0.515	-	-	-	-	-	-	-
AM_1 2021.11	0.146	0.729	0.522	0.584	0.464	-	-	-	-	-	-	-
AM_2 2021.11	0.14	0.714	0.515	0.571	0.451	-	-	-	-	-	-	-
AM_3 2021.11	0.134	0.698	0.512	0.566	0.447	-	-	-	-	-	-	-