Our new X account is live! Follow @wizwand_team for updates

Video Captioning on MSRVTT (B@4, M, R, C)

80.3CIDEr

mPLUG-2

Updated 2d ago

Evaluation Results

Method
mPLUG-2 2023.02	80.3	57.8	34.9	-	70.1
mPLUG-2 2023.05	80.3	57.8	34.9	-	-
mPLUG-2 2024.04	80.3	-	34.9	-	-
VAST(1.3B) 2023.05	78	56.7	-	-	-
GIT2 2023.02	75.9	54.8	33.1	-	68.2
GIT 2023.05	75.9	54.8	33.1	-	-
GIT2(5.1B) 2023.05	75.9	54.8	-	-	-
GIT-2 2023.10	75.9	54.8	33.1	-	68.2
GIT2 (5.1B) 2023.04	75.9	54.8	33.1	68.2	-
GIT2 2022.05	75.9	54.8	33.1	68.2	-
MA-LMM 2024.04	74.6	-	33.4	-	-
CoDi 2023.05	74.4	52.1	32.5	-	-
VALOR-L 2023.05	74	54.4	-	-	-
VALORL 2023.04	74	54.4	32.9	68	-
GIT 2023.02	73.9	53.8	32.9	-	67.7
GIT 2023.05	73.9	53.8	-	-	-
GIT 2024.04	73.9	-	32.9	-	-
GIT 2023.04	73.9	53.8	32.9	67.7	-
GIT 2022.05	73.9	53.8	32.9	67.7	-
MaMMUT 2023.05	73.6	-	-	-	-
VideoCoca 2023.02	73.2	53.8	-	-	68
VideoCoCa 2024.04	73.2	-	-	-	-
mPLUG-2Base 2023.02	72.4	52.2	32.1	-	66.9
mPlug-2 2023.10	72.4	52.2	32.1	-	66.9
Video-LLaMA 2024.04	71.6	-	32.9	-	-
RTQ 2023.12	69.3	49.6	-	-	66.1
VideoCoCa 2023.10	68	49.8	-	-	-
VALORB 2023.04	66.6	53.8	32.3	67	-
BLIP + HowTo100M 2023.10	65.9	49.4	32	-	66.2
BLIP 2023.10	65.5	49.2	32.2	-	66.1
HowToCaption 2023.10	65.3	49.8	32.2	-	66.3
HiTeA 2023.02	65.1	49.2	30.7	-	65
Vid2Seq 2023.10	64.6	50.8	-	-	-
GITL 2023.04	64.1	48.7	30.9	64.9	-
GIT-Large 2022.05	64.1	48.7	30.9	64.9	-
HiTeA 2023.05	62.5	-	-	-	-
VALOR 2023.04	61.5	48.1	30.4	64.3	-
TextKG (CLIP) 2023.03	60.8	46.6	30.5	-	64.8
TextKG 2023.12	60.8	46.6	-	-	64.8
STOA-VLP 2023.12	60.2	45.8	-	-	68.4
LAVENDER 2023.03	60.1	-	-	-	-
LAVENDER 2023.05	60.1	-	-	-	-
LAVENDER 2023.04	60.1	-	-	-	-
MV-GPT 2023.03	60	48.9	38.7	-	64
MV-GPT 2023.02	60	48.9	38.7	-	64
MV-GPT 2023.05	60	48.9	38.7	-	-
MV-GPT 2023.12	60	48.9	-	-	64
MV-GPT 2023.10	60	48.9	38.6	-	64
MV-GPT 2023.04	60	48.9	38.7	64	-
MV-GPT 2022.05	60	48.9	38.7	64	-
CMVC 2023.03	58.7	48.2	31.3	-	64.8
CMVC 2023.12	58.7	48.2	-	-	64.8
SMPFF 2023.05	58.5	48.4	-	-	-
SMPFF 2023.04	58.5	48.4	30.6	64.9	-
VIOLETv2 2023.05	58	-	-	-	-
VIOLETv2 2023.04	58	-	-	-	-
GIT-B 2023.10	57.8	46.6	29.6	-	63.2
GIT-Base 2022.05	57.8	46.6	29.6	63.2	-
CLIP4C 2023.03	57.7	46.1	30.7	-	63.7
CLIP4Caption 2023.02	57.7	46.1	30.7	-	63.7
Clip4Cap 2023.12	57.7	46.1	-	-	63.7
CLIP4Caption 2023.10	57.7	46.1	30.7	-	63.7
OmniViD 2024.03	56.6	44.3	29.9	62.7	-
SWINBERT 2023.03	55.9	45.4	30.6	-	64.1
SwinBERT 2023.12	55.9	45.4	-	-	64.1
SwinBERT 2023.02	53.8	41.9	29.9	-	62.1
SwinBERT 2023.05	53.8	41.9	-	-	-
SwinBERT 2024.04	53.8	-	29.9	-	-
SwinBERT 2023.10	53.8	41.9	29.9	-	62.1
SwinBERT 2023.04	53.8	41.9	29.9	62.1	-
SwinBERT 2022.05	53.8	41.9	29.9	62.1	-
SwinBERT 2024.03	53.8	41.9	29.9	62.1	-
OpenBook 2023.04	52.9	42.8	29.3	61.7	-
OpenBook 2022.05	52.9	33.9	23.7	50.2	-
OpenBook 2024.03	52.9	42.8	29.3	61.7	-
MELTR 2023.05	52.8	44.2	-	-	-
DeCEM 2023.03	52.3	45.2	29.7	-	64.7
HMN 2023.12	51.5	43.5	-	-	62.7
SAAT 2024.03	51	39.9	27.7	61.2	-
ORG-TRL 2023.05	50.9	43.6	28.8	-	-
ORG-TRL 2023.04	50.9	43.6	28.8	62.1	-
ORG-TRL 2022.05	50.9	43.6	28.8	62.1	-
ORG-TRL 2024.03	50.9	43.6	28.8	62.1	-
UniVL 2023.03	50	41.8	28.9	-	60.8
UniVL 2023.05	50	41.8	-	-	-
UniVL 2023.12	50	41.8	-	-	60.8
UniVL 2023.02	49.9	42.2	28.2	-	61.2
UniVL 2024.04	49.9	-	28.2	-	-
PMI-CAP 2022.05	49.4	42.1	28.7	-	-
PMI-CAP 2024.03	49.4	42.1	28.7	-	-
POS+VCT 2024.03	49.1	42.3	29.7	62.8	-
POS+CG 2024.03	48.7	42	28.2	61.6	-
Support-set 2023.04	48.6	38.9	28.2	59.8	-
Support-set 2022.05	48.6	38.9	28.2	59.8	-
GRU-EVE 2024.03	48.1	38.3	28.4	60.7	-
SibNet 2024.03	47.5	40.9	27.5	60.2	-
MGSA 2024.03	47.5	42.4	27.6	-	-
STG-KD 2022.05	47.1	40.5	28.3	60.9	-
STG-KD 2024.03	47.1	40.5	28.3	60.9	-
OA-BTG 2024.03	46.9	41.4	28.2	-	-

Showing 100 of 108 rows