Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Benchmarking on MMBench

83.4Score

LongVILA-7B (S3)

Updated 1mo ago

Evaluation Results

Method	Links
LongVILA-7B (S3) 2024.08		83.4
Meteor 2024.05		82.9
Brote-IM-XXL 2024.02		77.34
Brote-EX-XXL 2024.02		76.67
MMICL-XXL 2024.02		76.58
Cambrian-1-8B 2024.08		75.9
INF-LLaVA* 2024.07		74.38
Brote-IM-XL 2024.02		74.29
Brote-EX-XL 2024.02		73.27
MMICL-XL 2024.02		73.11
Mini-Gemini-HD-8B 2024.08		72.7
SPHINX-MoE 2024.08		71.3
INF-LLaVA 2024.07		70.35
InstructBLIP-XXL 2024.02		70.34
VILA 2024.08		70.3
Honeybee 2024.07		70.1
InstructBLIP-XL 2024.02		69.68
Prompt Highlighter 2024.07		69.5
VILA 2024.08		68.9
ConvLLaVA 2024.07		68.7
AcFormer 2024.07		68.4
MoE-LLaVA-2.7Bx4 2024.08		68
MoExtend 2024.08		67.8
LLaVA-1.5 2024.08		67.7
LLaVA-1.5 2024.08		67.7
HyperLLaVA 2024.08		65.9
TIVE 2024.07		65.8
RoboMamba 2024.05		65.7
MMICL-XXL (BLIP-2) 2024.02		65.24
MoE-LLaVA-2.7Bx4 2024.08		65.2
GenLLaVA 2024.07		65
LLaVA-NeXT-8B 2024.08		64.6
LLaVA1.5 2024.07		64.3
LLaVA-1.5 2024.08		64.3
LLaVA-1.5 2024.08		64.3
InstructBLIP 2023.11		60.9
Video-LLaVA 2023.11		60.9
Qwen-VL-7B-Chat 2024.08		60.6
Qwen-VL-Chat 2024.08		60.6
OneLLM 2024.07		60
LLaVA-Phi 2024.07		59.8
LLaVA-1.5† 2023.11		59.5
Shikra 2024.07		58.8
Shikra 2024.08		58.8
OtterHD-8B 2024.07		58.3
DreamLLM 2024.07		58.2
InstructBLIP 2023.11		58.2
VL-Mamba 2024.05		57
IDEFICS-80B 2024.08		54.5
Otter 2024.02		48.3
IDEFICS-9B 2024.08		48.2
LLaVA 2024.07		38.7
GILL 2024.07		38.2
Qwen-VL-7B 2024.08		38.2
Qwen-VL 2024.08		38.2
BLIP-2 2023.11		38.1
LLaVA 2024.02		36.2
AnyGPT 2024.07		36
InstructBLIP-7B 2024.08		36
InstructBLIP 2024.08		36
MiniGPT-4 2023.11		23
MGIE 2024.07		6.6