Share your thoughts, 1 month free Claude Pro on usSee more

Multi-image Reasoning on DEMON

38.94Accuracy

Brote-IM-XXL

Updated 1mo ago

Evaluation Results

Method	Links
Brote-IM-XXL 2024.02		38.94
Brote-IM-XXL (ours) 2024.02		38.94
Brote-EX-XXL 2024.02		38.7
Brote-EX-XXL (ours) 2024.02		38.7
MMICL-XL 2024.02		38.14
MMICL-XL 2024.02		38.14
Brote-IM-XL 2024.02		37.34
Brote-IM-XL (ours) 2024.02		37.34
Brote-EX-XL 2024.02		37.33
Brote-EX-XL (ours) 2024.02		37.33
VPG-C-LLAMA2 2024.02		37.22
VPG-C-LLaMA2 2024.02		37.22
VPG-C-Vicuna 2024.02		36.37
MMICL-XXL 2024.02		36.3
MMICL-XXL 2024.02		36.3
InstructBLIP-XXL 2024.02		33
InstructBLIP-XXL 2024.02		33
InstructBLIP-XL 2024.02		32.59
InstructBLIP-XL 2024.02		32.59
Otter 2024.02		24.51
Otter 2024.02		24.51