Multi-modal Question Answering on MMMU (val)

70.7Accuracy

Proprietary API SOTA (Hurst et al., 2024)

Updated 3d ago

Evaluation Results

Method	Links
Proprietary API SOTA (Hurst et al., 2024) 2025.01		70.7
Open-Source SOTA (Chen et al., 2024d) 2025.01		56.2
IXC-2.5-Chat 2025.01		44.1
IXC-2.5 2025.01		42.9