Multi-modal Question Answering on MMMU (val)

70.7Accuracy

Proprietary API SOTA (Hurst et al., 2024)

Updated 1mo ago

Evaluation Results

Method	Links
Proprietary API SOTA (Hurst et al., 2024) 2025.01		70.7
Open-Source SOTA (Chen et al., 2024d) 2025.01		56.2
IXC-2.5-Chat 2025.01		44.1
IXC-2.5 2025.01		42.9