Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MMT

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multi-modal Multi-image ReasoningMMT (val)
Accuracy67.4
14
Machine TranslationMMT eng-xx very-low-resource
chrF++49.2
12
Machine TranslationMMT eng-xx high-resource
chrF++64.7
12
Machine TranslationMMT eng-xx (all)
chrF++55.1
12
Multi-image UnderstandingMMT (val)
Accuracy67.4
11
Visual UnderstandingMMT
Score1,075.5
8
Machine TranslationMMT xx-yy (all)
chrF++42.8
6
Machine TranslationMMT xx-eng low-resource
chrF++51.5
6
Machine TranslationMMT eng-xx low-resource
chrF++41.8
6
Showing 9 of 9 rows