Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MM-Sum

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multimodal SummarizationMM-Sum Zero-Resource Languages (test)
ROUGE-1 Score33.67
96
Multimodal SummarizationMM-Sum low-resource 1.0
ROUGE-147.96
96
Multimodal Abstractive SummarizationMM-Sum mid-high-resource
ROUGE-141.51
90
Multimodal Abstractive SummarizationMM-Sum mid-high-resource (test)
ROUGE-141.59
90
Multimodal Abstractive SummarizationMM-Sum Avg., low-resource
ROUGE-1 Score30.55
6
Multimodal Abstractive SummarizationMM-Sum Welsh low-resource
ROUGE-132.86
6
Multimodal Abstractive SummarizationMM-Sum Telugu, low-resource
ROUGE-1 Score19.87
6
Multimodal Abstractive SummarizationMM-Sum Swahili low-resource
ROUGE-138.02
6
Multimodal Abstractive SummarizationMM-Sum Serbian Latin, low-resource
ROUGE-121.89
6
Multimodal Abstractive SummarizationMM-Sum Serbian Cyrillic, low-resource
R-123.88
6
Multimodal Abstractive SummarizationMM-Sum Punjabi, low-resource
ROUGE-130.57
6
Multimodal Abstractive SummarizationMM-Sum Pidgin low-resource
R-137.91
6
Multimodal Abstractive SummarizationMM-Sum Pashto low-resource
ROUGE-138.15
6
Multimodal Abstractive SummarizationMM-Sum Oromo low-resource
ROUGE-118.82
6
Multimodal Abstractive SummarizationMM-Sum Marathi low-resource
ROUGE-122.61
6
Multimodal Abstractive SummarizationMM-Sum Japanese low-resource
ROUGE-1 Score47.79
6
Multimodal Abstractive SummarizationMM-Sum Hausa low-resource
ROUGE-139.28
6
Multimodal Abstractive SummarizationMM-Sum Gujarati, low-resource
ROUGE-122.18
6
Multimodal Abstractive SummarizationMM-Sum French, low-resource
ROUGE-135.93
6
Multimodal Abstractive SummarizationMM-Sum Bengali low-resource
ROUGE-128.58
6
Multimodal SummarizationMM-Sum Zero-Resource Languages 1.0 (test)
ROUGE-1-
0
Multimodal Abstractive SummarizationMM-Sum mid-high-resource 1.0
ROUGE-1-
0
Showing 22 of 22 rows