Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Hateful Memes

Benchmarks

Task NameDataset NameSOTA ResultTrend
Hateful Meme DetectionHateful Memes (test)
AUROC0.828
67
Multimodal Hate Speech DetectionHateful Memes
ROC AUC0.892
29
Hateful Meme DetectionHateful Memes (val)
AUROC81.56
22
Multimodal ClassificationHateful Memes
Overall Score64.6
17
Hateful Meme DetectionHateful Memes (val test)
Accuracy51.05
15
ClassificationHateful Memes (test)
Accuracy82
15
Hateful content detectionHateful Memes
Accuracy82.3
12
Image ClassificationHateful Memes
Accuracy66
11
Multimodal ReasoningHateful Memes (HM) (test)
MiniGPT-4 Score62.33
10
Multimodal ClassificationHateful Memes (test)
Accuracy69.8
8
Multimodal ClassificationHateful Memes Synergy
Accuracy48.9
8
Content ModerationHateful Memes seen (test)
AUC-ROC89.2
7
OCRHateful Memes (dev)
ROC AUC78
4
Explanation GenerationHateful Memes (test)
BS78
3
Hate Speech DetectionHateful-Memes (HM) (val)
Accuracy69.85
2
Explanation GenerationHateful Memes
Bias Score0.78
2
Showing 16 of 16 rows