Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Hateful Memes

Benchmarks

Task NameDataset NameSOTA ResultTrend
Hateful Meme DetectionHateful Memes (test)
AUROC0.828
67
Multimodal Hate Speech DetectionHateful Memes
ROC AUC0.892
29
Hateful Meme DetectionHateful Memes (val)
AUROC81.56
22
Multimodal ClassificationHateful Memes
Overall Score64.6
17
Hateful Meme DetectionHateful Memes (val test)
Accuracy51.05
15
Image ClassificationHateful Memes
Accuracy66
11
Multimodal ReasoningHateful Memes (HM) (test)
MiniGPT-4 Score62.33
10
Content ModerationHateful Memes seen (test)
AUC-ROC89.2
7
ClassificationHateful Memes (test)
Precision0.66
4
OCRHateful Memes (dev)
ROC AUC78
4
Explanation GenerationHateful Memes
Bias Score0.78
2
Showing 11 of 11 rows