HatefulMemes
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Meme Classification | HatefulMemes | Accuracy82.1 | 60 | |
| Hateful Meme Detection | HatefulMemes | Accuracy63.5 | 23 | |
| Hate Speech Analysis | HatefulMemes | Binary F181.1 | 17 | |
| Hateful Meme Classification | HatefulMemes (unseen) | Accuracy77.65 | 11 | |
| Hateful Meme Classification | HatefulMemes (seen) | Accuracy78.7 | 11 | |
| Image Classification | HatefulMemes I (test) | ROC AUC0.791 | 11 | |
| Hateful Meme Detection | HatefulMemes v1.0 (test) | AUC87 | 10 | |
| Multimodal Hate Speech Detection | HatefulMemes seen (test) | Macro F184.8 | 10 | |
| Image Classification | HatefulMemes | ROC AUC0.808 | 5 | |
| Hate Speech Detection | HatefulMemes (dev) | ROC AUC73.4 | 5 | |
| Multimodal Content Moderation | HatefulMemes | Accuracy80.8 | 4 | |
| Multimodal Classification | HatefulMemes (test-seen) | Accuracy86.6 | 4 |
Showing 12 of 12 rows