DGM4
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Manipulation Detection | DGM4 (test) | Accuracy68.4 | 52 | |
| Multi-label Classification | DGM4 Entire Dataset 1.0 (test) | mAP92.48 | 15 | |
| Image Grounding | DGM4 Image Sub-dataset 1.0 (test) | IoU Mean84.07 | 15 | |
| Multi-modal Manipulation Detection and Grounding | DGM4 Average across domains (test) | Accuracy76.65 | 13 | |
| Multi-modal Manipulation Detection and Grounding | DGM4 Guardian domain (test) | Accuracy91.1 | 13 | |
| Multimodal Media Manipulation Text Grounding | DGM4 | Precision81.62 | 10 | |
| Multimodal Media Manipulation Image Grounding | DGM4 | Mean IoU82.47 | 10 | |
| Multimodal Multi-Label Media Manipulation Classification | DGM4 | OF185.07 | 10 | |
| Multimodal Binary Media Manipulation Classification | DGM4 | AUC0.956 | 10 | |
| Multimodal Manipulation Detection | DGM4 | Accuracy65.18 | 9 | |
| Multimodal Manipulation Detection | DGM4 large-scale | ACC97.14 | 9 | |
| Text Grounding | DGM4 | Precision79.38 | 9 | |
| Image Grounding | DGM4 | IoUm85.51 | 9 | |
| Multi-Label Classification | DGM4 | mAP91.37 | 9 | |
| Binary Classification | DGM4 | AUC97.82 | 9 | |
| Multi-modal Manipulation Detection and Grounding | DGM4 BBC domain (test) | Accuracy72.37 | 8 | |
| Multi-modal Manipulation Detection and Grounding | DGM4 Wash. domain (test) | Accuracy72.84 | 8 | |
| Multi-modal Manipulation Detection and Grounding | DGM4 USA domain (test) | Accuracy71.95 | 8 | |
| Text Grounding | DGM4 Entire Dataset 1.0 (test) | PR77.79 | 8 | |
| Binary Classification | DGM4 Entire Dataset 1.0 (test) | AUC96.34 | 8 | |
| Binary Classification | DGM4 (test) | AUC93.51 | 7 | |
| Misinformation Detection | DGM4 (test) | Accuracy55 | 7 | |
| Text Grounding | DGM4 Text 1.0 (test) | Precision82.88 | 7 | |
| Binary Classification | DGM4 Text Sub-dataset 1.0 (test) | AUC96.38 | 7 | |
| Binary Classification | DGM4 Image Sub-dataset 1.0 (test) | AUC97.15 | 7 |
Showing 25 of 36 rows