Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DGM4

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multi-label ClassificationDGM4 Entire Dataset 1.0 (test)
mAP92.48
15
Image GroundingDGM4 Image Sub-dataset 1.0 (test)
IoU Mean84.07
15
Multi-modal Manipulation Detection and GroundingDGM4 Average across domains (test)
Accuracy76.65
13
Multi-modal Manipulation Detection and GroundingDGM4 Guardian domain (test)
Accuracy91.1
13
Multimodal Media Manipulation Text GroundingDGM4
Precision81.62
10
Multimodal Media Manipulation Image GroundingDGM4
Mean IoU82.47
10
Multimodal Multi-Label Media Manipulation ClassificationDGM4
OF185.07
10
Multimodal Binary Media Manipulation ClassificationDGM4
AUC0.956
10
Multi-modal Manipulation Detection and GroundingDGM4 BBC domain (test)
Accuracy72.37
8
Multi-modal Manipulation Detection and GroundingDGM4 Wash. domain (test)
Accuracy72.84
8
Multi-modal Manipulation Detection and GroundingDGM4 USA domain (test)
Accuracy71.95
8
Text GroundingDGM4 Entire Dataset 1.0 (test)
PR77.79
8
Binary ClassificationDGM4 Entire Dataset 1.0 (test)
AUC96.34
8
Binary ClassificationDGM4 (test)
AUC93.51
7
Misinformation DetectionDGM4 (test)
Accuracy55
7
Text GroundingDGM4 Text 1.0 (test)
Precision82.88
7
Binary ClassificationDGM4 Text Sub-dataset 1.0 (test)
AUC96.38
7
Binary ClassificationDGM4 Image Sub-dataset 1.0 (test)
AUC97.15
7
Multimodal Fake News DetectionDGM4 Avg.
Macro F1 (multimodal)79.38
5
Multimodal Fake News DetectionDGM4 5% budget
Macro F1 (Multi)79.34
5
Multimodal Fake News DetectionDGM4 1% budget
Macro F1 (Multi)79.47
5
Multimodal Fake News DetectionDGM4 0.25% budget
Macro F1 (multi)79.66
5
Multi-modal Forgery Detection and GroundingDGM4 BBC
Accuracy72.37
5
Multi-modal Forgery Detection and GroundingDGM4 (Wash)
Accuracy70.28
5
Multi-modal Forgery Detection and GroundingDGM4 (USA)
Accuracy70.62
5
Showing 25 of 28 rows