Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MDSM

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multimodal Manipulation DetectionMDSM (test)
ACC82
52
Multi-modal Forgery Detection and GroundingMDSM AVG
Accuracy88.18
14
Multi-modal Forgery Detection and GroundingMDSM BBC
Accuracy89.74
14
Multi-modal Forgery Detection and GroundingMDSM (Wash.)
Accuracy86.64
14
Multi-modal Forgery Detection and GroundingMDSM USA
Accuracy88.8
14
Multi-modal Forgery Detection and GroundingMDSM Guardian
Accuracy92.6
14
Multi-modal Forgery Detection and GroundingMDSM NYT
Accuracy94.67
14
Multi-modal Misinformation DetectionMDSM Average across domains
Accuracy89.64
12
Multi-modal Misinformation DetectionMDSM BBC domain
Accuracy89.89
12
Multi-modal Misinformation DetectionMDSM Wash. domain
Accuracy88.88
12
Multi-modal Misinformation DetectionMDSM USA domain
Accuracy88.8
12
Multi-modal Misinformation DetectionMDSM Guardian domain
Accuracy95.63
12
Multi-modal Misinformation DetectionMDSM NYT domain
Accuracy96.26
12
Multimodal Manipulation DetectionMDSM
Accuracy88.13
9
Multimodal Manipulation DetectionMDSM large-scale
Accuracy88.49
9
Manipulation LocalizationMDSM AVG
mAP48.09
7
Manipulation DetectionMDSM AVG
Accuracy71.71
7
Manipulation LocalizationMDSM Wash. Post
mAP51.92
7
Manipulation DetectionMDSM Wash. Post
Accuracy73.24
7
Manipulation LocalizationMDSM USA Today
mAP51.46
7
Manipulation DetectionMDSM USA Today
Accuracy73.28
7
Manipulation LocalizationMDSM NYT
mAP31.56
7
Manipulation DetectionMDSM NYT
Accuracy70.22
7
Manipulation LocalizationMDSM BBC
mAP55.22
7
Manipulation DetectionMDSM BBC
Accuracy72.69
7
Showing 25 of 29 rows