Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MMFakeBench

Benchmarks

Task NameDataset NameSOTA ResultTrend
Binary manipulation detectionMMFakeBench 10000 samples (test)
F1 Score74.1
28
Binary manipulation detectionMMFakeBench 1000 samples (val)
F1 Score74.9
28
Fine-grained DetectionMMFakeBench 10000 (test)
F1 Score37.3
18
Fine-grained DetectionMMFakeBench 1000 (val)
F1 Score38.9
18
Coarse-level Multimodal Misinformation DetectionMMFakeBench
Accuracy80.6
14
Fine-grained Manipulation DetectionMMFakeBench (test)
Mic-F168.6
7
Multimodal Misinformation DetectionMMFakeBench
Accuracy82
7
Binary ClassificationMMFakeBench text-image (Out-Of-Domain)
Accuracy79.38
6
Showing 8 of 8 rows