MMFakeBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Manipulation Detection | MMFakeBench (test) | Accuracy79.4 | 52 | |
| Binary manipulation detection | MMFakeBench 10000 samples (test) | F1 Score74.1 | 28 | |
| Binary manipulation detection | MMFakeBench 1000 samples (val) | F1 Score74.9 | 28 | |
| Fine-grained Detection | MMFakeBench 10000 (test) | F1 Score37.3 | 18 | |
| Fine-grained Detection | MMFakeBench 1000 (val) | F1 Score38.9 | 18 | |
| Coarse-level Multimodal Misinformation Detection | MMFakeBench | Accuracy80.6 | 14 | |
| Multimodal Misinformation Detection | MMFakeBench | Accuracy82 | 11 | |
| Fine-grained Manipulation Detection | MMFakeBench (test) | Mic-F168.6 | 7 | |
| Binary Classification | MMFakeBench text-image (Out-Of-Domain) | Accuracy79.38 | 6 | |
| Multimodal Misinformation Detection | MMFakeBench (val) | F1 Score81.65 | 4 | |
| Multimodal Misinformation Detection | MMFakeBench official (test) | Accuracy82.4 | 3 |
Showing 11 of 11 rows