NIST
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Manipulation Localization | NIST16 | F1 Score92.7 | 93 | |
| Minutiae Extraction | NIST SD27 (test) | F1 Score71 | 77 | |
| Machine Translation (Chinese-to-English) | NIST 2003 (MT-03) | BLEU50.3 | 52 | |
| Machine Translation (Chinese-to-English) | NIST MT-05 2005 | BLEU50.72 | 42 | |
| Pixel-level Manipulation Detection | NIST | F1 Score73.7 | 34 | |
| Image Manipulation Localization | NIST 16 | AUC0.872 | 31 | |
| Tamper Localization | NIST | IoU44 | 30 | |
| Automatic Speech Recognition | NIST CTS CallHome 2000 | WER11 | 27 | |
| Machine Translation | NIST MT 06 2006 (test) | BLEU49.98 | 27 | |
| Machine Translation | NIST MT 04 2004 (test) | BLEU0.5061 | 27 | |
| Molecular retrieval | NIST 2020 (Scaffold) | Top-1 Accuracy46 | 16 | |
| Image Manipulation Detection and Localization | NIST 16 | P-F10.292 | 15 | |
| Image Forgery Detection | NIST16 | AUC0.76 | 15 | |
| Machine Translation (Chinese-to-English) | NIST MT-06 | BLEU38.04 | 15 | |
| Machine Translation (Chinese-to-English) | NIST MT 2004 | BLEU40.6 | 15 | |
| Image Forgery Localization | NIST 16 | F1 Score54.9 | 14 | |
| Image forgery localization | NIST16 | F1 (best)0.47 | 14 | |
| Molecular retrieval | NIST 2020 (Random split) | Top-1 Accuracy53.3 | 12 | |
| Image-level Nature Image Forgery Detection | NIST 16 | AUC85.1 | 12 | |
| Image Forgery Localization | NIST16 (test) | F1 Score97.4 | 12 | |
| Pixel-level Forgery Localization | NIST 16 | F1 Score0.5001 | 11 | |
| Image-level forgery detection | NIST16 | F1 Score72.71 | 11 | |
| Machine Translation | NIST Chinese-English MT08 (test) | BLEU40.45 | 11 | |
| Database Search | NIST (test) | Similarity (Sim_k)84 | 10 | |
| Bounding Box Localization | NIST 16 | IoU0.4473 | 10 |
Showing 25 of 51 rows