Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

NIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Machine Translation (Chinese-to-English)NIST 2003 (MT-03)
BLEU50.3
52
Minutiae ExtractionNIST SD27 (test)
F1 Score71
51
Image Manipulation LocalizationNIST16
F1 Score92.7
42
Machine Translation (Chinese-to-English)NIST MT-05 2005
BLEU50.72
42
Pixel-level Manipulation DetectionNIST
F1 Score73.7
34
Image Manipulation LocalizationNIST 16
AUC0.872
31
Automatic Speech RecognitionNIST CTS CallHome 2000
WER11
27
Machine TranslationNIST MT 06 2006 (test)
BLEU49.98
27
Machine TranslationNIST MT 04 2004 (test)
BLEU0.5061
27
Image Manipulation Detection and LocalizationNIST 16
P-F10.292
15
Image Forgery DetectionNIST16
AUC0.76
15
Machine Translation (Chinese-to-English)NIST MT-06
BLEU38.04
15
Machine Translation (Chinese-to-English)NIST MT 2004
BLEU40.6
15
Image forgery localizationNIST16
F1 (best)0.47
14
Image Forgery LocalizationNIST16 (test)
F1 Score97.4
12
Pixel-level Forgery LocalizationNIST 16
F1 Score0.5001
11
Image-level forgery detectionNIST16
F1 Score72.71
11
Machine TranslationNIST Chinese-English MT08 (test)
BLEU40.45
11
Database SearchNIST (test)
Similarity (Sim_k)84
10
Bounding Box LocalizationNIST 16
IoU0.4473
10
Tamper LocalizationNIST
IoU35
10
Machine TranslationNIST Zh-En All (test)
BLEU Score39.81
10
Database search retrievalNIST (test)
Win Rate88.9
9
Simultaneous Machine TranslationNIST 2003-2006 (test)
COMET Score83.37
8
Image Manipulation LocalizationNIST 2016 (test)
AUC99.2
8
Showing 25 of 39 rows