Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MT

Benchmarks

Task NameDataset NameSOTA ResultTrend
Machine TranslationMT en -> fr
BLEU39.01
14
Machine TranslationMT en -> de
BLEU29.41
14
Machine TranslationMT (test)
Average Win Rate58.24
12
Generative RecommendationMT
Latency (ms)11.7
9
Link PredictionMT2 org
MRR10.6
9
Makeup TransferMT
L2M Score0.183
8
RetrievalMT Small
Recall@101.12
6
RetrievalMT Large
Recall@100.97
6
Graph classificationMT standard
Accuracy88.4
6
retrievalMT-Other Cities High-Freq
Recall@50.5342
5
Makeup TransferMT (test)
Avg User Rating4.35
5
Machine TranslationMT Qwen2-7B-Instruct v1 (test)
Acceptance Length (τ)2.2
4
Inductive Link PredictionMT2 sci
MRR25.8
4
Makeup TransferMT
FID12.07
4
Industrial Defect DetectionMT (test)
mAP93.79
3
Machine TranslationMT
Throughput (tokens/s)188.69
3
Machine TranslationMT
Performance Loss11.2
1
Showing 17 of 17 rows