Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Machine Translation on FLoRes-200 Korean (test)
Loading...
21.7
BLEU
MuMo
18.476
19.313
20.15
20.987
Jan 19, 2024
BLEU
Tokens/sec
Speed Up Ratio
Updated 4d ago
Evaluation Results
Method
Method
Links
BLEU
Tokens/sec
Speed Up Ratio
MuMo
shots=3
2024.01
21.7
50.9
1.7
Spec.
shots=3, draft_model=L...
2024.01
21.5
29.2
0.98
Vanilla Decoding
shots=3
2024.01
21.2
29.8
1
Shortlisting
shots=3, target_langua...
2024.01
19.5
32.7
1.03
Spec. (w/o Rejection)
shots=3, draft_model=L...
2024.01
18.6
36.5
1.22
Feedback
Search any
task
Search any
task