Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Machine Translation on FLoRes-200 Japanese (test)
Loading...
26.3
BLEU
Vanilla Decoding
22.556
23.528
24.5
25.472
Jan 19, 2024
BLEU
Tokens/sec
Speed Up (x)
Updated 4d ago
Evaluation Results
Method
Method
Links
BLEU
Tokens/sec
Speed Up (x)
Vanilla Decoding
shots=3
2024.01
26.3
33.4
1
Spec.
shots=3, draft_model=L...
2024.01
26
34.5
1.03
Shortlisting
shots=3, target_langua...
2024.01
25.2
34.9
1.04
MuMo
shots=3
2024.01
24.3
58.3
1.75
Spec. (w/o Rejection)
shots=3, draft_model=L...
2024.01
22.7
39.9
1.21
Feedback
Search any
task
Search any
task