Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Machine Translation on human-collected unfaithful translation En => De (test)
Loading...
20.9
BLEU
Target-constrained tuning
6.5584
10.2817
14.005
17.7283
Jun 11, 2024
BLEU
COMET
Updated 4d ago
Evaluation Results
Method
Method
Links
BLEU
COMET
Target-constrained tuning
Setting=Supervised
2024.06
20.9
78
Target-constrained tuning LoRA
Setting=Supervised, Ad...
2024.06
20.6
78.5
Vanilla Instruction tuning LoRA
Setting=Supervised, Ad...
2024.06
20.3
78.5
Scheduled Sampling tuning LoRA
Setting=Supervised, Ad...
2024.06
20.2
78.5
R-Drop tuning LORA
Setting=Supervised, Ad...
2024.06
20.1
78.8
Vanilla Instruction Tuning
Setting=Supervised
2024.06
19.8
77.5
Vanilla Fewshot
Setting=Supervised
2024.06
15.7
74.2
Reweight Attention (RA)
Setting=Unsupervised
2024.06
10.6
63.3
Contrastive Decoding (CD)
Setting=Unsupervised
2024.06
9.1
61.5
Vanilla Zeroshot
Setting=Unsupervised
2024.06
7.11
60.6
Feedback
Search any
task
Search any
task