Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Idiomatic Translation on Inter-Indic hi-xx
Loading...
1.92
LLM-eval Score
Indictrans2
1.157368
1.355359
1.55335
1.751341
May 28, 2025
LLM-eval Score
COMET Score
Updated 4d ago
Evaluation Results
Method
Method
Links
LLM-eval Score
COMET Score
Indictrans2
Inference Method=Direct
2025.05
1.92
81
NLLB-200
Inference Method=Direct
2025.05
1.85
79
IdiomCE
Backbone=Gemma2-9b-it
2025.05
1.8233
72.83
Direct
Backbone=Gemma2-9b-it
2025.05
1.4833
75
IdiomCE
Backbone=LLama-3.1-8B
2025.05
1.42
61.6
Direct
Backbone=LLama-3.1-8B
2025.05
1.34
65.33
IdiomCE
Backbone=LLama-3.2-3B
2025.05
1.263
56.63
Direct
Backbone=LLama-3.2-3B
2025.05
1.1867
58.9
Feedback
Search any
task
Search any
task
