Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Idiomatic Translation on Inter-Indic (ta-xx)
Loading...
2.01
LLM-eval Score
Indictrans2
1.2196
1.4248
1.63
1.8352
May 28, 2025
LLM-eval Score
COMET Score
Updated 4d ago
Evaluation Results
Method
Method
Links
LLM-eval Score
COMET Score
Indictrans2
Inference Method=Direct
2025.05
2.01
0.77
IdiomCE
Backbone=Gemma2-9b-it
2025.05
1.9867
0.7267
NLLB-200
Inference Method=Direct
2025.05
1.84
0.77
Direct
Backbone=Gemma2-9b-it
2025.05
1.563
0.755
IdiomCE
Backbone=LLama-3.1-8B
2025.05
1.533
0.5993
IdiomCE
Backbone=LLama-3.2-3B
2025.05
1.2567
0.5387
Direct
Backbone=LLama-3.2-3B
2025.05
1.253
0.572
Direct
Backbone=LLama-3.1-8B
2025.05
1.25
0.6393
Feedback
Search any
task
Search any
task
