Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on Marathi (MR)
Loading...
90.7
Accuracy (ACC)
Gemma 3 12B
54.508
63.904
73.3
82.696
May 28, 2026
Accuracy (ACC)
Cross-Lingual Consistency (CLC)
Updated 5d ago
Evaluation Results
Method
Method
Links
Accuracy (ACC)
Cross-Lingual Consistency (CLC)
Gemma 3 12B
Setting=TinT
2026.05
90.7
89
Qwen 2.5 14B
Setting=TinT
2026.05
84.4
81.3
LLaMA 3.1 8B
Setting=TinT
2026.05
83
82
Gemma 3 12B
Setting=Baseline
2026.05
80.3
78.6
Qwen 2.5 14B
Setting=Baseline
2026.05
72.9
68.2
LLaMA 3.1 8B
Setting=Baseline
2026.05
55.9
52.9
Feedback
Search any
task
Search any
task