Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on Hindi (HI)
Loading...
91
Accuracy (ACC)
Gemma 3 12B
56.16
65.205
74.25
83.295
May 28, 2026
Accuracy (ACC)
Cross-Lingual Consistency (CLC)
Updated 5d ago
Evaluation Results
Method
Method
Links
Accuracy (ACC)
Cross-Lingual Consistency (CLC)
Gemma 3 12B
Setting=TinT
2026.05
91
88.8
Qwen 2.5 14B
Setting=TinT
2026.05
85.9
81.1
LLaMA 3.1 8B
Setting=TinT
2026.05
84.3
80.6
Gemma 3 12B
Setting=Baseline
2026.05
79.6
77.9
Qwen 2.5 14B
Setting=Baseline
2026.05
69.5
67.1
LLaMA 3.1 8B
Setting=Baseline
2026.05
57.5
53.9
Feedback
Search any
task
Search any
task