Think in English, Answer in Korean: Efficient Adaptation of Multilingual Tool-Using Agents
About
We present LuckyStar 111B, a 111B-parameter hybrid reasoning model developed through a collaboration between Cohere and LG CNS for Korean-English enterprise agents under practical memory and serving constraints. The model trains from Cohere's fully post-trained Command A model rather than a new pretraining run, and uses preamble conditioning to switch between concise non-reasoning behavior and longer tool-oriented reasoning. We study four choices for scaling tool-using agents efficiently: multilingual supervised fine-tuning, reinforcement learning with verifiable rewards for multi-step tool-use tasks, language-consistency rewards for Korean user-facing responses, and 4-bit quantization for single-GPU serving. The adapted model improves mathematical reasoning, function calling, and agentic natural-language-to-SQL (NL2SQL) performance while preserving general Korean and English instruction-following quality. These results provide a practical recipe and failure-mode analysis for adapting post-trained multilingual models to verifiable agentic workflows under memory-constrained deployment.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Mathematical Reasoning | MATH 500 | Pass@196 | 12 | |
| Instruction Following | IFEval Korean | Accuracy78.3 | 6 | |
| Knowledge Evaluation | KMMLU (test) | Accuracy68.6 | 6 | |
| Mathematical Reasoning | MATH 500 (Korean) | Pass@1 Accuracy95.6 | 6 | |
| Instruction Following | IFEval English | Accuracy89.4 | 6 | |
| Mathematical Reasoning | AIME Korean 2024 | Pass@1 Accuracy69.3 | 6 | |
| Mathematical Reasoning | AIME English 2024 | Pass@1 Accuracy73.7 | 6 | |
| Science Reasoning | ARC-C English (test) | Accuracy93.8 | 6 | |
| Conversation Quality | MT-Bench English | Score8.5 | 6 | |
| Science Reasoning | ARC-C Korean (test) | Accuracy89.2 | 6 |