Cross-Lingual Exploration for Parametric Knowledge
About
Parametric knowledge in Large Language Models is not equally accessible across languages. As a result, standard inference techniques often struggle to surface localized facts, leading to failures in cross-lingual knowledge transfer and consistency. In this work, we investigate techniques for accessing hidden factual knowledge by exploring cross-lingual prompting strategies. We identify four inherent dimensions of cross-lingual exploration that directly govern parametric knowledge retrieval and evaluate them on multilingual factual benchmarks covering 17 typologically diverse languages. Our results demonstrate that cross-lingual exploration significantly improves knowledge transfer and factual recall, representing a more efficient compute Pareto frontier than native-language scaling. Furthermore, we observe corresponding improvements in cross-lingual consistency, exceeding what can be explained by accuracy gains alone. Overall, our work establishes multilingual prompt exploration as a highly effective inference-time strategy for unlocking latent parametric knowledge.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Factual Knowledge Recall | CLIKE 1.0 (test) | Recall Score (EN)87.2 | 18 | |
| Factual Knowledge Recall | ECLeKTic 1.0 (test) | Recall (EN)83.9 | 17 |