MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment

AH Kargaran, A Modarressi, N Nikeghbal… - arxiv preprint arxiv …, 2024 - arxiv.org
English-centric large language models (LLMs) often show strong multilingual capabilities.
However, the multilingual performance of these models remains unclear and is not …

Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models

X Zhou, D Chen, S Cahyawijaya, X Duan… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce a novel analysis that leverages linguistic minimal pairs to probe the internal
linguistic representations of Large Language Models (LLMs). By measuring the similarity …

Do Multilingual LLMs Think In English?

L Schut, Y Gal, S Farquhar - arxiv preprint arxiv:2502.15603, 2025 - arxiv.org
Large language models (LLMs) have multilingual capabilities and can solve tasks across
various languages. However, we show that current LLMs make key decisions in a …

Lens: Rethinking Multilingual Enhancement for Large Language Models

W Zhao, Y Hu, J Guo, X Sui, T Wu, Y Deng… - arxiv preprint arxiv …, 2024 - arxiv.org
Despite the growing global demand for large language models (LLMs) that serve users from
diverse linguistic backgrounds, most cutting-edge LLMs remain predominantly English …

Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap

H Ko, G Son, D Choi - arxiv preprint arxiv:2501.02448, 2025 - arxiv.org
Large language models (LLMs) demonstrate exceptional performance on complex
reasoning tasks. However, despite their strong reasoning capabilities in high-resource …

RomanLens: Latent Romanization and its role in Multilinguality in LLMs

A Saji, JA Husain, T Jayakumar, R Dabre… - arxiv preprint arxiv …, 2025 - arxiv.org
Large Language Models (LLMs) exhibit remarkable multilingual generalization despite
being predominantly trained on English-centric corpora. A fundamental question arises: how …

The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model

J Chen, W Chen, J Su, J Xu, H Lin, M Ren, Y Lu… - arxiv preprint arxiv …, 2024 - arxiv.org
Large language models (LLMs) have shown significant multilingual capabilities. However,
the mechanisms underlying the development of these capabilities during pre-training are not …