Multilingual large language model: A survey of resources, taxonomy and frontiers

L Qin, Q Chen, Y Zhou, Z Chen, Y Li, L Liao… - arxiv preprint arxiv …, 2024 - arxiv.org
Multilingual Large Language Models are capable of using powerful Large Language
Models to handle and respond to queries in multiple languages, which achieves remarkable …

Fine-tuning large language models with sequential instructions

H Hu, S Yu, P Chen, EM Ponti - arxiv preprint arxiv:2403.07794, 2024 - arxiv.org
Despite the success of existing instruction-tuned models, we find that they usually struggle to
respond to queries with multiple instructions. This impairs their performance in complex …

A survey of multilingual large language models

L Qin, Q Chen, Y Zhou, Z Chen, Y Li, L Liao, M Li… - Patterns, 2025 - cell.com
Multilingual large language models (MLLMs) leverage advanced large language models to
process and respond to queries across multiple languages, achieving significant success in …

Crosslingual content scoring in five languages using machine-translation and multilingual transformer models

A Horbach, J Pehlke, R Laarmann-Quante… - International Journal of …, 2024 - Springer
This paper investigates crosslingual content scoring, a scenario where scoring models
trained on learner data in one language are applied to data in a different language. We …

Better low-resource entity recognition through translation and annotation fusion

Y Chen, V Shah, A Ritter - arxiv preprint arxiv:2305.13582, 2023 - arxiv.org
Pre-trained multilingual language models have enabled significant advancements in cross-
lingual transfer. However, these models often exhibit a performance disparity when …

Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges

J Becker, JP Wahle, B Gipp, T Ruas - arxiv preprint arxiv:2405.15604, 2024 - arxiv.org
Text generation has become more accessible than ever, and the increasing interest in these
systems, especially those using large language models, has spurred an increasing number …

Can llms handle low-resource dialects? a case study on translation and common sense reasoning in šariš

V Ondrejová, M Šuppa - … of the Eleventh Workshop on NLP for …, 2024 - aclanthology.org
Abstract While Large Language Models (LLMs) have demonstrated considerable potential
in advancing natural language processing in dialect-specific contexts, their effectiveness in …

Zero-Shot Cross-Lingual Sentiment Classification under Distribution Shift: an Exploratory Study

M De Raedt, SK Bitew, F Godin, T Demeester… - arxiv preprint arxiv …, 2023 - arxiv.org
The brittleness of finetuned language model performance on out-of-distribution (OOD) test
samples in unseen domains has been well-studied for English, yet is unexplored for multi …

Self-translate-train: Enhancing cross-lingual transfer of large language models via inherent capability

R Ri, S Kiyono, S Takase - arxiv preprint arxiv:2407.00454, 2024 - arxiv.org
Zero-shot cross-lingual transfer by fine-tuning multilingual pretrained models shows promise
for low-resource languages, but often suffers from misalignment of internal representations …

Translation Deserves Better: Analyzing Translation Artifacts in Cross-lingual Visual Question Answering

CH Park, K Lee, H Lim, J Kim, J Park, YJ Heo… - arxiv preprint arxiv …, 2024 - arxiv.org
Building a reliable visual question answering~(VQA) system across different languages is a
challenging problem, primarily due to the lack of abundant samples for training. To address …