Model merging in llms, mllms, and beyond: Methods, theories, applications and opportunities

E Yang, L Shen, G Guo, X Wang, X Cao… - arxiv preprint arxiv …, 2024 - arxiv.org
Model merging is an efficient empowerment technique in the machine learning community
that does not require the collection of raw training data and does not require expensive …

Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialect

G Shang, H Abdine, Y Khoubrane, A Mohamed… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce Atlas-Chat, the first-ever collection of LLMs specifically developed for dialectal
Arabic. Focusing on Moroccan Arabic, also known as Darija, we construct our instruction …