Model merging in llms, mllms, and beyond: Methods, theories, applications and opportunities

E Yang, L Shen, G Guo, X Wang, X Cao… - arxiv preprint arxiv …, 2024 - arxiv.org
Model merging is an efficient empowerment technique in the machine learning community
that does not require the collection of raw training data and does not require expensive …

Mediator: Memory-efficient LLM Merging with Less Parameter Conflicts and Uncertainty Based Routing

K Lai, Z Tang, X Pan, P Dong, X Liu, H Chen… - arxiv preprint arxiv …, 2025 - arxiv.org
Model merging aggregates Large Language Models (LLMs) finetuned on different tasks into
a stronger one. However, parameter conflicts between models leads to performance …