Model merging in llms, mllms, and beyond: Methods, theories, applications and opportunities

E Yang, L Shen, G Guo, X Wang, X Cao… - arxiv preprint arxiv …, 2024 - arxiv.org
Model merging is an efficient empowerment technique in the machine learning community
that does not require the collection of raw training data and does not require expensive …

Oml: Open, monetizable, and loyal ai

Z Cheng, E Contente, B Finch, O Golev… - arxiv preprint arxiv …, 2024 - arxiv.org
Artificial Intelligence (AI) has steadily improved across a wide range of tasks. However, the
development and deployment of AI are almost entirely controlled by a few powerful …

MergePrint: Robust Fingerprinting against Merging Large Language Models

S Yamabe, T Takahashi, F Waseda… - arxiv preprint arxiv …, 2024 - arxiv.org
As the cost of training large language models (LLMs) rises, protecting their intellectual
property has become increasingly critical. Model merging, which integrates multiple expert …

Periodic watermarking for copyright protection of large language models in cloud computing security

PG Ye, Z Li, Z Yang, P Chen, Z Zhang, N Li… - Computer Standards & …, 2025 - Elsevier
Abstract Large Language Models (LLMs) have become integral in advancing content
understanding and generation, leading to the proliferation of Embedding as a Service …

HM3: Hierarchical Multi-Objective Model Merging for Pretrained Models

Y Zhou, X Wu, J Wu, L Feng, KC Tan - arxiv preprint arxiv:2409.18893, 2024 - arxiv.org
Model merging is a technique that combines multiple large pretrained models into a single
model with enhanced performance and broader task adaptability. It has gained popularity in …

Mitigating the Backdoor Effect for Multi-Task Model Merging via Safety-Aware Subspace

J Yang, A Tang, D Zhu, Z Chen, L Shen… - arxiv preprint arxiv …, 2024 - arxiv.org
Model merging has gained significant attention as a cost-effective approach to integrate
multiple single-task fine-tuned models into a unified one that can perform well on multiple …