Model merging combines multiple expert models-finetuned from a base foundation model
on diverse tasks and domains-into a single, more capable model. However, most existing …

Deep model merging represents an emerging research direction that combines multiple fine-
tuned models to harness their specialized capabilities across different tasks and domains …

We introduce Reward-Guided Speculative Decoding (RSD), a novel framework aimed at
improving the efficiency of inference in large language models (LLMs). RSD synergistically …

Model merging has shown great promise at combining expert models, but the benefit of
merging is unclear when merging``generalist''models trained on many tasks. We explore …

AstroSage-Llama-3.1-8B is a domain-specialized natural-language AI assistant tailored for
research in astronomy, astrophysics, and cosmology. Trained on the complete collection of …

The increasing complexity of modern machine learning models exposes the limitations of
the traditional, monolithic approach to their development, raising concerns about cost and …