Towards personalized federated learning via heterogeneous model reassembly

J Wang, X Yang, S Cui, L Che, L Lyu… - Advances in Neural …, 2023 - proceedings.neurips.cc
This paper focuses on addressing the practical yet challenging problem of model
heterogeneity in federated learning, where clients possess models with different network …

Training-free pretrained model merging

Z Xu, K Yuan, H Wang, Y Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recently model merging techniques have surfaced as a solution to combine multiple single-
talent models into a single multi-talent model. However previous endeavors in this field have …

T-stitch: Accelerating sampling in pre-trained diffusion models with trajectory stitching

Z Pan, B Zhuang, DA Huang, W Nie, Z Yu… - arxiv preprint arxiv …, 2024 - arxiv.org
Sampling from diffusion probabilistic models (DPMs) is often expensive for high-quality
image generation and typically requires many steps with a large model. In this paper, we …

Configurable foundation models: Building llms from a modular perspective

C **ao, Z Zhang, C Song, D Jiang, F Yao, X Han… - arxiv preprint arxiv …, 2024 - arxiv.org
Advancements in LLMs have recently unveiled challenges tied to computational efficiency
and continual scalability due to their requirements of huge parameters, making the …

pFedClub: Controllable Heterogeneous Model Aggregation for Personalized Federated Learning

J Wang, Q Li, L Lyu, F Ma - Advances in Neural Information …, 2025 - proceedings.neurips.cc
Federated learning, a pioneering paradigm, enables collaborative model training without
exposing users' data to central servers. Most existing federated learning systems necessitate …

Efficient stitchable task adaptation

H He, Z Pan, J Liu, J Cai… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
The paradigm of pre-training and fine-tuning has laid the foundation for deploying deep
learning models. However most fine-tuning methods are designed to meet a specific …

Visual detection algorithm for enhanced environmental perception of unmanned surface vehicles in complex marine environments

K Dong, T Liu, Y Zheng, Z Shi, H Du… - Journal of Intelligent & …, 2024 - Springer
Unmanned surface vehicles (USVs) are distinguished by their intelligence, compactness,
and absence of human casualties, making them a vital component of the maritime industry …

Stitched vision transformer for age-related macular degeneration detection using retinal optical coherence tomography images

MM Azizi, S Abhari, H Sajedi - Plos one, 2024 - journals.plos.org
Age-related macular degeneration (AMD) is an eye disease that leads to the deterioration of
the central vision area of the eye and can gradually result in vision loss in elderly …

Efficient multiuser AI downloading via reusable knowledge broadcasting

H Wu, Q Zeng, K Huang - IEEE Transactions on Wireless …, 2024 - ieeexplore.ieee.org
For the sixth-generation (6G) mobile networks, in-situ model downloading has emerged as
an important use case to enable real-time adaptive artificial intelligence (AI) on edge …

Cluster-Learngene: Inheriting Adaptive Clusters for Vision Transformers

Q Wang, X Yang, F Feng, J Wang… - Advances in Neural …, 2025 - proceedings.neurips.cc
In recent years, the merging of vast datasets with powerful computational resources has led
to the emergence of large pre-trained models in the field of deep learning. However, the …