Selective Aggregation for Low-Rank Adaptation in Federated Learning

P Guo, S Zeng, Y Wang, H Fan, F Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
We investigate LoRA in federated learning through the lens of the asymmetry analysis of the
learned $ A $ and $ B $ matrices. In doing so, we uncover that $ A $ matrices are …