Communication-efficient and tensorized federated fine-tuning of large language models

S Ghiasvand, Y Yang, Z Xue, M Alizadeh… - arxiv preprint arxiv …, 2024 - arxiv.org
Parameter-efficient fine-tuning (PEFT) methods typically assume that Large Language
Models (LLMs) are trained on data from a single device or client. However, real-world …

AdaZeta: Adaptive zeroth-order tensor-train adaption for memory-efficient large language models fine-tuning

Y Yang, K Zhen, E Banijamal, A Mouchtaris… - arxiv preprint arxiv …, 2024 - arxiv.org
Fine-tuning large language models (LLMs) has achieved remarkable performance across
various natural language processing tasks, yet it demands more and more memory as …

Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks

Y Zhao, X Yu, X **ao, Z Chen, Z Liu, G Kurczveil… - arxiv preprint arxiv …, 2025 - arxiv.org
Physics-informed neural networks (PINNs) have shown promise in solving partial differential
equations (PDEs), with growing interest in their energy-efficient, real-time training on edge …

Ultra Memory-Efficient On-FPGA Training of Transformers via Tensor-Compressed Optimization

J Tian, J Lu, H Li, X Wang, I Young, Z Zhang - arxiv preprint arxiv …, 2025 - arxiv.org
Transformer models have achieved state-of-the-art performance across a wide range of
machine learning tasks. There is growing interest in training transformers on resource …

CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation

Z Liu, R Zhang, Z Wang, Z Yang, P Hovland… - arxiv preprint arxiv …, 2025 - arxiv.org
Large language models (LLMs) are revolutionizing many science and engineering fields.
However, their huge model sizes impose extremely demanding needs of computational …

TT-DeepONet: Un Framework Efficiente per la risoluzione di EDP su Dispositivi con Risorse Limitate, basato su Compressione Tensoriale

P TONELLI - thesis.unipd.it
Le equazioni differenziali alle derivate parziali (EDP) sono fondamentali per modellare e
comprendere fenomeni complessi in diverse discipline scientifiche e ingegneristiche, dalla …