A survey of resource-efficient llm and multimodal foundation models
Large foundation models, including large language models (LLMs), vision transformers
(ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine …
(ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine …
Melon: Breaking the memory wall for resource-efficient on-device machine learning
On-device learning is a promising technique for emerging privacy-preserving machine
learning paradigms. However, through quantitative experiments, we find that commodity …
learning paradigms. However, through quantitative experiments, we find that commodity …
Mandheling: Mixed-precision on-device dnn training with dsp offloading
This paper proposes Mandheling, the first system that enables highly resource-efficient on-
device training by orchestrating mixed-precision training with on-chip Digital Signal …
device training by orchestrating mixed-precision training with on-chip Digital Signal …
A comprehensive deep learning library benchmark and optimal library selection
Deploying deep learning (DL) on mobile devices has been a notable trend in recent years.
To support fast inference of on-device DL, DL libraries play a critical role as algorithms and …
To support fast inference of on-device DL, DL libraries play a critical role as algorithms and …
[PDF][PDF] Mobile Foundation Model as Firmware
In today's landscape, smartphones have evolved into hubs for hosting a multitude of deep
learning models aimed at local execution. A key realization driving this work is the notable …
learning models aimed at local execution. A key realization driving this work is the notable …
A probabilistic approach to blood glucose prediction in type 1 diabetes under meal uncertainties
Currently, most reliable and commercialized artificial pancreas systems for type 1 diabetes
are hybrid closed-loop systems, which require the user to announce every meal and its size …
are hybrid closed-loop systems, which require the user to announce every meal and its size …
On-device training: A first overview on existing systems
The recent breakthroughs in machine learning (ML) and deep learning (DL) have catalyzed
the design and development of various intelligent systems over wide application domains …
the design and development of various intelligent systems over wide application domains …
RoboCA3T: A Robot‐Inspired Computer‐Assisted adaptive autism therapy for improving joint attention and imitation skills through learning and computing …
Background This study presents a Robot‐Inspired Computer‐Assisted Adaptive Autism
Therapy (RoboCA3T) focusing on improving joint attention and imitation skills of children …
Therapy (RoboCA3T) focusing on improving joint attention and imitation skills of children …
Federated neural architecture search
To preserve user privacy while enabling mobile intelligence, techniques have been
proposed to train deep neural networks on decentralized data. However, training over …
proposed to train deep neural networks on decentralized data. However, training over …
Anatomizing Deep Learning Inference in Web Browsers
Web applications have increasingly adopted Deep Learning (DL) through in-browser
inference, wherein DL inference performs directly within Web browsers. The actual …
inference, wherein DL inference performs directly within Web browsers. The actual …