When large language models meet personalization: Perspectives of challenges and opportunities

J Chen, Z Liu, X Huang, C Wu, Q Liu, G Jiang, Y Pu… - World Wide Web, 2024 - Springer
The advent of large language models marks a revolutionary breakthrough in artificial
intelligence. With the unprecedented scale of training and model parameters, the capability …

Federated learning for internet of things: Recent advances, taxonomy, and open challenges

LU Khan, W Saad, Z Han, E Hossain… - … Surveys & Tutorials, 2021 - ieeexplore.ieee.org
The Internet of Things (IoT) will be ripe for the deployment of novel machine learning
algorithm for both network and application management. However, given the presence of …

Symbolic discovery of optimization algorithms

X Chen, C Liang, D Huang, E Real… - Advances in neural …, 2023 - proceedings.neurips.cc
We present a method to formulate algorithm discovery as program search, and apply it to
discover optimization algorithms for deep neural network training. We leverage efficient …

Dataset condensation with distribution matching

B Zhao, H Bilen - Proceedings of the IEEE/CVF Winter …, 2023 - openaccess.thecvf.com
Computational cost of training state-of-the-art deep models in many learning problems is
rapidly increasing due to more sophisticated models and larger datasets. A recent promising …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arxiv preprint arxiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

[HTML][HTML] AutoML: A systematic review on automated machine learning with neural architecture search

I Salehin, MS Islam, P Saha, SM Noman, A Tuni… - Journal of Information …, 2024 - Elsevier
Abstract AutoML (Automated Machine Learning) is an emerging field that aims to automate
the process of building machine learning models. AutoML emerged to increase productivity …

Mngnas: distilling adaptive combination of multiple searched networks for one-shot neural architecture search

Z Chen, G Qiu, P Li, L Zhu, X Yang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Recently neural architecture (NAS) search has attracted great interest in academia and
industry. It remains a challenging problem due to the huge search space and computational …

Meta-learning in neural networks: A survey

T Hospedales, A Antoniou, P Micaelli… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent
years. Contrary to conventional approaches to AI where tasks are solved from scratch using …

A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y **ao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

A survey on evolutionary neural architecture search

Y Liu, Y Sun, B Xue, M Zhang, GG Yen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have achieved great success in many applications. The
architectures of DNNs play a crucial role in their performance, which is usually manually …