Structured pruning for deep convolutional neural networks: A survey

Y He, L **ao - IEEE transactions on pattern analysis and …, 2023 - ieeexplore.ieee.org
The remarkable performance of deep Convolutional neural networks (CNNs) is generally
attributed to their deeper and wider architectures, which can come with significant …

Artificial intelligence for remote sensing data analysis: A review of challenges and opportunities

L Zhang, L Zhang - IEEE Geoscience and Remote Sensing …, 2022 - ieeexplore.ieee.org
Artificial intelligence (AI) plays a growing role in remote sensing (RS). Applications of AI,
particularly machine learning algorithms, range from initial image processing to high-level …

Neural prompt search

Y Zhang, K Zhou, Z Liu - IEEE Transactions on Pattern Analysis …, 2024 - ieeexplore.ieee.org
The size of vision models has grown exponentially over the last few years, especially after
the emergence of Vision Transformer. This has motivated the development of parameter …

Artificial intelligence: A powerful paradigm for scientific research

Y Xu, X Liu, X Cao, C Huang, E Liu, S Qian, X Liu… - The Innovation, 2021 - cell.com
Artificial intelligence (AI) coupled with promising machine learning (ML) techniques well
known from computer science is broadly affecting many aspects of various fields including …

Multiview transformers for video recognition

S Yan, X **ong, A Arnab, Z Lu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Video understanding requires reasoning at multiple spatiotemporal resolutions--from short
fine-grained motions to events taking place over longer durations. Although transformer …

Deep model reassembly

X Yang, D Zhou, S Liu, J Ye… - Advances in neural …, 2022 - proceedings.neurips.cc
In this paper, we explore a novel knowledge-transfer task, termed as Deep Model
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …

Application of meta-heuristic algorithms for training neural networks and deep learning architectures: A comprehensive review

M Kaveh, MS Mesgari - Neural Processing Letters, 2023 - Springer
The learning process and hyper-parameter optimization of artificial neural networks (ANNs)
and deep learning (DL) architectures is considered one of the most challenging machine …

Evoprompting: Language models for code-level neural architecture search

A Chen, D Dohan, D So - Advances in neural information …, 2023 - proceedings.neurips.cc
Given the recent impressive accomplishments of language models (LMs) for code
generation, we explore the use of LMs as general adaptive mutation and crossover …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arxiv preprint arxiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Lightweight deep learning for resource-constrained environments: A survey

HI Liu, M Galindo, H **e, LK Wong, HH Shuai… - ACM Computing …, 2024 - dl.acm.org
Over the past decade, the dominance of deep learning has prevailed across various
domains of artificial intelligence, including natural language processing, computer vision …