Deep learning-based object detection in maritime unmanned aerial vehicle imagery: Review and experimental comparisons

C Zhao, RW Liu, J Qu, R Gao - Engineering Applications of Artificial …, 2024 - Elsevier
With the advancement of maritime unmanned aerial vehicles (UAVs) and deep learning
technologies, the application of UAV-based object detection has become increasingly …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arxiv preprint arxiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

[HTML][HTML] AutoML: A systematic review on automated machine learning with neural architecture search

I Salehin, MS Islam, P Saha, SM Noman, A Tuni… - Journal of Information …, 2024 - Elsevier
Abstract AutoML (Automated Machine Learning) is an emerging field that aims to automate
the process of building machine learning models. AutoML emerged to increase productivity …

Automated knowledge distillation via monte carlo tree search

L Li, P Dong, Z Wei, Y Yang - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
In this paper, we present Auto-KD, the first automated search framework for optimal
knowledge distillation design. Traditional distillation techniques typically require handcrafted …

Emq: Evolving training-free proxies for automated mixed precision quantization

P Dong, L Li, Z Wei, X Niu, Z Tian… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Mixed-Precision Quantization (MQ) can achieve a competitive accuracy-complexity
trade-off for models. Conventional training-based search methods require time-consuming …

Training-free transformer architecture search

Q Zhou, K Sheng, X Zheng, K Li… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Recently, Vision Transformer (ViT) has achieved remarkable success in several
computer vision tasks. The progresses are highly relevant to the architecture design, then it …

Nas-bench-suite-zero: Accelerating research on zero cost proxies

A Krishnakumar, C White, A Zela… - Advances in …, 2022 - proceedings.neurips.cc
Zero-cost proxies (ZC proxies) are a recent architecture performance prediction technique
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …

Deepmad: Mathematical architecture design for deep convolutional neural network

X Shen, Y Wang, M Lin, Y Huang… - Proceedings of the …, 2023 - openaccess.thecvf.com
The rapid advances in Vision Transformer (ViT) refresh the state-of-the-art performances in
various vision tasks, overshadowing the conventional CNN-based models. This ignites a few …

Network properties determine neural network performance

C Jiang, Z Huang, T Pedapati, PY Chen, Y Sun… - Nature …, 2024 - nature.com
Abstract Machine learning influences numerous aspects of modern society, empowers new
technologies, from Alphago to ChatGPT, and increasingly materializes in consumer products …

Evaluating efficient performance estimators of neural architectures

X Ning, C Tang, W Li, Z Zhou, S Liang… - Advances in …, 2021 - proceedings.neurips.cc
Conducting efficient performance estimations of neural architectures is a major challenge in
neural architecture search (NAS). To reduce the architecture training costs in NAS, one-shot …