Deep learning-based object detection in maritime unmanned aerial vehicle imagery: Review and experimental comparisons
With the advancement of maritime unmanned aerial vehicles (UAVs) and deep learning
technologies, the application of UAV-based object detection has become increasingly …
technologies, the application of UAV-based object detection has become increasingly …
Neural architecture search: Insights from 1000 papers
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …
areas, including computer vision, natural language understanding, speech recognition, and …
[HTML][HTML] AutoML: A systematic review on automated machine learning with neural architecture search
Abstract AutoML (Automated Machine Learning) is an emerging field that aims to automate
the process of building machine learning models. AutoML emerged to increase productivity …
the process of building machine learning models. AutoML emerged to increase productivity …
Automated knowledge distillation via monte carlo tree search
In this paper, we present Auto-KD, the first automated search framework for optimal
knowledge distillation design. Traditional distillation techniques typically require handcrafted …
knowledge distillation design. Traditional distillation techniques typically require handcrafted …
Emq: Evolving training-free proxies for automated mixed precision quantization
Abstract Mixed-Precision Quantization (MQ) can achieve a competitive accuracy-complexity
trade-off for models. Conventional training-based search methods require time-consuming …
trade-off for models. Conventional training-based search methods require time-consuming …
Training-free transformer architecture search
Abstract Recently, Vision Transformer (ViT) has achieved remarkable success in several
computer vision tasks. The progresses are highly relevant to the architecture design, then it …
computer vision tasks. The progresses are highly relevant to the architecture design, then it …
Nas-bench-suite-zero: Accelerating research on zero cost proxies
Zero-cost proxies (ZC proxies) are a recent architecture performance prediction technique
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …
Deepmad: Mathematical architecture design for deep convolutional neural network
The rapid advances in Vision Transformer (ViT) refresh the state-of-the-art performances in
various vision tasks, overshadowing the conventional CNN-based models. This ignites a few …
various vision tasks, overshadowing the conventional CNN-based models. This ignites a few …
Network properties determine neural network performance
Abstract Machine learning influences numerous aspects of modern society, empowers new
technologies, from Alphago to ChatGPT, and increasingly materializes in consumer products …
technologies, from Alphago to ChatGPT, and increasingly materializes in consumer products …
Evaluating efficient performance estimators of neural architectures
Conducting efficient performance estimations of neural architectures is a major challenge in
neural architecture search (NAS). To reduce the architecture training costs in NAS, one-shot …
neural architecture search (NAS). To reduce the architecture training costs in NAS, one-shot …