Neural architecture search survey: A computer vision perspective

JS Kang, JK Kang, JJ Kim, KW Jeon, HJ Chung… - Sensors, 2023 - mdpi.com
In recent years, deep learning (DL) has been widely studied using various methods across
the globe, especially with respect to training methods and network structures, proving highly …

Extracting training data from diffusion models

N Carlini, J Hayes, M Nasr, M Jagielski… - 32nd USENIX Security …, 2023 - usenix.org
Image diffusion models such as DALL-E 2, Imagen, and Stable Diffusion have attracted
significant attention due to their ability to generate high-quality synthetic images. In this work …

One-step diffusion with distribution matching distillation

T Yin, M Gharbi, R Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Diffusion models generate high-quality images but require dozens of forward passes. We
introduce Distribution Matching Distillation (DMD) a procedure to transform a diffusion model …

Weight-sharing neural architecture search: A battle to shrink the optimization gap

L **e, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Consistency models

Y Song, P Dhariwal, M Chen, I Sutskever - 2023 - openreview.net
Diffusion models have significantly advanced the fields of image, audio, and video
generation, but they depend on an iterative sampling process that causes slow generation …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arxiv preprint arxiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Transgan: Two pure transformers can make one strong gan, and that can scale up

Y Jiang, S Chang, Z Wang - Advances in Neural …, 2021 - proceedings.neurips.cc
The recent explosive interest on transformers has suggested their potential to become
powerful``universal" models for computer vision tasks, such as classification, detection, and …

Symbolic regression via neural-guided genetic programming population seeding

TN Mundhenk, M Landajuela, R Glatt… - arxiv preprint arxiv …, 2021 - arxiv.org
Symbolic regression is the process of identifying mathematical expressions that fit observed
output from a black-box process. It is a discrete optimization problem generally believed to …

Graph neural network architecture search for rotating machinery fault diagnosis based on reinforcement learning

J Li, X Cao, R Chen, X Zhang, X Huang, Y Qu - Mechanical Systems and …, 2023 - Elsevier
In order to improve the accuracy of fault diagnosis, researchers are constantly trying to
develop new diagnostic models. However, limited by the inherent thinking of human beings …

Gradient normalization for generative adversarial networks

YL Wu, HH Shuai, ZR Tam… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
In this paper, we propose a novel normalization method called gradient normalization (GN)
to tackle the training instability of Generative Adversarial Networks (GANs) caused by the …