Diffusion models: A comprehensive survey of methods and applications

L Yang, Z Zhang, Y Song, S Hong, R Xu, Y Zhao… - ACM Computing …, 2023 - dl.acm.org
Diffusion models have emerged as a powerful new family of deep generative models with
record-breaking performance in many applications, including image synthesis, video …

Normalizing flows for probabilistic modeling and inference

G Papamakarios, E Nalisnick, DJ Rezende… - Journal of Machine …, 2021 - jmlr.org
Normalizing flows provide a general mechanism for defining expressive probability
distributions, only requiring the specification of a (usually simple) base distribution and a …

Generative pretraining from pixels

M Chen, A Radford, R Child, J Wu… - International …, 2020 - proceedings.mlr.press
Inspired by progress in unsupervised representation learning for natural language, we
examine whether similar models can learn useful representations for images. We train a …

[BOOK][B] Neural networks and deep learning

CC Aggarwal - 2018 - Springer
“Any AI smart enough to pass a Turing test is smart enough to know to fail it.”–*** Ian
McDonald Neural networks were developed to simulate the human nervous system for …

Categorical reparameterization with gumbel-softmax

E Jang, S Gu, B Poole - arxiv preprint arxiv:1611.01144, 2016 - arxiv.org
Categorical variables are a natural choice for representing discrete structure in the world.
However, stochastic neural networks rarely use categorical latent variables due to the …

Deep learning based recommender system: A survey and new perspectives

S Zhang, L Yao, A Sun, Y Tay - ACM computing surveys (CSUR), 2019 - dl.acm.org
With the growing volume of online information, recommender systems have been an
effective strategy to overcome information overload. The utility of recommender systems …

Generating diverse high-fidelity images with vq-vae-2

A Razavi, A Van den Oord… - Advances in neural …, 2019 - proceedings.neurips.cc
We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large
scale image generation. To this end, we scale and enhance the autoregressive priors used …

[PDF][PDF] Deep learning

I Goodfellow - 2016 - synapse.koreamed.org
An introduction to a broad range of topics in deep learning, covering mathematical and
conceptual background, deep learning techniques used in industry, and research …

Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models

S Bond-Taylor, A Leach, Y Long… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep generative models are a class of techniques that train deep neural networks to model
the distribution of training samples. Research has fragmented into various interconnected …

Image transformer

N Parmar, A Vaswani, J Uszkoreit… - International …, 2018 - proceedings.mlr.press
Image generation has been successfully cast as an autoregressive sequence generation or
transformation problem. Recent work has shown that self-attention is an effective way of …