Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models

S Bond-Taylor, A Leach, Y Long… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep generative models are a class of techniques that train deep neural networks to model
the distribution of training samples. Research has fragmented into various interconnected …

Priors in bayesian deep learning: A review

V Fortuin - International Statistical Review, 2022 - Wiley Online Library
While the choice of prior is one of the most critical parts of the Bayesian inference workflow,
recent Bayesian deep learning models have often fallen back on vague priors, such as …

Score-based generative modeling in latent space

A Vahdat, K Kreis, J Kautz - Advances in neural information …, 2021 - proceedings.neurips.cc
Score-based generative models (SGMs) have recently demonstrated impressive results in
terms of both sample quality and distribution coverage. However, they are usually applied …

Cold decoding: Energy-based constrained text generation with langevin dynamics

L Qin, S Welleck, D Khashabi… - Advances in Neural …, 2022 - proceedings.neurips.cc
Many applications of text generation require incorporating different constraints to control the
semantics or style of generated text. These constraints can be hard (eg, ensuring certain …

Learning generative vision transformer with energy-based latent space for saliency prediction

J Zhang, J **e, N Barnes, P Li - Advances in Neural …, 2021 - proceedings.neurips.cc
Vision transformer networks have shown superiority in many computer vision tasks. In this
paper, we take a step further by proposing a novel generative vision transformer with latent …

Latent diffusion energy-based model for interpretable text modeling

P Yu, S **e, X Ma, B Jia, B Pang, R Gao, Y Zhu… - arxiv preprint arxiv …, 2022 - arxiv.org
Latent space Energy-Based Models (EBMs), also known as energy-based priors, have
drawn growing interests in generative modeling. Fueled by its flexibility in the formulation …

Controllable and compositional generation with latent-space energy-based models

W Nie, A Vahdat… - Advances in Neural …, 2021 - proceedings.neurips.cc
Controllable generation is one of the key requirements for successful adoption of deep
generative models in real-world applications, but it still remains as a great challenge. In …

Vaebm: A symbiosis between variational autoencoders and energy-based models

Z **ao, K Kreis, J Kautz, A Vahdat - arxiv preprint arxiv:2010.00654, 2020 - arxiv.org
Energy-based models (EBMs) have recently been successful in representing complex
distributions of small images. However, sampling from them requires expensive Markov …

Trajectory prediction with latent belief energy-based model

B Pang, T Zhao, X **e, YN Wu - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Human trajectory prediction is critical for autonomous platforms like self-driving cars or
social robots. We present a latent belief energy-based model (LB-EBM) for diverse human …

Unleashing transformers: Parallel token prediction with discrete absorbing diffusion for fast high-resolution image generation from vector-quantized codes

S Bond-Taylor, P Hessey, H Sasaki, TP Breckon… - … on Computer Vision, 2022 - Springer
Whilst diffusion probabilistic models can generate high quality image content, key limitations
remain in terms of both generating high-resolution imagery and their associated high …