Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models

S Bond-Taylor, A Leach, Y Long… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep generative models are a class of techniques that train deep neural networks to model
the distribution of training samples. Research has fragmented into various interconnected …

Learning generative vision transformer with energy-based latent space for saliency prediction

J Zhang, J **e, N Barnes, P Li - Advances in Neural …, 2021 - proceedings.neurips.cc
Vision transformer networks have shown superiority in many computer vision tasks. In this
paper, we take a step further by proposing a novel generative vision transformer with latent …

Learning latent space energy-based prior model

B Pang, T Han, E Nijkamp, SC Zhu… - Advances in Neural …, 2020 - proceedings.neurips.cc
We propose an energy-based model (EBM) in the latent space of a generator model, so that
the EBM serves as a prior model that stands on the top-down network of the generator …

Trajectory prediction with latent belief energy-based model

B Pang, T Zhao, X **e, YN Wu - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Human trajectory prediction is critical for autonomous platforms like self-driving cars or
social robots. We present a latent belief energy-based model (LB-EBM) for diverse human …

Long document summarization with top-down and bottom-up inference

B Pang, E Nijkamp, W Kryściński, S Savarese… - arxiv preprint arxiv …, 2022 - arxiv.org
Text summarization aims to condense long documents and retain key information. Critical to
the success of a summarization model is the faithful inference of latent representations of …

A tale of two flows: Cooperative learning of langevin flow and normalizing flow toward energy-based model

J **e, Y Zhu, J Li, P Li - arxiv preprint arxiv:2205.06924, 2022 - arxiv.org
This paper studies the cooperative learning of two generative flow models, in which the two
models are iteratively updated based on the jointly synthesized examples. The first flow …

Learning probability distributions of sensory inputs with Monte Carlo predictive coding

G Oliviers, R Bogacz, A Meulemans - PLOS Computational …, 2024 - journals.plos.org
It has been suggested that the brain employs probabilistic generative models to optimally
interpret sensory information. This hypothesis has been formalised in distinct frameworks …

Learning joint latent space ebm prior model for multi-layer generator

J Cui, YN Wu, T Han - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
This paper studies the fundamental problem of learning multi-layer generator models. The
multi-layer generator model builds multiple layers of latent variables as a prior model on top …

An empirical Bayes method for differential expression analysis of single cells with deep generative models

P Boyeau, J Regier, A Gayoso… - Proceedings of the …, 2023 - National Acad Sciences
Detecting differentially expressed genes is important for characterizing subpopulations of
cells. In scRNA-seq data, however, nuisance variation due to technical factors like …

Learning energy-based model via dual-MCMC teaching

J Cui, T Han - Advances in Neural Information Processing …, 2023 - proceedings.neurips.cc
This paper studies the fundamental learning problem of the energy-based model (EBM).
Learning the EBM can be achieved using the maximum likelihood estimation (MLE), which …