How to train your energy-based models

Y Song, DP Kingma - arxiv preprint arxiv:2101.03288, 2021 - arxiv.org
Energy-Based Models (EBMs), also known as non-normalized probabilistic models, specify
probability density or mass functions up to an unknown normalizing constant. Unlike most …

Training restricted Boltzmann machines: An introduction

A Fischer, C Igel - Pattern Recognition, 2014 - Elsevier
Abstract Restricted Boltzmann machines (RBMs) are probabilistic graphical models that can
be interpreted as stochastic neural networks. They have attracted much attention as building …

An overview of restricted Boltzmann machines

V Upadhya, PS Sastry - Journal of the Indian Institute of Science, 2019 - Springer
The restricted Boltzmann machine (RBM) is a two-layered network of stochastic units with
undirected connections between pairs of units in the two layers. The two layers of nodes are …

Improved learning of Gaussian-Bernoulli restricted Boltzmann machines

KH Cho, A Ilin, T Raiko - Artificial Neural Networks and Machine Learning …, 2011 - Springer
We propose a few remedies to improve training of Gaussian-Bernoulli restricted Boltzmann
machines (GBRBM), which is known to be difficult. Firstly, we use a different …

Training restricted boltzmann machines with a d-wave quantum annealer

V Dixit, R Selvarajan, MA Alam, TS Humble… - Frontiers in …, 2021 - frontiersin.org
Restricted Boltzmann Machine (RBM) is an energy-based, undirected graphical model. It is
commonly used for unsupervised and supervised machine learning. Typically, RBM is …

Gaussian-bernoulli deep boltzmann machine

KH Cho, T Raiko, A Ilin - The 2013 International Joint …, 2013 - ieeexplore.ieee.org
In this paper, we study a model that we call Gaussian-Bernoulli deep Boltzmann machine
(GDBM) and discuss potential improvements in training the model. GDBM is designed to be …

Efficient training of energy-based models using jarzynski equality

D Carbone, M Hua, S Coste… - Advances in Neural …, 2023 - proceedings.neurips.cc
Energy-based models (EBMs) are generative models inspired by statistical physics with a
wide range of applications in unsupervised learning. Their performance is well measured by …

Inferential Wasserstein generative adversarial networks

Y Chen, Q Gao, X Wang - Journal of the Royal Statistical Society …, 2022 - academic.oup.com
Generative adversarial networks (GANs) have been impactful on many problems and
applications but suffer from unstable training. The Wasserstein GAN (WGAN) leverages the …

[PDF][PDF] Enhanced gradient and adaptive learning rate for training restricted Boltzmann machines

KH Cho, T Raiko, AT Ihler - … of the 28th international conference on …, 2011 - Citeseer
Boltzmann machines are often used as building blocks in greedy learning of deep networks.
However, training even a simplified model, known as restricted Boltzmann machine (RBM) …

Gaussian-binary restricted Boltzmann machines for modeling natural image statistics

J Melchior, N Wang, L Wiskott - PloS one, 2017 - journals.plos.org
We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines
(GRBMs) from the perspective of density models. The key aspect of this analysis is to show …