Restricted Boltzmann machine: Recent advances and mean-field theory

A Decelle, C Furtlehner - Chinese Physics B, 2021 - iopscience.iop.org
This review deals with restricted Boltzmann machine (RBM) under the light of statistical
physics. The RBM is a classical family of machine learning (ML) models which played a …

[HTML][HTML] Boltzmann machines as generalized Hopfield networks: a review of recent results and outlooks

C Marullo, E Agliari - Entropy, 2020 - mdpi.com
The Hopfield model and the Boltzmann machine are among the most popular examples of
neural networks. The latter, widely used for classification and feature detection, is able to …

Unsupervised generative modeling using matrix product states

ZY Han, J Wang, H Fan, L Wang, P Zhang - Physical Review X, 2018 - APS
Generative modeling, which learns joint probability distribution from data and generates
samples according to it, is an important task in machine learning and artificial intelligence …

Modern applications of machine learning in quantum sciences

A Dawid, J Arnold, B Requena, A Gresch… - arxiv preprint arxiv …, 2022 - arxiv.org
In this book, we provide a comprehensive introduction to the most recent advances in the
application of machine learning methods in quantum sciences. We cover the use of deep …

Constrained low-rank matrix estimation: Phase transitions, approximate message passing and applications

T Lesieur, F Krzakala, L Zdeborová - Journal of Statistical …, 2017 - iopscience.iop.org
This article is an extended version of previous work of Lesieur et al (2015 IEEE Int. Symp. on
Information Theory Proc. pp 1635–9 and 2015 53rd Annual Allerton Conf. on …

Mean-field message-passing equations in the Hopfield model and its generalizations

M Mézard - Physical Review E, 2017 - APS
Motivated by recent progress in using restricted Boltzmann machines as preprocessing
algorithms for deep neural network, we revisit the mean-field equations [belief-propagation …

Equilibrium and non-equilibrium regimes in the learning of restricted Boltzmann machines

A Decelle, C Furtlehner… - Advances in Neural …, 2021 - proceedings.neurips.cc
Abstract Training Restricted Boltzmann Machines (RBMs) has been challenging for a long
time due to the difficulty of computing precisely the log-likelihood gradient. Over the past …

Unsupervised hierarchical clustering using the learning dynamics of restricted Boltzmann machines

A Decelle, B Seoane, L Rosset - Physical Review E, 2023 - APS
Data sets in the real world are often complex and to some degree hierarchical, with groups
and subgroups of data sharing common characteristics at different levels of abstraction …

Inferring effective couplings with restricted Boltzmann machines

A Decelle, C Furtlehner, AJ Navas Gómez, B Seoane - SciPost Physics, 2024 - scipost.org
Generative models offer a direct way of modeling complex data. Energy-based models
attempt to encode the statistical correlations observed in the data at the level of the …

Statistical mechanics of mean-field disordered systems: a Hamilton-Jacobi approach

T Dominguez, JC Mourrat - arxiv preprint arxiv:2311.08976, 2023 - arxiv.org
The goal of this book is to present new mathematical techniques for studying the behaviour
of mean-field systems with disordered interactions. We mostly focus on certain problems of …