On the free energy of vector spin glasses with non-convex interactions

HB Chen, JC Mourrat - arxiv preprint arxiv:2311.08980, 2023 - arxiv.org
The limit free energy of spin-glass models with convex interactions can be represented as a
variational problem involving an explicit functional. Models with non-convex interactions are …

Supervised hebbian learning

F Alemanno, M Aquaro, I Kanter, A Barra… - Europhysics …, 2023 - iopscience.iop.org
In neural network's literature, Hebbian learning traditionally refers to the procedure by which
the Hopfield model and its generalizations store archetypes (ie, definite patterns that are …

Nonconvex interactions in mean-field spin glasses

JC Mourrat - Probability and Mathematical Physics, 2021 - msp.org
We propose a conjecture for the limit free energy of mean-field spin glasses with a bipartite
structure, and show that the conjectured limit is an upper bound. The conjectured limit is …

Fundamental limits of low-rank matrix estimation: the non-symmetric case

L Miolane - arxiv preprint arxiv:1702.00473, 2017 - arxiv.org
We consider the high-dimensional inference problem where the signal is a low-rank matrix
which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low …

Free energy in multi-species mixed p-spin spherical models

E Bates, Y Sohn - Electronic Journal of Probability, 2022 - projecteuclid.org
We prove a Parisi formula for the limiting free energy of multi-species spherical spin glasses
with mixed p-spin interactions. The upper bound involves a Guerra-style interpolation and …

Multi-species mean field spin glasses. Rigorous results

A Barra, P Contucci, E Mingione, D Tantari - Annales Henri Poincaré, 2015 - Springer
We study a multi-species spin glass system where the density of each species is kept fixed
at increasing volumes. The model reduces to the Sherrington–Kirkpatrick one for the single …

Dreaming neural networks: forgetting spurious memories and reinforcing pure ones

A Fachechi, E Agliari, A Barra - Neural Networks, 2019 - Elsevier
The standard Hopfield model for associative neural networks accounts for biological
Hebbian learning and acts as the harmonic oscillator for pattern recognition, however its …

Phase diagram of restricted Boltzmann machines and generalized Hopfield networks with arbitrary priors

A Barra, G Genovese, P Sollich, D Tantari - Physical Review E, 2018 - APS
Restricted Boltzmann machines are described by the Gibbs measure of a bipartite spin
glass, which in turn can be seen as a generalized Hopfield network. This equivalence allows …

Phase transitions in restricted Boltzmann machines with generic priors

A Barra, G Genovese, P Sollich, D Tantari - Physical Review E, 2017 - APS
We study generalized restricted Boltzmann machines with generic priors for units and
weights, interpolating between Boolean and Gaussian variables. We present a complete …

The solution of the deep Boltzmann machine on the Nishimori line

D Alberici, F Camilli, P Contucci, E Mingione - … in Mathematical Physics, 2021 - Springer
The deep Boltzmann machine on the Nishimori line with a finite number of layers is exactly
solved by a theorem that expresses its pressure through a finite dimensional variational …