Boltzmann machines as generalized Hopfield networks: a review of recent results and outlooks

C Marullo, E Agliari - Entropy, 2020 - mdpi.com
The Hopfield model and the Boltzmann machine are among the most popular examples of
neural networks. The latter, widely used for classification and feature detection, is able to …

[HTML][HTML] Regularization, early-stop** and dreaming: a Hopfield-like setup to address generalization and overfitting

E Agliari, F Alemanno, M Aquaro, A Fachechi - Neural Networks, 2024 - Elsevier
In this work we approach attractor neural networks from a machine learning perspective: we
look for optimal network parameters by applying a gradient descent over a regularized loss …

Dreaming neural networks: forgetting spurious memories and reinforcing pure ones

A Fachechi, E Agliari, A Barra - Neural Networks, 2019 - Elsevier
The standard Hopfield model for associative neural networks accounts for biological
Hebbian learning and acts as the harmonic oscillator for pattern recognition, however its …

Simplicial hopfield networks

TF Burns, T Fukai - arxiv preprint arxiv:2305.05179, 2023 - arxiv.org
Hopfield networks are artificial neural networks which store memory patterns on the states of
their neurons by choosing recurrent connection weights and update rules such that the …

Storage and learning phase transitions in the random-features hopfield model

M Negri, C Lauditi, G Perugini, C Lucibello… - Physical Review Letters, 2023 - APS
The Hopfield model is a paradigmatic model of neural networks that has been analyzed for
many decades in the statistical physics, neuroscience, and machine learning communities …

On the effective initialisation for restricted Boltzmann machines via duality with Hopfield model

FE Leonelli, E Agliari, L Albanese, A Barra - Neural Networks, 2021 - Elsevier
Abstract Restricted Boltzmann machines (RBMs) with a binary visible layer of size N and a
Gaussian hidden layer of size P have been proved to be equivalent to a Hopfield neural …

Neural networks with a redundant representation: Detecting the undetectable

E Agliari, F Alemanno, A Barra, M Centonze… - Physical review …, 2020 - APS
We consider a three-layer Sejnowski machine and show that features learnt via contrastive
divergence have a dual representation as patterns in a dense associative memory of order …

A new mechanical approach to handle generalized Hopfield neural networks

A Barra, M Beccaria, A Fachechi - Neural Networks, 2018 - Elsevier
We propose a modification of the cost function of the Hopfield model whose salient features
shine in its Taylor expansion and result in more than pairwise interactions with alternate …

Antiferromagnetic spatial photonic Ising machine through optoelectronic correlation computing

J Huang, Y Fang, Z Ruan - Communications Physics, 2021 - nature.com
Recently, spatial photonic Ising machines (SPIM) have been demonstrated to compute the
minima of Hamiltonians for large-scale spin systems. Here we propose to implement an …

Replica symmetry breaking in neural networks: a few steps toward rigorous results

E Agliari, L Albanese, A Barra… - Journal of Physics A …, 2020 - iopscience.iop.org
In this paper we adapt the broken replica interpolation technique (developed by Francesco
Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin …