Subdominant dense clusters allow for simple learning and high computational performance in neural networks with discrete synapses

C Baldassi, A Ingrosso, C Lucibello, L Saglietti… - Physical review …, 2015 - APS
We show that discrete synaptic weights can be efficiently used for learning in large scale
neural systems, and lead to unanticipated computational performance. We focus on the …

Frozen 1-RSB structure of the symmetric Ising perceptron

W Perkins, C Xu - Proceedings of the 53rd Annual ACM SIGACT …, 2021 - dl.acm.org
We prove, under an assumption on the critical points of a real-valued function, that the
symmetric Ising perceptron exhibits thefrozen 1-RSB'structure conjectured by Krauth and …

Algorithms and barriers in the symmetric binary perceptron model

D Gamarnik, EC Kızıldağ, W Perkins… - 2022 IEEE 63rd Annual …, 2022 - ieeexplore.ieee.org
The binary (or Ising) perceptron is a toy model of a single-layer neural network and can be
viewed as a random constraint satisfaction problem with a high degree of connectivity. The …

Spin glass theory and its new challenge: structured disorder

M Mézard - Indian Journal of Physics, 2024 - Springer
This paper first describes, from a high-level viewpoint, the main challenges that had to be
solved in order to develop a theory of spin glasses in the last fifty years. It then explains how …

Binary perceptron: efficient algorithms can find solutions in a rare well-connected cluster

E Abbe, S Li, A Sly - Proceedings of the 54th Annual ACM SIGACT …, 2022 - dl.acm.org
It was recently shown that almost all solutions in the symmetric binary perceptron are
isolated, even at low constraint densities, suggesting that finding typical solutions is hard. In …

Proof of the contiguity conjecture and lognormal limit for the symmetric perceptron

E Abbe, S Li, A Sly - 2021 IEEE 62nd Annual Symposium on …, 2022 - ieeexplore.ieee.org
We consider the symmetric binary perceptron model, a simple model of neural networks that
has gathered significant attention in the statistical physics, information theory and probability …

Storage capacity in symmetric binary perceptrons

B Aubin, W Perkins, L Zdeborová - Journal of Physics A …, 2019 - iopscience.iop.org
We study the problem of determining the capacity of the binary perceptron for two variants of
the problem where the corresponding constraint is symmetric. We call these variants the …

Mean-field inference methods for neural networks

M Gabrié - Journal of Physics A: Mathematical and Theoretical, 2020 - iopscience.iop.org
Abstract Machine learning algorithms relying on deep neural networks recently allowed a
great leap forward in artificial intelligence. Despite the popularity of their applications, the …

Algorithmic obstructions in the random number partitioning problem

D Gamarnik, EC Kızıldağ - The Annals of Applied Probability, 2023 - projecteuclid.org
Algorithmic obstructions in the random number partitioning problem Page 1 The Annals of
Applied Probability 2023, Vol. 33, No. 6B, 5497–5563 https://doi.org/10.1214/23-AAP1953 …

Typical and atypical solutions in nonconvex neural networks with discrete and continuous weights

C Baldassi, EM Malatesta, G Perugini, R Zecchina - Physical Review E, 2023 - APS
We study the binary and continuous negative-margin perceptrons as simple nonconvex
neural network models learning random rules and associations. We analyze the geometry of …