Optimal errors and phase transitions in high-dimensional generalized linear models

J Barbier, F Krzakala, N Macris, L Miolane… - Proceedings of the …, 2019 - pnas.org
Generalized linear models (GLMs) are used in high-dimensional machine learning,
statistics, communications, and signal processing. In this paper we analyze GLMs when the …

SPARCs for unsourced random access

A Fengler, P Jung, G Caire - IEEE Transactions on Information …, 2021 - ieeexplore.ieee.org
Unsourced random-access (U-RA) is a type of grant-free random access with a virtually
unlimited number of users, of which only a certain number K a are active on the same time …

The adaptive interpolation method: a simple scheme to prove replica formulas in Bayesian inference

J Barbier, N Macris - Probability theory and related fields, 2019 - Springer
In recent years important progress has been achieved towards proving the validity of the
replica predictions for the (asymptotic) mutual information (or “free energy”) in Bayesian …

Fundamental limits of weak recovery with applications to phase retrieval

M Mondelli, A Montanari - Conference On Learning Theory, 2018 - proceedings.mlr.press
In phase retrieval we want to recover an unknown signal $\boldsymbol x\in\mathbb C^ d $
from $ n $ quadratic measurements of the form $ y_i=|⟨\boldsymbol a_i,\boldsymbol x⟩|^ 2+ …

The committee machine: Computational to statistical gaps in learning a two-layers neural network

B Aubin, A Maillard, F Krzakala… - Advances in …, 2018 - proceedings.neurips.cc
Heuristic tools from statistical physics have been used in the past to compute the optimal
learning and generalization errors in the teacher-student scenario in multi-layer neural …

Fundamental barriers to high-dimensional regression with convex penalties

M Celentano, A Montanari - The Annals of Statistics, 2022 - projecteuclid.org
Fundamental barriers to high-dimensional regression with convex penalties Page 1 The
Annals of Statistics 2022, Vol. 50, No. 1, 170–196 https://doi.org/10.1214/21-AOS2100 © …

SPARCs and AMP for unsourced random access

A Fengler, P Jung, G Caire - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
This paper studies the optimal achievable performance of compressed sensing based
unsourced random-access communication over the real AWGN channel." Unsourced" …

The adaptive interpolation method for proving replica formulas. Applications to the Curie–Weiss and Wigner spike models

J Barbier, N Macris - Journal of Physics A: Mathematical and …, 2019 - iopscience.iop.org
In this contribution we give a pedagogic introduction to the newly introduced adaptive
interpolation method to prove in a simple and unified way replica formulas for Bayesian …

All-or-nothing statistical and computational phase transitions in sparse spiked matrix estimation

N Macris, C Rush - Advances in Neural Information …, 2020 - proceedings.neurips.cc
We determine statistical and computational limits for estimation of a rank-one matrix (the
spike) corrupted by an additive gaussian noise matrix, in a sparse limit, where the …

Inference with deep generative priors in high dimensions

P Pandit, M Sahraee-Ardakan… - IEEE Journal on …, 2020 - ieeexplore.ieee.org
Deep generative priors offer powerful models for complex-structured data, such as images,
audio, and text. Using these priors in inverse problems typically requires estimating the input …