Cpr: Retrieval augmented generation for copyright protection

A Golatkar, A Achille, L Zancato… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Retrieval Augmented Generation (RAG) is emerging as a flexible and robust
technique to adapt models to private users data without training to handle credit attribution …

Analysis of langevin monte carlo from poincare to log-sobolev

S Chewi, MA Erdogdu, M Li, R Shen… - Foundations of …, 2024 - Springer
Classically, the continuous-time Langevin diffusion converges exponentially fast to its
stationary distribution π under the sole assumption that π satisfies a Poincaré inequality …

Rapid convergence of the unadjusted langevin algorithm: Isoperimetry suffices

S Vempala, A Wibisono - Advances in neural information …, 2019 - proceedings.neurips.cc
Abstract We study the Unadjusted Langevin Algorithm (ULA) for sampling from a probability
distribution $\nu= e^{-f} $ on $\R^ n $. We prove a convergence guarantee in Kullback …

Towards a theory of non-log-concave sampling: first-order stationarity guarantees for Langevin Monte Carlo

K Balasubramanian, S Chewi… - … on Learning Theory, 2022 - proceedings.mlr.press
For the task of sampling from a density $\pi\propto\exp (-V) $ on $\R^ d $, where $ V $ is
possibly non-convex but $ L $-gradient Lipschitz, we prove that averaged Langevin Monte …

Convex analysis of the mean field langevin dynamics

A Nitanda, D Wu, T Suzuki - International Conference on …, 2022 - proceedings.mlr.press
As an example of the nonlinear Fokker-Planck equation, the mean field Langevin dynamics
recently attracts attention due to its connection to (noisy) gradient descent on infinitely wide …

Improved discretization analysis for underdamped Langevin Monte Carlo

S Zhang, S Chewi, M Li… - The Thirty Sixth …, 2023 - proceedings.mlr.press
Abstract Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample from
unnormalized densities by leveraging the momentum of a particle moving in a potential well …

Towards a complete analysis of langevin monte carlo: Beyond poincaré inequality

A Mousavi-Hosseini, TK Farghly, Y He… - The Thirty Sixth …, 2023 - proceedings.mlr.press
Langevin diffusions are rapidly convergent under appropriate functional inequality
assumptions. Hence, it is natural to expect that with additional smoothness conditions to …

Improved dimension dependence of a proximal algorithm for sampling

J Fan, B Yuan, Y Chen - The Thirty Sixth Annual Conference …, 2023 - proceedings.mlr.press
We propose a sampling algorithm that achieves superior complexity bounds in all the
classical settings (strongly log-concave, log-concave, Logarithmic-Sobolev inequality (LSI) …

Resolving the mixing time of the Langevin algorithm to its stationary distribution for log-concave sampling

JM Altschuler, K Talwar - arxiv preprint arxiv:2210.08448, 2022 - arxiv.org
Sampling from a high-dimensional distribution is a fundamental task in statistics,
engineering, and the sciences. A canonical approach is the Langevin Algorithm, ie, the …

Hausdorff dimension, heavy tails, and generalization in neural networks

U Simsekli, O Sener, G Deligiannidis… - Advances in Neural …, 2020 - proceedings.neurips.cc
Despite its success in a wide range of applications, characterizing the generalization
properties of stochastic gradient descent (SGD) in non-convex deep learning problems is …