The elements of differentiable programming

M Blondel, V Roulet - arxiv preprint arxiv:2403.14606, 2024 - arxiv.org
Artificial intelligence has recently experienced remarkable advances, fueled by large
models, vast datasets, accelerated hardware, and, last but not least, the transformative …

Anderson Accelerated Douglas--Rachford Splitting

A Fu, J Zhang, S Boyd - SIAM Journal on Scientific Computing, 2020 - SIAM
We consider the problem of nonsmooth convex optimization with linear equality constraints,
where the objective function is only accessible through its proximal operator. This problem …

On an improved PDE-based elliptic parameterization method for isogeometric analysis using preconditioned Anderson acceleration

Y Ji, K Chen, M Möller, C Vuik - Computer Aided Geometric Design, 2023 - Elsevier
Constructing an analysis-suitable parameterization for the computational domain from its
boundary representation plays a crucial role in the isogeometric design-through-analysis …

The effect of Anderson acceleration on superlinear and sublinear convergence

LG Rebholz, M **ao - Journal of Scientific Computing, 2023 - Springer
This paper considers the effect of Anderson acceleration (AA) on the convergence order of
nonlinear solvers in fixed point form xk+ 1= g (xk), that are looking for a fixed point x∗ of g …

Anderson acceleration of proximal gradient methods

V Mai, M Johansson - International Conference on Machine …, 2020 - proceedings.mlr.press
Anderson acceleration is a well-established and simple technique for speeding up fixed-
point computations with countless applications. This work introduces novel methods for …

Anderson acceleration as a Krylov method with application to convergence analysis

H De Sterck, Y He, OA Krzysik - Journal of Scientific Computing, 2024 - Springer
Anderson acceleration (AA) is widely used for accelerating the convergence of nonlinear
fixed-point methods, but little is known about how to quantify the asymptotic convergence …

Filtering for Anderson acceleration

S Pollock, LG Rebholz - SIAM Journal on Scientific Computing, 2023 - SIAM
This work introduces, analyzes, and demonstrates an efficient and theoretically sound
filtering strategy to ensure the condition of the least-squares problem solved at each iteration …

[KÖNYV][B] Solving Nonlinear Equations with Iterative Methods: Solvers and Examples in Julia

CT Kelley - 2022 - SIAM
This book on solvers for nonlinear equations is a user-oriented guide to algorithms and
implementation. It is a sequel to [111], which used MATLAB for the solvers and examples …

Accelerating and enabling convergence of nonlinear solvers for Navier–Stokes equations by continuous data assimilation

X Li, EV Hawkins, LG Rebholz, D Vargun - Computer Methods in Applied …, 2023 - Elsevier
This paper considers improving the Picard and Newton iterative solvers for the Navier–
Stokes equations in the setting where data measurements or solution observations are …

[HTML][HTML] An adaptive solution strategy for Richards' equation

JS Stokke, K Mitra, E Storvik, JW Both… - Computers & Mathematics …, 2023 - Elsevier
Flow in variably saturated porous media is typically modeled by the Richards equation, a
nonlinear elliptic-parabolic equation which is notoriously challenging to solve numerically. In …