Bayesian optimization algorithms for accelerator physics

R Roussel, AL Edelen, T Boltz, D Kennedy… - … review accelerators and …, 2024 - APS
Accelerator physics relies on numerical algorithms to solve optimization problems in online
accelerator control and tasks such as experimental design and model calibration in …

Simulation intelligence: Towards a new generation of scientific methods

A Lavin, D Krakauer, H Zenil, J Gottschlich… - arxiv preprint arxiv …, 2021 - arxiv.org
The original" Seven Motifs" set forth a roadmap of essential methods for the field of scientific
computing, where a motif is an algorithmic method that captures a pattern of computation …

Composable effects for flexible and accelerated probabilistic programming in NumPyro

D Phan, N Pradhan, M Jankowiak - arxiv preprint arxiv:1912.11554, 2019 - arxiv.org
NumPyro is a lightweight library that provides an alternate NumPy backend to the Pyro
probabilistic programming language with the same modeling interface, language primitives …

The elements of differentiable programming

M Blondel, V Roulet - arxiv preprint arxiv:2403.14606, 2024 - arxiv.org
Artificial intelligence has recently experienced remarkable advances, fueled by large
models, vast datasets, accelerated hardware, and, last but not least, the transformative …

Language model cascades

D Dohan, W Xu, A Lewkowycz, J Austin… - arxiv preprint arxiv …, 2022 - arxiv.org
Prompted models have demonstrated impressive few-shot learning abilities. Repeated
interactions at test-time with a single model, or the composition of multiple models together …

Technology readiness levels for machine learning systems

A Lavin, CM Gilligan-Lee, A Visnjic, S Ganju… - Nature …, 2022 - nature.com
The development and deployment of machine learning systems can be executed easily with
modern tools, but the process is typically rushed and means-to-an-end. Lack of diligence …

Differentiable particle filtering via entropy-regularized optimal transport

A Corenflos, J Thornton… - International …, 2021 - proceedings.mlr.press
Particle Filtering (PF) methods are an established class of procedures for performing
inference in non-linear state-space models. Resampling is a key ingredient of PF necessary …

Probabilistic symmetries and invariant neural networks

B Bloem-Reddy, Y Whye - Journal of Machine Learning Research, 2020 - jmlr.org
Treating neural network inputs and outputs as random variables, we characterize the
structure of neural networks that can be used to model data that are invariant or equivariant …

A-nesi: A scalable approximate method for probabilistic neurosymbolic inference

E van Krieken, T Thanapalasingam… - Advances in …, 2023 - proceedings.neurips.cc
We study the problem of combining neural networks with symbolic reasoning. Recently
introduced frameworks for Probabilistic Neurosymbolic Learning (PNL), such as …

The bayesian learning rule

ME Khan, H Rue - arxiv preprint arxiv:2107.04562, 2021 - arxiv.org
We show that many machine-learning algorithms are specific instances of a single algorithm
called the Bayesian learning rule. The rule, derived from Bayesian principles, yields a wide …