Sample-efficient reinforcement learning for CERN accelerator control

V Kain, S Hirlander, B Goddard, FM Velotti… - … Review Accelerators and …, 2020 - APS
Numerical optimization algorithms are already established tools to increase and stabilize the
performance of particle accelerators. These algorithms have many advantages, are …

Deep reinforcement learning for self-tuning laser source of dissipative solitons

E Kuprikov, A Kokhanovskiy, K Serebrennikov… - Scientific Reports, 2022 - nature.com
Increasing complexity of modern laser systems, mostly originated from the nonlinear
dynamics of radiation, makes control of their operation more and more challenging, calling …

Basic reinforcement learning techniques to control the intensity of a seeded free-electron laser

N Bruchon, G Fenu, G Gaio, M Lonza, FH O'Shea… - Electronics, 2020 - mdpi.com
Optimal tuning of particle accelerators is a challenging task. Many different approaches have
been proposed in the past to solve two main problems—attainment of an optimal working …

Adaptive machine learning for robust diagnostics and control of time-varying particle accelerator components and beams

A Scheinker - Information, 2021 - mdpi.com
Machine learning (ML) is growing in popularity for various particle accelerator applications
including anomaly detection such as faulty beam position monitor or RF fault identification …

Policy gradient methods for free-electron laser and terahertz source optimization and stabilization at the FERMI free-electron laser at Elettra

FH O'Shea, N Bruchon, G Gaio - Physical Review Accelerators and Beams, 2020 - APS
In this article we report on the application of a model-free reinforcement learning method to
the optimization of accelerator systems. We simplify a policy gradient algorithm to …

Model-free and bayesian ensembling model-based deep reinforcement learning for particle accelerator control demonstrated on the FERMI FEL

S Hirlaender, N Bruchon - arxiv preprint arxiv:2012.09737, 2020 - arxiv.org
Reinforcement learning holds tremendous promise in accelerator controls. The primary goal
of this paper is to show how this approach can be utilised on an operational level on …

[PDF][PDF] First steps toward an autonomous accelerator, a common project between DESY and KIT

A Eichler, F Burkart, J Kaiser, W Kuropka, O Stein… - Proc. IPAC'21, 2021 - core.ac.uk
Reinforcement learning algorithms have risen in popularity in the accelerator physics
community in recent years, showing potential in beam control and in the optimization and …

Orbit correction based on improved reinforcement learning algorithm

X Chen, Y Jia, X Qi, Z Wang, Y He - Physical Review Accelerators and Beams, 2023 - APS
Recently, reinforcement learning (RL) algorithms have been applied to a wide range of
control problems in accelerator commissioning. In order to achieve efficient and fast control …

Efficient beam commissioning in HIPI accelerator based on reinforcement learning

C Su, Z Wang, X Chen, Y Jia, X Qi, W Wang… - Nuclear Instruments and …, 2025 - Elsevier
Beam tuning in particle accelerators presents a significant challenge, especially when the
accelerator's configuration cannot be determined through physical modeling. A common …

Trend-Based SAC Beam Control Method with Zero-Shot in Superconducting Linear Accelerator

X Chen, X Qi, C Su, Y He, Z Wang, K Sun, C **… - arxiv preprint arxiv …, 2023 - arxiv.org
The superconducting linear accelerator is a highly flexiable facility for modern scientific
discoveries, necessitating weekly reconfiguration and tuning. Accordingly, minimizing setup …