Machine learning methods for small data challenges in molecular science

B Dou, Z Zhu, E Merkurjev, L Ke, L Chen… - Chemical …, 2023 - ACS Publications
Small data are often used in scientific and engineering research due to the presence of
various constraints, such as time, cost, ethics, privacy, security, and technical limitations in …

Inverse statistical problems: from the inverse Ising problem to data science

HC Nguyen, R Zecchina, J Berg - Advances in Physics, 2017 - Taylor & Francis
Inverse problems in statistical physics are motivated by the challenges of 'big data'in
different fields, in particular high-throughput experiments in biology. In inverse problems, the …

Fine-tuning of continuous-time diffusion models as entropy-regularized control

M Uehara, Y Zhao, K Black, E Hajiramezanali… - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion models excel at capturing complex data distributions, such as those of natural
images and proteins. While diffusion models are trained to represent the distribution in the …

[PDF][PDF] A generalized path integral control approach to reinforcement learning

E Theodorou, J Buchli, S Schaal - The Journal of Machine Learning …, 2010 - jmlr.org
With the goal to generate more scalable algorithms with higher efficiency and fewer open
parameters, reinforcement learning (RL) has recently moved towards combining classical …

Hierarchical models in the brain

K Friston - PLoS computational biology, 2008 - journals.plos.org
This paper describes a general model that subsumes many parametric models for
continuous data. The model comprises hidden layers of state-space or dynamic causal …

Solving high-dimensional Hamilton–Jacobi–Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path space

N Nüsken, L Richter - Partial differential equations and applications, 2021 - Springer
Optimal control of diffusion processes is intimately connected to the problem of solving
certain Hamilton–Jacobi–Bellman equations. Building on recent machine learning inspired …

Optimal control as a graphical model inference problem

HJ Kappen, V Gómez, M Opper - Machine learning, 2012 - Springer
We reformulate a class of non-linear stochastic optimal control problems introduced by
Todorov (in Advances in Neural Information Processing Systems, vol. 19, pp. 1369–1376 …

Whence the expected free energy?

B Millidge, A Tschantz, CL Buckley - Neural Computation, 2021 - ieeexplore.ieee.org
The expected free energy (EFE) is a central quantity in the theory of active inference. It is the
quantity that all active inference agents are mandated to minimize through action, and its …

Reinforcement learning and optimal adaptive control: An overview and implementation examples

SG Khan, G Herrmann, FL Lewis, T Pipe… - Annual reviews in …, 2012 - Elsevier
This paper provides an overview of the reinforcement learning and optimal adaptive control
literature and its application to robotics. Reinforcement learning is bridging the gap between …

Reinforcement learning of motor skills in high dimensions: A path integral approach

E Theodorou, J Buchli, S Schaal - 2010 IEEE International …, 2010 - ieeexplore.ieee.org
Reinforcement learning (RL) is one of the most general approaches to learning control. Its
applicability to complex motor systems, however, has been largely impossible so far due to …