Understanding reinforcement learning-based fine-tuning of diffusion models: A tutorial and review

M Uehara, Y Zhao, T Biancalani, S Levine - arxiv preprint arxiv …, 2024 - arxiv.org
This tutorial provides a comprehensive survey of methods for fine-tuning diffusion models to
optimize downstream reward functions. While diffusion models are widely known to provide …

Improving and generalizing flow-based generative models with minibatch optimal transport

A Tong, K Fatras, N Malkin, G Huguet, Y Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Continuous normalizing flows (CNFs) are an attractive generative modeling technique, but
they have thus far been held back by limitations in their simulation-based maximum …

ISB: Image-to-Image Schr\"odinger Bridge

GH Liu, A Vahdat, DA Huang, EA Theodorou… - arxiv preprint arxiv …, 2023 - arxiv.org
We propose Image-to-Image Schr\" odinger Bridge (I $^ 2$ SB), a new class of conditional
diffusion models that directly learn the nonlinear diffusion processes between two given …

A theory of continuous generative flow networks

S Lahlou, T Deleu, P Lemos, D Zhang… - International …, 2023 - proceedings.mlr.press
Generative flow networks (GFlowNets) are amortized variational inference algorithms that
are trained to sample from unnormalized target distributions over compositional objects. A …

Recent advances in path integral control for trajectory optimization: An overview in theoretical and algorithmic perspectives

M Kazim, JG Hong, MG Kim, KKK Kim - Annual Reviews in Control, 2024 - Elsevier
This paper presents a tutorial overview of path integral (PI) approaches for stochastic
optimal control and trajectory optimization. We concisely summarize the theoretical …

Fine-tuning of continuous-time diffusion models as entropy-regularized control

M Uehara, Y Zhao, K Black, E Hajiramezanali… - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion models excel at capturing complex data distributions, such as those of natural
images and proteins. While diffusion models are trained to represent the distribution in the …

Aligned diffusion schrödinger bridges

VR Somnath, M Pariset, YP Hsieh… - Uncertainty in …, 2023 - proceedings.mlr.press
Diffusion Schrödinger bridges (DSBs) have recently emerged as a powerful framework for
recovering stochastic dynamics via their marginal observations at different time points …

Diffusion bridge mixture transports, Schrödinger bridge problems and generative modeling

S Peluchetti - Journal of Machine Learning Research, 2023 - jmlr.org
The dynamic Schrödinger bridge problem seeks a stochastic process that defines a
transport between two target probability measures, while optimally satisfying the criteria of …

An optimal control perspective on diffusion-based generative modeling

J Berner, L Richter, K Ullrich - arxiv preprint arxiv:2211.01364, 2022 - arxiv.org
We establish a connection between stochastic optimal control and generative models based
on stochastic differential equations (SDEs), such as recently developed diffusion …

Deep generalized schrödinger bridge

GH Liu, T Chen, O So… - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract Mean-Field Game (MFG) serves as a crucial mathematical framework in modeling
the collective behavior of individual agents interacting stochastically with a large population …