Opportunities and challenges of diffusion models for generative AI
Diffusion models, a powerful and universal generative artificial intelligence technology, have
achieved tremendous success and opened up new possibilities in diverse applications. In …
achieved tremendous success and opened up new possibilities in diverse applications. In …
Learning gflownets from partial episodes for improved convergence and stability
K Madan, J Rector-Brooks… - International …, 2023 - proceedings.mlr.press
Generative flow networks (GFlowNets) are a family of algorithms for training a sequential
sampler of discrete objects under an unnormalized target density and have been …
sampler of discrete objects under an unnormalized target density and have been …
Diffusion models for black-box optimization
S Krishnamoorthy, SM Mashkaria… - … on Machine Learning, 2023 - proceedings.mlr.press
The goal of offline black-box optimization (BBO) is to optimize an expensive black-box
function using a fixed dataset of function evaluations. Prior works consider forward …
function using a fixed dataset of function evaluations. Prior works consider forward …
An overview of diffusion models: Applications, guided generation, statistical rates and optimization
Diffusion models, a powerful and universal generative AI technology, have achieved
tremendous success in computer vision, audio, reinforcement learning, and computational …
tremendous success in computer vision, audio, reinforcement learning, and computational …
Bidirectional learning for offline infinite-width model-based optimization
In offline model-based optimization, we strive to maximize a black-box objective function by
only leveraging a static dataset of designs and their scores. This problem setting arises in …
only leveraging a static dataset of designs and their scores. This problem setting arises in …
ExPT: synthetic pretraining for few-shot experimental design
Experimental design is a fundamental problem in many science and engineering fields. In
this problem, sample efficiency is crucial due to the time, money, and safety costs of real …
this problem, sample efficiency is crucial due to the time, money, and safety costs of real …
Design from policies: Conservative test-time adaptation for offline policy optimization
In this work, we decouple the iterative bi-level offline RL (value estimation and policy
extraction) from the offline training phase, forming a non-iterative bi-level paradigm and …
extraction) from the offline training phase, forming a non-iterative bi-level paradigm and …
Importance-aware co-teaching for offline model-based optimization
Offline model-based optimization aims to find a design that maximizes a property of interest
using only an offline dataset, with applications in robot, protein, and molecule design …
using only an offline dataset, with applications in robot, protein, and molecule design …
Parallel-mentoring for offline model-based optimization
We study offline model-based optimization to maximize a black-box objective function with a
static dataset of designs and scores. These designs encompass a variety of domains …
static dataset of designs and scores. These designs encompass a variety of domains …
Gradient-based bi-level optimization for deep learning: A survey
Bi-level optimization, especially the gradient-based category, has been widely used in the
deep learning community including hyperparameter optimization and meta-knowledge …
deep learning community including hyperparameter optimization and meta-knowledge …