Decision-focused learning: Foundations, state of the art, benchmark and future opportunities

J Mandi, J Kotary, S Berden, M Mulamba… - Journal of Artificial …, 2024 - jair.org
Decision-focused learning (DFL) is an emerging paradigm that integrates machine learning
(ML) and constrained optimization to enhance decision quality by training ML models in an …

A review of the gumbel-max trick and its extensions for discrete stochasticity in machine learning

IAM Huijben, W Kool, MB Paulus… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
The Gumbel-max trick is a method to draw a sample from a categorical distribution, given by
its unnormalized (log-) probabilities. Over the past years, the machine learning community …

Efficient and modular implicit differentiation

M Blondel, Q Berthet, M Cuturi… - Advances in neural …, 2022 - proceedings.neurips.cc
Automatic differentiation (autodiff) has revolutionized machine learning. Itallows to express
complex computations by composing elementary ones in creativeways and removes the …

Differentiable convex optimization layers

A Agrawal, B Amos, S Barratt, S Boyd… - Advances in neural …, 2019 - proceedings.neurips.cc
Recent work has shown how to embed differentiable optimization problems (that is,
problems whose solutions can be backpropagated through) as layers within deep learning …

End-to-end differentiable physics for learning and control

F de Avila Belbute-Peres, K Smith… - Advances in neural …, 2018 - proceedings.neurips.cc
We present a differentiable physics engine that can be integrated as a module in deep
neural networks for end-to-end learning. As a result, structured physics knowledge can be …

DC3: A learning method for optimization with hard constraints

PL Donti, D Rolnick, JZ Kolter - arxiv preprint arxiv:2104.12225, 2021 - arxiv.org
Large optimization problems with hard constraints arise in many settings, yet classical
solvers are often prohibitively slow, motivating the use of deep networks as cheap" …

Satnet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver

PW Wang, P Donti, B Wilder… - … Conference on Machine …, 2019 - proceedings.mlr.press
Integrating logical reasoning within deep learning architectures has been a major goal of
modern AI systems. In this paper, we propose a new direction toward this goal by …

Melding the data-decisions pipeline: Decision-focused learning for combinatorial optimization

B Wilder, B Dilkina, M Tambe - Proceedings of the AAAI Conference on …, 2019 - aaai.org
Creating impact in real-world settings requires artificial intelligence techniques to span the
full pipeline from data, to predictive models, to decisions. These components are typically …

Multiscale deep equilibrium models

S Bai, V Koltun, JZ Kolter - Advances in neural information …, 2020 - proceedings.neurips.cc
We propose a new class of implicit networks, the multiscale deep equilibrium model
(MDEQ), suited to large-scale and highly hierarchical pattern recognition domains. An …

Learning with differentiable pertubed optimizers

Q Berthet, M Blondel, O Teboul… - Advances in neural …, 2020 - proceedings.neurips.cc
Abstract Machine learning pipelines often rely on optimizers procedures to make discrete
decisions (eg, sorting, picking closest neighbors, or shortest paths). Although these discrete …