Graphical models, exponential families, and variational inference

MJ Wainwright, MI Jordan - Foundations and Trends® in …, 2008 - nowpublishers.com
The formalism of probabilistic graphical models provides a unifying framework for capturing
complex dependencies among random variables, and building large-scale multivariate …

Why does deep and cheap learning work so well?

HW Lin, M Tegmark, D Rolnick - Journal of Statistical Physics, 2017 - Springer
We show how the success of deep learning could depend not only on mathematics but also
on physics: although well-known mathematical theorems guarantee that neural networks …

Message passing algorithms for scalable multitarget tracking

F Meyer, T Kropfreiter, JL Williams, R Lau… - Proceedings of the …, 2018 - ieeexplore.ieee.org
Situation-aware technologies enabled by multitarget tracking will lead to new services and
applications in fields such as autonomous driving, indoor localization, robotic networks, and …

A tutorial on dual decomposition and lagrangian relaxation for inference in natural language processing

AM Rush, MJ Collins - Journal of Artificial Intelligence Research, 2012 - jair.org
Dual decomposition, and more generally Lagrangian relaxation, is a classical method for
combinatorial optimization; it has recently been applied to several inference problems in …

Structured learning and prediction in computer vision

S Nowozin, CH Lampert - Foundations and Trends® in …, 2011 - nowpublishers.com
Powerful statistical models that can be learned efficiently from large amounts of data are
currently revolutionizing computer vision. These models possess a rich internal structure …

MRF energy minimization and beyond via dual decomposition

N Komodakis, N Paragios… - IEEE transactions on …, 2010 - ieeexplore.ieee.org
This paper introduces a new rigorous theoretical framework to address discrete MRF-based
optimization in computer vision. Such a framework exploits the powerful technique of Dual …

Fixing max-product: Convergent message passing algorithms for MAP LP-relaxations

A Globerson, T Jaakkola - Advances in neural information …, 2007 - proceedings.neurips.cc
We present a novel message passing algorithm for approximating the MAP problem in
graphical models. The algorithm is similar in structure to max-product but unlike max-product …

Gaussian belief propagation: Theory and aplication

D Bickson - arxiv preprint arxiv:0811.2518, 2008 - arxiv.org
The canonical problem of solving a system of linear equations arises in numerous contexts
in information theory, communication theory, and related fields. In this contribution, we …

Norm-product belief propagation: Primal-dual message-passing for approximate inference

T Hazan, A Shashua - IEEE Transactions on Information …, 2010 - ieeexplore.ieee.org
Inference problems in graphical models can be represented as a constrained optimization of
a free-energy function. In this paper, we treat both forms of probabilistic inference, estimating …

[PDF][PDF] An augmented Lagrangian approach to constrained MAP inference.

AFT Martins, MAT Figueiredo, PMQ Aguiar, NA Smith… - ICML, 2011 - cs.cmu.edu
We propose a new algorithm for approximate MAP inference on factor graphs, by combining
augmented Lagrangian optimization with the dual decomposition method. Each slave …