Tractable control for autoregressive language generation

H Zhang, M Dang, N Peng… - … on Machine Learning, 2023 - proceedings.mlr.press
Despite the success of autoregressive large language models in text generation, it remains
a major challenge to generate text that satisfies complex constraints: sampling from the …

A compositional atlas of tractable circuit operations for probabilistic inference

A Vergari, YJ Choi, A Liu, S Teso… - Advances in Neural …, 2021 - proceedings.neurips.cc
Circuit representations are becoming the lingua franca to express and reason about
tractable generative and discriminative models. In this paper, we show how complex …

Understanding the distillation process from deep generative models to tractable probabilistic circuits

X Liu, A Liu, G Van den Broeck… - … Conference on Machine …, 2023 - proceedings.mlr.press
Abstract Probabilistic Circuits (PCs) are a general and unified computational framework for
tractable probabilistic models that support efficient computation of various inference tasks …

Sparse probabilistic circuits via pruning and growing

M Dang, A Liu… - Advances in Neural …, 2022 - proceedings.neurips.cc
Probabilistic circuits (PCs) are a tractable representation of probability distributions allowing
for exact and efficient computation of likelihoods and marginals. There has been significant …

Scaling up probabilistic circuits by latent variable distillation

A Liu, H Zhang, GV Broeck - arxiv preprint arxiv:2210.04398, 2022 - arxiv.org
Probabilistic Circuits (PCs) are a unified framework for tractable probabilistic models that
support efficient computation of various probabilistic queries (eg, marginal probabilities) …

Tractable regularization of probabilistic circuits

A Liu, G Van den Broeck - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Abstract Probabilistic Circuits (PCs) are a promising avenue for probabilistic modeling. They
combine advantages of probabilistic graphical models (PGMs) with those of neural networks …

Scaling tractable probabilistic circuits: A systems perspective

A Liu, K Ahmed, GV Broeck - arxiv preprint arxiv:2406.00766, 2024 - arxiv.org
Probabilistic Circuits (PCs) are a general framework for tractable deep generative models,
which support exact and efficient probabilistic inference on their learned distributions …

Lossless compression with probabilistic circuits

A Liu, S Mandt, GV Broeck - arxiv preprint arxiv:2111.11632, 2021 - arxiv.org
Despite extensive progress on image generation, common deep generative model
architectures are not easily applied to lossless compression. For example, VAEs suffer from …

Probabilistic sufficient explanations

E Wang, P Khosravi, GV Broeck - arxiv preprint arxiv:2105.10118, 2021 - arxiv.org
Understanding the behavior of learned classifiers is an important task, and various black-
box explanations, logical reasoning approaches, and model-specific methods have been …

DPU: DAG processing unit for irregular graphs with precision-scalable posit arithmetic in 28 nm

N Shah, LIG Olascoaga, S Zhao… - IEEE Journal of Solid …, 2021 - ieeexplore.ieee.org
Computation in several real-world applications such as probabilistic machine learning,
sparse linear algebra, and robotic navigation can be modeled as irregular directed acyclic …