Tractable control for autoregressive language generation

H Zhang, M Dang, N Peng… - … on Machine Learning, 2023 - proceedings.mlr.press
Despite the success of autoregressive large language models in text generation, it remains
a major challenge to generate text that satisfies complex constraints: sampling from the …

Building expressive and tractable probabilistic generative models: A review

S Sidheekh, S Natarajan - arxiv preprint arxiv:2402.00759, 2024 - arxiv.org
We present a comprehensive survey of the advancements and techniques in the field of
tractable probabilistic generative modeling, primarily focusing on Probabilistic Circuits …

Understanding the distillation process from deep generative models to tractable probabilistic circuits

X Liu, A Liu, G Van den Broeck… - … Conference on Machine …, 2023 - proceedings.mlr.press
Abstract Probabilistic Circuits (PCs) are a general and unified computational framework for
tractable probabilistic models that support efficient computation of various inference tasks …

Scaling tractable probabilistic circuits: A systems perspective

A Liu, K Ahmed, GV Broeck - arxiv preprint arxiv:2406.00766, 2024 - arxiv.org
Probabilistic Circuits (PCs) are a general framework for tractable deep generative models,
which support exact and efficient probabilistic inference on their learned distributions …

What is the Relationship between Tensor Factorizations and Circuits (and How Can We Exploit it)?

L Loconte, A Mari, G Gala, R Peharz… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper establishes a rigorous connection between circuit representations and tensor
factorizations, two seemingly distinct yet fundamentally related areas. By connecting these …

Probabilistic integral circuits

G Gala, C de Campos, R Peharz… - International …, 2024 - proceedings.mlr.press
Continuous latent variables (LVs) are a key ingredient of many generative models, as they
allow modelling expressive mixtures with an uncountable number of components. In …

Bayesian structure scores for probabilistic circuits

Y Yang, G Gala, R Peharz - International Conference on …, 2023 - proceedings.mlr.press
Probabilistic circuits (PCs) are a prominent representation of probability distributions with
tractable inference. While parameter learning in PCs is rigorously studied, structure learning …

Image inpainting via tractable steering of diffusion models

A Liu, M Niepert, GV Broeck - arxiv preprint arxiv:2401.03349, 2023 - arxiv.org
Diffusion models are the current state of the art for generating photorealistic images.
Controlling the sampling process for constrained image generation tasks such as inpainting …

Unifying and understanding overparameterized circuit representations via low-rank tensor decompositions

A Mari, G Vessio, A Vergari - The 6th Workshop on Tractable …, 2023 - openreview.net
Tensorizing probabilistic circuits (PCs)-structured computational graphs capable of
efficiently and accurately performing various probabilistic reasoning tasks-is the go-to way to …

Scaling Continuous Latent Variable Models as Probabilistic Integral Circuits

G Gala, C de Campos, A Vergari… - arxiv preprint arxiv …, 2024 - arxiv.org
Probabilistic integral circuits (PICs) have been recently introduced as probabilistic models
enjoying the key ingredient behind expressive generative models: continuous latent …