Gauging tensor networks with belief propagation

J Tindall, M Fishman - SciPost Physics, 2023 - scipost.org
Effectively compressing and optimizing tensor networks requires reliable methods for fixing
the latent degrees of freedom of the tensors, known as the gauge. Here we introduce a new …

Factor graph neural networks

Z Zhang, F Wu, WS Lee - Advances in Neural Information …, 2020 - proceedings.neurips.cc
Most of the successful deep neural network architectures are structured, often consisting of
elements like convolutional neural networks and gated recurrent neural networks. Recently …

Loop Series Expansions for Tensor Networks

G Evenbly, N Pancotti, A Milsted, J Gray… - arxiv preprint arxiv …, 2024 - arxiv.org
Belief propagation (BP) can be a useful tool to approximately contract a tensor network,
provided that the contributions from any closed loops in the network are sufficiently weak. In …

Blockwise acceleration of alternating least squares for canonical tensor decomposition

D Evans, N Ye - Numerical Linear Algebra with Applications, 2023 - Wiley Online Library
The canonical polyadic (CP) decomposition of tensors is one of the most important tensor
decompositions. While the well‐known alternating least squares (ALS) algorithm is often …

Dynamic programming in rank space: Scaling structured inference with low-rank HMMs and PCFGs

S Yang, W Liu, K Tu - arxiv preprint arxiv:2205.00484, 2022 - arxiv.org
Hidden Markov Models (HMMs) and Probabilistic Context-Free Grammars (PCFGs) are
widely used structured models, both of which can be represented as factor graph grammars …

Neuralizing efficient higher-order belief propagation

MH Dupty, WS Lee - arxiv preprint arxiv:2010.09283, 2020 - arxiv.org
Graph neural network models have been extensively used to learn node representations for
graph structured data in an end-to-end setting. These models often rely on localized first …

Visual relationship detection with low rank non-negative tensor decomposition

MH Dupty, Z Zhang, WS Lee - Proceedings of the AAAI Conference on …, 2020 - aaai.org
We address the problem of Visual Relationship Detection (VRD) which aims to describe the
relationships between pairs of objects in the form of triplets of (subject, predicate, object). We …

On the Importance of the Execution Schedule for Bayesian Inference

PWA Wijnings, M Roa-Villescas, S Stuijk… - ACM Transactions on …, 2024 - dl.acm.org
Bayesian inference is a probabilistic approach to the problem of drawing conclusions from
observed data. Its main challenge is computational, which the Bayesian community tends to …

Factor graph neural networks

Z Zhang, MH Dupty, F Wu, JQ Shi, WS Lee - Journal of Machine Learning …, 2023 - jmlr.org
In recent years, we have witnessed a surge of Graph Neural Networks (GNNs), most of
which can learn powerful representations in an end-to-end fashion with great success in …

Spectral approximate inference

S Park, E Yang, SY Yun, J Shin - … Conference on Machine …, 2019 - proceedings.mlr.press
Given a graphical model (GM), computing its partition function is the most essential
inference task, but it is computationally intractable in general. To address the issue, iterative …