Equivariance with learned canonicalization functions

SO Kaba, AK Mondal, Y Zhang… - International …, 2023 - proceedings.mlr.press
Symmetry-based neural networks often constrain the architecture in order to achieve
invariance or equivariance to a group of transformations. In this paper, we propose an …

Equivariant networks for crystal structures

O Kaba, S Ravanbakhsh - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Supervised learning with deep models has tremendous potential for applications in
materials science. Recently, graph neural networks have been used in this context, drawing …

Advances in Set Function Learning: A Survey of Techniques and Applications

J **e, G Tong - ACM Computing Surveys, 2025 - dl.acm.org
Set function learning has emerged as a crucial area in machine learning, addressing the
challenge of modeling functions that take sets as inputs. Unlike traditional machine learning …

Object-centric architectures enable efficient causal representation learning

A Mansouri, J Hartford, Y Zhang, Y Bengio - arxiv preprint arxiv …, 2023 - arxiv.org
Causal representation learning has showed a variety of settings in which we can
disentangle latent variables with identifiability guarantees (up to some reasonable …

Torchdeq: A library for deep equilibrium models

Z Geng, JZ Kolter - arxiv preprint arxiv:2310.18605, 2023 - arxiv.org
Deep Equilibrium (DEQ) Models, an emerging class of implicit models that maps inputs to
fixed points of neural networks, are of growing interest in the deep learning community …

Three-operator splitting for learning to predict equilibria in convex games

D McKenzie, H Heaton, Q Li, S Wu Fung, S Osher… - SIAM Journal on …, 2024 - SIAM
Systems of competing agents can often be modeled as games. Assuming rationality, the
most likely outcomes are given by an equilibrium, eg, a Nash equilibrium. In many practical …

Symmetry breaking and equivariant neural networks

SO Kaba, S Ravanbakhsh - arxiv preprint arxiv:2312.09016, 2023 - arxiv.org
Using symmetry as an inductive bias in deep learning has been proven to be a principled
approach for sample-efficient model design. However, the relationship between symmetry …

Unlocking slot attention by changing optimal transport costs

Y Zhang, DW Zhang, S Lacoste-Julien… - International …, 2023 - proceedings.mlr.press
Slot attention is a powerful method for object-centric modeling in images and videos.
However, its set-equivariance limits its ability to handle videos with a dynamic number of …