Nonlinear independent component analysis for principled disentanglement in unsupervised deep learning

A Hyvärinen, I Khemakhem, H Morioka - Patterns, 2023 - cell.com
A central problem in unsupervised deep learning is how to find useful representations of
high-dimensional data, sometimes called" disentanglement." Most approaches are heuristic …

Identifiability of latent-variable and structural-equation models: from linear to nonlinear

A Hyvärinen, I Khemakhem, R Monti - Annals of the Institute of Statistical …, 2024 - Springer
An old problem in multivariate statistics is that linear Gaussian models are often
unidentifiable. In factor analysis, an orthogonal rotation of the factors is unidentifiable, while …

Nonparametric identifiability of causal representations from unknown interventions

J von Kügelgen, M Besserve… - Advances in …, 2023 - proceedings.neurips.cc
We study causal representation learning, the task of inferring latent causal variables and
their causal relations from high-dimensional functions (“mixtures”) of the variables. Prior …

Learning linear causal representations from interventions under general nonlinear mixing

S Buchholz, G Rajendran… - Advances in …, 2023 - proceedings.neurips.cc
We study the problem of learning causal representations from unknown, latent interventions
in a general setting, where the latent distribution is Gaussian but the mixing function is …

Causal component analysis

L Wendong, A Kekić, J von Kügelgen… - Advances in …, 2023 - proceedings.neurips.cc
Abstract Independent Component Analysis (ICA) aims to recover independent latent
variables from observed mixtures thereof. Causal Representation Learning (CRL) aims …

Not all neuro-symbolic concepts are created equal: Analysis and mitigation of reasoning shortcuts

E Marconato, S Teso, A Vergari… - Advances in Neural …, 2023 - proceedings.neurips.cc
Abstract Neuro-Symbolic (NeSy) predictive models hold the promise of improved
compliance with given constraints, systematic generalization, and interpretability, as they …

Provably learning object-centric representations

J Brady, RS Zimmermann, Y Sharma… - International …, 2023 - proceedings.mlr.press
Learning structured representations of the visual world in terms of objects promises to
significantly improve the generalization abilities of current machine learning models. While …

Independent mechanism analysis, a new concept?

L Gresele, J Von Kügelgen, V Stimper… - Advances in neural …, 2021 - proceedings.neurips.cc
Independent component analysis provides a principled framework for unsupervised
representation learning, with solid theory on the identifiability of the latent code that …

Disentanglement via latent quantization

K Hsu, W Dorrell, J Whittington… - Advances in Neural …, 2023 - proceedings.neurips.cc
In disentangled representation learning, a model is asked to tease apart a dataset's
underlying sources of variation and represent them independently of one another. Since the …

Additive decoders for latent variables identification and cartesian-product extrapolation

S Lachapelle, D Mahajan, I Mitliagkas… - Advances in …, 2023 - proceedings.neurips.cc
We tackle the problems of latent variables identification and" out-of-support''image
generation in representation learning. We show that both are possible for a class of …