A survey on time-series pre-trained models

Q Ma, Z Liu, Z Zheng, Z Huang, S Zhu… - … on Knowledge and …, 2024 - ieeexplore.ieee.org
Time-Series Mining (TSM) is an important research area since it shows great potential in
practical applications. Deep learning models that rely on massive labeled data have been …

Nonlinear independent component analysis for principled disentanglement in unsupervised deep learning

A Hyvärinen, I Khemakhem, H Morioka - Patterns, 2023 - cell.com
A central problem in unsupervised deep learning is how to find useful representations of
high-dimensional data, sometimes called" disentanglement." Most approaches are heuristic …

Toward causal representation learning

B Schölkopf, F Locatello, S Bauer, NR Ke… - Proceedings of the …, 2021 - ieeexplore.ieee.org
The two fields of machine learning and graphical causality arose and are developed
separately. However, there is, now, cross-pollination and increasing interest in both fields to …

Self-supervised learning with data augmentations provably isolates content from style

J Von Kügelgen, Y Sharma, L Gresele… - Advances in neural …, 2021 - proceedings.neurips.cc
Self-supervised representation learning has shown remarkable success in a number of
domains. A common practice is to perform data augmentation via hand-crafted …

Interventional causal representation learning

K Ahuja, D Mahajan, Y Wang… - … conference on machine …, 2023 - proceedings.mlr.press
Causal representation learning seeks to extract high-level latent factors from low-level
sensory data. Most existing methods rely on observational data and structural assumptions …

Nonparametric identifiability of causal representations from unknown interventions

J von Kügelgen, M Besserve… - Advances in …, 2023 - proceedings.neurips.cc
We study causal representation learning, the task of inferring latent causal variables and
their causal relations from high-dimensional functions (“mixtures”) of the variables. Prior …

The emergence of reproducibility and consistency in diffusion models

H Zhang, J Zhou, Y Lu, M Guo, P Wang… - Forty-first International …, 2024 - openreview.net
In this work, we investigate an intriguing and prevalent phenomenon of diffusion models
which we term as" consistent model reproducibility'': given the same starting noise input and …

Variational autoencoders and nonlinear ica: A unifying framework

I Khemakhem, D Kingma, R Monti… - International …, 2020 - proceedings.mlr.press
The framework of variational autoencoders allows us to efficiently learn deep latent-variable
models, such that the model's marginal distribution over observed variables fits the data …

Weakly-supervised disentanglement without compromises

F Locatello, B Poole, G Rätsch… - International …, 2020 - proceedings.mlr.press
Intelligent agents should be able to learn useful representations by observing changes in
their environment. We model such observations as pairs of non-iid images sharing at least …

MoVi-Fi: Motion-robust vital signs waveform recovery via deep interpreted RF sensing

Z Chen, T Zheng, C Cai, J Luo - Proceedings of the 27th annual …, 2021 - dl.acm.org
Vital signs are crucial indicators for human health, and researchers are studying contact-free
alternatives to existing wearable vital signs sensors. Unfortunately, most of these designs …