Recent advances in autoencoder-based representation learning

M Tschannen, O Bachem, M Lucic - arxiv preprint arxiv:1812.05069, 2018 - arxiv.org
Learning useful representations with little or no supervision is a key challenge in artificial
intelligence. We provide an in-depth review of recent advances in representation learning …

Information theoretic learning-enhanced dual-generative adversarial networks with causal representation for robust OOD generalization

X Zhou, X Zheng, T Shu, W Liang… - … on Neural Networks …, 2023 - ieeexplore.ieee.org
Recently, machine/deep learning techniques are achieving remarkable success in a variety
of intelligent control and management systems, promising to change the future of artificial …

Monte carlo gradient estimation in machine learning

S Mohamed, M Rosca, M Figurnov, A Mnih - Journal of Machine Learning …, 2020 - jmlr.org
This paper is a broad and accessible survey of the methods we have at our disposal for
Monte Carlo gradient estimation in machine learning and across the statistical sciences: the …

An introduction to neural data compression

Y Yang, S Mandt, L Theis - Foundations and Trends® in …, 2023 - nowpublishers.com
Neural compression is the application of neural networks and other machine learning
methods to data compression. Recent advances in statistical machine learning have opened …

Deep generative models for molecular science

PB Jørgensen, MN Schmidt, O Winther - Molecular informatics, 2018 - Wiley Online Library
Generative deep machine learning models now rival traditional quantum‐mechanical
computations in predicting properties of new structures, and they come with a significantly …

Bayesian compression for deep learning

C Louizos, K Ullrich, M Welling - Advances in neural …, 2017 - proceedings.neurips.cc
Compression and computational efficiency in deep learning have become a problem of
great significance. In this work, we argue that the most principled and effective way to attack …

Information-theoretic probing with minimum description length

E Voita, I Titov - arxiv preprint arxiv:2003.12298, 2020 - arxiv.org
To measure how well pretrained representations encode some linguistic property, it is
common to use accuracy of a probe, ie a classifier trained to predict the property from the …

Video compression with rate-distortion autoencoders

A Habibian, T Rozendaal… - Proceedings of the …, 2019 - openaccess.thecvf.com
In this paper we present aa deep generative model for lossy video compression. We employ
a model that consists of a 3D autoencoder with a discrete latent space and an …

Soft weight-sharing for neural network compression

K Ullrich, E Meeds, M Welling - arxiv preprint arxiv:1702.04008, 2017 - arxiv.org
The success of deep learning in numerous application domains created the de-sire to run
and train them on mobile devices. This however, conflicts with their computationally, memory …

Practical variational inference for neural networks

A Graves - Advances in neural information processing …, 2011 - proceedings.neurips.cc
Variational methods have been previously explored as a tractable approximation to
Bayesian inference for neural networks. However the approaches proposed so far have only …