Variational diffusion models

D Kingma, T Salimans, B Poole… - Advances in neural …, 2021 - proceedings.neurips.cc
Diffusion-based generative models have demonstrated a capacity for perceptually
impressive synthesis, but can they also be great likelihood-based models? We answer this …

Maximum likelihood training of score-based diffusion models

Y Song, C Durkan, I Murray… - Advances in neural …, 2021 - proceedings.neurips.cc
Score-based diffusion models synthesize samples by reversing a stochastic process that
diffuses data to noise, and are trained by minimizing a weighted combination of score …

Language modeling is compression

G Delétang, A Ruoss, PA Duquenne, E Catt… - arxiv preprint arxiv …, 2023 - arxiv.org
It has long been established that predictive models can be transformed into lossless
compressors and vice versa. Incidentally, in recent years, the machine learning community …

An introduction to neural data compression

Y Yang, S Mandt, L Theis - Foundations and Trends® in …, 2023 - nowpublishers.com
Neural compression is the application of neural networks and other machine learning
methods to data compression. Recent advances in statistical machine learning have opened …

Nonlinear transform coding

J Ballé, PA Chou, D Minnen, S Singh… - IEEE Journal of …, 2020 - ieeexplore.ieee.org
We review a class of methods that can be collected under the name nonlinear transform
coding (NTC), which over the past few years have become competitive with the best linear …

Autoregressive diffusion models

E Hoogeboom, AA Gritsenko, J Bastings… - arxiv preprint arxiv …, 2021 - arxiv.org
We introduce Autoregressive Diffusion Models (ARDMs), a model class encompassing and
generalizing order-agnostic autoregressive models (Uria et al., 2014) and absorbing …

“Low-resource” text classification: A parameter-free classification method with compressors

Z Jiang, M Yang, M Tsirlin, R Tang… - Findings of the …, 2023 - aclanthology.org
Deep neural networks (DNNs) are often used for text classification due to their high
accuracy. However, DNNs can be computationally intensive, requiring millions of …

Gaussianimage: 1000 fps image representation and compression by 2d gaussian splatting

X Zhang, X Ge, T Xu, D He, Y Wang, H Qin… - … on Computer Vision, 2024 - Springer
Implicit neural representations (INRs) recently achieved great success in image
representation and compression, offering high visual quality and fast rendering speeds with …

Integer discrete flows and lossless compression

E Hoogeboom, J Peters… - Advances in Neural …, 2019 - proceedings.neurips.cc
Lossless compression methods shorten the expected representation size of data without
loss of information, using a statistical model. Flow-based models are attractive in this setting …

Bayesian flow networks

A Graves, RK Srivastava, T Atkinson… - arxiv preprint arxiv …, 2023 - arxiv.org
This paper introduces Bayesian Flow Networks (BFNs), a new class of generative model in
which the parameters of a set of independent distributions are modified with Bayesian …