Givt: Generative infinite-vocabulary transformers

M Tschannen, C Eastwood, F Mentzer - European Conference on …, 2024 - Springer
Abstract We introduce Generative Infinite-Vocabulary Transformers (GIVT) which generate
vector sequences with real-valued entries, instead of discrete tokens from a finite …

Vqfr: Blind face restoration with vector-quantized dictionary and parallel decoder

Y Gu, X Wang, L **e, C Dong, G Li, Y Shan… - … on Computer Vision, 2022 - Springer
Although generative facial prior and geometric prior have recently demonstrated high-quality
results for blind face restoration, producing fine-grained facial details faithful to inputs …

Straightening out the straight-through estimator: Overcoming optimization challenges in vector quantized networks

M Huh, B Cheung, P Agrawal… - … Conference on Machine …, 2023 - proceedings.mlr.press
This work examines the challenges of training neural networks using vector quantization
using straight-through estimation. We find that the main cause of training instability is the …

Hierarchical vector quantized transformer for multi-class unsupervised anomaly detection

R Lu, YJ Wu, L Tian, D Wang… - Advances in Neural …, 2023 - proceedings.neurips.cc
Abstract Unsupervised image Anomaly Detection (UAD) aims to learn robust and
discriminative representations of normal samples. While separate solutions per class endow …

Assessing antibody and nanobody nativeness for hit selection and humanization with AbNatiV

A Ramon, M Ali, M Atkinson, A Saturnino… - Nature Machine …, 2024 - nature.com
Monoclonal antibodies have emerged as key therapeutics. In particular, nanobodies, small,
single-domain antibodies that are naturally expressed in camelids, are rapidly gaining …

Variable-rate hierarchical CPC leads to acoustic unit discovery in speech

S Cuervo, A Lancucki, R Marxer… - Advances in …, 2022 - proceedings.neurips.cc
The success of deep learning comes from its ability to capture the hierarchical structure of
data by learning high-level representations defined in terms of low-level ones. In this paper …

Hierarchical imitation learning with vector quantized models

K Kujanpää, J Pajarinen, A Ilin - International Conference on …, 2023 - proceedings.mlr.press
The ability to plan actions on multiple levels of abstraction enables intelligent agents to solve
complex tasks effectively. However, learning the models for both low and high-level …

Vector Quantization for Recommender Systems: A Review and Outlook

Q Liu, X Dong, J **ao, N Chen, H Hu, J Zhu… - arxiv preprint arxiv …, 2024 - arxiv.org
Vector quantization, renowned for its unparalleled feature compression capabilities, has
been a prominent topic in signal processing and machine learning research for several …

Rethinking the objectives of vector-quantized tokenizers for image synthesis

Y Gu, X Wang, Y Ge, Y Shan… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Vector-Quantized (VQ-based) generative models usually consist of two basic
components ie VQ tokenizers and generative transformers. Prior research focuses on …

[HTML][HTML] Data augmentation for Gram-stain images based on Vector Quantized Variational AutoEncoder

V Shwetha, K Prasad, C Mukhopadhyay, B Banerjee - Neurocomputing, 2024 - Elsevier
Availability of large-scale datasets plays a significant role in segmentation and classification
tasks using deep learning. However, domains such as healthcare inherently suffer from …