Givt: Generative infinite-vocabulary transformers
Abstract We introduce Generative Infinite-Vocabulary Transformers (GIVT) which generate
vector sequences with real-valued entries, instead of discrete tokens from a finite …
vector sequences with real-valued entries, instead of discrete tokens from a finite …
Vqfr: Blind face restoration with vector-quantized dictionary and parallel decoder
Although generative facial prior and geometric prior have recently demonstrated high-quality
results for blind face restoration, producing fine-grained facial details faithful to inputs …
results for blind face restoration, producing fine-grained facial details faithful to inputs …
Straightening out the straight-through estimator: Overcoming optimization challenges in vector quantized networks
This work examines the challenges of training neural networks using vector quantization
using straight-through estimation. We find that the main cause of training instability is the …
using straight-through estimation. We find that the main cause of training instability is the …
Hierarchical vector quantized transformer for multi-class unsupervised anomaly detection
Abstract Unsupervised image Anomaly Detection (UAD) aims to learn robust and
discriminative representations of normal samples. While separate solutions per class endow …
discriminative representations of normal samples. While separate solutions per class endow …
Assessing antibody and nanobody nativeness for hit selection and humanization with AbNatiV
A Ramon, M Ali, M Atkinson, A Saturnino… - Nature Machine …, 2024 - nature.com
Monoclonal antibodies have emerged as key therapeutics. In particular, nanobodies, small,
single-domain antibodies that are naturally expressed in camelids, are rapidly gaining …
single-domain antibodies that are naturally expressed in camelids, are rapidly gaining …
Variable-rate hierarchical CPC leads to acoustic unit discovery in speech
The success of deep learning comes from its ability to capture the hierarchical structure of
data by learning high-level representations defined in terms of low-level ones. In this paper …
data by learning high-level representations defined in terms of low-level ones. In this paper …
Hierarchical imitation learning with vector quantized models
The ability to plan actions on multiple levels of abstraction enables intelligent agents to solve
complex tasks effectively. However, learning the models for both low and high-level …
complex tasks effectively. However, learning the models for both low and high-level …
Vector Quantization for Recommender Systems: A Review and Outlook
Vector quantization, renowned for its unparalleled feature compression capabilities, has
been a prominent topic in signal processing and machine learning research for several …
been a prominent topic in signal processing and machine learning research for several …
Rethinking the objectives of vector-quantized tokenizers for image synthesis
Abstract Vector-Quantized (VQ-based) generative models usually consist of two basic
components ie VQ tokenizers and generative transformers. Prior research focuses on …
components ie VQ tokenizers and generative transformers. Prior research focuses on …
[HTML][HTML] Data augmentation for Gram-stain images based on Vector Quantized Variational AutoEncoder
Availability of large-scale datasets plays a significant role in segmentation and classification
tasks using deep learning. However, domains such as healthcare inherently suffer from …
tasks using deep learning. However, domains such as healthcare inherently suffer from …