Reducing information bottleneck for weakly supervised semantic segmentation
Weakly supervised semantic segmentation produces pixel-level localization from class
labels; however, a classifier trained on such labels is likely to focus on a small discriminative …
labels; however, a classifier trained on such labels is likely to focus on a small discriminative …
Graph structure learning with variational information bottleneck
Abstract Graph Neural Networks (GNNs) have shown promising results on a broad spectrum
of applications. Most empirical studies of GNNs directly take the observed graph as input …
of applications. Most empirical studies of GNNs directly take the observed graph as input …
Improving self-supervised learning by characterizing idealized representations
Despite the empirical successes of self-supervised learning (SSL) methods, it is unclear
what characteristics of their representations lead to high downstream accuracies. In this …
what characteristics of their representations lead to high downstream accuracies. In this …
Effective surrogate gradient learning with high-order information bottleneck for spike-based machine intelligence
S Yang, B Chen - IEEE transactions on neural networks and …, 2023 - ieeexplore.ieee.org
Brain-inspired computing technique presents a promising approach to prompt the rapid
development of artificial general intelligence (AGI). As one of the most critical aspects …
development of artificial general intelligence (AGI). As one of the most critical aspects …
Lossy compression for lossless prediction
Most data is automatically collected and only ever" seen" by algorithms. Yet, data
compressors preserve perceptual fidelity rather than just the information needed by …
compressors preserve perceptual fidelity rather than just the information needed by …
Optimal representations for covariate shift
Machine learning systems often experience a distribution shift between training and testing.
In this paper, we introduce a simple variational objective whose optima are exactly the set of …
In this paper, we introduce a simple variational objective whose optima are exactly the set of …
Compressive visual representations
Learning effective visual representations that generalize well without human supervision is a
fundamental problem in order to apply Machine Learning to a wide variety of tasks …
fundamental problem in order to apply Machine Learning to a wide variety of tasks …
Vne: An effective method for improving deep representation by manipulating eigenvalue distribution
Since the introduction of deep learning, a wide scope of representation properties, such as
decorrelation, whitening, disentanglement, rank, isotropy, and mutual information, have …
decorrelation, whitening, disentanglement, rank, isotropy, and mutual information, have …
Deep purified feature mining model for joint named entity recognition and relation extraction
Y Wang, Y Wang, Z Sun, Y Li, S Hu, Y Ye - Information Processing & …, 2023 - Elsevier
Table filling based joint named entity recognition and relation extraction task aims to share
representation of subtasks in a table to extract structured knowledge. However, most of …
representation of subtasks in a table to extract structured knowledge. However, most of …
Minimum description length and generalization guarantees for representation learning
M Sefidgaran, A Zaidi… - Advances in Neural …, 2024 - proceedings.neurips.cc
A major challenge in designing efficient statistical supervised learning algorithms is finding
representations that perform well not only on available training samples but also on unseen …
representations that perform well not only on available training samples but also on unseen …