Reducing information bottleneck for weakly supervised semantic segmentation

J Lee, J Choi, J Mok, S Yoon - Advances in neural …, 2021 - proceedings.neurips.cc
Weakly supervised semantic segmentation produces pixel-level localization from class
labels; however, a classifier trained on such labels is likely to focus on a small discriminative …

Graph structure learning with variational information bottleneck

Q Sun, J Li, H Peng, J Wu, X Fu, C Ji… - Proceedings of the AAAI …, 2022 - ojs.aaai.org
Abstract Graph Neural Networks (GNNs) have shown promising results on a broad spectrum
of applications. Most empirical studies of GNNs directly take the observed graph as input …

Improving self-supervised learning by characterizing idealized representations

Y Dubois, S Ermon, TB Hashimoto… - Advances in Neural …, 2022 - proceedings.neurips.cc
Despite the empirical successes of self-supervised learning (SSL) methods, it is unclear
what characteristics of their representations lead to high downstream accuracies. In this …

Effective surrogate gradient learning with high-order information bottleneck for spike-based machine intelligence

S Yang, B Chen - IEEE transactions on neural networks and …, 2023 - ieeexplore.ieee.org
Brain-inspired computing technique presents a promising approach to prompt the rapid
development of artificial general intelligence (AGI). As one of the most critical aspects …

Lossy compression for lossless prediction

Y Dubois, B Bloem-Reddy, K Ullrich… - Advances in Neural …, 2021 - proceedings.neurips.cc
Most data is automatically collected and only ever" seen" by algorithms. Yet, data
compressors preserve perceptual fidelity rather than just the information needed by …

Optimal representations for covariate shift

Y Ruan, Y Dubois, CJ Maddison - arxiv preprint arxiv:2201.00057, 2021 - arxiv.org
Machine learning systems often experience a distribution shift between training and testing.
In this paper, we introduce a simple variational objective whose optima are exactly the set of …

Compressive visual representations

KH Lee, A Arnab, S Guadarrama… - Advances in Neural …, 2021 - proceedings.neurips.cc
Learning effective visual representations that generalize well without human supervision is a
fundamental problem in order to apply Machine Learning to a wide variety of tasks …

Vne: An effective method for improving deep representation by manipulating eigenvalue distribution

J Kim, S Kang, D Hwang, J Shin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Since the introduction of deep learning, a wide scope of representation properties, such as
decorrelation, whitening, disentanglement, rank, isotropy, and mutual information, have …

Deep purified feature mining model for joint named entity recognition and relation extraction

Y Wang, Y Wang, Z Sun, Y Li, S Hu, Y Ye - Information Processing & …, 2023 - Elsevier
Table filling based joint named entity recognition and relation extraction task aims to share
representation of subtasks in a table to extract structured knowledge. However, most of …

Minimum description length and generalization guarantees for representation learning

M Sefidgaran, A Zaidi… - Advances in Neural …, 2024 - proceedings.neurips.cc
A major challenge in designing efficient statistical supervised learning algorithms is finding
representations that perform well not only on available training samples but also on unseen …