Approximately equivariant graph networks

N Huang, R Levie, S Villar - Advances in Neural …, 2024 - proceedings.neurips.cc
Graph neural networks (GNNs) are commonly described as being permutation equivariant
with respect to node relabeling in the graph. This symmetry of GNNs is often compared to …

Steerers: A framework for rotation equivariant keypoint descriptors

G Bökman, J Edstedt, M Felsberg… - Proceedings of the …, 2024 - openaccess.thecvf.com
Image keypoint descriptions that are discriminative and matchable over large changes in
viewpoint are vital for 3D reconstruction. However descriptions output by learned descriptors …

Towards fully covariant machine learning

S Villar, DW Hogg, W Yao, GA Kevrekidis… - arxiv preprint arxiv …, 2023 - arxiv.org
Any representation of data involves arbitrary investigator choices. Because those choices
are external to the data-generating process, each choice leads to an exact symmetry …

Understanding the Role of Equivariance in Self-supervised Learning

Y Wang, K Hu, S Gupta, Z Ye, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
Contrastive learning has been a leading paradigm for self-supervised learning, but it is
widely observed that it comes at the price of sacrificing useful features (\eg colors) by being …

Affine steerers for structured keypoint description

G Bökman, J Edstedt, M Felsberg, F Kahl - European Conference on …, 2024 - Springer
We propose a way to train deep learning based keypoint descriptors that makes them
approximately equivariant for locally affine transformations of the image plane. The main …

Color Equivariant Network

F O'Mahony, Y Yang, C Allen-Blanchette - arxiv preprint arxiv:2406.09588, 2024 - arxiv.org
Group equivariant convolutional neural networks have been designed for a variety of
geometric transformations from 2D and 3D rotation groups, to semi-groups such as scale …

PseudoNeg-MAE: Self-Supervised Point Cloud Learning using Conditional Pseudo-Negative Embeddings

S Mahendren, S Rahman, P Koniusz… - arxiv preprint arxiv …, 2024 - arxiv.org
We propose PseudoNeg-MAE, a novel self-supervised learning framework that enhances
global feature representation of point cloud mask autoencoder by making them both …

Learning equivariant tensor functions with applications to sparse vector recovery

WG Gregory, J Tonelli-Cueto, NF Marshall… - arxiv preprint arxiv …, 2024 - arxiv.org
This work characterizes equivariant polynomial functions from tuples of tensor inputs to
tensor outputs. Loosely motivated by physics, we focus on equivariant functions with respect …

When Text Embedding Meets Large Language Model: A Comprehensive Survey

Z Nie, Z Feng, M Li, C Zhang, Y Zhang, D Long… - arxiv preprint arxiv …, 2024 - arxiv.org
Text embedding has become a foundational technology in natural language processing
(NLP) during the deep learning era, driving advancements across a wide array of …

Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses

P Koromilas, G Bouritsas, T Giannakopoulos… - arxiv preprint arxiv …, 2024 - arxiv.org
What do different contrastive learning (CL) losses actually optimize for? Although multiple
CL methods have demonstrated remarkable representation learning capabilities, the …