Approximately equivariant graph networks
Graph neural networks (GNNs) are commonly described as being permutation equivariant
with respect to node relabeling in the graph. This symmetry of GNNs is often compared to …
with respect to node relabeling in the graph. This symmetry of GNNs is often compared to …
Steerers: A framework for rotation equivariant keypoint descriptors
Image keypoint descriptions that are discriminative and matchable over large changes in
viewpoint are vital for 3D reconstruction. However descriptions output by learned descriptors …
viewpoint are vital for 3D reconstruction. However descriptions output by learned descriptors …
Towards fully covariant machine learning
Any representation of data involves arbitrary investigator choices. Because those choices
are external to the data-generating process, each choice leads to an exact symmetry …
are external to the data-generating process, each choice leads to an exact symmetry …
Understanding the Role of Equivariance in Self-supervised Learning
Contrastive learning has been a leading paradigm for self-supervised learning, but it is
widely observed that it comes at the price of sacrificing useful features (\eg colors) by being …
widely observed that it comes at the price of sacrificing useful features (\eg colors) by being …
Affine steerers for structured keypoint description
We propose a way to train deep learning based keypoint descriptors that makes them
approximately equivariant for locally affine transformations of the image plane. The main …
approximately equivariant for locally affine transformations of the image plane. The main …
Color Equivariant Network
Group equivariant convolutional neural networks have been designed for a variety of
geometric transformations from 2D and 3D rotation groups, to semi-groups such as scale …
geometric transformations from 2D and 3D rotation groups, to semi-groups such as scale …
PseudoNeg-MAE: Self-Supervised Point Cloud Learning using Conditional Pseudo-Negative Embeddings
We propose PseudoNeg-MAE, a novel self-supervised learning framework that enhances
global feature representation of point cloud mask autoencoder by making them both …
global feature representation of point cloud mask autoencoder by making them both …
Learning equivariant tensor functions with applications to sparse vector recovery
This work characterizes equivariant polynomial functions from tuples of tensor inputs to
tensor outputs. Loosely motivated by physics, we focus on equivariant functions with respect …
tensor outputs. Loosely motivated by physics, we focus on equivariant functions with respect …
When Text Embedding Meets Large Language Model: A Comprehensive Survey
Text embedding has become a foundational technology in natural language processing
(NLP) during the deep learning era, driving advancements across a wide array of …
(NLP) during the deep learning era, driving advancements across a wide array of …
Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses
What do different contrastive learning (CL) losses actually optimize for? Although multiple
CL methods have demonstrated remarkable representation learning capabilities, the …
CL methods have demonstrated remarkable representation learning capabilities, the …