Agent attention: On the integration of softmax and linear attention

D Han, T Ye, Y Han, Z **a, S Pan, P Wan… - … on Computer Vision, 2024 - Springer
The attention module is the key component in Transformers. While the global attention
mechanism offers high expressiveness, its excessive computational cost restricts its …

Object-centric learning with capsule networks: A survey

F De Sousa Ribeiro, K Duarte, M Everett… - ACM Computing …, 2024 - dl.acm.org
Capsule networks emerged as a promising alternative to convolutional neural networks for
learning object-centric representations. The idea is to explicitly model part-whole hierarchies …

Spinnet: Learning a general surface descriptor for 3d point cloud registration

S Ao, Q Hu, B Yang, A Markham… - Proceedings of the …, 2021 - openaccess.thecvf.com
Extracting robust and general 3D local features is key to downstream tasks such as point
cloud registration and reconstruction. Existing learning-based local descriptors are either …

Diffusionnet: Discretization agnostic learning on surfaces

N Sharp, S Attaiki, K Crane, M Ovsjanikov - ACM Transactions on …, 2022 - dl.acm.org
We introduce a new general-purpose approach to deep learning on three-dimensional
surfaces based on the insight that a simple diffusion layer is highly effective for spatial …

RoReg: Pairwise point cloud registration with oriented descriptors and local rotations

H Wang, Y Liu, Q Hu, B Wang, J Chen… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
We present RoReg, a novel point cloud registration framework that fully exploits oriented
descriptors and estimated local rotations in the whole registration pipeline. Previous …

Scalars are universal: Equivariant machine learning, structured like classical physics

S Villar, DW Hogg, K Storey-Fisher… - Advances in …, 2021 - proceedings.neurips.cc
There has been enormous progress in the last few years in designing neural networks that
respect the fundamental symmetries and coordinate freedoms of physical law. Some of …

You only hypothesize once: Point cloud registration with rotation-equivariant descriptors

H Wang, Y Liu, Z Dong, W Wang - Proceedings of the 30th ACM …, 2022 - dl.acm.org
In this paper, we propose a novel local descriptor-based framework, called You Only
Hypothesize Once (YOHO), for the registration of two unaligned point clouds. In contrast to …

Equivariant point network for 3d point cloud analysis

H Chen, S Liu, W Chen, H Li… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Features that are equivariant to a larger group of symmetries have been shown to be more
discriminative and powerful in recent studies. However, higher-order equivariant features …

Intrinsic dimension, persistent homology and generalization in neural networks

T Birdal, A Lou, LJ Guibas… - Advances in Neural …, 2021 - proceedings.neurips.cc
Disobeying the classical wisdom of statistical learning theory, modern deep neural networks
generalize well even though they typically contain millions of parameters. Recently, it has …

Canonical capsules: Self-supervised capsules in canonical pose

W Sun, A Tagliasacchi, B Deng… - Advances in …, 2021 - proceedings.neurips.cc
We propose a self-supervised capsule architecture for 3D point clouds. We compute capsule
decompositions of objects through permutation-equivariant attention, and self-supervise the …