Agent attention: On the integration of softmax and linear attention
The attention module is the key component in Transformers. While the global attention
mechanism offers high expressiveness, its excessive computational cost restricts its …
mechanism offers high expressiveness, its excessive computational cost restricts its …
Object-centric learning with capsule networks: A survey
Capsule networks emerged as a promising alternative to convolutional neural networks for
learning object-centric representations. The idea is to explicitly model part-whole hierarchies …
learning object-centric representations. The idea is to explicitly model part-whole hierarchies …
Spinnet: Learning a general surface descriptor for 3d point cloud registration
Extracting robust and general 3D local features is key to downstream tasks such as point
cloud registration and reconstruction. Existing learning-based local descriptors are either …
cloud registration and reconstruction. Existing learning-based local descriptors are either …
Diffusionnet: Discretization agnostic learning on surfaces
We introduce a new general-purpose approach to deep learning on three-dimensional
surfaces based on the insight that a simple diffusion layer is highly effective for spatial …
surfaces based on the insight that a simple diffusion layer is highly effective for spatial …
RoReg: Pairwise point cloud registration with oriented descriptors and local rotations
We present RoReg, a novel point cloud registration framework that fully exploits oriented
descriptors and estimated local rotations in the whole registration pipeline. Previous …
descriptors and estimated local rotations in the whole registration pipeline. Previous …
Scalars are universal: Equivariant machine learning, structured like classical physics
There has been enormous progress in the last few years in designing neural networks that
respect the fundamental symmetries and coordinate freedoms of physical law. Some of …
respect the fundamental symmetries and coordinate freedoms of physical law. Some of …
You only hypothesize once: Point cloud registration with rotation-equivariant descriptors
In this paper, we propose a novel local descriptor-based framework, called You Only
Hypothesize Once (YOHO), for the registration of two unaligned point clouds. In contrast to …
Hypothesize Once (YOHO), for the registration of two unaligned point clouds. In contrast to …
Equivariant point network for 3d point cloud analysis
Features that are equivariant to a larger group of symmetries have been shown to be more
discriminative and powerful in recent studies. However, higher-order equivariant features …
discriminative and powerful in recent studies. However, higher-order equivariant features …
Intrinsic dimension, persistent homology and generalization in neural networks
Disobeying the classical wisdom of statistical learning theory, modern deep neural networks
generalize well even though they typically contain millions of parameters. Recently, it has …
generalize well even though they typically contain millions of parameters. Recently, it has …
Canonical capsules: Self-supervised capsules in canonical pose
We propose a self-supervised capsule architecture for 3D point clouds. We compute capsule
decompositions of objects through permutation-equivariant attention, and self-supervise the …
decompositions of objects through permutation-equivariant attention, and self-supervise the …