Hopfield networks is all you need
We introduce a modern Hopfield network with continuous states and a corresponding
update rule. The new Hopfield network can store exponentially (with the dimension of the …
update rule. The new Hopfield network can store exponentially (with the dimension of the …
Arcface: Additive angular margin loss for deep face recognition
One of the main challenges in feature learning using Deep Convolutional Neural Networks
(DCNNs) for large-scale face recognition is the design of appropriate loss functions that can …
(DCNNs) for large-scale face recognition is the design of appropriate loss functions that can …
On sparse modern hopfield model
We introduce the sparse modern Hopfield model as a sparse extension of the modern
Hopfield model. Like its dense counterpart, the sparse modern Hopfield model equips a …
Hopfield model. Like its dense counterpart, the sparse modern Hopfield model equips a …
[BUCH][B] Discrete energy on rectifiable sets
Our goal is to provide an introduction to the study of minimal energy problems, particularly
from the perspective of generating point configurations that provide useful discretizations of …
from the perspective of generating point configurations that provide useful discretizations of …
STanhop: Sparse tandem hopfield model for memory-enhanced time series prediction
We present STanHop-Net (Sparse Tandem Hopfield Network) for multivariate time series
prediction with memory-enhanced capabilities. At the heart of our approach is STanHop, a …
prediction with memory-enhanced capabilities. At the heart of our approach is STanHop, a …
A Comparison of Popular Point Configurations on
There are many ways to generate a set of nodes on the sphere for use in a variety of
problems in numerical analysis. We present a survey of quickly generated point sets on …
problems in numerical analysis. We present a survey of quickly generated point sets on …
Efficient spherical designs with good geometric properties
RS Womersley - … computational mathematics-A celebration of the 80th …, 2018 - Springer
Spherical t-designs on 𝕊 d⊂ ℝ d+ 1 S^ d ⊂ R^ d+ 1 provide N nodes for an equal weight
numerical integration rule which is exact for all spherical polynomials of degree at most t …
numerical integration rule which is exact for all spherical polynomials of degree at most t …
Nonparametric modern hopfield models
We present a nonparametric construction for deep learning compatible modern Hopfield
models and utilize this framework to debut an efficient variant. Our key contribution stems …
models and utilize this framework to debut an efficient variant. Our key contribution stems …
SQ lower bounds for learning mixtures of linear classifiers
We study the problem of learning mixtures of linear classifiers under Gaussian covariates.
Given sample access to a mixture of $ r $ distributions on $\mathbb {R}^ n $ of the form …
Given sample access to a mixture of $ r $ distributions on $\mathbb {R}^ n $ of the form …
Orthogonal over-parameterized training
The inductive bias of a neural network is largely determined by the architecture and the
training algorithm. To achieve good generalization, how to effectively train a neural network …
training algorithm. To achieve good generalization, how to effectively train a neural network …