Hopfield networks is all you need

H Ramsauer, B Schäfl, J Lehner, P Seidl… - arxiv preprint arxiv …, 2020 - arxiv.org
We introduce a modern Hopfield network with continuous states and a corresponding
update rule. The new Hopfield network can store exponentially (with the dimension of the …

Multi-task learning as a bargaining game

A Navon, A Shamsian, I Achituve, H Maron… - arxiv preprint arxiv …, 2022 - arxiv.org
In Multi-task learning (MTL), a joint model is trained to simultaneously make predictions for
several tasks. Joint training reduces computation costs and improves data efficiency; …

On sparse modern hopfield model

JYC Hu, D Yang, D Wu, C Xu… - Advances in Neural …, 2023 - proceedings.neurips.cc
We introduce the sparse modern Hopfield model as a sparse extension of the modern
Hopfield model. Like its dense counterpart, the sparse modern Hopfield model equips a …

Limited feedforward waveform design for OFDM dual-functional radar-communications

MF Keskin, V Koivunen… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
We consider the problem of time-frequency waveform design for an OFDM dual-functional
radar-communications (DFRC) system that communicates with an OFDM receiver while …

Outlier-efficient hopfield layers for large transformer-based models

JYC Hu, PH Chang, R Luo, HY Chen, W Li… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce an Outlier-Efficient Modern Hopfield Model (termed $\mathrm {OutEffHop} $)
and use it to address the outlier inefficiency problem of {training} gigantic transformer-based …

Multi-static target detection and power allocation for integrated sensing and communication in cell-free massive MIMO

Z Behdad, ÖT Demir, KW Sung… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
This paper studies an integrated sensing and communication (ISAC) system within a
centralized cell-free massive MIMO (multiple-input multiple-output) network for target …

Uniform memory retrieval with larger capacity for modern hopfield models

D Wu, JYC Hu, TY Hsiao, H Liu - arxiv preprint arxiv:2404.03827, 2024 - arxiv.org
We propose a two-stage memory retrieval dynamics for modern Hopfield models, termed
$\mathtt {U\text {-} Hop} $, with enhanced memory capacity. Our key contribution is a …

Cell-free massive MIMO in O-RAN: Energy-aware joint orchestration of cloud, fronthaul, and radio resources

ÖT Demir, M Masoudi, E Björnson… - IEEE Journal on …, 2024 - ieeexplore.ieee.org
For the energy-efficient deployment of cell-free massive MIMO functionality in a practical
wireless network, the end-to-end (from radio site to the cloud) energy-aware operation is …

Self-paced learning for latent variable models

M Kumar, B Packer, D Koller - Advances in neural …, 2010 - proceedings.neurips.cc
Latent variable models are a powerful tool for addressing several tasks in machine learning.
However, the algorithms for learning the parameters of latent variable models are prone to …

STanhop: Sparse tandem hopfield model for memory-enhanced time series prediction

D Wu, JYC Hu, W Li, BY Chen, H Liu - arxiv preprint arxiv:2312.17346, 2023 - arxiv.org
We present STanHop-Net (Sparse Tandem Hopfield Network) for multivariate time series
prediction with memory-enhanced capabilities. At the heart of our approach is STanHop, a …