Fifth-generation (5G) cellular communications promise to deliver the gigabit experience to
mobile users, with a capacity increase of up to three orders of magnitude with respect to …

As a paradigm to recover the sparse signal from a small set of linear measurements,
compressed sensing (CS) has stimulated a great deal of interest in recent years. In order to …

Modern practice for training classification deepnets involves a terminal phase of training
(TPT), which begins at the epoch where training error first vanishes. During TPT, the training …

When training deep neural networks for classification tasks, an intriguing empirical
phenomenon has been widely observed in the last-layer classifiers and features, where (i) …

Understand the fundamentals of wireless and MIMO communication with this accessible and
comprehensive text. Viewing the subject through an information theory lens, but also …

The recently discovered Neural Collapse (NC) phenomenon occurs pervasively in today's
deep net training paradigm of driving cross-entropy (CE) loss towards zero. During NC, last …

We study the optimal memorization capacity of modern Hopfield models and Kernelized
Hopfield Models (KHMs), a transformer-compatible class of Dense Associative Memories …

In this paper, we introduce the Layer-Peeled Model, a nonconvex, yet analytically tractable,
optimization program, in a quest to better understand deep neural networks that are trained …

This first chapter formulates the objectives of compressive sensing. It introduces the
standard compressive problem studied throughout the book and reveals its ubiquity in many …

MIMO-OFDM is a key technology for next-generation cellular communications (3GPP-LTE,
Mobile WiMAX, IMT-Advanced) as well as wireless LAN (IEEE 802.11 a, IEEE 802.11 n) …