The increasing demand for memory in hyperscale applications has led to memory becoming
a large portion of the overall datacenter spend. The emergence of coherent interfaces like …

High-capacity non-volatile memory (NVM) is a new main memory tier. Tiered DRAM+ NVM
servers increase total memory capacity by up to 8x, but can diminish memory bandwidth by …

Fast DRAM increasingly dominates infrastructure spend in large scale computing
environments and this trend will likely worsen without an architectural shift. The cost of …

Memory capacity is a major bottleneck for training deep neural networks (DNN).
Heterogeneous memory (HM) combining fast and slow memories provides a promising …

Compute and memory are tightly coupled within each server in traditional datacenters.
Large-scale datacenter operators have identified this coupling as a root cause behind …

The state-of-the-art approximate nearest neighbor search (ANNS) algorithms face a
fundamental tradeoff between query latency and accuracy, because of small main memory …

Current HPC systems provide memory resources that are statically configured and tightly
coupled with compute nodes. However, workloads on HPC systems are evolving. Diverse …

The increasing demand of big data analytics for more main memory capacity in datacenters
and exascale computing environments is driving the integration of heterogeneous memory …

Modern High-Performance Computing (HPC) systems are adding extra layers to the memory
and storage hierarchy named deep memory and storage hierarchy (DMSH), to increase I/O …

We demonstrate that hardware management of a tiered memory system offers better
performance for many applications than current methods of software management …