CAFE: Towards Compact, Adaptive, and Fast Embedding for Large-scale Recommendation Models
Recently, the growing memory demands of embedding tables in Deep Learning
Recommendation Models (DLRMs) pose great challenges for model training and …
Recommendation Models (DLRMs) pose great challenges for model training and …
CAFE+: Towards Compact, Adaptive, and Fast Embedding for Large-scale Online Recommendation Models
The growing memory demands of embedding tables in Deep Learning Recommendation
Models (DLRMs) pose great challenges for model training and deployment. Existing …
Models (DLRMs) pose great challenges for model training and deployment. Existing …
Revisiting Data Analysis with Pre-trained Foundation Models
Data analysis focuses on harnessing advanced statistics, programming, and machine
learning techniques to extract valuable insights from vast datasets. An increasing volume …
learning techniques to extract valuable insights from vast datasets. An increasing volume …
From Sancus to Sancus: staleness and quantization-aware full-graph decentralized training in graph neural networks
Graph neural networks (GNNs) have emerged due to their success at modeling graph data.
Yet, it is challenging for GNNs to efficiently scale to large graphs. Thus, distributed GNNs …
Yet, it is challenging for GNNs to efficiently scale to large graphs. Thus, distributed GNNs …
Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling
In current deep learning tasks, Adam style optimizers such as Adam, Adagrad, RMSProp,
Adafactor, and Lion have been widely used as alternatives to SGD style optimizers. These …
Adafactor, and Lion have been widely used as alternatives to SGD style optimizers. These …
Zero-Indexing Internet Search Augmented Generation for Large Language Models
Retrieval augmented generation has emerged as an effective method to enhance large
language model performance. This approach typically relies on an internal retrieval module …
language model performance. This approach typically relies on an internal retrieval module …