Embedding Compression in Recommender Systems: A Survey

S Li, H Guo, X Tang, R Tang, L Hou, R Li… - ACM Computing …, 2024 - dl.acm.org
To alleviate the problem of information explosion, recommender systems are widely
deployed to provide personalized information filtering services. Usually, embedding tables …

Learning vector-quantized item representation for transferable sequential recommenders

Y Hou, Z He, J McAuley, WX Zhao - … of the ACM Web Conference 2023, 2023 - dl.acm.org
Recently, the generality of natural language text has been leveraged to develop transferable
recommender systems. The basic idea is to employ pre-trained language models (PLM) to …

A model of two tales: Dual transfer learning framework for improved long-tail item recommendation

Y Zhang, DZ Cheng, T Yao, X Yi, L Hong… - Proceedings of the web …, 2021 - dl.acm.org
Highly skewed long-tail item distribution is very common in recommendation systems. It
significantly hurts model performance on tail items. To improve tail-item recommendation …

Mixed dimension embeddings with application to memory-efficient recommendation systems

AA Ginart, M Naumov, D Mudigere… - … on Information Theory …, 2021 - ieeexplore.ieee.org
Embedding representations power machine intelligence in many applications, including
recommendation systems, but they are space intensive-potentially occupying hundreds of …

Dreamshard: Generalizable embedding table placement for recommender systems

D Zha, L Feng, Q Tan, Z Liu, KH Lai… - Advances in …, 2022 - proceedings.neurips.cc
We study embedding table placement for distributed recommender systems, which aims to
partition and place the tables on multiple hardware devices (eg, GPUs) to balance the …

Learnable embedding sizes for recommender systems

S Liu, C Gao, Y Chen, D **, Y Li - arxiv preprint arxiv:2101.07577, 2021 - arxiv.org
The embedding-based representation learning is commonly used in deep learning
recommendation models to map the raw sparse features to dense vectors. The traditional …

Automated embedding size search in deep recommender systems

H Liu, X Zhao, C Wang, X Liu, J Tang - Proceedings of the 43rd …, 2020 - dl.acm.org
Deep recommender systems have achieved promising performance on real-world
recommendation tasks. They typically represent users and items in a low-dimensional …

Autodim: Field-aware embedding dimension searchin recommender systems

X Zhao, H Liu, H Liu, J Tang, W Guo, J Shi… - Proceedings of the Web …, 2021 - dl.acm.org
Practical large-scale recommender systems usually contain thousands of feature fields from
users, items, contextual information, and their interactions. Most of them empirically allocate …

HET: scaling out huge embedding model training via cache-enabled distributed framework

X Miao, H Zhang, Y Shi, X Nie, Z Yang, Y Tao… - arxiv preprint arxiv …, 2021 - arxiv.org
Embedding models have been an effective learning paradigm for high-dimensional data.
However, one open issue of embedding models is that their representations (latent factors) …

Autoloss: Automated loss function search in recommendations

X Zhao, H Liu, W Fan, H Liu, J Tang… - Proceedings of the 27th …, 2021 - dl.acm.org
Designing an effective loss function plays a crucial role in training deep recommender
systems. Most existing works often leverage a predefined and fixed loss function that could …