A survey on mixture of experts

W Cai, J Jiang, F Wang, J Tang, S Kim… - arxiv preprint arxiv …, 2024 - arxiv.org
Large language models (LLMs) have garnered unprecedented advancements across
diverse fields, ranging from natural language processing to computer vision and beyond …

Erase: Benchmarking feature selection methods for deep recommender systems

P Jia, Y Wang, Z Du, X Zhao, Y Wang, B Chen… - Proceedings of the 30th …, 2024 - dl.acm.org
Deep Recommender Systems (DRS) are increasingly dependent on a large number of
feature fields for more precise recommendations. Effective feature selection methods are …

FedMoE: Personalized Federated Learning via Heterogeneous Mixture of Experts

H Mei, D Cai, A Zhou, S Wang, M Xu - arxiv preprint arxiv:2408.11304, 2024 - arxiv.org
As Large Language Models (LLMs) push the boundaries of AI capabilities, their demand for
data is growing. Much of this data is private and distributed across edge devices, making …

Enhancing Movie Recommendations in Fully Automated Vehicles: A Multi-Interest Approach With Transformer Models

Y Liu, K Wang, F Wu, Z Su, TH Luan… - IEEE Internet of Things …, 2025 - ieeexplore.ieee.org
This paper investigates a top N movie recommendation system in fully automated vehicles
(FAVs). While many existing movie recommendation systems have been integrated to …

HierRec: Scenario-Aware Hierarchical Modeling for Multi-scenario Recommendations

J Gao, B Chen, M Zhu, X Zhao, X Li, Y Wang… - Proceedings of the 33rd …, 2024 - dl.acm.org
Click-Through Rate (CTR) prediction is a fundamental technique in recommendation and
advertising systems. Recent studies have shown that implementing multi-scenario …

Hierarchical Time-Aware Mixture of Experts for Multi-Modal Sequential Recommendation

S Zhang, L Chen, D Shen, C Wang, H **ong - arxiv preprint arxiv …, 2025 - arxiv.org
Multi-modal sequential recommendation (SR) leverages multi-modal data to learn more
comprehensive item features and user preferences than traditional SR methods, which has …

An Adaptive Entire-space Multi-scenario Multi-task Transfer Learning Model for Recommendations

Q Yi, J Tang, X Zhao, Y Zeng, Z Song… - IEEE Transactions on …, 2025 - ieeexplore.ieee.org
Multi-scenario and multi-task recommendation systems efficiently facilitate knowledge
transfer across different scenarios and tasks. However, many existing approaches …

Scenario-Wise Rec: A Multi-Scenario Recommendation Benchmark

X Li, J Gao, P Jia, Y Wang, W Wang, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
Multi Scenario Recommendation (MSR) tasks, referring to building a unified model to
enhance performance across all recommendation scenarios, have recently gained much …

Efficient Multi-task Prompt Tuning for Recommendation

T Bai, L Huang, Y Yu, C Yang, C Hou, Z Zhao… - arxiv preprint arxiv …, 2024 - arxiv.org
With the expansion of business scenarios, real recommender systems are facing challenges
in dealing with the constantly emerging new tasks in multi-task learning frameworks. In this …

Collaborative Knowledge Fusion: A Novel Approach for Multi-task Recommender Systems via LLMs

C Zhao, X Su, M He, H Zhao, J Fan, X Li - arxiv preprint arxiv:2410.20642, 2024 - arxiv.org
Owing to the impressive general intelligence of large language models (LLMs), there has
been a growing trend to integrate them into recommender systems to gain a more profound …