A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024‏ - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

Self-supervised learning for recommender systems: A survey

J Yu, H Yin, X **a, T Chen, J Li… - IEEE Transactions on …, 2023‏ - ieeexplore.ieee.org
In recent years, neural architecture-based recommender systems have achieved
tremendous success, but they still fall short of expectation when dealing with highly sparse …

Graph self-supervised learning: A survey

Y Liu, M **, S Pan, C Zhou, Y Zheng… - IEEE transactions on …, 2022‏ - ieeexplore.ieee.org
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …

Self-supervised learning on graphs: Contrastive, generative, or predictive

L Wu, H Lin, C Tan, Z Gao, SZ Li - IEEE Transactions on …, 2021‏ - ieeexplore.ieee.org
Deep learning on graphs has recently achieved remarkable success on a variety of tasks,
while such success relies heavily on the massive and carefully labeled data. However …

Simple unsupervised graph representation learning

Y Mo, L Peng, J Xu, X Shi, X Zhu - … of the AAAI conference on artificial …, 2022‏ - ojs.aaai.org
In this paper, we propose a simple unsupervised graph representation learning method to
conduct effective and efficient contrastive learning. Specifically, the proposed multiplet loss …

A survey of graph neural networks in various learning paradigms: methods, applications, and challenges

L Waikhom, R Patgiri - Artificial Intelligence Review, 2023‏ - Springer
In the last decade, deep learning has reinvigorated the machine learning field. It has solved
many problems in computer vision, speech recognition, natural language processing, and …

Disencdr: Learning disentangled representations for cross-domain recommendation

J Cao, X Lin, X Cong, J Ya, T Liu, B Wang - Proceedings of the 45th …, 2022‏ - dl.acm.org
Data sparsity is a long-standing problem in recommender systems. To alleviate it, Cross-
Domain Recommendation (CDR) has attracted a surge of interests, which utilizes the rich …

A review-aware graph contrastive learning framework for recommendation

J Shuai, K Zhang, L Wu, P Sun, R Hong… - Proceedings of the 45th …, 2022‏ - dl.acm.org
Most modern recommender systems predict users' preferences with two components: user
and item embedding learning, followed by the user-item interaction modeling. By utilizing …

Generative-contrastive graph learning for recommendation

Y Yang, Z Wu, L Wu, K Zhang, R Hong… - Proceedings of the 46th …, 2023‏ - dl.acm.org
By treating users' interactions as a user-item graph, graph learning models have been
widely deployed in Collaborative Filtering~(CF) based recommendation. Recently …

Contrastive cross-domain sequential recommendation

J Cao, X Cong, J Sheng, T Liu, B Wang - Proceedings of the 31st ACM …, 2022‏ - dl.acm.org
Cross-Domain Sequential Recommendation (CDSR) aims to predict future interactions
based on user's historical sequential interactions from multiple domains. Generally, a key …