A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

A comprehensive survey on test-time adaptation under distribution shifts

J Liang, R He, T Tan - International Journal of Computer Vision, 2024 - Springer
Abstract Machine learning methods strive to acquire a robust model during the training
process that can effectively generalize to test samples, even in the presence of distribution …

Graphmae: Self-supervised masked graph autoencoders

Z Hou, X Liu, Y Cen, Y Dong, H Yang, C Wang… - Proceedings of the 28th …, 2022 - dl.acm.org
Self-supervised learning (SSL) has been extensively explored in recent years. Particularly,
generative SSL has seen emerging success in natural language processing and other …

Self-supervised graph learning for recommendation

J Wu, X Wang, F Feng, X He, L Chen, J Lian… - Proceedings of the 44th …, 2021 - dl.acm.org
Representation learning on user-item graph for recommendation has evolved from using
single ID or interaction history to exploiting higher-order neighbors. This leads to the …

Are graph augmentations necessary? simple graph contrastive learning for recommendation

J Yu, H Yin, X **a, T Chen, L Cui… - Proceedings of the 45th …, 2022 - dl.acm.org
Contrastive learning (CL) recently has spurred a fruitful line of research in the field of
recommendation, since its ability to extract self-supervised signals from the raw data is well …

Self-supervised learning: Generative or contrastive

X Liu, F Zhang, Z Hou, L Mian, Z Wang… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep supervised learning has achieved great success in the last decade. However, its
defects of heavy dependence on manual labels and vulnerability to attacks have driven …

Graph contrastive learning automated

Y You, T Chen, Y Shen, Z Wang - … Conference on Machine …, 2021 - proceedings.mlr.press
Self-supervised learning on graph-structured data has drawn recent interest for learning
generalizable, transferable and robust representations from unlabeled graphs. Among …

Graphgpt: Graph instruction tuning for large language models

J Tang, Y Yang, W Wei, L Shi, L Su, S Cheng… - Proceedings of the 47th …, 2024 - dl.acm.org
Graph Neural Networks (GNNs) have evolved to understand graph structures through
recursive exchanges and aggregations among nodes. To enhance robustness, self …

Improving graph collaborative filtering with neighborhood-enriched contrastive learning

Z Lin, C Tian, Y Hou, WX Zhao - … of the ACM web conference 2022, 2022 - dl.acm.org
Recently, graph collaborative filtering methods have been proposed as an effective
recommendation approach, which can capture users' preference over items by modeling the …

Graph self-supervised learning: A survey

Y Liu, M **, S Pan, C Zhou, Y Zheng… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …