A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
A comprehensive survey on test-time adaptation under distribution shifts
Abstract Machine learning methods strive to acquire a robust model during the training
process that can effectively generalize to test samples, even in the presence of distribution …
process that can effectively generalize to test samples, even in the presence of distribution …
Graphmae: Self-supervised masked graph autoencoders
Self-supervised learning (SSL) has been extensively explored in recent years. Particularly,
generative SSL has seen emerging success in natural language processing and other …
generative SSL has seen emerging success in natural language processing and other …
Self-supervised graph learning for recommendation
Representation learning on user-item graph for recommendation has evolved from using
single ID or interaction history to exploiting higher-order neighbors. This leads to the …
single ID or interaction history to exploiting higher-order neighbors. This leads to the …
Are graph augmentations necessary? simple graph contrastive learning for recommendation
Contrastive learning (CL) recently has spurred a fruitful line of research in the field of
recommendation, since its ability to extract self-supervised signals from the raw data is well …
recommendation, since its ability to extract self-supervised signals from the raw data is well …
Self-supervised learning: Generative or contrastive
Deep supervised learning has achieved great success in the last decade. However, its
defects of heavy dependence on manual labels and vulnerability to attacks have driven …
defects of heavy dependence on manual labels and vulnerability to attacks have driven …
Graph contrastive learning automated
Self-supervised learning on graph-structured data has drawn recent interest for learning
generalizable, transferable and robust representations from unlabeled graphs. Among …
generalizable, transferable and robust representations from unlabeled graphs. Among …
Graphgpt: Graph instruction tuning for large language models
Graph Neural Networks (GNNs) have evolved to understand graph structures through
recursive exchanges and aggregations among nodes. To enhance robustness, self …
recursive exchanges and aggregations among nodes. To enhance robustness, self …
Improving graph collaborative filtering with neighborhood-enriched contrastive learning
Recently, graph collaborative filtering methods have been proposed as an effective
recommendation approach, which can capture users' preference over items by modeling the …
recommendation approach, which can capture users' preference over items by modeling the …
Graph self-supervised learning: A survey
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …
works have focused on (semi-) supervised learning, resulting in shortcomings including …