A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

A survey on hypergraph representation learning

A Antelmi, G Cordasco, M Polato, V Scarano… - ACM Computing …, 2023 - dl.acm.org
Hypergraphs have attracted increasing attention in recent years thanks to their flexibility in
naturally modeling a broad range of systems where high-order relationships exist among …

A comprehensive survey on deep graph representation learning

W Ju, Z Fang, Y Gu, Z Liu, Q Long, Z Qiao, Y Qin… - Neural Networks, 2024 - Elsevier
Graph representation learning aims to effectively encode high-dimensional sparse graph-
structured data into low-dimensional dense vectors, which is a fundamental task that has …

Graph neural networks: foundation, frontiers and applications

L Wu, P Cui, J Pei, L Zhao, X Guo - … of the 28th ACM SIGKDD conference …, 2022 - dl.acm.org
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …

A survey on deep semi-supervised learning

X Yang, Z Song, I King, Z Xu - IEEE transactions on knowledge …, 2022 - ieeexplore.ieee.org
Deep semi-supervised learning is a fast-growing field with a range of practical applications.
This paper provides a comprehensive survey on both fundamentals and recent advances in …

CatBoost for big data: an interdisciplinary review

JT Hancock, TM Khoshgoftaar - Journal of big data, 2020 - Springer
Abstract Gradient Boosted Decision Trees (GBDT's) are a powerful tool for classification and
regression tasks in Big Data. Researchers should be familiar with the strengths and …

Natural language generation and understanding of big code for AI-assisted programming: A review

MF Wong, S Guo, CN Hang, SW Ho, CW Tan - Entropy, 2023 - mdpi.com
This paper provides a comprehensive review of the literature concerning the utilization of
Natural Language Processing (NLP) techniques, with a particular focus on transformer …

Influence maximization in social networks using graph embedding and graph neural network

S Kumar, A Mallik, A Khetarpal, BS Panda - Information Sciences, 2022 - Elsevier
With the boom in technologies and mobile networks in recent years, online social networks
have become an integral part of our daily lives. These virtual networks connect people …

An overview of deep semi-supervised learning

Y Ouali, C Hudelot, M Tami - arxiv preprint arxiv:2006.05278, 2020 - arxiv.org
Deep neural networks demonstrated their ability to provide remarkable performances on a
wide range of supervised learning tasks (eg, image classification) when trained on extensive …

Unsupervised social bot detection via structural information theory

H Peng, J Zhang, X Huang, Z Hao, A Li, Z Yu… - ACM Transactions on …, 2024 - dl.acm.org
Research on social bot detection plays a crucial role in maintaining the order and reliability
of information dissemination while increasing trust in social interactions. The current …