Pure transformers are powerful graph learners

J Kim, D Nguyen, S Min, S Cho… - Advances in Neural …, 2022 - proceedings.neurips.cc
We show that standard Transformers without graph-specific modifications can lead to
promising results in graph learning both in theory and practice. Given a graph, we simply …

[HTML][HTML] Deep Learning techniques for web-based attack detection in industry 5.0: a novel approach

A Salam, F Ullah, F Amin, M Abrar - Technologies, 2023 - mdpi.com
As the manufacturing industry advances towards Industry 5.0, which heavily integrates
advanced technologies such as cyber-physical systems, artificial intelligence, and the …

Learning probabilistic symmetrization for architecture agnostic equivariance

J Kim, D Nguyen, A Suleymanzade… - Advances in Neural …, 2023 - proceedings.neurips.cc
We present a novel framework to overcome the limitations of equivariant architectures in
learning functions with group symmetries. In contrary to equivariant architectures, we use an …

[HTML][HTML] Enhancing Jujube Forest Growth Estimation and Disease Detection Using a Novel Diffusion-Transformer Architecture

X Hu, Z Zhang, L Zheng, T Chen, C Peng, Y Wang, R Li… - Plants, 2024 - mdpi.com
This paper proposes an advanced deep learning model that integrates the Diffusion-
Transformer structure and parallel attention mechanism for the tasks of growth estimation …

[HTML][HTML] SAT-GATv2: A Dynamic Attention-Based Graph Neural Network for Solving Boolean Satisfiability Problem

W Chang, W Liu - Electronics, 2025 - mdpi.com
We propose SAT-GATv2, a graph neural network (GNN)-based model designed to solve the
Boolean satisfiability problem (SAT) through graph-based deep learning techniques. SAT …

[HTML][HTML] NGD-transformer: Navigation geodesic distance positional encoding with self-attention pooling for graph transformer on 3D triangle mesh

J Zhuang, X Liu, W Zhuang - Symmetry, 2022 - mdpi.com
Following the significant success of the transformer in NLP and computer vision, this paper
attempts to extend it to 3D triangle mesh. The aim is to determine the shape's global …

Intelligenza artificiale, Large Language Models (LLMs) e Retrieval-Augmented Generation (RAG). Nuovi strumenti per l'accesso alle risorse archivistiche e …

G Di Marcantonio - Bibliothecae. it, 2024 - u-pad.unimc.it
Abstract Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG)
systems offer a new paradigm for querying and retrieving information, making the resource …

[PDF][PDF] Deep Learning Techniques for Web-Based Attack Detection in Industry 5.0: A Novel Approach. Technologies 2023, 11, 107

A Salam, F Ullah, F Amin, M Abrar - Data Science and Big Data in …, 2023 - dlib.hust.edu.vn
As the manufacturing industry advances towards Industry 5.0, which heavily integrates
advanced technologies such as cyber-physical systems, artificial intelligence, and the …