[HTML][HTML] A survey of transformers

T Lin, Y Wang, X Liu, X Qiu - AI open, 2022 - Elsevier
Transformers have achieved great success in many artificial intelligence fields, such as
natural language processing, computer vision, and audio processing. Therefore, it is natural …

Deep learning in diverse intelligent sensor based systems

Y Zhu, M Wang, X Yin, J Zhang, E Meijering, J Hu - Sensors, 2022 - mdpi.com
Deep learning has become a predominant method for solving data analysis problems in
virtually all fields of science and engineering. The increasing complexity and the large …

A survey on text classification: From traditional to deep learning

Q Li, H Peng, J Li, C **a, R Yang, L Sun… - ACM Transactions on …, 2022 - dl.acm.org
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …

A survey on text classification: From shallow to deep learning

Q Li, H Peng, J Li, C **a, R Yang, L Sun, PS Yu… - arxiv preprint arxiv …, 2020 - arxiv.org
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …

Code structure–guided transformer for source code summarization

S Gao, C Gao, Y He, J Zeng, L Nie, X **a… - ACM Transactions on …, 2023 - dl.acm.org
Code summaries help developers comprehend programs and reduce their time to infer the
program functionalities during software maintenance. Recent efforts resort to deep learning …

Introduction to transformers: an nlp perspective

T **ao, J Zhu - arxiv preprint arxiv:2311.17633, 2023 - arxiv.org
Transformers have dominated empirical machine learning models of natural language
processing. In this paper, we introduce basic concepts of Transformers and present key …

Molformer: Motif-based transformer on 3d heterogeneous molecular graphs

F Wu, D Radev, SZ Li - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Procuring expressive molecular representations underpins AI-driven molecule design and
scientific discovery. The research mainly focuses on atom-level homogeneous molecular …

Quantum self-attention neural networks for text classification

G Li, X Zhao, X Wang - Science China Information Sciences, 2024 - Springer
An emerging direction of quantum computing is to establish meaningful quantum
applications in various fields of artificial intelligence, including natural language processing …

Locker: Locally constrained self-attentive sequential recommendation

Z He, H Zhao, Z Lin, Z Wang, A Kale… - Proceedings of the 30th …, 2021 - dl.acm.org
Recently, self-attentive models have shown promise in sequential recommendation, given
their potential to capture user long-term preferences and short-term dynamics …

Linking common vulnerabilities and exposures to the mitre att&ck framework: A self-distillation approach

B Ampel, S Samtani, S Ullman, H Chen - arxiv preprint arxiv:2108.01696, 2021 - arxiv.org
Due to the ever-increasing threat of cyber-attacks to critical cyber infrastructure,
organizations are focusing on building their cybersecurity knowledge base. A salient list of …