[HTML][HTML] A survey of transformers

T Lin, Y Wang, X Liu, X Qiu - AI open, 2022 - Elsevier
Transformers have achieved great success in many artificial intelligence fields, such as
natural language processing, computer vision, and audio processing. Therefore, it is natural …

Recent advances in deep learning models: a systematic literature review

R Malhotra, P Singh - Multimedia Tools and Applications, 2023 - Springer
In recent years, deep learning has evolved as a rapidly growing and stimulating field of
machine learning and has redefined state-of-the-art performances in a variety of …

Adaptive frequency filters as efficient global token mixers

Z Huang, Z Zhang, C Lan, ZJ Zha… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent vision transformers, large-kernel CNNs and MLPs have attained remarkable
successes in broad vision tasks thanks to their effective information fusion in the global …

Deep learning in diverse intelligent sensor based systems

Y Zhu, M Wang, X Yin, J Zhang, E Meijering, J Hu - Sensors, 2022 - mdpi.com
Deep learning has become a predominant method for solving data analysis problems in
virtually all fields of science and engineering. The increasing complexity and the large …

Inparformer: evolutionary decomposition transformers with interactive parallel attention for long-term time series forecasting

H Cao, Z Huang, T Yao, J Wang, H He… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Long-term time series forecasting (LTSF) provides substantial benefits for numerous real-
world applications, whereas places essential demands on the model capacity to capture …

The explainability of transformers: Current status and directions

P Fantozzi, M Naldi - Computers, 2024 - mdpi.com
An increasing demand for model explainability has accompanied the widespread adoption
of transformers in various fields of applications. In this paper, we conduct a survey of the …

Trafficgpt: Breaking the token barrier for efficient long traffic analysis and generation

J Qu, X Ma, J Li - arxiv preprint arxiv:2403.05822, 2024 - arxiv.org
Over the years, network traffic analysis and generation have advanced significantly. From
traditional statistical methods, the field has progressed to sophisticated deep learning …

Multi-temporal dependency handling in video smoke recognition: A holistic approach spanning spatial, short-term, and long-term perspectives

F Yang, Q Xue, Y Cao, X Li, W Zhang, G Li - Expert Systems with …, 2024 - Elsevier
Accurately recognizing video-based smoke is still a profoundly challenging task due to the
special characteristics of smoke, such as non-rigid morphology, semi-transparent …

RSMformer: an efficient multiscale transformer-based framework for long sequence time-series forecasting

G Tong, Z Ge, D Peng - Applied Intelligence, 2024 - Springer
Long sequence time-series forecasting (LSTF) is a significant and challenging task. Many
real-world applications require long-term forecasting of time series. In recent years …

Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential Modeling

J Zou, A Sun, C Long, E Kanoulas - ACM Transactions on Information …, 2024 - dl.acm.org
In conversational recommender systems (CRSs), conversations usually involve a set of
items and item-related entities or attributes, eg, director is a related entity of a movie. These …