A survey on time-series pre-trained models

Q Ma, Z Liu, Z Zheng, Z Huang, S Zhu… - … on Knowledge and …, 2024 - ieeexplore.ieee.org
Time-Series Mining (TSM) is an important research area since it shows great potential in
practical applications. Deep learning models that rely on massive labeled data have been …

Deep time series forecasting models: A comprehensive survey

X Liu, W Wang - Mathematics, 2024 - mdpi.com
Deep learning, a crucial technique for achieving artificial intelligence (AI), has been
successfully applied in many fields. The gradual application of the latest architectures of …

UniTS: A unified multi-task time series model

S Gao, T Koker, O Queen… - Advances in …, 2025 - proceedings.neurips.cc
Although pre-trained transformers and reprogrammed text-based LLMs have shown strong
performance on time series tasks, the best-performing architectures vary widely across …

Universal time-series representation learning: A survey

P Trirat, Y Shin, J Kang, Y Nam, J Na, M Bae… - arxiv preprint arxiv …, 2024 - arxiv.org
Time-series data exists in every corner of real-world systems and services, ranging from
satellites in the sky to wearable devices on human bodies. Learning representations by …

Real-time network intrusion detection via decision transformers

J Chen, H Zhou, Y Mei, G Adam, ND Bastian… - arxiv preprint arxiv …, 2023 - arxiv.org
Many cybersecurity problems that require real-time decision-making based on temporal
observations can be abstracted as a sequence modeling problem, eg, network intrusion …

Automated contrastive learning strategy search for time series

B **g, Y Wang, G Sui, J Hong, J He, Y Yang… - Proceedings of the 33rd …, 2024 - dl.acm.org
In recent years, Contrastive Learning (CL) has become a predominant representation
learning paradigm for time series. Most existing methods manually build specific CL …

Epidemiology-aware neural ode with continuous disease transmission graph

G Wan, Z Liu, MSY Lau, BA Prakash, W ** - arxiv preprint arxiv …, 2024 - arxiv.org
Effective epidemic forecasting is critical for public health strategies and efficient medical
resource allocation, especially in the face of rapidly spreading infectious diseases. However …

Dna-t: Deformable neighborhood attention transformer for irregular medical time series

J Huang, B Yang, K Yin, J Xu - IEEE Journal of Biomedical and …, 2024 - ieeexplore.ieee.org
The real-world Electronic Health Records (EHRs) present irregularities due to changes in
the patient's health status, resulting in various time intervals between observations and …

PyDTS: A Python Toolkit for Deep Learning Time Series Modelling

PA Schirmer, I Mporas - Entropy, 2024 - mdpi.com
In this article, the topic of time series modelling is discussed. It highlights the criticality of
analysing and forecasting time series data across various sectors, identifying five primary …

Segment, Shuffle, and Stitch: A Simple Layer for Improving Time-Series Representations

S Grover, A Jalali, A Etemad - Advances in Neural …, 2025 - proceedings.neurips.cc
Existing approaches for learning representations of time-series keep the temporal
arrangement of the time-steps intact with the presumption that the original order is the most …