Long sequence time-series forecasting with deep learning: A survey

Z Chen, M Ma, T Li, H Wang, C Li - Information Fusion, 2023 - Elsevier
The development of deep learning technology has brought great improvements to the field
of time series forecasting. Short sequence time-series forecasting no longer satisfies the …

Self-supervised learning for time series analysis: Taxonomy, progress, and prospects

K Zhang, Q Wen, C Zhang, R Cai, M **… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Self-supervised learning (SSL) has recently achieved impressive performance on various
time series tasks. The most prominent advantage of SSL is that it reduces the dependence …

One fits all: Power general time series analysis by pretrained lm

T Zhou, P Niu, L Sun, R ** - Advances in neural …, 2023 - proceedings.neurips.cc
Although we have witnessed great success of pre-trained models in natural language
processing (NLP) and computer vision (CV), limited progress has been made for general …

[PDF][PDF] Timesnet: Temporal 2d-variation modeling for general time series analysis

H Wu, T Hu, Y Liu, H Zhou, J Wang, M Long - arxiv preprint arxiv …, 2022 - arxiv.org
Time series analysis is of immense importance in extensive applications, such as weather
forecasting, anomaly detection, and action recognition. This paper focuses on temporal …

Are transformers effective for time series forecasting?

A Zeng, M Chen, L Zhang, Q Xu - … of the AAAI conference on artificial …, 2023 - ojs.aaai.org
Recently, there has been a surge of Transformer-based solutions for the long-term time
series forecasting (LTSF) task. Despite the growing performance over the past few years, we …

Recipe for a general, powerful, scalable graph transformer

L Rampášek, M Galkin, VP Dwivedi… - Advances in …, 2022 - proceedings.neurips.cc
We propose a recipe on how to build a general, powerful, scalable (GPS) graph Transformer
with linear complexity and state-of-the-art results on a diverse set of benchmarks. Graph …

Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting

Y Zhang, J Yan - The eleventh international conference on learning …, 2023 - openreview.net
Recently many deep models have been proposed for multivariate time series (MTS)
forecasting. In particular, Transformer-based models have shown great potential because …

Non-stationary transformers: Exploring the stationarity in time series forecasting

Y Liu, H Wu, J Wang, M Long - Advances in Neural …, 2022 - proceedings.neurips.cc
Transformers have shown great power in time series forecasting due to their global-range
modeling ability. However, their performance can degenerate terribly on non-stationary real …

Transformers in time series: A survey

Q Wen, T Zhou, C Zhang, W Chen, Z Ma, J Yan… - arxiv preprint arxiv …, 2022 - arxiv.org
Transformers have achieved superior performances in many tasks in natural language
processing and computer vision, which also triggered great interest in the time series …

Lag-llama: Towards foundation models for time series forecasting

K Rasul, A Ashok, AR Williams… - … -FoMo: Robustness of …, 2023 - openreview.net
Aiming to build foundation models for time-series forecasting and study their scaling
behavior, we present here our work-in-progress on Lag-Llama, a general-purpose …