A review of irregular time series data handling with gated recurrent neural networks

PB Weerakody, KW Wong, G Wang, W Ela - Neurocomputing, 2021 - Elsevier
Irregular time series data is becoming increasingly prevalent with the growth of multi-sensor
systems as well as the continued use of unstructured manual data recording mechanisms …

A tutorial review of neural network modeling approaches for model predictive control

YM Ren, MS Alhajeri, J Luo, S Chen, F Abdullah… - Computers & Chemical …, 2022 - Elsevier
An overview of the recent developments of time-series neural network modeling is
presented along with its use in model predictive control (MPC). A tutorial on the construction …

Simplified state space layers for sequence modeling

JTH Smith, A Warrington, SW Linderman - arxiv preprint arxiv:2208.04933, 2022 - arxiv.org
Models using structured state space sequence (S4) layers have achieved state-of-the-art
performance on long-range sequence modeling tasks. An S4 layer combines linear state …

Nhits: Neural hierarchical interpolation for time series forecasting

C Challu, KG Olivares, BN Oreshkin… - Proceedings of the …, 2023 - ojs.aaai.org
Recent progress in neural forecasting accelerated improvements in the performance of large-
scale forecasting systems. Yet, long-horizon forecasting remains a very difficult task. Two …

On neural differential equations

P Kidger - arxiv preprint arxiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …

Efficiently modeling long sequences with structured state spaces

A Gu, K Goel, C Ré - arxiv preprint arxiv:2111.00396, 2021 - arxiv.org
A central goal of sequence modeling is designing a single principled model that can
address sequence data across a range of modalities and tasks, particularly on long-range …

Combining recurrent, convolutional, and continuous-time models with linear state space layers

A Gu, I Johnson, K Goel, K Saab… - Advances in neural …, 2021 - proceedings.neurips.cc
Recurrent neural networks (RNNs), temporal convolutions, and neural differential equations
(NDEs) are popular families of deep learning models for time-series data, each with unique …

Csdi: Conditional score-based diffusion models for probabilistic time series imputation

Y Tashiro, J Song, Y Song… - Advances in neural …, 2021 - proceedings.neurips.cc
The imputation of missing values in time series has many applications in healthcare and
finance. While autoregressive models are natural candidates for time series imputation …

Contiformer: Continuous-time transformer for irregular time series modeling

Y Chen, K Ren, Y Wang, Y Fang… - Advances in Neural …, 2023 - proceedings.neurips.cc
Modeling continuous-time dynamics on irregular time series is critical to account for data
evolution and correlations that occur continuously. Traditional methods including recurrent …

Hippo: Recurrent memory with optimal polynomial projections

A Gu, T Dao, S Ermon, A Rudra… - Advances in neural …, 2020 - proceedings.neurips.cc
A central problem in learning from sequential data is representing cumulative history in an
incremental fashion as more data is processed. We introduce a general framework (HiPPO) …