Unified training of universal time series forecasting transformers

G Woo, C Liu, A Kumar, C **ong, S Savarese, D Sahoo - 2024 - ink.library.smu.edu.sg
Deep learning for time series forecasting has traditionally operated within a one-model-per-
dataset framework, limiting its potential to leverage the game-changing impact of large pre …

Timer: Generative pre-trained transformers are large time series models

Y Liu, H Zhang, C Li, X Huang, J Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
Deep learning has contributed remarkably to the advancement of time series analysis. Still,
deep models can encounter performance bottlenecks in real-world data-scarce scenarios …

[HTML][HTML] Chronos: Learning the language of time series

AF Ansari, L Stella, C Turkmen, X Zhang, P Mercado… - 2024 - amazon.science
We introduce Chronos, a simple yet effective framework for pretrained probabilistic time
series models. Chronos tokenizes time series values using scaling and quantization into a …

Approaching human-level forecasting with language models

D Halawi, F Zhang, C Yueh-Han… - arxiv preprint arxiv …, 2024 - arxiv.org
Forecasting future events is important for policy and decision making. In this work, we study
whether language models (LMs) can forecast at the level of competitive human forecasters …

Is mamba capable of in-context learning?

R Grazzi, J Siems, S Schrodi, T Brox… - arxiv preprint arxiv …, 2024 - arxiv.org
State of the art foundation models such as GPT-4 perform surprisingly well at in-context
learning (ICL), a variant of meta-learning concerning the learned ability to solve tasks during …

Accurate predictions on small data with a tabular foundation model

N Hollmann, S Müller, L Purucker, A Krishnakumar… - Nature, 2025 - nature.com
Tabular data, spreadsheets organized in rows and columns, are ubiquitous across scientific
fields, from biomedicine to particle physics to economics and climate science,. The …

Generative pretrained hierarchical transformer for time series forecasting

Z Liu, J Yang, M Cheng, Y Luo, Z Li - Proceedings of the 30th ACM …, 2024 - dl.acm.org
Recent efforts have been dedicated to enhancing time series forecasting accuracy by
introducing advanced network architectures and self-supervised pretraining strategies …

Efficient bayesian learning curve extrapolation using prior-data fitted networks

S Adriaensen, H Rakotoarison… - Advances in Neural …, 2023 - proceedings.neurips.cc
Learning curve extrapolation aims to predict model performance in later epochs of training,
based on the performance in earlier epochs. In this work, we argue that, while the inherent …

A survey of time series foundation models: Generalizing time series representation with large language model

J Ye, W Zhang, K Yi, Y Yu, Z Li, J Li, F Tsung - arxiv preprint arxiv …, 2024 - arxiv.org
Time series data are ubiquitous across various domains, making time series analysis
critically important. Traditional time series models are task-specific, featuring singular …

Tunetables: Context optimization for scalable prior-data fitted networks

B Feuer, RT Schirrmeister, V Cherepanova… - arxiv preprint arxiv …, 2024 - arxiv.org
While tabular classification has traditionally relied on from-scratch training, a recent
breakthrough called prior-data fitted networks (PFNs) challenges this approach. Similar to …