Transformers and Their Roles as Time Series Foundation Models

D Wu, Y He, Y Cao, J Fan, H Liu - arxiv preprint arxiv:2502.03383, 2025 - arxiv.org
We give a comprehensive analysis of transformers as time series foundation models,
focusing on their approximation and generalization capabilities. First, we demonstrate that …

Transformers versus the EM Algorithm in Multi-class Clustering

Y He, HY Chen, Y Cao, J Fan, H Liu - arxiv preprint arxiv:2502.06007, 2025 - arxiv.org
LLMs demonstrate significant inference capacities in complicated machine learning tasks,
using the Transformer model as its backbone. Motivated by the limited understanding of …