Transformers as statisticians: Provable in-context learning with in-context algorithm selection

Y Bai, F Chen, H Wang, C **ong… - Advances in neural …, 2023 - proceedings.neurips.cc
Neural sequence models based on the transformer architecture have demonstrated
remarkable\emph {in-context learning}(ICL) abilities, where they can perform new tasks …

When do neural nets outperform boosted trees on tabular data?

D McElfresh, S Khandagale… - Advances in …, 2023 - proceedings.neurips.cc
Tabular data is one of the most commonly used types of data in machine learning. Despite
recent advances in neural nets (NNs) for tabular data, there is still an active discussion on …

Forecastpfn: Synthetically-trained zero-shot forecasting

S Dooley, GS Khurana, C Mohapatra… - Advances in …, 2023 - proceedings.neurips.cc
The vast majority of time-series forecasting approaches require a substantial training
dataset. However, many real-life forecasting applications have very little initial observations …

Accurate predictions on small data with a tabular foundation model

N Hollmann, S Müller, L Purucker, A Krishnakumar… - Nature, 2025 - nature.com
Tabular data, spreadsheets organized in rows and columns, are ubiquitous across scientific
fields, from biomedicine to particle physics to economics and climate science,. The …

Tunetables: Context optimization for scalable prior-data fitted networks

B Feuer, RT Schirrmeister, V Cherepanova… - arxiv preprint arxiv …, 2024 - arxiv.org
While tabular classification has traditionally relied on from-scratch training, a recent
breakthrough called prior-data fitted networks (PFNs) challenges this approach. Similar to …

Early fault classification in rotating machinery with limited data using TabPFN

L Magadán, J Roldán-Gómez, JC Granda… - IEEE Sensors …, 2023 - ieeexplore.ieee.org
Intelligent fault detection and classification is a cornerstone of prognostic and health
management of rotating machinery (RM) research. Correctly classifying and predicting RM …

Interpretable machine learning for TabPFN

D Rundel, J Kobialka, C von Crailsheim… - World Conference on …, 2024 - Springer
Abstract The recently developed Prior-Data Fitted Networks (PFNs) have shown very
promising results for applications in low-data regimes. The TabPFN model, a special case of …

Untrained and Unmatched: Fast and Accurate Zero-Training Classification for Tabular Engineering Data

C Picard, F Ahmed - Journal of Mechanical Design, 2024 - asmedigitalcollection.asme.org
In engineering design, navigating complex decision-making landscapes demands a
thorough exploration of the design, performance, and constraint spaces, often impeded by …

EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks

M Arbel, D Salinas, F Hutter - arxiv preprint arxiv:2502.06684, 2025 - arxiv.org
Recent foundational models for tabular data, such as TabPFN, have demonstrated
remarkable effectiveness in adapting to new tasks through in-context learning. However …

What exactly has TabPFN learned to do?

C McCarter - arxiv preprint arxiv:2502.08978, 2025 - arxiv.org
TabPFN [Hollmann et al., 2023], a Transformer model pretrained to perform in-context
learning on fresh tabular classification problems, was presented at the last ICLR conference …