Foundation models for generalist medical artificial intelligence

M Moor, O Banerjee, ZSH Abad, HM Krumholz… - Nature, 2023 - nature.com
The exceptionally rapid development of highly flexible, reusable artificial intelligence (AI)
models is likely to usher in newfound capabilities in medicine. We propose a new paradigm …

Artificial intelligence for geoscience: Progress, challenges and perspectives

T Zhao, S Wang, C Ouyang, M Chen, C Liu, J Zhang… - The Innovation, 2024 - cell.com
This paper explores the evolution of geoscientific inquiry, tracing the progression from
traditional physics-based models to modern data-driven approaches facilitated by significant …

Foundation models for time series analysis: A tutorial and survey

Y Liang, H Wen, Y Nie, Y Jiang, M **, D Song… - Proceedings of the 30th …, 2024 - dl.acm.org
Time series analysis stands as a focal point within the data mining community, serving as a
cornerstone for extracting valuable insights crucial to a myriad of real-world applications …

Pushing the frontiers in climate modelling and analysis with machine learning

V Eyring, WD Collins, P Gentine, EA Barnes… - Nature Climate …, 2024 - nature.com
Climate modelling and analysis are facing new demands to enhance projections and
climate information. Here we argue that now is the time to push the frontiers of machine …

Pde-refiner: Achieving accurate long rollouts with neural pde solvers

P Lippe, B Veeling, P Perdikaris… - Advances in …, 2023 - proceedings.neurips.cc
Time-dependent partial differential equations (PDEs) are ubiquitous in science and
engineering. Recently, mostly due to the high computational cost of traditional solution …

Large ai models in health informatics: Applications, challenges, and the future

J Qiu, L Li, J Sun, J Peng, P Shi… - IEEE Journal of …, 2023 - ieeexplore.ieee.org
Large AI models, or foundation models, are models recently emerging with massive scales
both parameter-wise and data-wise, the magnitudes of which can reach beyond billions …

Mamba-nd: Selective state space modeling for multi-dimensional data

S Li, H Singh, A Grover - European Conference on Computer Vision, 2024 - Springer
In recent years, Transformers have become the de-facto architecture for sequence modeling
on text and multi-dimensional data, such as images and video. However, the use of self …

An expert's guide to training physics-informed neural networks

S Wang, S Sankaran, H Wang, P Perdikaris - arxiv preprint arxiv …, 2023 - arxiv.org
Physics-informed neural networks (PINNs) have been popularized as a deep learning
framework that can seamlessly synthesize observational data and partial differential …

WeatherBench 2: A benchmark for the next generation of data‐driven global weather models

S Rasp, S Hoyer, A Merose, I Langmore… - Journal of Advances …, 2024 - Wiley Online Library
WeatherBench 2 is an update to the global, medium‐range (1–14 days) weather forecasting
benchmark proposed by (Rasp et al., 2020, https://doi. org/10.1029/2020ms002203) …

Dyffusion: A dynamics-informed diffusion model for spatiotemporal forecasting

S Rühling Cachay, B Zhao… - Advances in neural …, 2023 - proceedings.neurips.cc
While diffusion models can successfully generate data and make predictions, they are
predominantly designed for static images. We propose an approach for training diffusion …