Transformers in single-cell omics: a review and new perspectives

A Szałata, K Hrovatin, S Becker, A Tejada-Lapuerta… - Nature …, 2024 - nature.com
Recent efforts to construct reference maps of cellular phenotypes have expanded the
volume and diversity of single-cell omics data, providing an unprecedented resource for …

Profiling cell identity and tissue architecture with single-cell and spatial transcriptomics

GS Gulati, JP D'Silva, Y Liu, L Wang… - … Reviews Molecular Cell …, 2024 - nature.com
Single-cell transcriptomics has broadened our understanding of cellular diversity and gene
expression dynamics in healthy and diseased tissues. Recently, spatial transcriptomics has …

A comprehensive review on synergy of multi-modal data and ai technologies in medical diagnosis

X Xu, J Li, Z Zhu, L Zhao, H Wang, C Song, Y Chen… - Bioengineering, 2024 - mdpi.com
Disease diagnosis represents a critical and arduous endeavor within the medical field.
Artificial intelligence (AI) techniques, spanning from machine learning and deep learning to …

Assessing the limits of zero-shot foundation models in single-cell biology

KZ Kedzierska, L Crawford, AP Amini, AX Lu - bioRxiv, 2023 - biorxiv.org
The advent and success of foundation models such as GPT has sparked growing interest in
their application to single-cell biology. Models like Geneformer and scGPT have emerged …

A comprehensive survey of foundation models in medicine

W Khan, S Leem, KB See, JK Wong… - IEEE Reviews in …, 2025 - ieeexplore.ieee.org
Foundation models (FMs) are large-scale deeplearning models that are developed using
large datasets and self-supervised learning methods. These models serve as a base for …

Evaluating the utilities of foundation models in single-cell data analysis

T Liu, K Li, Y Wang, H Li, H Zhao - bioRxiv, 2023 - biorxiv.org
Abstract Foundation Models (FMs) have made significant strides in both industrial and
scientific domains. In this paper, we evaluate the performance of FMs for single-cell …

Nicheformer: a foundation model for single-cell and spatial omics

AC Schaar, A Tejada-Lapuerta, G Palla, R Gutgesell… - bioRxiv, 2024 - biorxiv.org
Tissue makeup relies fundamentally on the cellular microenvironment. Spatial single-cell
genomics allows probing the underlying cellular interactions in an unbiased, scalable …

AI-driven multi-omics integration for multi-scale predictive modeling of causal genotype-environment-phenotype relationships

Y Wu, L **e - arxiv preprint arxiv:2407.06405, 2024 - arxiv.org
Despite the wealth of single-cell multi-omics data, it remains challenging to predict the
consequences of novel genetic and chemical perturbations in the human body. It requires …

General-purpose pre-trained large cellular models for single-cell transcriptomics

H Bian, Y Chen, E Luo, X Wu, M Hao… - National Science …, 2024 - academic.oup.com
The great capability of AI large language models (LLMs) pre-trained on massive natural
language data has inspired scientists to develop a few …

How do large language models understand genes and cells

C Fang, Y Wang, Y Song, Q Long, W Lu… - ACM Transactions on …, 2024 - dl.acm.org
Researching genes and their interactions is crucial for deciphering the fundamental laws of
cellular activity, advancing disease treatment, drug discovery, and more. Large language …