Sequence modeling and design from molecular to genome scale with Evo

E Nguyen, M Poli, MG Durrant, B Kang, D Katrekar… - Science, 2024 - science.org
The genome is a sequence that encodes the DNA, RNA, and proteins that orchestrate an
organism's function. We present Evo, a long-context genomic foundation model with a …

Towards a theory of model distillation

E Boix-Adsera - arxiv preprint arxiv:2403.09053, 2024 - arxiv.org
Distillation is the task of replacing a complicated machine learning model with a simpler
model that approximates the original [BCNM06, HVD15]. Despite many practical …

State-free inference of state-space models: The transfer function approach

RN Parnichkun, S Massaroli, A Moro, JTH Smith… - arxiv preprint arxiv …, 2024 - arxiv.org
We approach designing a state-space model for deep learning applications through its dual
representation, the transfer function, and uncover a highly efficient sequence parallel …