Current strategies to address data scarcity in artificial intelligence-based drug discovery: A comprehensive review

A Gangwal, A Ansari, I Ahmad, AK Azad… - Computers in Biology …, 2024 - Elsevier
Artificial intelligence (AI) has played a vital role in computer-aided drug design (CADD). This
development has been further accelerated with the increasing use of machine learning (ML) …

[HTML][HTML] Deep learning for low-data drug discovery: hurdles and opportunities

D van Tilborg, H Brinkmann, E Criscuolo… - Current Opinion in …, 2024 - Elsevier
Deep learning is becoming increasingly relevant in drug discovery, from de novo design to
protein structure prediction and synthesis planning. However, it is often challenged by the …

Enhancing activity prediction models in drug discovery with the ability to understand human language

P Seidl, A Vall, S Hochreiter… - … on Machine Learning, 2023 - proceedings.mlr.press
Activity and property prediction models are the central workhorses in drug discovery and
materials sciences, but currently, they have to be trained or fine-tuned for new tasks. Without …

Towards foundational models for molecular learning on large-scale multi-task datasets

D Beaini, S Huang, JA Cunha, Z Li… - arxiv preprint arxiv …, 2023 - arxiv.org
Recently, pre-trained foundation models have enabled significant advancements in multiple
fields. In molecular machine learning, however, where datasets are often hand-curated, and …

On computational limits of modern hopfield models: A fine-grained complexity analysis

JYC Hu, T Lin, Z Song, H Liu - arxiv preprint arxiv:2402.04520, 2024 - arxiv.org
We investigate the computational limits of the memory retrieval dynamics of modern Hopfield
models from the fine-grained complexity analysis. Our key contribution is the …

STanhop: Sparse tandem hopfield model for memory-enhanced time series prediction

D Wu, JYC Hu, W Li, BY Chen, H Liu - arxiv preprint arxiv:2312.17346, 2023 - arxiv.org
We present STanHop-Net (Sparse Tandem Hopfield Network) for multivariate time series
prediction with memory-enhanced capabilities. At the heart of our approach is STanHop, a …

Outlier-efficient hopfield layers for large transformer-based models

JYC Hu, PH Chang, R Luo, HY Chen, W Li… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce an Outlier-Efficient Modern Hopfield Model (termed $\mathtt {OutEffHop} $)
and use it to address the outlier-induced challenge of quantizing gigantic transformer-based …

In-context learning for few-shot molecular property prediction

C Fifty, J Leskovec, S Thrun - arxiv preprint arxiv:2310.08863, 2023 - arxiv.org
In-context learning has become an important approach for few-shot learning in Large
Language Models because of its ability to rapidly adapt to new tasks without fine-tuning …

Nonparametric modern hopfield models

JYC Hu, BY Chen, D Wu, F Ruan, H Liu - arxiv preprint arxiv:2404.03900, 2024 - arxiv.org
We present a nonparametric construction for deep learning compatible modern Hopfield
models and utilize this framework to debut an efficient variant. Our key contribution stems …

[HTML][HTML] Exploring new horizons: Empowering computer-assisted drug design with few-shot learning

S Silva-Mendonça, AR de Sousa Vitória… - Artificial Intelligence in …, 2023 - Elsevier
Computational approaches have revolutionized the field of drug discovery, collectively
known as Computer-Assisted Drug Design (CADD). Advancements in computing power …