To transformers and beyond: large language models for the genome

ME Consens, C Dufault, M Wainberg, D Forster… - arxiv preprint arxiv …, 2023 - arxiv.org
In the rapidly evolving landscape of genomics, deep learning has emerged as a useful tool
for tackling complex computational challenges. This review focuses on the transformative …

[HTML][HTML] Modern language models refute Chomsky's approach to language

ST Piantadosi - From fieldwork to linguistic theory: A tribute to …, 2023 - books.google.com
Modern machine learning has subverted and bypassed the theoretical framework of
Chomsky's generative approach to linguistics, including its core claims to particular insights …

[HTML][HTML] Measuring and modeling the motor system with machine learning

SB Hausmann, AM Vargas, A Mathis… - Current opinion in …, 2021 - Elsevier
The utility of machine learning in understanding the motor system is promising a revolution
in how to collect, measure, and analyze data. The field of movement science already …

Training spiking neural networks using lessons from deep learning

JK Eshraghian, M Ward, EO Neftci… - Proceedings of the …, 2023 - ieeexplore.ieee.org
The brain is the perfect place to look for inspiration to develop more efficient neural
networks. The inner workings of our synapses and neurons provide a glimpse at what the …

Seeing is believing: Brain-inspired modular training for mechanistic interpretability

Z Liu, E Gan, M Tegmark - Entropy, 2023 - mdpi.com
We introduce Brain-Inspired Modular Training (BIMT), a method for making neural networks
more modular and interpretable. Inspired by brains, BIMT embeds neurons in a geometric …

The combination of Hebbian and predictive plasticity learns invariant object representations in deep sensory networks

MS Halvagal, F Zenke - Nature Neuroscience, 2023 - nature.com
Recognition of objects from sensory stimuli is essential for survival. To that end, sensory
networks in the brain must form object representations invariant to stimulus changes, such …

Supervised learning in physical networks: From machine learning to learning machines

M Stern, D Hexner, JW Rocks, AJ Liu - Physical Review X, 2021 - APS
Materials and machines are often designed with particular goals in mind, so that they exhibit
desired responses to given forces or constraints. Here we explore an alternative approach …

Abstract representations emerge naturally in neural networks trained to perform multiple tasks

WJ Johnston, S Fusi - Nature Communications, 2023 - nature.com
Humans and other animals demonstrate a remarkable ability to generalize knowledge
across distinct contexts and objects during natural behavior. We posit that this ability to …

A survey on adversarial attacks for malware analysis

K Aryal, M Gupta, M Abdelsalam, P Kunwar… - IEEE …, 2024 - ieeexplore.ieee.org
Machine learning-based malware analysis approaches are widely researched and
deployed in critical infrastructures for detecting and classifying evasive and growing …