Brain-to-Text Decoding with Context-Aware Neural Representations and Large Language Models

J Li, T Le, C Fan, M Chen, E Shlizerman - arxiv preprint arxiv:2411.10657, 2024 - arxiv.org
Decoding attempted speech from neural activity offers a promising avenue for restoring
communication abilities in individuals with speech impairments. Previous studies have …

Towards Linguistic Neural Representation Learning and Sentence Retrieval from Electroencephalogram Recordings

J Zhou, Y Duan, Z Zhao, YC Chang, YK Wang… - Proceedings of the 1st …, 2024 - dl.acm.org
Decoding linguistic information from non-invasive brain signals using EEG has gained
increasing research attention due to its vast applicational potential. Recently, a number of …

NeuGPT: Unified multi-modal Neural GPT

Y Yang, Y Duan, H Jo, Q Zhang, R Xu… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper introduces NeuGPT, a groundbreaking multi-modal language generation model
designed to harmonize the fragmented landscape of neural recording research …

CCSUMSP: A cross-subject Chinese speech decoding framework with unified topology and multi-modal semantic pre-training

S Huang, Y Wang, H Luo - Information Fusion, 2025 - Elsevier
Decoding speech from brain signals has been a long-standing challenge in neuroscience
and brain-computer interface research. While significant progress has been made in English …

BrainECHO: Semantic Brain Signal Decoding through Vector-Quantized Spectrogram Reconstruction for Whisper-Enhanced Text Generation

J Li, Z Song, J Wang, M Zhang, Z Zhang - arxiv preprint arxiv:2410.14971, 2024 - arxiv.org
Recent advances in decoding language from brain signals (EEG and MEG) have been
significantly driven by pre-trained language models, leading to remarkable progress on …

E2H: A Two-Stage Non-Invasive Neural Signal Driven Humanoid Robotic Whole-Body Control Framework

Y Duan, Q Zhang, J Zhou, J Sun, X Jiang, J Cao… - arxiv preprint arxiv …, 2024 - arxiv.org
Recent advancements in humanoid robotics, including the integration of hierarchical
reinforcement learning-based control and the utilization of LLM planning, have significantly …

MAD: Multi-Alignment MEG-to-Text Decoding

Y Yang, H Jo, Y Duan, Q Zhang, J Zhou… - arxiv preprint arxiv …, 2024 - arxiv.org
Deciphering language from brain activity is a crucial task in brain-computer interface (BCI)
research. Non-invasive cerebral signaling techniques including electroencephalography …

Are EEG-to-Text Models Working?

H Jo, Y Yang, J Han, Y Duan, H **ong… - arxiv preprint arxiv …, 2024 - arxiv.org
This work critically analyzes existing models for open-vocabulary EEG-to-Text translation.
We identify a crucial limitation: previous studies often employed implicit teacher-forcing …