SottoVoce: An ultrasound imaging-based silent speech interaction using deep neural networks

N Kimura, M Kono, J Rekimoto - … of the 2019 CHI Conference on Human …, 2019 - dl.acm.org
The availability of digital devices operated by voice is expanding rapidly. However, the
applications of voice interfaces are still restricted. For example, speaking in public places …

DNN-based acoustic-to-articulatory inversion using ultrasound tongue imaging

D Porras, A Sepúlveda-Sepúlveda… - 2019 International Joint …, 2019 - ieeexplore.ieee.org
Speech sounds are produced as the coordinated movement of the speaking organs. There
are several available methods to model the relation of articulatory movements and the …

TaLNet: Voice reconstruction from tongue and lip articulation with transfer learning from text-to-speech synthesis

JX Zhang, K Richmond, ZH Ling, L Dai - Proceedings of the AAAI …, 2021 - ojs.aaai.org
This paper presents TaLNet, a model for voice reconstruction with ultrasound tongue and
optical lip videos as inputs. TaLNet is based on an encoder-decoder architecture. Separate …

SilentSpeller: Towards mobile, hands-free, silent speech text entry using electropalatography

N Kimura, T Gemicioglu, J Womack, R Li… - Proceedings of the …, 2022 - dl.acm.org
Speech is inappropriate in many situations, limiting when voice control can be used. Most
unvoiced speech text entry systems can not be used while on-the-go due to movement …

Ultrasound-based silent speech interface built on a continuous vocoder

TG Csapó, MS Al-Radhi, G Németh… - arxiv preprint arxiv …, 2019 - arxiv.org
Recently it was shown that within the Silent Speech Interface (SSI) field, the prediction of F0
is possible from Ultrasound Tongue Images (UTI) as the articulatory input, using Deep …

Speaker-independent classification of phonetic segments from raw ultrasound in child speech

MS Ribeiro, A Eshky, K Richmond… - ICASSP 2019-2019 …, 2019 - ieeexplore.ieee.org
Ultrasound tongue imaging (UTI) provides a convenient way to visualize the vocal tract
during speech production. UTI is increasingly being used for speech therapy, making it …