This work presents a scalable solution to open-vocabulary visual speech recognition. To
achieve this, we constructed the largest existing visual speech recognition dataset …

The multimodal nature of speech is often ignored in human-computer interaction, but lip
deformations and other body motion, such as those of the head, convey additional …

Multimodal signal processing has become an important topic of research for overcoming
certain problems of audio-only speech processing. Audio-visual speech recognition is one …

We review recent research that examines audio-visual integration in multimodal
communication. The topics include bimodality in human speech, human and automated lip …

We have made significant progress in automatic speech recognition ASR for well-defined
applications like dictation and medium vocabulary transaction processing tasks in relatively …

We have reported activities in audiovisual speech processing, with emphasis on lip reading
and lip synchronization. These research results have shown that, with lip reading, it is …

This paper concentrates on the visual front end for hidden Markov model based automatic
lipreading. Two approaches for extracting features relevant to lipreading, given image …

Microphones and cameras have been extensively used to observe and detect human
activity and to facilitate natural modes of interaction between humans and intelligent …

Strides in computer technology and the search for deeper, more powerful techniques in
signal processing have brought multimodal research to the forefront in recent years. Audio …

This paper presents an audio visual automatic speech recognition (AV-ASR) system using a
Transformer-based architecture. We particularly focus on the scene context provided by the …