The goal of this paper is to learn strong lip reading models that can recognise speech in
silent videos. Most prior works deal with the open-set visual speech recognition problem by …

The separation of speech signals measured at multiple microphones in noisy and
reverberant environments using only the audio modality has limitations because there is …

Recently, there has been growing use of deep neural networks in many modern speech-
based systems such as speaker recognition, speech enhancement, and emotion …

A computer vision-based wayfinding and navigation aid can improve the mobility of blind
and visually impaired people to travel independently. In this paper, we develop a new …

Speech activity detection (SAD) plays an important role in current speech processing
systems, including automatic speech recognition (ASR). SAD is particularly difficult in …

The performance of traditional voice activity detectors significantly deteriorates in the
presence of highly nonstationary noise and transient interferences. One solution is to …

We address the problem of voice activity detection in difficult acoustic environments
including high levels of noise and transients, which are common in real life scenarios. We …

Active speaker detection refers to the task of inferring which (if any) of the visible people in a
video is/are speaking. Existing methods based on audiovisual fusion are often confused by …

The visual voice activity detection (V-VAD) problem in unconstrained environments is
investigated in this paper. A novel method for V-VAD in the wild, exploiting local shape and …

Humans can extract speech signals that they need to understand from a mixture of
background noise, interfering sound sources, and reverberation for effective communication …