Speech enhancement and speech separation are two related tasks, whose purpose is to
extract either one or more target speech signals, respectively, from a mixture of sounds …

Multimodal deep learning, in the context of biometrics, encounters significant challenges
due to the dependence on long speech utterances and RGB images, which are often …

Lip reading is a form of “listening” to people that happens visually. It's also referred to as
“Speech reading.” This is done by observing the speaker's face and listening to the spoken …

For many small-and medium-vocabulary tasks, audio-visual speech recognition can
significantly improve the recognition rates compared to audio-only systems. However, there …

Data fusion plays an important role in many technical applications that require efficient
processing of multimodal sensory observations. A prominent example is audiovisual signal …

Audiovisual speaker tracking is an application that has been tackled by a wide range of
classical approaches based on Gaussian filters, most notably the well-known Kalman filter …

An important aspect of audiovisual speaker localization is the appropriate fusion of acoustic
and visual observations based on their time-varying reliability. In this study, a framework …

Multimodal data fusion is an important aspect of many object localization and tracking
frameworks that rely on sensory observations from different sources. A prominent example is …

Estimating the positions of multiple speakers can be helpful for tasks like automatic speech
recognition or speaker diarization. Both applications benefit from a known speaker position …

The rapid advancement and democratization of technology have led to an abundance of
sensors. Consequently, the integration of these diverse modalities presents an advantage …