Robotic vision, otherwise known as computer vision for robots, is a critical process for robots
to collect and interpret detailed information related to human actions, goals, and …

This report presents the dataset and baseline of Task 3 of the DCASE2021 Challenge on
Sound Event Localization and Detection (SELD). The dataset is based on emulation of real …

In this paper, we review recent results on audiovisual (AV) fusion. We also discuss some of
the challenges and report on approaches to address them. One important issue in AV fusion …

We propose a new efficient framework, the Unified Context Network (UniCon), for robust
active speaker detection (ASD). Traditional methods for ASD usually operate on each …

This paper addresses the problem of localizing audio sources using binaural
measurements. We propose a supervised formulation that simultaneously localizes multiple …

In this paper, we present an integrated robotic system capable of participating in and
performing a wide range of educational and entertainment tasks collaborating with one or …

Active speakers have traditionally been identified in video by detecting their moving lips.
This paper demonstrates the same using spatio-temporal features that aim to capture other …

We address unsupervised audio-visual speech enhancement based on variational
autoencoders (VAEs), where the prior distribution of clean speech spectrogram is simulated …

We investigated the mouth-opening transition pattern (MOTP), which represents the change
of mouth-opening degree during the end of an utterance, and used it to predict the next …

Socially cognitive robots are supposed to communicate and interact with humans and other
robots in the most natural way. Listeners turn their heads to-ward speakers to enhance …