Intelligent virtual agents are used to accomplish complex multi-modal tasks such as human
instruction comprehension in mixed-reality environments by increasingly adopting richer …

Supporting real-time, on-device execution of multi-modal referring instruction
comprehension models is an important challenge to be tackled in embodied Human-Robot …

During human-robot conversation, it is critical for robots to be able to answer users'
questions accurately and provide a suitable explanation for why they arrive at the answer …

Intelligent virtual agents are used to accomplish complex multi-modal tasks such as human
instruction comprehension in mixed-reality environments by increasingly adopting richer …

We present a multi-modal human instruction comprehension prototype for object acquisition
tasks that involve verbal, visual and pointing gesture cues. Our prototype includes an AR …

Verbal communication is a key challenge for human-robot interaction. Although existing off-
the-shelf speech recognition methods work accurately to address the part of this challenge …