Dragon: A dialogue-based robot for assistive navigation with visual language grounding

S Liu, A Hasan, K Hong, R Wang… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
Persons with visual impairments (PwVI) have difficulties understanding and navigating
spaces around them. Current wayfinding technologies either focus solely on navigation or …

A data-efficient visual-audio representation with intuitive fine-tuning for voice-controlled robots

P Chang, S Liu, T Ji, N Chakraborty, K Hong… - arxiv preprint arxiv …, 2023 - arxiv.org
A command-following robot that serves people in everyday life must continually improve
itself in deployment domains with minimal help from its end users, instead of engineers …

ANAVI: Audio Noise Awareness using Visuals of Indoor environments for NAVIgation

V Jain, R Veerapaneni, Y Bisk - arxiv preprint arxiv:2410.18932, 2024 - arxiv.org
We propose Audio Noise Awareness using Visuals of Indoors for NAVIgation for quieter
robot path planning. While humans are naturally aware of the noise they make and its …

Learning structured interaction models for robot navigation in human environments

S Liu - 2024 - ideals.illinois.edu
Robots are becoming increasingly prevalent in our daily lives. However, these autonomous
agents work best in isolation. Integrating robots into human environments remains …

Learning Rewards and Skills to Follow Commands with a Data Efficient Visual-Audio Representation

P Chang, S Liu, T Ji, N Chakraborty, DL McPherson… - 2023 - openreview.net
Based on the recent advancements in representation learning, we propose a novel
framework for command-following robots with raw sensor inputs. Previous RL-based …

Designing and building a dialogue mechanism suitable for RoboPuppet with using deep inference learning

M Amirkhani, H Shahbazi - Amirkabir Journal of Mechanical …, 2023 - mej.aut.ac.ir
This research endeavors to construct a mechanism, blending text mining and natural
language processing, to apply a deep learning dialogue and deep reasoning approach to" …

[PDF][PDF] Structured Interaction Models for Robot Learning in Human Spaces

S Liu - shui**g725.github.io
Robots are becoming increasingly capable of performing tasks in isolation. However, how to
operate them in human environments remains an open challenge. Subtle and highly …