Robots that use language

S Tellex, N Gopalan, H Kress-Gazit… - Annual Review of …, 2020 - annualreviews.org
This article surveys the use of natural language in robotics from a robotics point of view. To
use human language, robots must map words to aspects of the physical world, mediated by …

Experience grounds language

Y Bisk, A Holtzman, J Thomason, J Andreas… - ar** natural language instructions to complex
spatial actions in a 3D blocks world. We first introduce a new dataset that pairs complex 3D …

Follownet: Robot navigation by following natural language directions with deep reinforcement learning

P Shah, M Fiser, A Faust, JC Kew… - arxiv preprint arxiv …, 2018 - arxiv.org
Understanding and following directions provided by humans can enable robots to navigate
effectively in unknown situations. We present FollowNet, an end-to-end differentiable neural …

Improving grounded natural language understanding through human-robot dialog

J Thomason, A Padmakumar, J Sinapov… - … on Robotics and …, 2019 - ieeexplore.ieee.org
Natural language understanding for robotics can require substantial domain-and platform-
specific engineering. For example, for mobile robots to pick-and-place objects in an …

Asking follow-up clarifications to resolve ambiguities in human-robot conversation

FI Doğan, I Torre, I Leite - 2022 17th ACM/IEEE International …, 2022 - ieeexplore.ieee.org
When a robot aims to comprehend its human partner's request by identifying the referenced
objects in Human-Robot Conversation, ambiguities can occur because the environment …

Grounding robot plans from natural language instructions with incomplete world knowledge

D Nyga, S Roy, R Paul, D Park… - … on robot learning, 2018 - proceedings.mlr.press
Our goal is to enable robots to interpret and execute high-level tasks conveyed using natural
language instructions. For example, consider tasking a household robot to,“prepare my …