Robots that use language
This article surveys the use of natural language in robotics from a robotics point of view. To
use human language, robots must map words to aspects of the physical world, mediated by …
use human language, robots must map words to aspects of the physical world, mediated by …
[HTML][HTML] Robot task planning and explanation in open and uncertain worlds
A long-standing goal of AI is to enable robots to plan in the face of uncertain and incomplete
information, and to handle task failure intelligently. This paper shows how to achieve this …
information, and to handle task failure intelligently. This paper shows how to achieve this …
Grounding spatial relations for human-robot interaction
We propose a system for human-robot interaction that learns both models for spatial
prepositions and for object recognition. Our system grounds the meaning of an input …
prepositions and for object recognition. Our system grounds the meaning of an input …
Using syntax to ground referring expressions in natural images
We introduce GroundNet, a neural network for referring expression recognition---the task of
localizing (or grounding) in an image the object referred to by a natural language …
localizing (or grounding) in an image the object referred to by a natural language …
Grounding the interaction: Anchoring situated discourse in everyday human-robot interaction
This paper presents how extraction, representation and use of symbolic knowledge from real-
world perception and human-robot verbal and non-verbal interaction can actually enable a …
world perception and human-robot verbal and non-verbal interaction can actually enable a …
PATI: a projection-based augmented table-top interface for robot programming
As robots begin to provide daily assistance to individuals in human environments, their end-
users, who do not necessarily have substantial technical training or backgrounds in robotics …
users, who do not necessarily have substantial technical training or backgrounds in robotics …
Multimodal estimation and communication of latent semantic knowledge for robust execution of robot instructions
The goal of this article is to enable robots to perform robust task execution following human
instructions in partially observable environments. A robot's ability to interpret and execute …
instructions in partially observable environments. A robot's ability to interpret and execute …
Asking follow-up clarifications to resolve ambiguities in human-robot conversation
When a robot aims to comprehend its human partner's request by identifying the referenced
objects in Human-Robot Conversation, ambiguities can occur because the environment …
objects in Human-Robot Conversation, ambiguities can occur because the environment …
A framework for resolving open-world referential expressions in distributed heterogeneous knowledge bases
We present a domain-independent approach to reference resolution that allows a robotic or
virtual agent to resolve references to entities (eg, objects and locations) found in open …
virtual agent to resolve references to entities (eg, objects and locations) found in open …
A givenness hierarchy theoretic approach
As robots become increasingly prevalent in our society, it becomes increasingly important to
endow them with natural language capabilities. Natural language capabilities are especially …
endow them with natural language capabilities. Natural language capabilities are especially …