Language grounding with 3d objects
Seemingly simple natural language requests to a robot are generally underspecified, for
example" Can you bring me the wireless mouse?" Flat images of candidate mice may not …
example" Can you bring me the wireless mouse?" Flat images of candidate mice may not …
A joint network for grasp detection conditioned on natural language commands
We consider the task of gras** a target object based on a natural language command
query. Previous work primarily focused on localizing the object given the query, which …
query. Previous work primarily focused on localizing the object given the query, which …
Robot object retrieval with contextual natural language queries
Doro: Disambiguation of referred object for embodied agents
Robotic task instructions often involve a referred object that the robot must locate (ground)
within the environment. While task intent understanding is an essential part of natural …
within the environment. While task intent understanding is an essential part of natural …
Talk-to-Resolve: Combining scene understanding and spatial dialogue to resolve granular task ambiguity for a collocated robot
The utility of collocating robots largely depends on the easy and intuitive interaction
mechanism with the human. If a robot accepts task instruction in natural language, first, it has …
mechanism with the human. If a robot accepts task instruction in natural language, first, it has …
Multimodal attention branch network for perspective-free sentence generation
In this paper, we address the automatic sentence generation of fetching instructions for
domestic service robots. Typical fetching commands such as “bring me the yellow toy from …
domestic service robots. Typical fetching commands such as “bring me the yellow toy from …
Alleviating the burden of labeling: Sentence generation by attention branch encoder–decoder network
Domestic service robots (DSRs) are a promising solution to the shortage of home care
workers. However, one of the main limitations of DSRs is their inability to interact naturally …
workers. However, one of the main limitations of DSRs is their inability to interact naturally …
A multimodal target-source classifier with attention branches to understand ambiguous instructions for fetching daily objects
In this study, we focus on multimodal language understanding for fetching instructions in the
domestic service robots context. This task consists of predicting a target object, as instructed …
domestic service robots context. This task consists of predicting a target object, as instructed …
Affordance-based robot object retrieval
Natural language object retrieval is a highly useful yet challenging task for robots in human-
centric environments. Previous work has primarily focused on commands specifying the …
centric environments. Previous work has primarily focused on commands specifying the …