Navigation instruction generation with bev perception and large language models
S Fan, R Liu, W Wang, Y Yang - European Conference on Computer …, 2024 - Springer
Navigation instruction generation, which requires embodied agents to describe the
navigation routes, has been of great interest in robotics and human-computer interaction …
navigation routes, has been of great interest in robotics and human-computer interaction …
Lana: A language-capable navigator for instruction following and generation
Recently, visual-language navigation (VLN)--entailing robot agents to follow navigation
instructions--has shown great advance. However, existing literature put most emphasis on …
instructions--has shown great advance. However, existing literature put most emphasis on …
Counterfactual cycle-consistent learning for instruction following and generation in vision-language navigation
Since the rise of vision-language navigation (VLN), great progress has been made in
instruction following--building a follower to navigate environments under the guidance of …
instruction following--building a follower to navigate environments under the guidance of …
A review of spatial reasoning and interaction for real-world robotics
Truly universal helper robots capable of co** with unknown, unstructured environments
must be capable of spatial reasoning, ie establishing geometric relations between objects …
must be capable of spatial reasoning, ie establishing geometric relations between objects …
Learning to follow and generate instructions for language-capable navigation
Visual-language navigation (VLN) is a challenging task that requires embodied agents to
follow natural language instructions to navigate in previously unseen environments …
follow natural language instructions to navigate in previously unseen environments …
Multimodal estimation and communication of latent semantic knowledge for robust execution of robot instructions
The goal of this article is to enable robots to perform robust task execution following human
instructions in partially observable environments. A robot's ability to interpret and execute …
instructions in partially observable environments. A robot's ability to interpret and execute …
Navigational instruction generation as inverse reinforcement learning with neural machine translation
Modern robotics applications that involve human-robot interaction require robots to be able
to communicate with humans seamlessly and effectively. Natural language provides a …
to communicate with humans seamlessly and effectively. Natural language provides a …
Generating landmark navigation instructions from maps as a graph-to-text problem
Car-focused navigation services are based on turns and distances of named streets,
whereas navigation instructions naturally used by humans are centered around physical …
whereas navigation instructions naturally used by humans are centered around physical …
Common law annotations: Investigating the stability of dialog system output annotations
Abstract Metrics for Inter-Annotator Agreement (IAA), like Cohen's Kappa, are crucial for
validating annotated datasets. Although high agreement is often used to show the reliability …
validating annotated datasets. Although high agreement is often used to show the reliability …
Visual complexity and its effects on referring expression generation
Speakers' perception of a visual scene influences the language they use to describe it—
which objects they choose to mention and how they characterize the relationships between …
which objects they choose to mention and how they characterize the relationships between …