Navigating to objects in the real world

T Gervet, S Chintala, D Batra, J Malik, DS Chaplot - Science Robotics, 2023 - science.org
Semantic navigation is necessary to deploy mobile robots in uncontrolled environments
such as homes or hospitals. Many learning-based approaches have been proposed in …

Habitat-matterport 3d semantics dataset

K Yadav, R Ramrakhya… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract We present the Habitat-Matterport 3D Semantics (HM3DSEM) dataset. HM3DSEM
is the largest dataset of 3D real-world spaces with densely annotated semantics that is …

Clip-fields: Weakly supervised semantic fields for robotic memory

NMM Shafiullah, C Paxton, L Pinto, S Chintala… - arxiv preprint arxiv …, 2022 - arxiv.org
We propose CLIP-Fields, an implicit scene model that can be used for a variety of tasks,
such as segmentation, instance identification, semantic search over space, and view …

Weakly-supervised multi-granularity map learning for vision-and-language navigation

P Chen, D Ji, K Lin, R Zeng, T Li… - Advances in Neural …, 2022 - proceedings.neurips.cc
We address a practical yet challenging problem of training robot agents to navigate in an
environment following a path described by some language instructions. The instructions …

A review of platforms for simulating embodied agents in 3D virtual environments

DP Kaur, NP Singh, B Banerjee - Artificial Intelligence Review, 2023 - Springer
The unprecedented rise in research interest in artificial intelligence (AI) and related areas,
such as computer vision, machine learning, robotics, and cognitive science, during the last …

Embodied AI in education: A review on the body, environment, and mind

B Memarian, T Doleck - Education and Information Technologies, 2024 - Springer
A key feature of embodied education is the participation of the learners' body and mind with
the environment. Yet, little work has been done to review the state of embodied education …

Goat: Go to any thing

M Chang, T Gervet, M Khanna, S Yenamandra… - arxiv preprint arxiv …, 2023 - arxiv.org
In deployment scenarios such as homes and warehouses, mobile robots are expected to
autonomously navigate for extended periods, seamlessly executing tasks articulated in …

3d-aware object goal navigation via simultaneous exploration and identification

J Zhang, L Dai, F Meng, Q Fan… - Proceedings of the …, 2023 - openaccess.thecvf.com
Object goal navigation (ObjectNav) in unseen environments is a fundamental task for
Embodied AI. Agents in existing works learn ObjectNav policies based on 2D maps, scene …

Annotator: A generic active learning baseline for lidar semantic segmentation

B **e, S Li, Q Guo, C Liu… - Advances in Neural …, 2023 - proceedings.neurips.cc
Active learning, a label-efficient paradigm, empowers models to interactively query an oracle
for labeling new data. In the realm of LiDAR semantic segmentation, the challenges stem …

Etpnav: Evolving topological planning for vision-language navigation in continuous environments

D An, H Wang, W Wang, Z Wang… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Vision-language navigation is a task that requires an agent to follow instructions to navigate
in environments. It becomes increasingly crucial in the field of embodied AI, with potential …