A survey of embodied ai: From simulators to research tasks

J Duan, S Yu, HL Tan, H Zhu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
There has been an emerging paradigm shift from the era of “internet AI” to “embodied AI,”
where AI algorithms and agents no longer learn from datasets of images, videos or text …

Diffusion-based generation, optimization, and planning in 3d scenes

S Huang, Z Wang, P Li, B Jia, T Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce SceneDiffuser, a conditional generative model for 3D scene understanding.
SceneDiffuser provides a unified model for solving scene-conditioned generation …

Poni: Potential functions for objectgoal navigation with interaction-free learning

SK Ramakrishnan, DS Chaplot… - Proceedings of the …, 2022 - openaccess.thecvf.com
State-of-the-art approaches to ObjectGoal navigation (ObjectNav) rely on reinforcement
learning and typically require significant computational resources and time for learning. We …

Ai2-thor: An interactive 3d environment for visual ai

E Kolve, R Mottaghi, W Han, E VanderBilt… - arxiv preprint arxiv …, 2017 - arxiv.org
We introduce The House Of inteRactions (THOR), a framework for visual AI research,
available at http://ai2thor. allenai. org. AI2-THOR consists of near photo-realistic 3D indoor …

Robot learning in the era of foundation models: A survey

X **ao, J Liu, Z Wang, Y Zhou, Y Qi, Q Cheng… - arxiv preprint arxiv …, 2023 - arxiv.org
The proliferation of Large Language Models (LLMs) has s fueled a shift in robot learning
from automation towards general embodied Artificial Intelligence (AI). Adopting foundation …

Layout-based causal inference for object navigation

S Zhang, X Song, W Li, Y Bai, X Yu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Previous works for ObjectNav task attempt to learn the association (eg relation graph)
between the visual inputs and the goal during training. Such association contains the prior …

Continuous scene representations for embodied ai

SY Gadre, K Ehsani, S Song… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We propose Continuous Scene Representations (CSR), a scene representation
constructed by an embodied agent navigating within a space, where objects and their …

Room-and-object aware knowledge reasoning for remote embodied referring expression

C Gao, J Chen, S Liu, L Wang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract The Remote Embodied Referring Expression (REVERIE) is a recently raised task
that requires an agent to navigate to and localise a referred remote object according to a …

Visual navigation with spatial attention

B Mayo, T Hazan, A Tal - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
This work focuses on object goal visual navigation, aiming at finding the location of an object
from a given class, where in each step the agent is provided with an egocentric RGB image …

Scene graph contrastive learning for embodied navigation

KP Singh, J Salvador, L Weihs… - Proceedings of the …, 2023 - openaccess.thecvf.com
Training effective embodied AI agents often involves expert imitation, specialized
components such as maps, or leveraging additional sensors for depth and localization …