Towards zero domain gap: A comprehensive study of realistic lidar simulation for autonomy testing

S Manivasagam, IA Bârsan, J Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Testing the full autonomy system in simulation is the safest and most scalable way to
evaluate autonomous vehicle performance before deployment. This requires simulating …

Topological planning with transformers for vision-and-language navigation

K Chen, JK Chen, J Chuang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Conventional approaches to vision-and-language navigation (VLN) are trained end-to-end
but struggle to perform well in freely traversable environments. Inspired by the robotics …

A survey of visual navigation: From geometry to embodied AI

T Zhang, X Hu, J **ao, G Zhang - Engineering Applications of Artificial …, 2022 - Elsevier
The capacity to extract information and comprehend an unseen environment is critical for
mobile robots to navigate. Few surveys has mentioned the combinatorial-non-optimality …

Position: Towards unified alignment between agents, humans, and environment

Z Yang, A Liu, Z Liu, K Liu, F **ong, Y Wang… - … on Machine Learning, 2024 - openreview.net
The rapid progress of foundation models has led to the prosperity of autonomous agents,
which leverage the universal capabilities of foundation models to conduct reasoning …

Towards unified alignment between agents, humans, and environment

Z Yang, A Liu, Z Liu, K Liu, F **ong, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The rapid progress of foundation models has led to the prosperity of autonomous agents,
which leverage the universal capabilities of foundation models to conduct reasoning …

Visuomotor mechanical search: Learning to retrieve target objects in clutter

A Kurenkov, J Taglic, R Kulkarni… - 2020 IEEE/RSJ …, 2020 - ieeexplore.ieee.org
When searching for objects in cluttered environments, it is often necessary to perform
complex interactions in order to move occluding objects out of the way and fully reveal the …

D5rl: Diverse datasets for data-driven deep reinforcement learning

R Rafailov, K Hatch, A Singh, L Smith, A Kumar… - arxiv preprint arxiv …, 2024 - arxiv.org
Offline reinforcement learning algorithms hold the promise of enabling data-driven RL
methods that do not require costly or dangerous real-world exploration and benefit from …

Are we there yet? learning to localize in embodied instruction following

S Storks, Q Gao, G Thattai, G Tur - arxiv preprint arxiv:2101.03431, 2021 - arxiv.org
Embodied instruction following is a challenging problem requiring an agent to infer a
sequence of primitive actions to achieve a goal environment state from complex language …

Spatio-temporal graph localization networks for image-based navigation

T Niwa, S Taguchi, N Hirose - 2022 IEEE/RSJ International …, 2022 - ieeexplore.ieee.org
Localization in topological maps is essential for image-based navigation using an RGB
camera. Localization using only one camera can be challenging in medium-to-large-sized …

Localizing against drawn maps via spline-based registration

K Chen, M Vázquez, S Savarese - 2020 IEEE/RSJ International …, 2020 - ieeexplore.ieee.org
We propose a method to facilitate robot navigation relative to sketched maps of human
environments. Our main contribution centers around using thin plate splines for registering …