Real-world robot applications of foundation models: A review

K Kawaharazuka, T Matsushima… - Advanced …, 2024 - Taylor & Francis
Recent developments in foundation models, like Large Language Models (LLMs) and Vision-
Language Models (VLMs), trained on extensive data, facilitate flexible application across …

Toward general-purpose robots via foundation models: A survey and meta-analysis

Y Hu, Q **e, V Jain, J Francis, J Patrikar… - arxiv preprint arxiv …, 2023 - arxiv.org
Building general-purpose robots that operate seamlessly in any environment, with any
object, and utilizing various skills to complete diverse tasks has been a long-standing goal in …

Deep learning based 3D segmentation: A survey

Y He, H Yu, X Liu, Z Yang, W Sun, S Anwar… - arxiv preprint arxiv …, 2021 - arxiv.org
3D segmentation is a fundamental and challenging problem in computer vision with
applications in autonomous driving and robotics. It has received significant attention from the …

Clio: Real-Time Task-Driven Open-Set 3D Scene Graphs

D Maggio, Y Chang, N Hughes, M Trang… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
Modern tools for class-agnostic image segmentation (eg, SegmentAnything) and open-set
semantic understanding (eg, CLIP) provide unprecedented opportunities for robot …

When llms step into the 3d world: A survey and meta-analysis of 3d tasks via multi-modal large language models

X Ma, Y Bhalgat, B Smart, S Chen, X Li, J Ding… - arxiv preprint arxiv …, 2024 - arxiv.org
As large language models (LLMs) evolve, their integration with 3D spatial data (3D-LLMs)
has seen rapid progress, offering unprecedented capabilities for understanding and …

Maskclustering: View consensus based mask graph clustering for open-vocabulary 3d instance segmentation

M Yan, J Zhang, Y Zhu, H Wang - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Open-vocabulary 3D instance segmentation is cutting-edge for its ability to segment 3D
instances without predefined categories. However progress in 3D lags behind its 2D …

Deep learning based 3D segmentation in computer vision: A survey

Y He, H Yu, X Liu, Z Yang, W Sun, S Anwar, A Mian - Information Fusion, 2025 - Elsevier
Abstract 3D segmentation is a fundamental and challenging problem in computer vision with
applications in autonomous driving and robotics. It has received significant attention from the …

Neural Fields in Robotics: A Survey

MZ Irshad, M Comi, YC Lin, N Heppert… - arxiv preprint arxiv …, 2024 - arxiv.org
Neural Fields have emerged as a transformative approach for 3D scene representation in
computer vision and robotics, enabling accurate inference of geometry, 3D semantics, and …

R-Bench: Benchmarking the Robustness of Referring Perception Models Under Perturbations

X Li, K Qiu, J Wang, X Xu, R Singh, K Yamazaki… - … on Computer Vision, 2024 - Springer
Referring perception, which aims at grounding visual objects with multimodal referring
guidance, is essential for bridging the gap between humans, who provide instructions, and …

Unlocking Robotic Autonomy: A Survey on the Applications of Foundation Models

DS Jang, DH Cho, WC Lee, SK Ryu, B Jeong… - International Journal of …, 2024 - Springer
The advancement of foundation models, such as large language models (LLMs), vision-
language models (VLMs), diffusion models, and robotics foundation models (RFMs), has …