Language-driven physics-based scene synthesis and editing via feature splatting

RZ Qiu, G Yang, W Zeng, X Wang - European Conference on Computer …, 2024 - Springer
Scene representations using 3D Gaussian primitives have produced excellent results in
modeling the appearance of static and dynamic 3D scenes. Many graphics applications …

[PDF][PDF] Gendp: 3d semantic fields for category-level generalizable diffusion policy

Y Wang, G Yin, B Huang, T Kelestemur… - … Annual Conference on …, 2024 - robopil.github.io
• Generalizable Representation: Some existing semantic fields or representations are
trained on small-scale datasets and are challenging to transfer to novel scenes or object …

[PDF][PDF] Roboduet: A framework affording mobile-manipulation and crossembodiment

G Pan, Q Ben, Z Yuan, G Jiang, Y Ji… - arxiv preprint arxiv …, 2024 - locomanip-duet.github.io
Combining the mobility of legged robots with the manipulation skills of arms has the
potential to significantly expand the operational range and enhance the capabilities of …

Verifiably following complex robot instructions with foundation models

B Quartey, E Rosen, S Tellex, G Konidaris - arxiv preprint arxiv …, 2024 - arxiv.org
Enabling mobile robots to follow complex natural language instructions is an important yet
challenging problem. People want to flexibly express constraints, refer to arbitrary landmarks …

Openobj: Open-vocabulary object-level neural radiance fields with fine-grained understanding

Y Deng, J Wang, J Zhao, J Dou… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
In recent years, there has been a surge of interest in open-vocabulary 3D scene
reconstruction facilitated by visual language models (VLMs), which showcase remarkable …

Neural Fields in Robotics: A Survey

MZ Irshad, M Comi, YC Lin, N Heppert… - arxiv preprint arxiv …, 2024 - arxiv.org
Neural Fields have emerged as a transformative approach for 3D scene representation in
computer vision and robotics, enabling accurate inference of geometry, 3D semantics, and …

Nl-slam for oc-vln: Natural language grounded slam for object-centric vln

S Raychaudhuri, D Ta, K Ashton, AX Chang… - arxiv preprint arxiv …, 2024 - arxiv.org
Landmark-based navigation (eg go to the wooden desk) and relative positional navigation
(eg move 5 meters forward) are distinct navigation challenges solved very differently in …

TidyBot++: An Open-Source Holonomic Mobile Manipulator for Robot Learning

J Wu, W Chong, R Holmberg, A Prasad, Y Gao… - arxiv preprint arxiv …, 2024 - arxiv.org
Exploiting the promise of recent advances in imitation learning for mobile manipulation will
require the collection of large numbers of human-guided demonstrations. This paper …