Shapellm: Universal 3d object understanding for embodied interaction

Z Qi, R Dong, S Zhang, H Geng, C Han, Z Ge… - … on Computer Vision, 2024 - Springer
This paper presents ShapeLLM, the first 3D Multimodal Large Language Model (LLM)
designed for embodied interaction, exploring a universal 3D object understanding with 3D …

Robo-abc: Affordance generalization beyond categories via semantic correspondence for robot manipulation

Y Ju, K Hu, G Zhang, G Zhang, M Jiang… - European Conference on …, 2024 - Springer
Enabling robotic manipulation that generalizes to out-of-distribution scenes is a crucial step
toward the open-world embodied intelligence. For human beings, this ability is rooted in the …

Manipllm: Embodied multimodal large language model for object-centric robotic manipulation

X Li, M Zhang, Y Geng, H Geng… - Proceedings of the …, 2024 - openaccess.thecvf.com
Robot manipulation relies on accurately predicting contact points and end-effector directions
to ensure successful operation. However learning-based robot manipulation trained on a …

Robot learning in the era of foundation models: A survey

X ** motions for diverse objects at scale
H Zhang, S Christen, Z Fan, O Hilliges… - European Conference on …, 2024 - Springer
Human hands possess the dexterity to interact with diverse objects such as gras** specific
parts of the objects and/or approaching them from desired directions. More importantly …

ArtiGrasp: Physically plausible synthesis of bi-manual dexterous gras** and articulation

H Zhang, S Christen, Z Fan, L Zheng… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We present ArtiGrasp, a novel method to synthesize bimanual hand-object interactions that
include gras** and articulation. This task is challenging due to the diversity of the global …

SemGrasp : Semantic Grasp Generation via Language Aligned Discretization

K Li, J Wang, L Yang, C Lu, B Dai - European Conference on Computer …, 2024 - Springer
Generating natural human grasps necessitates consideration of not just object geometry but
also semantic information. Solely depending on object shape for grasp generation confines …

Ram: Retrieval-based affordance transfer for generalizable zero-shot robotic manipulation

Y Kuang, J Ye, H Geng, J Mao, C Deng… - arxiv preprint arxiv …, 2024 - arxiv.org
This work proposes a retrieve-and-transfer framework for zero-shot robotic manipulation,
dubbed RAM, featuring generalizability across various objects, environments, and …

Empower dexterous robotic hand for human-centric smart manufacturing: A perception and skill learning perspective

B Gao, J Fan, P Zheng - Robotics and Computer-Integrated Manufacturing, 2025 - Elsevier
Recent rapid developments of dexterous robotic hands have greatly enhanced the
manipulative capabilities of robots, enabling them to perform industrial tasks in human-like …

Lessons from Learning to Spin" Pens"

J Wang, Y Yuan, H Che, H Qi, Y Ma, J Malik… - arxiv preprint arxiv …, 2024 - arxiv.org
In-hand manipulation of pen-like objects is an important skill in our daily lives, as many tools
such as hammers and screwdrivers are similarly shaped. However, current learning-based …