Reconstructing hands in 3d with transformers

G Pavlakos, D Shan, I Radosavovic… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present an approach that can reconstruct hands in 3D from monocular input. Our
approach for Hand Mesh Recovery HaMeR follows a fully transformer-based architecture …

A dataset of relighted 3D interacting hands

G Moon, S Saito, W Xu, R Joshi… - Advances in …, 2023 - proceedings.neurips.cc
The two-hand interaction is one of the most challenging signals to analyze due to the self-
similarity, complicated articulations, and occlusions of hands. Although several datasets …

gsdf: Geometry-driven signed distance functions for 3d hand-object reconstruction

Z Chen, S Chen, C Schmid… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Signed distance functions (SDFs) is an attractive framework that has recently shown
promising results for 3D shape reconstruction from images. SDFs seamlessly generalize to …

Bringing inputs to shared domains for 3D interacting hands recovery in the wild

G Moon - Proceedings of the IEEE/CVF conference on …, 2023 - openaccess.thecvf.com
Despite recent achievements, existing 3D interacting hands recovery methods have shown
results mainly on motion capture (MoCap) environments, not on in-the-wild (ITW) ones. This …

A2j-transformer: Anchor-to-joint transformer network for 3d interacting hand pose estimation from a single rgb image

C Jiang, Y **ao, C Wu, M Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract 3D interacting hand pose estimation from a single RGB image is a challenging task,
due to serious self-occlusion and inter-occlusion towards hands, confusing similar …

Reconstructing interacting hands with interaction prior from monocular images

B Zuo, Z Zhao, W Sun, W **e… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reconstructing interacting hands from monocular images is indispensable in AR/VR
applications. Most existing solutions rely on the accurate localization of each skeleton joint …

Challenges and solutions for vision-based hand gesture interpretation: A review

K Gao, H Zhang, X Liu, X Wang, L **e, B Ji… - Computer Vision and …, 2024 - Elsevier
Hand gesture is one of the most efficient and natural interfaces in current human–computer
interaction (HCI) systems. Despite the great progress achieved in hand gesture-based HCI …

Hierarchical temporal transformer for 3D hand pose estimation and action recognition from egocentric RGB videos

Y Wen, H Pan, L Yang, J Pan… - Proceedings of the …, 2023 - openaccess.thecvf.com
Understanding dynamic hand motions and actions from egocentric RGB videos is a
fundamental yet challenging task due to self-occlusion and ambiguity. To address occlusion …

Decoupled iterative refinement framework for interacting hands reconstruction from a single rgb image

P Ren, C Wen, X Zheng, Z Xue, H Sun… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reconstructing interacting hands from a single RGB image is a very challenging task. On the
one hand, severe mutual occlusion and similar local appearance between two hands …

Renderih: A large-scale synthetic dataset for 3d interacting hand pose estimation

L Li, L Tian, X Zhang, Q Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
The current interacting hand (IH) datasets are relatively simplistic in terms of background
and texture, with hand joints being annotated by a machine annotator, which may result in …