Hugs: Human gaussian splats

M Kocabas, JHR Chang, J Gabriel… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recent advances in neural rendering have improved both training and rendering times by
orders of magnitude. While these methods demonstrate state-of-the-art quality and speed …

Deep learning for 3d human pose estimation and mesh recovery: A survey

Y Liu, C Qiu, Z Zhang - Neurocomputing, 2024 - Elsevier
Abstract 3D human pose estimation and mesh recovery have attracted widespread research
interest in many areas, such as computer vision, autonomous driving, and robotics. Deep …

Graspxl: Generating gras** motions for diverse objects at scale

H Zhang, S Christen, Z Fan, O Hilliges… - European Conference on …, 2024 - Springer
Human hands possess the dexterity to interact with diverse objects such as gras** specific
parts of the objects and/or approaching them from desired directions. More importantly …

Benchmarks and challenges in pose estimation for egocentric hand interactions with objects

Z Fan, T Ohkawa, L Yang, N Lin, Z Zhou, S Zhou… - … on Computer Vision, 2024 - Springer
We interact with the world with our hands and see it through our own (egocentric)
perspective. A holistic 3D understanding of such interactions from egocentric views is …

Gras** diverse objects with simulated humanoids

Z Luo, J Cao, S Christen, A Winkler, K Kitani… - arxiv preprint arxiv …, 2024 - arxiv.org
We present a method for controlling a simulated humanoid to grasp an object and move it to
follow an object trajectory. Due to the challenges in controlling a humanoid with dexterous …

Diffh2o: Diffusion-based synthesis of hand-object interactions from textual descriptions

S Christen, S Hampali, F Sener, E Remelli… - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
We introduce DiffH2O, a new diffusion-based framework for synthesizing realistic, dexterous
hand-object interactions from natural language. Our model employs a temporal two-stage …

Intertrack: Tracking human object interaction without object templates

X **e, JE Lenssen, G Pons-Moll - arxiv preprint arxiv:2408.13953, 2024 - arxiv.org
Tracking human object interaction from videos is important to understand human behavior
from the rapidly growing stream of video data. Previous video-based methods require …

SHOWMe: Robust object-agnostic hand-object 3D reconstruction from RGB video

A Swamy, V Leroy, P Weinzaepfel, F Baradel… - Computer Vision and …, 2024 - Elsevier
In this paper, we tackle the problem of detailed hand-object 3D reconstruction from
monocular video with unknown objects, for applications where the required accuracy and …

DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image

Q Wu, Z Dou, S Xu, S Shimada, C Wang, Z Yu… - arxiv preprint arxiv …, 2024 - arxiv.org
Reconstructing 3D hand-face interactions with deformations from a single image is a
challenging yet crucial task with broad applications in AR, VR, and gaming. The challenges …

Get a grip: Reconstructing hand-object stable grasps in egocentric videos

Z Zhu, D Damen - arxiv preprint arxiv:2312.15719, 2023 - arxiv.org
We propose the task of Hand-Object Stable Grasp Reconstruction (HO-SGR), the
reconstruction of frames during which the hand is stably holding the object. We first develop …