Humans in 4D: Reconstructing and tracking humans with transformers

S Goel, G Pavlakos, J Rajasegaran… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present an approach to reconstruct humans and track them over time. At the core of our
approach, we propose a fully" transformerized" version of a network for human mesh …

Human motion diffusion as a generative prior

Y Shafir, G Tevet, R Kapon, AH Bermano - arxiv preprint arxiv:2303.01418, 2023 - arxiv.org
Recent work has demonstrated the significant potential of denoising diffusion models for
generating human motion, including text-to-motion capabilities. However, these methods are …

Nifty: Neural object interaction fields for guided human motion synthesis

N Kulkarni, D Rempe, K Genova… - Proceedings of the …, 2024 - openaccess.thecvf.com
We address the problem of generating realistic 3D motions of humans interacting with
objects in a scene. Our key idea is to create a neural interaction field attached to a specific …

NIKI: Neural inverse kinematics with invertible neural networks for 3d human pose and shape estimation

J Li, S Bian, Q Liu, J Tang… - Proceedings of the …, 2023 - openaccess.thecvf.com
With the progress of 3D human pose and shape estimation, state-of-the-art methods can
either be robust to occlusions or obtain pixel-aligned accuracy in non-occlusion cases …

Monohuman: Animatable human neural field from monocular video

Z Yu, W Cheng, X Liu, W Wu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Animating virtual avatars with free-view control is crucial for various applications like virtual
reality and digital entertainment. Previous studies have attempted to utilize the …

Decoupling human and camera motion from videos in the wild

V Ye, G Pavlakos, J Malik… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a method to reconstruct global human trajectories from videos in the wild. Our
optimization method decouples the camera and human motion, which allows us to place …

Gfpose: Learning 3d human pose prior with gradient fields

H Ci, M Wu, W Zhu, X Ma, H Dong… - Proceedings of the …, 2023 - openaccess.thecvf.com
Learning 3D human pose prior is essential to human-centered AI. Here, we present GFPose,
a versatile framework to model plausible 3D human poses for various applications. At the …

Visibility aware human-object interaction tracking from single rgb camera

X **e, BL Bhatnagar… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Capturing the interactions between humans and their environment in 3D is important for
many applications in robotics, graphics, and vision. Recent works to reconstruct the 3D …

Refit: Recurrent fitting network for 3d human recovery

Y Wang, K Daniilidis - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Abstract We present Recurrent Fitting (ReFit), a neural network architecture for single-image,
parametric 3D human reconstruction. ReFit learns a feedback-update loop that mirrors the …

Nsf: Neural surface fields for human modeling from monocular depth

Y Xue, BL Bhatnagar, R Marin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Obtaining personalized 3D animatable avatars from a monocular camera has several real
world applications in gaming, virtual try-on, animation, and VR/XR, etc. However, it is very …