Humans in 4D: Reconstructing and tracking humans with transformers

S Goel, G Pavlakos, J Rajasegaran… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present an approach to reconstruct humans and track them over time. At the core of our
approach, we propose a fully" transformerized" version of a network for human mesh …

Bedlam: A synthetic dataset of bodies exhibiting detailed lifelike animated motion

MJ Black, P Patel, J Tesch… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We show, for the first time, that neural networks trained only on synthetic data achieve state-
of-the-art accuracy on the problem of 3D human pose and shape (HPS) estimation from real …

Decoupling human and camera motion from videos in the wild

V Ye, G Pavlakos, J Malik… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a method to reconstruct global human trajectories from videos in the wild. Our
optimization method decouples the camera and human motion, which allows us to place …

TRACE: 5D temporal regression of avatars with dynamic cameras in 3D environments

Y Sun, Q Bao, W Liu, T Mei… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Although the estimation of 3D human pose and shape (HPS) is rapidly progressing, current
methods still cannot reliably estimate moving humans in global coordinates, which is critical …

Visibility aware human-object interaction tracking from single rgb camera

X **e, BL Bhatnagar… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Capturing the interactions between humans and their environment in 3D is important for
many applications in robotics, graphics, and vision. Recent works to reconstruct the 3D …

On the benefits of 3d pose and tracking for human action recognition

J Rajasegaran, G Pavlakos… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work we study the benefits of using tracking and 3D poses for action recognition. To
achieve this, we take the Lagrangian view on analysing actions over a trajectory of human …

Multi-hmr: Multi-person whole-body human mesh recovery in a single shot

F Baradel, M Armando, S Galaaoui, R Brégier… - … on Computer Vision, 2024 - Springer
We present Multi-HMR, a strong single-shot model for multi-person 3D human mesh
recovery from a single RGB image. Predictions encompass the whole body, ie., including …

Trackflow: Multi-object tracking with normalizing flows

G Mancusi, A Panariello, A Porrello… - Proceedings of the …, 2023 - openaccess.thecvf.com
The field of multi-object tracking has recently seen a renewed interest in the good old
schema of tracking-by-detection, as its simplicity and strong priors spare it from the complex …

TEMPO: Efficient multi-view pose estimation, tracking, and forecasting

R Choudhury, KM Kitani… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Existing volumetric methods for predicting 3D human pose estimation are accurate, but
computationally expensive and optimized for single time-step prediction. We present …

Motionchain: Conversational motion controllers via multimodal prompts

B Jiang, X Chen, C Zhang, F Yin, Z Li, G Yu… - European Conference on …, 2024 - Springer
Recent advancements in language models have demonstrated their adeptness in
conducting multi-turn dialogues and retaining conversational context. However, this …