Mofusion: A framework for denoising-diffusion-based motion synthesis

R Dabral, MH Mughal, V Golyanik… - Proceedings of the …, 2023 - openaccess.thecvf.com
Conventional methods for human motion synthesis have either been deterministic or have
had to struggle with the trade-off between motion diversity vs motion quality. In response to …

Avatars grow legs: Generating smooth human motion from sparse tracking inputs with diffusion model

Y Du, R Kips, A Pumarola, S Starke… - Proceedings of the …, 2023 - openaccess.thecvf.com
With the recent surge in popularity of AR/VR applications, realistic and accurate control of
3D full-body avatars has become a highly demanded feature. A particular challenge is that …

Ego-body pose estimation via ego-head pose estimation

J Li, K Liu, J Wu - Proceedings of the IEEE/CVF Conference …, 2023 - openaccess.thecvf.com
Estimating 3D human motion from an egocentric video sequence plays a critical role in
human behavior understanding and has various applications in VR/AR. However, naively …

Humaniflow: Ancestor-conditioned normalising flows on so (3) manifolds for human pose and shape distribution estimation

A Sengupta, I Budvytis… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Monocular 3D human pose and shape estimation is an ill-posed problem since multiple 3D
solutions can explain a 2D image of a subject. Recent approaches predict a probability …

A Survey on 3D Egocentric Human Pose Estimation

MM Azam, K Desai - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Egocentric human pose estimation aims to estimate human body poses and develop body
representations from a first-person camera perspective. It has gained vast popularity in …

Realistic full-body tracking from sparse observations via joint-level modeling

X Zheng, Z Su, C Wen, Z Xue… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
To bridge the physical and virtual worlds for rapidly developed VR/AR applications, the
ability to realistically drive 3D full-body avatars is of great significance. Although real-time …

Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Camera

J Lee, H Joo - Proceedings of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
We present a lightweight and affordable motion capture method based on two smartwatches
and a head-mounted camera. In contrast to the existing approaches that use six or more …

From Method to Application: A Review of Deep 3D Human Motion Capture

Z Niu, K Lu, J Xue, X Qin, J Wang… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Motion capture technology is crucial in various applications like animation, virtual reality and
sports analysis. With the development of deep learning methods, significant progress has …

Hmd-nemo: Online 3d avatar motion generation from sparse observations

S Aliakbarian, F Saleh, D Collier… - Proceedings of the …, 2023 - openaccess.thecvf.com
Generating both plausible and accurate full body avatar motion is the key to the quality of
immersive experiences in mixed reality scenarios. Head-Mounted Devices (HMDs) typically …

Bodiffusion: Diffusing sparse observations for full-body human motion synthesis

A Castillo, M Escobar, G Jeanneret… - Proceedings of the …, 2023 - openaccess.thecvf.com
Mixed reality applications require tracking the user's full-body motion to enable an
immersive experience. However, typical head-mounted devices can only track head and …