In this work we present Digital Life Project a framework utilizing language as the universal
medium to build autonomous 3D characters who are capable of engaging in social …

To represent people in mixed reality applications for collaboration and communication, we
need to generate realistic and faithful avatar poses. However, the signal streams that can be …

While camera-based capture systems remain the gold standard for recording human motion,
learning-based tracking systems based on sparse wearable sensors are gaining popularity …

Generating both plausible and accurate full body avatar motion is the key to the quality of
immersive experiences in mixed reality scenarios. Head-Mounted Devices (HMDs) typically …

Objective: Marker-based motion capture, considered the gold standard in human motion
analysis, is expensive and requires trained personnel. Advances in inertial sensing and …

We introduce a novel task within the field of 3D dance generation, termed dance
accompaniment, which necessitates the generation of responsive movements from a dance …

Human plays a key role in metaverse and digital twin systems and thus live three-
dimensional (3D) human shape reconstruction brings significant improvement for highly …

It is especially challenging to achieve real-time human motion tracking on a standalone VR
Head-Mounted Display (HMD) such as Meta Quest and PICO. In this paper we propose …

Ultra-high precision motion sensing leveraging computer vision (CV) is a key technology in
many high-precision AR/VR applications such as precise industrial manufacture and image …

Abstract Real-time optical Motion Capture (MoCap) systems have not benefited from the
advances in modern data-driven modeling. In this work we apply machine learning to solve …