Ego-exo4d: Understanding skilled human activity from first-and third-person perspectives
Abstract We present Ego-Exo4D a diverse large-scale multimodal multiview video dataset
and benchmark challenge. Ego-Exo4D centers around simultaneously-captured egocentric …
and benchmark challenge. Ego-Exo4D centers around simultaneously-captured egocentric …
Controllable human-object interaction synthesis
Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate
realistic human behaviors. In this work, we address the challenging problem of generating …
realistic human behaviors. In this work, we address the challenging problem of generating …
Object motion guided human motion synthesis
Modeling human behaviors in contextual environments has a wide range of applications in
character animation, embodied AI, VR/AR, and robotics. In real-world scenarios, humans …
character animation, embodied AI, VR/AR, and robotics. In real-world scenarios, humans …
Optimizing diffusion noise can serve as universal motion priors
Abstract We propose Diffusion Noise Optimization (DNO) a new method that effectively
leverages existing motion diffusion models as motion priors for a wide range of motion …
leverages existing motion diffusion models as motion priors for a wide range of motion …
Nymeria: A massive collection of multimodal egocentric daily motion in the wild
We introduce Nymeria-a large-scale, diverse, richly annotated human motion dataset
collected in the wild with multiple multimodal egocentric devices. The dataset comes with a) …
collected in the wild with multiple multimodal egocentric devices. The dataset comes with a) …
Egolocate: Real-time motion capture, localization, and map** with sparse body-mounted sensors
Human and environment sensing are two important topics in Computer Vision and Graphics.
Human motion is often captured by inertial sensors, while the environment is mostly …
Human motion is often captured by inertial sensors, while the environment is mostly …
3d human pose perception from egocentric stereo videos
While head-mounted devices are becoming more compact they provide egocentric views
with significant self-occlusions of the device user. Hence existing methods often fail to …
with significant self-occlusions of the device user. Hence existing methods often fail to …
An outlook into the future of egocentric vision
What will the future be? We wonder! In this survey, we explore the gap between current
research in egocentric vision and the ever-anticipated future, where wearable computing …
research in egocentric vision and the ever-anticipated future, where wearable computing …
Generative proxemics: A prior for 3d social interaction from images
Social interaction is a fundamental aspect of human behavior and communication. The way
individuals position themselves in relation to others also known as proxemics conveys social …
individuals position themselves in relation to others also known as proxemics conveys social …
EgoExo-Fitness: towards egocentric and exocentric full-body action understanding
Abstract We present EgoExo-Fitness, a new full-body action understanding dataset,
featuring fitness sequence videos recorded from synchronized egocentric and fixed …
featuring fitness sequence videos recorded from synchronized egocentric and fixed …