Ego-exo4d: Understanding skilled human activity from first-and third-person perspectives

K Grauman, A Westbury, L Torresani… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract We present Ego-Exo4D a diverse large-scale multimodal multiview video dataset
and benchmark challenge. Ego-Exo4D centers around simultaneously-captured egocentric …

Controllable human-object interaction synthesis

J Li, A Clegg, R Mottaghi, J Wu, X Puig… - European Conference on …, 2024 - Springer
Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate
realistic human behaviors. In this work, we address the challenging problem of generating …

Object motion guided human motion synthesis

J Li, J Wu, CK Liu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
Modeling human behaviors in contextual environments has a wide range of applications in
character animation, embodied AI, VR/AR, and robotics. In real-world scenarios, humans …

Optimizing diffusion noise can serve as universal motion priors

K Karunratanakul, K Preechakul… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract We propose Diffusion Noise Optimization (DNO) a new method that effectively
leverages existing motion diffusion models as motion priors for a wide range of motion …

Nymeria: A massive collection of multimodal egocentric daily motion in the wild

L Ma, Y Ye, F Hong, V Guzov, Y Jiang… - … on Computer Vision, 2024 - Springer
We introduce Nymeria-a large-scale, diverse, richly annotated human motion dataset
collected in the wild with multiple multimodal egocentric devices. The dataset comes with a) …

Egolocate: Real-time motion capture, localization, and map** with sparse body-mounted sensors

X Yi, Y Zhou, M Habermann, V Golyanik… - ACM Transactions on …, 2023 - dl.acm.org
Human and environment sensing are two important topics in Computer Vision and Graphics.
Human motion is often captured by inertial sensors, while the environment is mostly …

3d human pose perception from egocentric stereo videos

H Akada, J Wang, V Golyanik… - Proceedings of the …, 2024 - openaccess.thecvf.com
While head-mounted devices are becoming more compact they provide egocentric views
with significant self-occlusions of the device user. Hence existing methods often fail to …

An outlook into the future of egocentric vision

C Plizzari, G Goletto, A Furnari, S Bansal… - International Journal of …, 2024 - Springer
What will the future be? We wonder! In this survey, we explore the gap between current
research in egocentric vision and the ever-anticipated future, where wearable computing …

Generative proxemics: A prior for 3d social interaction from images

L Müller, V Ye, G Pavlakos, M Black… - Proceedings of the …, 2024 - openaccess.thecvf.com
Social interaction is a fundamental aspect of human behavior and communication. The way
individuals position themselves in relation to others also known as proxemics conveys social …

EgoExo-Fitness: towards egocentric and exocentric full-body action understanding

YM Li, WJ Huang, AL Wang, LA Zeng, JK Meng… - … on Computer Vision, 2024 - Springer
Abstract We present EgoExo-Fitness, a new full-body action understanding dataset,
featuring fitness sequence videos recorded from synchronized egocentric and fixed …