Synbody: Synthetic dataset with layered human models for 3d human perception and modeling

Z Yang, Z Cai, H Mei, S Liu, Z Chen… - Proceedings of the …, 2023 - openaccess.thecvf.com
Synthetic data has emerged as a promising source for 3D human research as it offers low-
cost access to large-scale human datasets. To advance the diversity and annotation quality …

Dancecamera3d: 3d camera movement synthesis with music and dance

Z Wang, J Jia, S Sun, H Wu, R Han… - Proceedings of the …, 2024 - openaccess.thecvf.com
Choreographers determine what the dances look like while cameramen determine the final
presentation of dances. Recently various methods and datasets have showcased the …

Whac: World-grounded humans and cameras

W Yin, Z Cai, R Wang, F Wang, C Wei, H Mei… - … on Computer Vision, 2024 - Springer
Estimating human and camera trajectories with accurate scale in the world coordinate
system from a monocular video is a highly desirable yet challenging and ill-posed problem …

Cinematic behavior transfer via nerf-based differentiable filming

X Jiang, A Rao, J Wang, D Lin… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
In the evolving landscape of digital media and video production the precise manipulation
and reproduction of visual elements like camera movements and character actions are …

CinePreGen: Camera Controllable Video Previsualization via Engine-powered Diffusion

Y Chen, A Rao, X Jiang, S **ao, R Ma, Z Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
With advancements in video generative AI models (eg, SORA), creators are increasingly
using these techniques to enhance video previsualization. However, they face challenges …

ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Database

A Rao, JP Chou, M Agrawala - Proceedings of the 37th Annual ACM …, 2024 - dl.acm.org
Scriptwriters usually rely on their mental visualization to create a vivid story by using their
imagination to see, feel, and experience the scenes they are writing. Besides mental …

Embodied Human Activity Recognition

S Hu, Y Gong, G Mori - Proceedings of the IEEE/CVF Winter …, 2024 - openaccess.thecvf.com
We study how to utilize the mobility of an embodied agent to improve its ability to recognize
human activities. We introduce the embodied human activity recognition problem, where an …