State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Gaussian head avatar: Ultra high-fidelity head avatar via dynamic gaussians

Y Xu, B Chen, Z Li, H Zhang, L Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Creating high-fidelity 3D head avatars has always been a research hotspot but there
remains a great challenge under lightweight sparse view setups. In this paper we propose …

Relightable gaussian codec avatars

S Saito, G Schwartz, T Simon, J Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
The fidelity of relighting is bounded by both geometry and appearance representations. For
geometry both mesh and volumetric approaches have difficulty modeling intricate structures …

Authentic volumetric avatars from a phone scan

C Cao, T Simon, JK Kim, G Schwartz… - ACM Transactions on …, 2022 - dl.acm.org
Creating photorealistic avatars of existing people currently requires extensive person-
specific data capture, which is usually only accessible to the VFX industry and not the …

Total capture: A 3d deformation model for tracking faces, hands, and bodies

H Joo, T Simon, Y Sheikh - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
We present a unified deformation model for the markerless capture of multiple scales of
human movement, including facial expressions, body motion, and hand gestures. An initial …

Dreamface: Progressive generation of animatable 3d faces under text guidance

L Zhang, Q Qiu, H Lin, Q Zhang, C Shi, W Yang… - arxiv preprint arxiv …, 2023 - arxiv.org
Emerging Metaverse applications demand accessible, accurate, and easy-to-use tools for
3D digital human creations in order to depict different cultures and societies as if in the …

AvatarMe: Realistically Renderable 3D Facial Reconstruction" in-the-wild"

A Lattas, S Moschoglou, B Gecer… - Proceedings of the …, 2020 - openaccess.thecvf.com
Over the last years, with the advent of Generative Adversarial Networks (GANs), many face
analysis tasks have accomplished astounding performance, with applications including, but …

Monogaussianavatar: Monocular gaussian point-based head avatar

Y Chen, L Wang, Q Li, H **ao, S Zhang… - ACM SIGGRAPH 2024 …, 2024 - dl.acm.org
The ability to animate photo-realistic head avatars reconstructed from monocular portrait
video sequences represents a crucial step in bridging the gap between the virtual and real …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

A benchmark dataset and evaluation for non-lambertian and uncalibrated photometric stereo

B Shi, Z Wu, Z Mo, D Duan… - Proceedings of the …, 2016 - openaccess.thecvf.com
Recent progress on photometric stereo extends the technique to deal with general materials
and unknown illumination conditions. However, due to the lack of suitable benchmark data …