State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

A Survey of Non‐Rigid 3D Registration

B Deng, Y Yao, RM Dyke, J Zhang - Computer Graphics Forum, 2022 - Wiley Online Library
Non‐rigid registration computes an alignment between a source surface with a target
surface in a non‐rigid manner. In the past decade, with the advances in 3D sensing …

Codetalker: Speech-driven 3d facial animation with discrete motion prior

J **ng, M **a, Y Zhang, X Cun… - Proceedings of the …, 2023 - openaccess.thecvf.com
Speech-driven 3D facial animation has been widely studied, yet there is still a gap to
achieving realism and vividness due to the highly ill-posed nature and scarcity of audio …

Learning an animatable detailed 3D face model from in-the-wild images

Y Feng, H Feng, MJ Black, T Bolkart - ACM Transactions on Graphics …, 2021 - dl.acm.org
While current monocular 3D face reconstruction methods can recover fine geometric details,
they suffer several limitations. Some methods produce faces that cannot be realistically …

Dynamic neural radiance fields for monocular 4d facial avatar reconstruction

G Gafni, J Thies, M Zollhofer… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present dynamic neural radiance fields for modeling the appearance and dynamics of a
human face. Digitally modeling and reconstructing a talking human is a key building-block …

Neural head avatars from monocular rgb videos

PW Grassal, M Prinzler, T Leistner… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Neural Head Avatars, a novel neural representation that explicitly
models the surface geometry and appearance of an animatable human avatar that can be …

Towards metrical reconstruction of human faces

W Zielonka, T Bolkart, J Thies - European conference on computer vision, 2022 - Springer
Face reconstruction and tracking is a building block of numerous applications in AR/VR,
human-machine interaction, as well as medical applications. Most of these applications rely …

Authentic volumetric avatars from a phone scan

C Cao, T Simon, JK Kim, G Schwartz… - ACM Transactions on …, 2022 - dl.acm.org
Creating photorealistic avatars of existing people currently requires extensive person-
specific data capture, which is usually only accessible to the VFX industry and not the …

Deep video portraits

H Kim, P Garrido, A Tewari, W Xu, J Thies… - ACM transactions on …, 2018 - dl.acm.org
We present a novel approach that enables photo-realistic re-animation of portrait videos
using only an input video. In contrast to existing approaches that are restricted to …

[PDF][PDF] Learning a model of facial shape and expression from 4D scans.

T Li, T Bolkart, MJ Black, H Li, J Romero - ACM Trans. Graph., 2017 - 3dvar.com
Learning a model of facial shape and expression from 4D scans Page 1 Learning a model
of facial shape and expression from 4D scans TIANYE LI∗†, University of Southern …