State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Codetalker: Speech-driven 3d facial animation with discrete motion prior

J **ng, M **a, Y Zhang, X Cun… - Proceedings of the …, 2023 - openaccess.thecvf.com
Speech-driven 3D facial animation has been widely studied, yet there is still a gap to
achieving realism and vividness due to the highly ill-posed nature and scarcity of audio …

Learning an animatable detailed 3D face model from in-the-wild images

Y Feng, H Feng, MJ Black, T Bolkart - ACM Transactions on Graphics …, 2021 - dl.acm.org
While current monocular 3D face reconstruction methods can recover fine geometric details,
they suffer several limitations. Some methods produce faces that cannot be realistically …

Dynamic neural radiance fields for monocular 4d facial avatar reconstruction

G Gafni, J Thies, M Zollhofer… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present dynamic neural radiance fields for modeling the appearance and dynamics of a
human face. Digitally modeling and reconstructing a talking human is a key building-block …

Neural head avatars from monocular rgb videos

PW Grassal, M Prinzler, T Leistner… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Neural Head Avatars, a novel neural representation that explicitly
models the surface geometry and appearance of an animatable human avatar that can be …

[PDF][PDF] Learning a model of facial shape and expression from 4D scans.

T Li, T Bolkart, MJ Black, H Li, J Romero - ACM Trans. Graph., 2017 - 3dvar.com
Learning a model of facial shape and expression from 4D scans Page 1 Learning a model
of facial shape and expression from 4D scans TIANYE LI∗†, University of Southern …

Facescape: a large-scale high quality 3d face dataset and detailed riggable 3d face prediction

H Yang, H Zhu, Y Wang, M Huang… - Proceedings of the …, 2020 - openaccess.thecvf.com
In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and propose a
novel algorithm that is able to predict elaborate riggable 3D face models from a single image …

Total capture: A 3d deformation model for tracking faces, hands, and bodies

H Joo, T Simon, Y Sheikh - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
We present a unified deformation model for the markerless capture of multiple scales of
human movement, including facial expressions, body motion, and hand gestures. An initial …

Face2face: Real-time face capture and reenactment of rgb videos

J Thies, M Zollhofer, M Stamminger… - Proceedings of the …, 2016 - openaccess.thecvf.com
We present a novel approach for real-time facial reenactment of a monocular target video
sequence (eg, Youtube video). The source sequence is also a monocular video stream …

3D approaches and challenges in facial expression recognition algorithms—a literature review

F Nonis, N Dagnes, F Marcolin, E Vezzetti - Applied Sciences, 2019 - mdpi.com
In recent years, facial expression analysis and recognition (FER) have emerged as an active
research topic with applications in several different areas, including the human-computer …