State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Dynamic neural radiance fields for monocular 4d facial avatar reconstruction

G Gafni, J Thies, M Zollhofer… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present dynamic neural radiance fields for modeling the appearance and dynamics of a
human face. Digitally modeling and reconstructing a talking human is a key building-block …

Neural head avatars from monocular rgb videos

PW Grassal, M Prinzler, T Leistner… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Neural Head Avatars, a novel neural representation that explicitly
models the surface geometry and appearance of an animatable human avatar that can be …

Face2face: Real-time face capture and reenactment of rgb videos

J Thies, M Zollhofer, M Stamminger… - Proceedings of the …, 2016 - openaccess.thecvf.com
We present a novel approach for real-time facial reenactment of a monocular target video
sequence (eg, Youtube video). The source sequence is also a monocular video stream …

Deep alignment network: A convolutional neural network for robust face alignment

M Kowalski, J Naruniec… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
In this paper, we propose Deep Alignment Network (DAN), a robust face alignment method
based on a deep neural network architecture. DAN consists of multiple stages, where each …

Near‐eye display and tracking technologies for virtual and augmented reality

GA Koulieris, K Akşit, M Stengel… - Computer Graphics …, 2019 - Wiley Online Library
Virtual and augmented reality (VR/AR) are expected to revolutionise entertainment,
healthcare, communication and the manufacturing industries among many others. Near‐eye …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

[PDF][PDF] Real-time expression transfer for facial reenactment.

J Thies, M Zollhöfer, M Nießner, L Valgaerts… - ACM Trans …, 2015 - niessnerlab.org
We present a method for the real-time transfer of facial expressions from an actor in a source
video to an actor in a target video, thus enabling the ad-hoc control of the facial expressions …

Learning mid-level features for recognition

YL Boureau, F Bach, Y LeCun… - 2010 IEEE computer …, 2010 - ieeexplore.ieee.org
Many successful models for scene or object recognition transform low-level descriptors
(such as Gabor filter responses, or SIFT descriptors) into richer representations of …

Reconstruction of personalized 3D face rigs from monocular video

P Garrido, M Zollhöfer, D Casas, L Valgaerts… - ACM Transactions on …, 2016 - dl.acm.org
We present a novel approach for the automatic creation of a personalized high-quality 3D
face rig of an actor from just monocular video data (eg, vintage movies). Our rig is based on …