State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Learning an animatable detailed 3D face model from in-the-wild images

Y Feng, H Feng, MJ Black, T Bolkart - ACM Transactions on Graphics …, 2021 - dl.acm.org
While current monocular 3D face reconstruction methods can recover fine geometric details,
they suffer several limitations. Some methods produce faces that cannot be realistically …

[HTML][HTML] Survey on 3D face reconstruction from uncalibrated images

A Morales, G Piella, FM Sukno - Computer Science Review, 2021 - Elsevier
Recently, a lot of attention has been focused on the incorporation of 3D data into face
analysis and its applications. Despite providing a more accurate representation of the face …

Live speech portraits: real-time photorealistic talking-head animation

Y Lu, J Chai, X Cao - ACM Transactions on Graphics (ToG), 2021 - dl.acm.org
To the best of our knowledge, we first present a live system that generates personalized
photorealistic talking-head animation only driven by audio signals at over 30 fps. Our system …

Deep video portraits

H Kim, P Garrido, A Tewari, W Xu, J Thies… - ACM transactions on …, 2018 - dl.acm.org
We present a novel approach that enables photo-realistic re-animation of portrait videos
using only an input video. In contrast to existing approaches that are restricted to …

[PDF][PDF] Learning a model of facial shape and expression from 4D scans.

T Li, T Bolkart, MJ Black, H Li, J Romero - ACM Trans. Graph., 2017 - 3dvar.com
Learning a model of facial shape and expression from 4D scans Page 1 Learning a model
of facial shape and expression from 4D scans TIANYE LI∗†, University of Southern …

Face2face: Real-time face capture and reenactment of rgb videos

J Thies, M Zollhofer, M Stamminger… - Proceedings of the …, 2016 - openaccess.thecvf.com
We present a novel approach for real-time facial reenactment of a monocular target video
sequence (eg, Youtube video). The source sequence is also a monocular video stream …

Text-based editing of talking-head video

O Fried, A Tewari, M Zollhöfer, A Finkelstein… - ACM Transactions on …, 2019 - dl.acm.org
Editing talking-head video to change the speech content or to remove filler words is
challenging. We propose a novel method to edit talking-head video based on its transcript to …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

[PDF][PDF] Real-time expression transfer for facial reenactment.

J Thies, M Zollhöfer, M Nießner, L Valgaerts… - ACM Trans …, 2015 - niessnerlab.org
We present a method for the real-time transfer of facial expressions from an actor in a source
video to an actor in a target video, thus enabling the ad-hoc control of the facial expressions …