State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

[PDF][PDF] Real-time expression transfer for facial reenactment.

J Thies, M Zollhöfer, M Nießner, L Valgaerts… - ACM Trans …, 2015 - niessnerlab.org
We present a method for the real-time transfer of facial expressions from an actor in a source
video to an actor in a target video, thus enabling the ad-hoc control of the facial expressions …

Online modeling for real-time facial animation

S Bouaziz, M Pauly - US Patent 9,378,576, 2016 - Google Patents
Embodiments relate to a method for real-time facial anima tion, and a processing device for
real-time facial animation. The method includes providing a dynamic expression model …

Displaced dynamic expression regression for real-time facial tracking and animation

C Cao, Q Hou, K Zhou - ACM Transactions on graphics (TOG), 2014 - dl.acm.org
We present a fully automatic approach to real-time facial tracking and animation with a
single video camera. Our approach does not need any calibration for each individual user. It …

Realtime performance-based facial animation

T Weise, S Bouaziz, H Li, M Pauly - ACM transactions on graphics (TOG), 2011 - dl.acm.org
This paper presents a system for performance-based character animation that enables any
user to control the facial expressions of a digital avatar in realtime. The user is recorded in a …

[PDF][PDF] Practice and theory of blendshape facial models.

JP Lewis, K Anjyo, T Rhee, M Zhang… - … (State of the Art …, 2014 - scribblethink.org
Abstract “Blendshapes”, a simple linear model of facial expression, is the prevalent
approach to realistic facial animation. It has driven animated characters in Hollywood films …

3D shape regression for real-time facial animation

C Cao, Y Weng, S Lin, K Zhou - ACM Transactions on Graphics (TOG), 2013 - dl.acm.org
We present a real-time performance-driven facial animation system based on 3D shape
regression. In this system, the 3D positions of facial landmark points are inferred by a …

Face transfer with multilinear models

D Vlasic, M Brand, H Pfister, J Popovic - ACM SIGGRAPH 2006 Courses, 2006 - dl.acm.org
Face Transfer is a method for map** videorecorded performances of one individual to
facial animations of another. It extracts visemes (speech-related mouth articulations) …

Real-time high-fidelity facial performance capture

C Cao, D Bradley, K Zhou, T Beeler - ACM Transactions on Graphics …, 2015 - dl.acm.org
We present the first real-time high-fidelity facial capture method. The core idea is to enhance
a global real-time face tracker, which provides a low-resolution face mesh, with local …