Differentiable rendering: A survey

H Kato, D Beker, M Morariu, T Ando… - arxiv preprint arxiv …, 2020 - arxiv.org
Deep neural networks (DNNs) have shown remarkable performance improvements on
vision-related tasks such as object detection or image segmentation. Despite their success …

State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

[PDF][PDF] Practice and theory of blendshape facial models.

JP Lewis, K Anjyo, T Rhee, M Zhang… - … (State of the Art …, 2014 - scribblethink.org
Abstract “Blendshapes”, a simple linear model of facial expression, is the prevalent
approach to realistic facial animation. It has driven animated characters in Hollywood films …

Facial performance sensing head-mounted display

H Li, L Trutoiu, K Olszewski, L Wei, T Trutna… - ACM Transactions on …, 2015 - dl.acm.org
There are currently no solutions for enabling direct face-to-face interaction between virtual
reality (VR) users wearing head-mounted displays (HMDs). The main challenge is that the …

High-fidelity facial and speech animation for VR HMDs

K Olszewski, JJ Lim, S Saito, H Li - ACM Transactions on Graphics (TOG), 2016 - dl.acm.org
Significant challenges currently prohibit expressive interaction in virtual reality (VR).
Occlusions introduced by head-mounted displays (HMDs) make existing facial tracking …

Real-time facial segmentation and performance capture from rgb input

S Saito, T Li, H Li - Computer Vision–ECCV 2016: 14th European …, 2016 - Springer
We introduce the concept of unconstrained real-time 3D facial performance capture through
explicit semantic segmentation in the RGB input. To ensure robustness, cutting edge …

Production-level facial performance capture using deep convolutional neural networks

S Laine, T Karras, T Aila, A Herva, S Saito… - Proceedings of the …, 2017 - dl.acm.org
We present a real-time deep learning framework for video-based facial performance capture-
--the dense 3D tracking of an actor's face given a monocular video. Our pipeline begins with …

Local anatomically-constrained facial performance retargeting

P Chandran, L Ciccone, M Gross… - ACM Transactions on …, 2022 - dl.acm.org
Generating realistic facial animation for CG characters and digital doubles is one of the
hardest tasks in animation. A typical production workflow involves capturing the performance …

A survey on the pipeline evolution of facial capture and tracking for digital humans

C Vilchis, C Perez-Guerrero, M Mendez-Ruiz… - Multimedia …, 2023 - Springer
With the introduction of concepts for virtual interaction and digital doubles, a rich scenario
has been created for embodied avatars to strive. These avatars, more recently referred to as …

An Implicit Physical Face Model Driven by Expression and Style

L Yang, G Zoss, P Chandran, P Gotardo… - SIGGRAPH Asia 2023 …, 2023 - dl.acm.org
3D facial animation is often produced by manipulating facial deformation models (or rigs),
that are traditionally parameterized by expression controls. A key component that is usually …