3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

[PDF][PDF] Extreme 3D Face Reconstruction: Seeing Through Occlusions.

AT Tran, T Hassner, I Masi, E Paz, Y Nirkin… - CVPR, 2018 - openaccess.thecvf.com
Existing single view, 3D face reconstruction methods can produce beautifully detailed 3D
results, but typically only for near frontal, unobstructed viewpoints. We describe a system …

High-fidelity facial reflectance and geometry inference from an unconstrained image

S Yamaguchi, S Saito, K Nagano, Y Zhao… - ACM Transactions on …, 2018 - dl.acm.org
We present a deep learning-based technique to infer high-quality facial reflectance and
geometry given a single unconstrained image of the subject, which may contain partial …

Learning physics-guided face relighting under directional light

T Nestmeyer, JF Lalonde, I Matthews… - Proceedings of the …, 2020 - openaccess.thecvf.com
Relighting is an essential step in realistically transferring objects from a captured image into
another environment. For example, authentic telepresence in Augmented Reality requires …

Photorealistic facial texture inference using deep neural networks

S Saito, L Wei, L Hu, K Nagano… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
We present a data-driven inference method that can synthesize a photorealistic texture map
of a complete 3D face model given a partial 2D view of a person in the wild. After an initial …

Face relighting with geometrically consistent shadows

A Hou, M Sarkis, N Bi, Y Tong… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Most face relighting methods are able to handle diffuse shadows, but struggle to handle
hard shadows, such as those cast by the nose. Methods that propose techniques for …

Towards high fidelity monocular face reconstruction with rich reflectance using self-supervised learning and ray tracing

A Dib, C Thebault, J Ahn, PH Gosselin… - Proceedings of the …, 2021 - openaccess.thecvf.com
Robust face reconstruction from monocular image in general lighting conditions is
challenging. Methods combining deep neural network encoders with differentiable …

Towards high fidelity face relighting with realistic shadows

A Hou, Z Zhang, M Sarkis, N Bi… - Proceedings of the …, 2021 - openaccess.thecvf.com
Existing face relighting methods often struggle with two problems: maintaining the local
facial details of the subject and accurately removing and synthesizing shadows in the relit …

Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image

Y Mei, Y Zeng, H Zhang, Z Shu… - Proceedings of the …, 2024 - openaccess.thecvf.com
At the core of portrait photography is the search for ideal lighting and viewpoint. The process
often requires advanced knowledge in photography and an elaborate studio setup. In this …

LightPainter: interactive portrait relighting with freehand scribble

Y Mei, H Zhang, X Zhang, J Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent portrait relighting methods have achieved realistic results of portrait lighting effects
given a desired lighting representation such as an environment map. However, these …