Recovering 3d human mesh from monocular images: A survey

Y Tian, H Zhang, Y Liu, L Wang - IEEE transactions on pattern …, 2023 - ieeexplore.ieee.org
Estimating human pose and shape from monocular images is a long-standing problem in
computer vision. Since the release of statistical body models, 3D human mesh recovery has …

Differentiable rendering: A survey

H Kato, D Beker, M Morariu, T Ando… - arxiv preprint arxiv …, 2020 - arxiv.org
Deep neural networks (DNNs) have shown remarkable performance improvements on
vision-related tasks such as object detection or image segmentation. Despite their success …

Emoca: Emotion driven monocular face capture and animation

R Daněček, MJ Black, T Bolkart - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
As 3D facial avatars become more widely used for communication, it is critical that they
faithfully convey emotion. Unfortunately, the best recent methods that regress parametric 3D …

Learning an animatable detailed 3D face model from in-the-wild images

Y Feng, H Feng, MJ Black, T Bolkart - ACM Transactions on Graphics …, 2021 - dl.acm.org
While current monocular 3D face reconstruction methods can recover fine geometric details,
they suffer several limitations. Some methods produce faces that cannot be realistically …

Nerf: Representing scenes as neural radiance fields for view synthesis

B Mildenhall, PP Srinivasan, M Tancik… - Communications of the …, 2021 - dl.acm.org
We present a method that achieves state-of-the-art results for synthesizing novel views of
complex scenes by optimizing an underlying continuous volumetric scene function using a …

Multiview neural surface reconstruction by disentangling geometry and appearance

L Yariv, Y Kasten, D Moran, M Galun… - Advances in …, 2020 - proceedings.neurips.cc
In this work we address the challenging problem of multiview 3D surface reconstruction. We
introduce a neural network architecture that simultaneously learns the unknown geometry …

Differentiable volumetric rendering: Learning implicit 3d representations without 3d supervision

M Niemeyer, L Mescheder… - Proceedings of the …, 2020 - openaccess.thecvf.com
Learning-based 3D reconstruction methods have shown impressive results. However, most
methods require 3D supervision which is often hard to obtain for real-world datasets …

Adop: Approximate differentiable one-pixel point rendering

D Rückert, L Franke, M Stamminger - ACM Transactions on Graphics …, 2022 - dl.acm.org
In this paper we present ADOP, a novel point-based, differentiable neural rendering
pipeline. Like other neural renderers, our system takes as input calibrated camera images …

Mixture of volumetric primitives for efficient neural rendering

S Lombardi, T Simon, G Schwartz… - ACM Transactions on …, 2021 - dl.acm.org
Real-time rendering and animation of humans is a core function in games, movies, and
telepresence applications. Existing methods have a number of drawbacks we aim to …

Stylerig: Rigging stylegan for 3d control over portrait images

A Tewari, M Elgharib, G Bharaj… - Proceedings of the …, 2020 - openaccess.thecvf.com
StyleGAN generates photorealistic portrait images of faces with eyes, teeth, hair and context
(neck, shoulders, background), but lacks a rig-like control over semantic face parameters …