State of the Art in Dense Monocular Non‐Rigid 3D Reconstruction

E Tretschk, N Kairanda, M BR, R Dabral… - Computer Graphics …, 2023 - Wiley Online Library
Abstract 3D reconstruction of deformable (or non‐rigid) scenes from a set of monocular 2D
image observations is a long‐standing and actively researched area of computer vision and …

Gaussian head avatar: Ultra high-fidelity head avatar via dynamic gaussians

Y Xu, B Chen, Z Li, H Zhang, L Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Creating high-fidelity 3D head avatars has always been a research hotspot but there
remains a great challenge under lightweight sparse view setups. In this paper we propose …

Nersemble: Multi-view radiance field reconstruction of human heads

T Kirschstein, S Qian, S Giebenhain, T Walter… - ACM Transactions on …, 2023 - dl.acm.org
We focus on reconstructing high-fidelity radiance fields of human heads, capturing their
animations over time, and synthesizing re-renderings from novel viewpoints at arbitrary time …

Real-time radiance fields for single-image portrait view synthesis

A Trevithick, M Chan, M Stengel, E Chan… - ACM Transactions on …, 2023 - dl.acm.org
We present a one-shot method to infer and render a photorealistic 3D representation from a
single unposed image (eg, face portrait) in real-time. Given a single RGB input, our image …

Havatar: High-fidelity head avatar via facial model conditioned neural radiance field

X Zhao, L Wang, J Sun, H Zhang, J Suo… - ACM Transactions on …, 2023 - dl.acm.org
The problem of modeling an animatable 3D human head avatar under lightweight setups is
of significant importance but has not been well solved. Existing 3D representations either …

Learning neural parametric head models

S Giebenhain, T Kirschstein… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a novel 3D morphable model for complete human heads based on hybrid
neural fields. At the core of our model lies a neural parametric representation that …

Latentavatar: Learning latent expression code for expressive neural head avatar

Y Xu, H Zhang, L Wang, X Zhao, H Huang… - ACM SIGGRAPH 2023 …, 2023 - dl.acm.org
Existing approaches to animatable NeRF-based head avatars are either built upon face
templates or use the expression coefficients of templates as the driving signal. Despite the …

Headgas: Real-time animatable head avatars via 3d gaussian splatting

H Dhamo, Y Nie, A Moreau, J Song, R Shaw… - … on Computer Vision, 2024 - Springer
Abstract 3D head animation has seen major quality and runtime improvements over the last
few years, particularly empowered by the advances in differentiable rendering and neural …

Fitme: Deep photorealistic 3d morphable model avatars

A Lattas, S Moschoglou, S Ploumpis… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we introduce FitMe, a facial reflectance model and a differentiable rendering
optimization pipeline, that can be used to acquire high-fidelity renderable human avatars …

Renerf: Relightable neural radiance fields with nearfield lighting

Y Xu, G Zoss, P Chandran, M Gross… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent work on radiance fields and volumetric inverse rendering (eg, NeRFs) has provided
excellent results in building data-driven models of real scenes for novel view synthesis with …