Relightable gaussian codec avatars

S Saito, G Schwartz, T Simon, J Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
The fidelity of relighting is bounded by both geometry and appearance representations. For
geometry both mesh and volumetric approaches have difficulty modeling intricate structures …

Nerfactor: Neural factorization of shape and reflectance under an unknown illumination

X Zhang, PP Srinivasan, B Deng, P Debevec… - ACM Transactions on …, 2021 - dl.acm.org
We address the problem of recovering the shape and spatially-varying reflectance of an
object from multi-view images (and their camera poses) of an object illuminated by one …

Nerv: Neural reflectance and visibility fields for relighting and view synthesis

PP Srinivasan, B Deng, X Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present a method that takes as input a set of images of a scene illuminated by
unconstrained known lighting, and produces as output a 3D representation that can be …

Physg: Inverse rendering with spherical gaussians for physics-based material editing and relighting

K Zhang, F Luan, Q Wang, K Bala… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present an end-to-end inverse rendering pipeline that includes a fully differentiable
renderer, and can reconstruct geometry, materials, and illumination from scratch from a set …

Neumesh: Learning disentangled neural mesh-based implicit field for geometry and texture editing

B Yang, C Bao, J Zeng, H Bao, Y Zhang, Z Cui… - … on Computer Vision, 2022 - Springer
Very recently neural implicit rendering techniques have been rapidly evolved and shown
great advantages in novel view synthesis and 3D scene reconstruction. However, existing …

Nero: Neural geometry and brdf reconstruction of reflective objects from multiview images

Y Liu, P Wang, C Lin, X Long, J Wang, L Liu… - ACM Transactions on …, 2023 - dl.acm.org
We present a neural rendering-based method called NeRO for reconstructing the geometry
and the BRDF of reflective objects from multiview images captured in an unknown …

Relight my nerf: A dataset for novel view synthesis and relighting of real world objects

M Toschi, R De Matteo, R Spezialetti… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we focus on the problem of rendering novel views from a Neural Radiance
Field (NeRF) under unobserved light conditions. To this end, we introduce a novel dataset …

Relighting neural radiance fields with shadow and highlight hints

C Zeng, G Chen, Y Dong, P Peers, H Wu… - ACM SIGGRAPH 2023 …, 2023 - dl.acm.org
This paper presents a novel neural implicit radiance representation for free viewpoint
relighting from a small set of unstructured photographs of an object lit by a moving point light …

Nemf: Inverse volume rendering with neural microflake field

Y Zhang, T Xu, J Yu, Y Ye, Y **g… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recovering the physical attributes of an object's appearance from its images captured under
an unknown illumination is challenging yet essential for photo-realistic rendering. Recent …

Dilightnet: Fine-grained lighting control for diffusion-based image generation

C Zeng, Y Dong, P Peers, Y Kong, H Wu… - ACM SIGGRAPH 2024 …, 2024 - dl.acm.org
This paper presents a novel method for exerting fine-grained lighting control during text-
driven diffusion-based image generation. While existing diffusion models already have the …