Differentiable rendering: A survey

H Kato, D Beker, M Morariu, T Ando… - arxiv preprint arxiv …, 2020 - arxiv.org
Deep neural networks (DNNs) have shown remarkable performance improvements on
vision-related tasks such as object detection or image segmentation. Despite their success …

A comprehensive review of vision-based 3d reconstruction methods

L Zhou, G Wu, Y Zuo, X Chen, H Hu - Sensors, 2024 - mdpi.com
With the rapid development of 3D reconstruction, especially the emergence of algorithms
such as NeRF and 3DGS, 3D reconstruction has become a popular research topic in recent …

Relightable 3d gaussians: Realistic point cloud relighting with brdf decomposition and ray tracing

J Gao, C Gu, Y Lin, Z Li, H Zhu, X Cao, L Zhang… - … on Computer Vision, 2024 - Springer
In this paper, we present a novel differentiable point-based rendering framework to achieve
photo-realistic relighting. To make the reconstructed scene relightable, we enhance vanilla …

Advances in neural rendering

A Tewari, J Thies, B Mildenhall… - Computer Graphics …, 2022 - Wiley Online Library
Synthesizing photo‐realistic images and videos is at the heart of computer graphics and has
been the focus of decades of research. Traditionally, synthetic images of a scene are …

Physg: Inverse rendering with spherical gaussians for physics-based material editing and relighting

K Zhang, F Luan, Q Wang, K Bala… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present an end-to-end inverse rendering pipeline that includes a fully differentiable
renderer, and can reconstruct geometry, materials, and illumination from scratch from a set …

Intrinsic image diffusion for indoor single-view material estimation

P Kocsis, V Sitzmann… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract We present Intrinsic Image Diffusion a generative model for appearance
decomposition of indoor scenes. Given a single input view we sample multiple possible …

Differentiable signed distance function rendering

D Vicini, S Speierer, W Jakob - ACM Transactions on Graphics (TOG), 2022 - dl.acm.org
Physically-based differentiable rendering has recently emerged as an attractive new
technique for solving inverse problems that recover complete 3D scene representations from …

Mitsuba 2: A retargetable forward and inverse renderer

M Nimier-David, D Vicini, T Zeltner… - ACM Transactions on …, 2019 - dl.acm.org
Modern rendering systems are confronted with a dauntingly large and growing set of
requirements: in their pursuit of realism, physically based techniques must increasingly …

Differentiable vector graphics rasterization for editing and learning

TM Li, M Lukáč, M Gharbi, J Ragan-Kelley - ACM Transactions on …, 2020 - dl.acm.org
We introduce a differentiable rasterizer that bridges the vector graphics and raster image
domains, enabling powerful raster-based loss functions, optimization procedures, and …

Neilf: Neural incident light field for physically-based material estimation

Y Yao, J Zhang, J Liu, Y Qu, T Fang… - European conference on …, 2022 - Springer
We present a differentiable rendering framework for material and lighting estimation from
multi-view images and a reconstructed geometry. In the framework, we represent scene …