[HTML][HTML] DILF: Differentiable rendering-based multi-view Image–Language Fusion for zero-shot 3D shape understanding

X Ning, Z Yu, L Li, W Li, P Tiwari - Information Fusion, 2024 - Elsevier
Zero-shot 3D shape understanding aims to recognize “unseen” 3D categories that are not
present in training data. Recently, Contrastive Language–Image Pre-training (CLIP) has …

Recursive control variates for inverse rendering

B Nicolet, F Rousselle, J Novak, A Keller… - ACM Transactions on …, 2023 - dl.acm.org
We present a method for reducing errors---variance and bias---in physically based
differentiable rendering (PBDR). Typical applications of PBDR repeatedly render a scene as …

Neural-PBIR reconstruction of shape, material, and illumination

C Sun, G Cai, Z Li, K Yan, C Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reconstructing the shape and spatially varying surface appearances of a physical-world
object as well as its surrounding illumination based on 2D images (eg, photographs) of the …

Factorized inverse path tracing for efficient and accurate material-lighting estimation

L Wu, R Zhu, MB Yaldiz, Y Zhu, H Cai… - Proceedings of the …, 2023 - openaccess.thecvf.com
Inverse path tracing has recently been applied to joint material and lighting estimation, given
geometry and multi-view HDR observations of an indoor scene. However, it has two major …

Rasterized Edge Gradients: Handling Discontinuities Differentiably

S Pidhorskyi, T Simon, G Schwartz, H Wen… - … on Computer Vision, 2024 - Springer
Computing the gradients of a rendering process is paramount for diverse applications in
computer vision and graphics. However, accurate computation of these gradients is …

RNA: Relightable Neural Assets

K Mullia, F Luan, X Sun, M Hašan - ACM Transactions on Graphics, 2024 - dl.acm.org
High-fidelity 3D assets with materials composed of fibers (including hair), complex layered
material shaders, or fine scattering geometry are critical in high-end realistic rendering …

Projective sampling for differentiable rendering of geometry

Z Zhang, N Roussel, W Jakob - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
Discontinuous visibility changes at object boundaries remain a persistent source of difficulty
in the area of differentiable rendering. Left untreated, they bias computed gradients so …

Plateau-reduced differentiable path tracing

M Fischer, T Ritschel - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Current differentiable renderers provide light transport gradients with respect to arbitrary
scene parameters. However, the mere existence of these gradients does not guarantee …

Eclipse: Disambiguating illumination and materials using unintended shadows

D Verbin, B Mildenhall, P Hedman… - Proceedings of the …, 2024 - openaccess.thecvf.com
Decomposing an object's appearance into representations of its materials and the
surrounding illumination is difficult even when the object's 3D shape is known beforehand …

Warped-area reparameterization of differential path integrals

P Xu, S Bangaru, TM Li, S Zhao - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
Physics-based differentiable rendering is becoming increasingly crucial for tasks in inverse
rendering and machine learning pipelines. To address discontinuities caused by geometric …