Neural operators for accelerating scientific simulations and design

K Azizzadenesheli, N Kovachki, Z Li… - Nature Reviews …, 2024 - nature.com
Scientific discovery and engineering design are currently limited by the time and cost of
physical experiments. Numerical simulations are an alternative approach but are usually …

Instruct-nerf2nerf: Editing 3d scenes with instructions

A Haque, M Tancik, AA Efros… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a
scene and the collection of images used to reconstruct it, our method uses an image …

Unisim: A neural closed-loop sensor simulator

Z Yang, Y Chen, J Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Rigorously testing autonomy systems is essential for making safe self-driving vehicles (SDV)
a reality. It requires one to generate safety critical scenarios beyond what can be collected …

Sugar: Surface-aligned gaussian splatting for efficient 3d mesh reconstruction and high-quality mesh rendering

A Guédon, V Lepetit - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
We propose a method to allow precise and extremely fast mesh extraction from 3D Gaussian
Splatting. Gaussian Splatting has recently become very popular as it yields realistic …

3d neural field generation using triplane diffusion

JR Shue, ER Chan, R Po, Z Ankner… - Proceedings of the …, 2023 - openaccess.thecvf.com
Diffusion models have emerged as the state-of-the-art for image generation, among other
tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural …

Relightable 3d gaussians: Realistic point cloud relighting with brdf decomposition and ray tracing

J Gao, C Gu, Y Lin, Z Li, H Zhu, X Cao, L Zhang… - … on Computer Vision, 2024 - Springer
In this paper, we present a novel differentiable point-based rendering framework to achieve
photo-realistic relighting. To make the reconstructed scene relightable, we enhance vanilla …

Block-nerf: Scalable large scene neural view synthesis

M Tancik, V Casser, X Yan, S Pradhan… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Block-NeRF, a variant of Neural Radiance Fields that can represent
large-scale environments. Specifically, we demonstrate that when scaling NeRF to render …

Efficient geometry-aware 3d generative adversarial networks

ER Chan, CZ Lin, MA Chan… - Proceedings of the …, 2022 - openaccess.thecvf.com
Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using
only collections of single-view 2D photographs has been a long-standing challenge …

Bakedsdf: Meshing neural sdfs for real-time view synthesis

L Yariv, P Hedman, C Reiser, D Verbin… - ACM SIGGRAPH 2023 …, 2023 - dl.acm.org
We present a method for reconstructing high-quality meshes of large unbounded real-world
scenes suitable for photorealistic novel view synthesis. We first optimize a hybrid neural …

Humannerf: Free-viewpoint rendering of moving people from monocular video

CY Weng, B Curless, PP Srinivasan… - Proceedings of the …, 2022 - openaccess.thecvf.com
We introduce a free-viewpoint rendering method--HumanNeRF--that works on a given
monocular video of a human performing complex body motions, eg a video from YouTube …