Next-generation deep learning based on simulators and synthetic data

CM de Melo, A Torralba, L Guibas, J DiCarlo… - Trends in cognitive …, 2022 - cell.com
Deep learning (DL) is being successfully applied across multiple domains, yet these models
learn in a most artificial way: they require large quantities of labeled data to grasp even …

Block-nerf: Scalable large scene neural view synthesis

M Tancik, V Casser, X Yan, S Pradhan… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Block-NeRF, a variant of Neural Radiance Fields that can represent
large-scale environments. Specifically, we demonstrate that when scaling NeRF to render …

Hexplane: A fast representation for dynamic scenes

A Cao, J Johnson - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Modeling and re-rendering dynamic 3D scenes is a challenging task in 3D vision. Prior
approaches build on NeRF and rely on implicit representations. This is slow since it requires …

Instruct-nerf2nerf: Editing 3d scenes with instructions

A Haque, M Tancik, AA Efros… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a
scene and the collection of images used to reconstruct it, our method uses an image …

Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields

JT Barron, B Mildenhall, M Tancik… - Proceedings of the …, 2021 - openaccess.thecvf.com
The rendering procedure used by neural radiance fields (NeRF) samples a scene with a
single ray per pixel and may therefore produce renderings that are excessively blurred or …

Kilonerf: Speeding up neural radiance fields with thousands of tiny mlps

C Reiser, S Peng, Y Liao… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
NeRF synthesizes novel views of a scene with unprecedented quality by fitting a neural
radiance field to RGB images. However, NeRF requires querying a deep Multi-Layer …

Decomposing nerf for editing via feature field distillation

S Kobayashi, E Matsumoto… - Advances in Neural …, 2022 - proceedings.neurips.cc
Emerging neural radiance fields (NeRF) are a promising scene representation for computer
graphics, enabling high-quality 3D reconstruction and novel view synthesis from image …

Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d

Y Liao, J **e, A Geiger - IEEE Transactions on Pattern Analysis …, 2022 - ieeexplore.ieee.org
For the last few decades, several major subfields of artificial intelligence including computer
vision, graphics, and robotics have progressed largely independently from each other …

Panoptic neural fields: A semantic object-aware neural scene representation

A Kundu, K Genova, X Yin, A Fathi… - Proceedings of the …, 2022 - openaccess.thecvf.com
We present PanopticNeRF, an object-aware neural scene representation that decomposes
a scene into a set of objects (things) and background (stuff). Each object is represented by a …

Unisim: A neural closed-loop sensor simulator

Z Yang, Y Chen, J Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Rigorously testing autonomy systems is essential for making safe self-driving vehicles (SDV)
a reality. It requires one to generate safety critical scenarios beyond what can be collected …