Next-generation deep learning based on simulators and synthetic data

CM de Melo, A Torralba, L Guibas, J DiCarlo… - Trends in cognitive …, 2022 - cell.com
Deep learning (DL) is being successfully applied across multiple domains, yet these models
learn in a most artificial way: they require large quantities of labeled data to grasp even …

3d object detection from images for autonomous driving: a survey

X Ma, W Ouyang, A Simonelli… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
3D object detection from images, one of the fundamental and challenging problems in
autonomous driving, has received increasing attention from both industry and academia in …

Instruct-nerf2nerf: Editing 3d scenes with instructions

A Haque, M Tancik, AA Efros… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a
scene and the collection of images used to reconstruct it, our method uses an image …

Hexplane: A fast representation for dynamic scenes

A Cao, J Johnson - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Modeling and re-rendering dynamic 3D scenes is a challenging task in 3D vision. Prior
approaches build on NeRF and rely on implicit representations. This is slow since it requires …

Unisim: A neural closed-loop sensor simulator

Z Yang, Y Chen, J Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Rigorously testing autonomy systems is essential for making safe self-driving vehicles (SDV)
a reality. It requires one to generate safety critical scenarios beyond what can be collected …

Gaussian grou**: Segment and edit anything in 3d scenes

M Ye, M Danelljan, F Yu, L Ke - European Conference on Computer …, 2024 - Springer
Abstract The recent Gaussian Splatting achieves high-quality and real-time novel-view
synthesis of the 3D scenes. However, it is solely concentrated on the appearance and …

Street gaussians: Modeling dynamic urban scenes with gaussian splatting

Y Yan, H Lin, C Zhou, W Wang, H Sun, K Zhan… - … on Computer Vision, 2024 - Springer
This paper aims to tackle the problem of modeling dynamic urban streets for autonomous
driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to …

Drivinggaussian: Composite gaussian splatting for surrounding dynamic autonomous driving scenes

X Zhou, Z Lin, X Shan, Y Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present DrivingGaussian an efficient and effective framework for surrounding dynamic
autonomous driving scenes. For complex scenes with moving objects we first sequentially …

Suds: Scalable urban dynamic scenes

H Turki, JY Zhang, F Ferroni… - Proceedings of the …, 2023 - openaccess.thecvf.com
We extend neural radiance fields (NeRFs) to dynamic large-scale urban scenes. Prior work
tends to reconstruct single video clips of short durations (up to 10 seconds). Two reasons …

Decomposing nerf for editing via feature field distillation

S Kobayashi, E Matsumoto… - Advances in Neural …, 2022 - proceedings.neurips.cc
Emerging neural radiance fields (NeRF) are a promising scene representation for computer
graphics, enabling high-quality 3D reconstruction and novel view synthesis from image …