Unisim: A neural closed-loop sensor simulator

Z Yang, Y Chen, J Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Rigorously testing autonomy systems is essential for making safe self-driving vehicles (SDV)
a reality. It requires one to generate safety critical scenarios beyond what can be collected …

Street gaussians: Modeling dynamic urban scenes with gaussian splatting

Y Yan, H Lin, C Zhou, W Wang, H Sun, K Zhan… - … on Computer Vision, 2024 - Springer
This paper aims to tackle the problem of modeling dynamic urban streets for autonomous
driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to …

Editable scene simulation for autonomous driving via collaborative llm-agents

Y Wei, Z Wang, Y Lu, C Xu, C Liu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Scene simulation in autonomous driving has gained significant attention because of its huge
potential for generating customized data. However existing editable scene simulation …

Neural fields meet explicit geometric representations for inverse rendering of urban scenes

Z Wang, T Shen, J Gao, S Huang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reconstruction and intrinsic decomposition of scenes from captured imagery would enable
many applications such as relighting and virtual object insertion. Recent NeRF based …

Everlight: Indoor-outdoor editable hdr lighting estimation

MRK Dastjerdi, J Eisenmann… - Proceedings of the …, 2023 - openaccess.thecvf.com
Because of the diversity in lighting environments, existing illumination estimation techniques
have been designed explicitly on indoor or outdoor environments. Methods have focused …

BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation

Y Ge, Y Tang, J Xu, C Gokmen, C Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
The systematic evaluation and understanding of computer vision models under varying
conditions require large amounts of data with comprehensive and customized labels which …

Lift3d: Synthesize 3d training data by lifting 2d gan to 3d generative radiance field

L Li, Q Lian, L Wang, N Ma… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
This work explores the use of 3D generative models to synthesize training data for 3D vision
tasks. The key requirements of the generative models are that the generated data should be …

3d copy-paste: Physically plausible object insertion for monocular 3d detection

Y Ge, HX Yu, C Zhao, Y Guo, X Huang… - Advances in …, 2023 - proceedings.neurips.cc
A major challenge in monocular 3D object detection is the limited diversity and quantity of
objects in real datasets. While augmenting real scenes with virtual objects holds promise to …

Reconstructing objects in-the-wild for realistic sensor simulation

Z Yang, S Manivasagam, Y Chen… - … on Robotics and …, 2023 - ieeexplore.ieee.org
Reconstructing objects from real world data and rendering them at novel views is critical to
bringing realism, diversity and scale to simulation for robotics training and testing. In this …

Neural lighting simulation for urban scenes

A Pun, G Sun, J Wang, Y Chen… - Advances in …, 2023 - proceedings.neurips.cc
Different outdoor illumination conditions drastically alter the appearance of urban scenes,
and they can harm the performance of image-based robot perception systems if not seen …