Next-generation deep learning based on simulators and synthetic data

CM de Melo, A Torralba, L Guibas, J DiCarlo… - Trends in cognitive …, 2022 - cell.com
Deep learning (DL) is being successfully applied across multiple domains, yet these models
learn in a most artificial way: they require large quantities of labeled data to grasp even …

A survey on visual traffic simulation: Models, evaluations, and applications in autonomous driving

Q Chao, H Bi, W Li, T Mao, Z Wang… - Computer Graphics …, 2020 - Wiley Online Library
Virtualized traffic via various simulation models and real‐world traffic data are promising
approaches to reconstruct detailed traffic flows. A variety of applications can benefit from the …

Training deep networks with synthetic data: Bridging the reality gap by domain randomization

J Tremblay, A Prakash, D Acuna… - Proceedings of the …, 2018 - openaccess.thecvf.com
We present a system for training deep neural networks for object detection using synthetic
images. To handle the variability in real-world data, the system relies upon the technique of …

Deep object pose estimation for semantic robotic gras** of household objects

J Tremblay, T To, B Sundaralingam, Y **ang… - arxiv preprint arxiv …, 2018 - arxiv.org
Using synthetic data for training deep neural networks for robotic manipulation holds the
promise of an almost unlimited amount of pre-labeled training data, generated safely out of …

[BOOK][B] Synthetic data for deep learning

SI Nikolenko - 2021 - Springer
You are holding in your hands… oh, come on, who holds books like this in their hands
anymore? Anyway, you are reading this, and it means that I have managed to release one of …

Infinite photorealistic worlds using procedural generation

A Raistrick, L Lipson, Z Ma, L Mei… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural
world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from …

Auxiliary tasks in multi-task learning

L Liebel, M Körner - arxiv preprint arxiv:1805.06334, 2018 - arxiv.org
Multi-task convolutional neural networks (CNNs) have shown impressive results for certain
combinations of tasks, such as single-image depth estimation (SIDE) and semantic …

Driving policy transfer via modularity and abstraction

M Müller, A Dosovitskiy, B Ghanem, V Koltun - arxiv preprint arxiv …, 2018 - arxiv.org
End-to-end approaches to autonomous driving have high sample complexity and are difficult
to scale to realistic urban driving. Simulation can help end-to-end driving systems by …

Structured domain randomization: Bridging the reality gap by context-aware synthetic data

A Prakash, S Boochoon, M Brophy… - … on Robotics and …, 2019 - ieeexplore.ieee.org
We present structured domain randomization (SDR), a variant of domain randomization
(DR) that takes into account the structure of the scene in order to add context to the …

Synscapes: A photorealistic synthetic dataset for street scene parsing

M Wrenninge, J Unger - arxiv preprint arxiv:1810.08705, 2018 - arxiv.org
We introduce Synscapes--a synthetic dataset for street scene parsing created using
photorealistic rendering techniques, and show state-of-the-art results for training and …