End-to-end autonomous driving: Challenges and frontiers

L Chen, P Wu, K Chitta, B Jaeger… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The autonomous driving community has witnessed a rapid growth in approaches that
embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle …

Transfuser: Imitation with transformer-based sensor fusion for autonomous driving

K Chitta, A Prakash, B Jaeger, Z Yu… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
How should we integrate representations from complementary sensors for autonomous
driving? Geometry-based fusion has shown promise for perception (eg, object detection …

Multi-modal fusion transformer for end-to-end autonomous driving

A Prakash, K Chitta, A Geiger - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
How should representations from complementary sensors be integrated for autonomous
driving? Geometry-based sensor fusion has shown great promise for perception tasks such …

Parting with misconceptions about learning-based vehicle motion planning

D Dauner, M Hallgarten, A Geiger… - Conference on Robot …, 2023 - proceedings.mlr.press
The release of nuPlan marks a new era in vehicle motion planning research, offering the first
large-scale real-world dataset and evaluation schemes requiring both precise short-term …

Hidden biases of end-to-end driving models

B Jaeger, K Chitta, A Geiger - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
End-to-end driving systems have recently made rapid progress, in particular on CARLA.
Independent of their major contribution, they introduce changes to minor system …

Neat: Neural attention fields for end-to-end autonomous driving

K Chitta, A Prakash, A Geiger - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Efficient reasoning about the semantic, spatial, and temporal structure of a scene is a crucial
prerequisite for autonomous driving. We present NEural ATtention fields (NEAT), a novel …

End-to-end urban driving by imitating a reinforcement learning coach

Z Zhang, A Liniger, D Dai, F Yu… - Proceedings of the …, 2021 - openaccess.thecvf.com
End-to-end approaches to autonomous driving commonly rely on expert demonstrations.
Although humans are good drivers, they are not good coaches for end-to-end algorithms …

Plant: Explainable planning transformers via object-level representations

K Renz, K Chitta, OB Mercea, A Koepke… - arxiv preprint arxiv …, 2022 - arxiv.org
Planning an optimal route in a complex environment requires efficient reasoning about the
surrounding scene. While human drivers prioritize important objects and ignore details not …

Adapt: Action-aware driving caption transformer

B **, X Liu, Y Zheng, P Li, H Zhao… - … on Robotics and …, 2023 - ieeexplore.ieee.org
End-to-end autonomous driving has great potential in the transportation industry. However,
the lack of transparency and interpretability of the automatic decision-making process …

King: Generating safety-critical driving scenarios for robust imitation via kinematics gradients

N Hanselmann, K Renz, K Chitta… - … on Computer Vision, 2022 - Springer
Simulators offer the possibility of safe, low-cost development of self-driving systems.
However, current driving simulators exhibit naïve behavior models for background traffic …