KIT | KIT-Bibliothek | Impressum | Datenschutz

Minimizing Safety Interference for Safe and Comfortable Automated Driving with Distributional Reinforcement Learning

Kamran, Danial; Engelgeh, Tizian; Busch, Marvin; Fischer, Johannes ORCID iD icon; Stiller, Christoph

Abstract:

Despite recent advances in reinforcement learning (RL), its application in safety critical domains like autonomous vehicles is still challenging. Although penalizing RL agents for risky situations can help to learn safe policies, it may also lead to highly conservative behavior. In this paper, we propose a distributional RL framework in order to learn adaptive policies which allow to tune their level of conservativity at run-time based on the desired comfort and utility. Using a proactive safety verification approach, the proposed framework can guarantee that actions generated from RL are failsafe according to the worst-case assumptions. Concurrently, the policy is encouraged to minimize safety interference and generate more comfortable behavior. We trained and evaluated the proposed approach and baseline policies using a high level simulator with a variety of randomized scenarios including several corner cases which rarely happen in reality but are very crucial. In light of our experiments, the behavior of policies learned using distributional RL is adaptive at run-time and robust to the environment uncertainty. Quantitatively, the learned distributional RL agent reduces the average driving time more than 50\% compared to the normal DQN policy. ... mehr


Download
Originalveröffentlichung
DOI: 10.1109/IROS51168.2021.9636847
Scopus
Zitationen: 14
Zugehörige Institution(en) am KIT Institut für Mess- und Regelungstechnik (MRT)
Institut für Mess- und Regelungstechnik mit Maschinenlaboratorium (MRT)
Publikationstyp Proceedingsbeitrag
Publikationsdatum 16.12.2021
Sprache Englisch
Identifikator ISBN: 978-1-6654-1714-3
ISSN: 2153-0866
KITopen-ID: 1000136250
Erschienen in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Veranstaltung IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021), Prag, Tschechien, 27.09.2021 – 01.10.2021
Verlag Institute of Electrical and Electronics Engineers (IEEE)
Seiten 1236 – 1243
Nachgewiesen in arXiv
Dimensions
Scopus
Relationen in KITopen
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page