Analyzing Influence of Robustness of Neural Networks on the Safety of Autonomous Vehicles

Jin Zhang, Robert Taylor, Igor Kozin, Jingyue Li

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

Neural networks (NNs) have shown remarkable performance of perception in their application in autonomous vehicles (AVs). However, NNs are intrinsically vulnerable to perturbations, such as occurrences outside of the training sets, scene noise, instrument noise, image translation, and rotation, or small changes intentionally added to the original image (called adversarial perturbations). Incorrect conclusions from the perception systems (e.g., missing objects, wrong classification, and traffic sign misdetection or misreading) have been a major cause of disengagement incidents in AVs. In order to explore the dynamic nature of hazardous events in AVs, we develop a range of methods to analyze AV safety and security. This work is part of the project and is devoted to analyzing the influence of robustness in the NN-based perception system by using fault tree analysis (FTA). We extend the traditional FTA to represent combinations of failure causes in the multi-dimensional space, i.e., two variables that influence whether the image is classified correctly. The extended FTA is demonstrated on the traffic sign recognition module of AV theoretically and in practice.
Original languageEnglish
Title of host publicationProceedings of the 31st European Safety and Reliability Conference
EditorsBruno Castanier, Marko Cepin, David Bigaud, Christophe Berenguer
PublisherResearch Publishing Services
Publication date2021
Pages2276-2284
ISBN (Print)978-981-18-2016-8
DOIs
Publication statusPublished - 2021
Event31st European Safety and Reliability Conference - Angers, France
Duration: 19 Sep 202123 Sep 2021

Conference

Conference31st European Safety and Reliability Conference
Country/TerritoryFrance
CityAngers
Period19/09/202123/09/2021

Fingerprint

Dive into the research topics of 'Analyzing Influence of Robustness of Neural Networks on the Safety of Autonomous Vehicles'. Together they form a unique fingerprint.

Cite this