ML-Based Fault Injection for Autonomous Vehicles: A Case for Bayesian Fault Injection

Proceedings - 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2019

Volumn , Issue , 2019, Pages 112-124

  Jha, Saurabh ^a   Banerjee, Subho ^a   Tsai, Timothy ^b   Hari, Siva K S ^b   Sullivan, Michael B ^b   Kalbarczyk, Zbigniew T ^a   Keckler, Stephen W ^b   Iyer, Ravishankar K ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b NVIDIA   (United States)

Author keywords

Autonomous Vehicles; Fault Injection; Machine Learning

Indexed keywords

ACCIDENT PREVENTION; ACCIDENTS; LEARNING SYSTEMS; MACHINE LEARNING; SOFTWARE TESTING;

AV TECHNOLOGY; BAYESIAN; END TO END; FAULT INJECTION; FAULT INJECTION ENGINES; FULLY-AUTONOMOUS VEHICLES; SAFETY-CRITICAL FAULTS;

AUTONOMOUS VEHICLES;

EID: 85072099788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DSN.2019.00025     Document Type: Conference Paper

References (63)

1. S. M. Erlien, Shared vehicle control using safe driving envelopes for obstacle avoidance and stability, Ph.D. dissertation, Stanford University, 2015.
2. J. Suh, B. Kim, and K. Yi, Design and evaluation of a driving mode decision algorithm for automated driving vehicle on a motorway, IFACPapersOnLine, vol. 49, no. 11, pp. 115-120, 2016.
3. Nvidia, nvidia drive | nvidia developer, https://developer.nvidia.com/driveworks.
4. Baidu, Apollo Open Platform, http://apollo.auto, Accessed: 2018-09-02.
5. CommaAI, OpenPilot: Open source driving agent, https://github.com/commaai/openpilot, Accessed: 2018-09-12.
6. S. Alvarez, Research group demos why Tesla Autopilot could crash into a stationary vehicle, https://www.teslarati.com/tesla-research-groupautopilot-crash-demo/, June 2018.
7. T.S., Why Ubers self-driving car killed a pedestrian, The Economist May 29, 2018 https://www.economist.com/the-economist-explains/2018/05/29/why-ubers-self-driving-car-killed-a-pedestrian.
8. S. S. Banerjee et al., Hands off the wheel in autonomous vehicles?: A systems perspective on over a million miles of field data, in Proc. 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). IEEE, 2018.
9. C. Fan et al., DryVR: Data-Driven Verification and Compositional Reasoning for Automotive systems, in Computer Aided Verification. Springer International Publishing, 2017, pp. 441-461.
10. E. M. Clarke and O. Grumberg, The model checking problem for concurrent systems with many similar processes, in Proc. Temporal Logic in Specification, 1987, pp. 188-201. [Online]. Available: https://doi.org/10.1007/3-540-51803-7-26
11. E. M. Clarke, E. A. Emerson, and A. P. Sistla, Automatic verification of finite state concurrent systems using temporal logic specifications: A practical approach, in Conference Record of the Tenth Annual ACM Symposium on Principles of Programming Languages, 1983, pp. 117-126. [Online]. Available: https://doi.org/10.1145/567067.567080
12. J. R. Bitner et al., Efficient algorithmic circuit verification using indexed bdds, in Digest of Papers: 24th Symposium on Fault-Tolerant Computing, 1994, pp. 266-275. [Online]. Available: https://doi.org/10.1109/FTCS.1994.315633
13. J. Shen and J. A. Abraham, Native mode functional test generation for processors with applications to self test and design validation, in Int. Proc. Test Conference. IEEE, 1998, pp. 990-999.
14. R. K. Roy et al., Compaction of atpg-generated test sequences for sequential circuits, in Digest of Technical Papers, 1988 IEEE International Conference on Computer-Aided Design, 1988, pp. 382-385. [Online]. Available: https://doi.org/10.1109/ICCAD.1988.122533
15. I. Hamzaoglu and J. H. Patel, Deterministic test pattern generation techniques for sequential circuits, in Proceedings of the 2000 IEEE/ACM International Conference on Computer-Aided Design, 2000, pp. 538-543. [Online]. Available: https://doi.org/10.1109/ICCAD.2000.896528
16. M.-C. Hsueh, T. K. Tsai, and R. K. Iyer, Fault injection techniques and tools, Computer, vol. 30, no. 4, pp. 75-82, April 1997.
17. L. Fraade-Blanar et al., Measuring automated vehicle safety, 2018.
18. M. T. Review, many cars have a hundred million lines of code, https://www.technologyreview.com/s/508231/many-cars-have-ahundred-million-lines-of-code/.
19. A. Hawkins, Nvidia says its new supercomputer will enable the highest level of automated driving, The Verge Oct. 10, 2017 https://www.theverge.com/2017/10/10/16449416/nvidia-pegasusself-driving-car-ai-robotaxi.
20. H. Esmaeilzadeh et al., Dark silicon and the end of multicore scaling, in Proceedings of the 38th Annual International Symposium on Computer Architecture, 2011, pp. 365-376.
21. T. Karnik and P. Hazucha, Characterization of soft errors caused by single event upsets in CMOS processes, IEEE Transactions on Dependable and Secure Computing, vol. 1, no. 2, pp. 128-143, 2004.
22. M. Musuvathi et al., Finding and reproducing heisenbugs in concurrent programs. in OSDI, vol. 8, 2008, pp. 267-280.
23. S. K. S. Hari et al., Sassifi: An architecture-level fault injection tool for gpu application resilience evaluation, in Performance Analysis of Systems and Software (ISPASS), 2017 IEEE International Symposium on. IEEE, 2017, pp. 249-258.
24. G. Li et al., Understanding Error Propagation in Deep Learning Neural Network (DNN) Accelerators and Applications, in Proc. International Conf. for High Performance Computing, Networking, Storage and Analysis, 2017, pp. 8:1-8:12.
25. NHTSA, Automated Driving Systems: A Vision for Safety, https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/13069aads2.0- 090617-v9a-tag.pdf, 2017.
26. A. Abdulkhaleq et al., A Systematic Approach Based on STPA for Developing a Dependable Architecture for Fully Automated Driving Vehicles, Procedia Engineering, vol. 179, pp. 41-51, 2017.
27. N. Leveson, A new accident model for engineering safer systems, Safety science, vol. 42, no. 4, pp. 237-270, 2004.
28. K. Pei et al., DeepXplore: Automated whitebox testing of deep learning systems, in Proc. of the 26th Symposium on Operating Systems Principles, 2017, pp. 1-18.
29. B. Salami, O. Unsal, and A. Cristal, On the Resilience of RTL NN Accelerators: Fault Characterization and Mitigation, arXiv preprint arXiv:1806.09679, 2018.
30. B. Reagen et al., Ares: A framework for quantifying the resilience of deep neural networks, in Proceedings of the 55th Annual Design Automation Conference. ACM, 2018, p. 17.
31. S. Jha et al., AVFI: Fault Injection for Autonomous Vehicles, in Proc. 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W), pp. 55-56.
32. A. H. M. Rubaiyat, Y. Qin, and H. Alemzadeh, Experimental resilience assessment of an open-source driving agent, arXiv preprint arXiv:1807.06172, 2018.
33. K. J. Astrom and T. Hagglund, PID controllers: theory, design, and tuning. Instrument Society of America Research Triangle Park, NC, 1995, vol. 2.
34. S. M. Erlien, S. Fujita, and J. C. Gerdes, Safe driving envelopes for shared control of ground vehicles, IFAC Proceedings Volumes, vol. 46, no. 21, pp. 831-836, 2013.
35. S. J. Anderson, S. B. Karumanchi, and K. Iagnemma, Constraint-based planning and control for safe, semi-autonomous operation of vehicles, in Proc. 2012 IEEE Intelligent Vehicles Symposium (IV), 2012 IEEE, pp. 383-388.
36. A. Avizienis et al., Basic concepts and taxonomy of dependable and secure computing, IEEE Trans. Dependable Secur. Comput., vol. 1, no. 1, pp. 11-33, Jan. 2004.
37. S. J. Julier and J. K. Uhlmann, New extension of the Kalman filter to nonlinear systems, in Signal pfrocessing, sensor fusion, and target recognition VI, vol. 3068. International Society for Optics and Photonics, 1997, pp. 182-194.
38. J. Pearl, Theoretical impediments to machine learning with seven sparks from the causal revolution, 2018.
39. S. M. LaValle, Planning algorithms. Cambridge University Press, 2006.
40. P. L. DeVries and P. Hamill, A first course in computational physics, 1995.
41. D. Koller et al., Towards robust automatic traffic scene analysis in real-time, in Pattern Recognition, 1994. Vol. 1-Conference A: Computer Vision Image Processing., Proceedings of the 12th IAPR International Conference on, vol. 1. IEEE, 1994, pp. 126-131.
42. J. Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufmann, 2014.
43. A. P. Dempster, N. M. Laird, and D. B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, Journal of the Royal Statistical Society. Series B (methodological), pp. 1-38, 1977.
44. SAE International, Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles, Sep 2016.
45. A. B. Watson and J. A. Solomon, Model of visual contrast gain control and pattern masking, JOSA A, vol. 14, no. 9, pp. 2379-2391, 1997.
46. P. Debevec and S. Gibson, A tone mapping algorithm for high contrast images, in 13th Eurographics Workshop on Rendering: Pisa, Italy. Citeseer, 2002.
47. D. Menon and G. Calvagno, Color image demosaicking: An overview, Signal Processing: Image Communication, vol. 26, no. 8-9, pp. 518-533, 2011.
48. J. Redmon et al., You only look once: Unified, real-time object detection, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 779-788.
49. D. Reid et al., An algorithm for tracking multiple targets, IEEE Transactions on Automatic Control, vol. 24, no. 6, pp. 843-854, 1979.
50. A. Houenou et al., Vehicle trajectory prediction based on motion model and maneuver recognition, in Intelligent Robots and Systems, Proc. 2013 IEEE/RSJ International Conference, pp. 4363-4369.
51. A. Dosovitskiy et al., CARLA: An open urban driving simulator, in Proc. of the 1st Annual Conf. on Robot Learning, 2017, pp. 1-16.
52. NVIDIA, NVIDIA Drive Simulation, https://www.nvidia.com/en-us/self-driving-cars/drive-constellation/, Accessed: 2018-09-02.
53. Nvidia, Drive Pegasus, https://www.nvidia.com/en-us/self-driving-cars/drive-platform/, Accessed: 2018-09-12.
54. NEOUSYS, nuvo-6108gc gpu computing platform | nvidia rtx 2080-gtx 1080ti-titanx, https://www.neousys-tech.com/en/product/application/gpucomputing/nuvo-6108gc-gpu-computing, Accessed: 2018-11-28.
55. M. Waskom, seaborn.boxplot, https://seaborn.pydata.org/generated/seaborn.boxplot.html.
56. J. M. Anderson et al., Autonomous vehicle technology: A guide for policymakers, RAND Corp., Tech. Rep. RR-443-2-RC, 2016.
57. N. Kalra and S. M. Paddock, Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability? Transportation Research Part A: Policy and Practice, vol. 94, pp. 182-193, 2016.
58. S. Jha et al., Kayotee: A Fault Injection-based System to Assess the Safety and Reliability of Autonomous Vehicles to Faults and Errors, in Third IEEE International Workshop on Automotive Reliability Test. IEEE, 2018.
59. Waymo, On the Road to Fully Self-Driving, Waymo Safety Report https://assets.documentcloud.org/documents/4107762/Waymo-Safety-Report-2017.pdf, Accessed: 2017-11-27.
60. P. Koopman and M. Wagner, Toward a framework for highly automated vehicle safety validation, SAE Technical Paper, Tech. Rep., 2018.
61. J. Lu et al., No need to worry about adversarial examples in object detection in autonomous vehicles, arXiv preprint arXiv:1707.03501, 2017.
62. K. Pei et al., Towards practical verification of machine learning: The case of computer vision systems, arXiv preprint arXiv:1712.01785, 2017.
63. H. Lakkaraju et al., Identifying unknown unknowns in the open world: Representations and policies for guided exploration. in AAAI, vol. 1, 2017, p. 2.