Perceptions on the state of the art in verification and validation in cyber-physical systems

IEEE Systems Journal

Volumn 11, Issue 4, 2017, Pages 2614-2627

  Zheng, Xi ^a,b   Julien, Christine ^a   Kim, Miryung ^c   Khurshid, Sarfraz ^a  

^a The University of Texas at Austin   (United States)

^b DEAKIN UNIVERSITY   (Australia)

^c Department of Civil and Environmental Engineering   (United States)

Author keywords

Computational modeling; Computer simulation; Formal specifications; Formal verification; Networked control systems; Software engineering; Software testing

Indexed keywords

COMPUTER CONTROL SYSTEMS; COMPUTER SIMULATION; CYBER PHYSICAL SYSTEM; EMBEDDED SYSTEMS; FORMAL SPECIFICATION; FORMAL VERIFICATION; HIGH LEVEL LANGUAGES; MODEL CHECKING; NETWORKED CONTROL SYSTEMS; SOFTWARE ENGINEERING; SOFTWARE TESTING; STATIC ANALYSIS; SURVEYS;

COMPUTATIONAL MODEL; CYBER-PHYSICAL SYSTEMS (CPS); HIGH LEVEL OF ABSTRACTION; HIGH-LEVEL PROGRAMMING LANGUAGE; LITERATURE REVIEWS; RESOURCE CONSTRAINT; SEMI STRUCTURED INTERVIEWS; VERIFICATION-AND-VALIDATION;

PROGRAM DEBUGGING;

EID: 85063082745     PISSN: 19328184     EISSN: 19379234     Source Type: Journal    
DOI: 10.1109/JSYST.2015.2496293     Document Type: Article

References (110)

1. E. Abrahám-Mumm, U. Hannemann, and M. Steffen, “Verification of hybrid systems: Formalization and proof rules in PVS,” in Proc. Int. Conf. Eng. Complex Comput. Syst. (ICECCS), 2001, pp. 48-57.
2. R. Akella and B. M. McMillin, “Model-checking BNDC properties in cyber-physical systems,” in Proc. 33rd Annu. IEEE Int. Comput. Softw. Appl. Conf. (COMPSAC), 2009, vol. 1, pp. 660-663.
3. A. T. Al-Hammouri, “A comprehensive co-simulation platform for cyber-physical systems,” Comput. Commun., vol. 36, no. 1, pp. 8-19, 2012.
4. J. Alglave, A. F. Donaldson, D. Kroening, and M. Tautschnig, “Making software verification tools really work,” in Automated Technology for Verification and Analysis. New York, NY, USA: Springer, 2011, pp. 28-42.
5. Y. Annpureddy, C. Liu, G. Fainekos, and S. Sankaranarayanan, S-TaLiRo: A Tool for Temporal Logic Falsification for Hybrid Systems. New York, NY, USA: Springer, 2011.
6. R. Baheti and H. Gill, “Cyber-physical systems,” in The Impact of Control Technology, 2011, pp. 161-166, www.ieeecss.org
7. C. Baier, J.-P. Katoen, and H. Hermanns, “Approximative symbolic model checking of continuous-time Markov chains,” in Proc. Concurrency Theory (CONCUR'99), 1999, pp. 146-161.
8. T. Ball, V. Levin, and S. K. Rajamani, “A decade of software model checking with SLAM,” Commun. ACM, vol. 54, no. 7, pp. 68-76, 2011.
9. A. Basu, M. Bozga, and J. Sifakis, “Modeling heterogeneous real-time components in BIP,” in Proc. 4th IEEE Int. Conf. Softw. Eng. Formal Methods (SEFM), 2006, pp. 3-12.
10. A. Bauer, M. Leucker, and C. Schallhart, “Runtime verification for LTL and TLTL,” ACM Trans. Softw. Eng. Methodol., vol. 20, no. 4, p. 14, 2011.
11. M. Ben-Ari, Principles of the Spin Model Checker. New York, NY, USA: Springer, 2008.
12. B. Blanchet et al., “Design and implementation of a special-purpose static program analyzer for safety-critical real-time embedded software,” in The Essence of Computation. New York, NY, USA: Springer, 2002, pp. 85-108.
13. C. D. Bodemann and F. De Rose, “The successful development process with matlab simulink in the framework Of ESA's ATV project,” in Proc. Int. Astronaut. Conf. (IAC), 2004, IAC-04-U.3.B.03.
14. B. Boehm, “Verifying and validating software requirements and design specifications,” in IEEE Softw., vol. 1, no. 1, pp. 75-88, Jan. 1984.
15. J. Botaschanjan et al., “On the correctness of upper layers of automotive systems,” Formal Aspects Comput., vol. 20, no. 6, pp. 637-662, 2008.
16. D. Broman, P. Derler, and J. Eidson, “Temporal issues in cyber-physical systems,” J. Indian Inst. Sci., vol. 93, no. 3, pp. 389-402, 2013.
17. L. Bu et al., “Toward online hybrid systems model checking of cyber-physical systems' time-bounded short-run behavior,” ACM SIGBED Rev., vol. 8, no. 2, pp. 7-10, 2011.
18. F. Chen and G. Roşu, “Java-MOP: A monitoring oriented programming environment for Java,” in Proc. Tools Algorithms Construct. Anal. Syst., 2005, pp. 546-550.
19. T. Chen, M. Diciolla, M. Kwiatkowska, and A. Mereacre, “Quantitative verification of implantable cardiac pacemakers,” in Proc. IEEE Real-Time Syst. Symp. (RTSS), 2012, pp. 263-272.
20. A. Cimatti, E. Clarke, F. Giunchiglia, and M. Roveri, “NuSMV: A new symbolic model verifier,” in Proc. Comput. Aided Verificat. (CAV), 1999, pp. 495-499.
21. R. Clarisó and J. Cortadella, “The octahedron abstract domain,” in Static Analysis, Heidelberg, Berlin: Springer, 2004, pp. 312-327.
22. E. M. Clarke, B. Krogh, A. Platzer, and R. Rajkumar, “Analysis and verification challenges for cyber-physical transportation systems,” in Proc. Nat. Workshop Res. High Confidence Transp., 2008.
23. E. M. Clarke and P. Zuliani, “Statistical model checking for cyber-physical systems,” in Proc. Autom. Technol. Verificat. Anal., 2011, pp. 1-12.
24. R. Colgren, “Efficient model reduction for the control of large-scale systems,” in Proc. Efficient Model. Control Large-Scale Syst., 2010, pp. 59-72.
25. P. Cousot and R. Cousot, “Abstract interpretation: A unified lattice model for static analysis of programs by construction or approximation of fixpoints,” in Proc. Principles Programm. Lang. (POPL), 1977, pp. 238-252.
26. J. W. Creswell, Qualitative Inquiry and Research Design: Choosing Among the Five Traditions. Newbury Park, CA, USA: SAGE, 2012.
27. J. W. Creswell and A. L. Garrett, “The “movement” of mixed methods research and the role of educators,” South Afr. J. Edu., vol. 3, pp. 321-333, 2008.
28. C. Daws, A. Olivero, S. Tripakis, and S. Yovine, “The tool KRONOS,” in Proc. Hybrid Syst. III, 1996, pp. 208-219.
29. P. Derler, E. A. Lee, and A. S. Vincentelli, “Modeling cyber-physical systems,” Proc. IEEE, vol. 100, no. 1, pp. 13-28, Jan. 2012.
30. A. Deutsch, “Static verification of dynamic properties,” PolySpace White Paper, 2004.
31. A. Donzé, “Breach, a toolbox for verification and parameter synthesis of hybrid systems,” in Proc. Comput. Aided Verificat., 2010, pp. 167-170.
32. A. Donzé, O. Maler, E. Bartocci, D. Nickovic, R. Grosu, and S. Smolka, “On temporal logic and signal processing,” in Proc. Autom. Technol. Verificat. Anal., 2012, pp. 92-106.
33. V. D'silva, D. Kroening, and G. Weissenbacher, “A survey of automated techniques for formal software verification,” IEEE Trans. Comput. Aided Des. Integr. Circuits Syst., vol. 27, no. 7, pp. 1165-1178, Jul. 2008.
34. J. El-khoury, F. Asplund, M. Biehl, F. Loiret, and M. Törngren, “A roadmap towards integrated CPS development environments,” in 1st Open EIT ICT Labs Workshop on Cyber-Physical Systems Engineering, 2013 [Online]. Available: http://bit.ly/1MvTbPQ
35. H. Elmqvist, S. E. Mattsson, and M. Otter, “Modelica-A language for physical system modeling, visualization and interaction,” in Proc. Comput. Aided Control Syst. Des. (CACSD), 1999, pp. 630-639.
36. G. Frehse, A. Hamann, S. Quinton, and M. Woehrle, “Formal analysis of timing effects on closed-loop properties of control software,” in Proc. Real-Time Syst. Symp. (RTSS), 2014, pp. 53-62.
37. W. Freiseisen, R. Keber, W. Medetz, P. Pau, and D. Stelzmueller, “Using modelica for testing embedded systems,” in Proc. 2nd Int. Model. Conf., 2002, pp. 195-201.
38. H. Garavel, F. Lang, R. Mateescu, and W. Serwe, “CADP 2011: A toolbox for the construction and analysis of distributed processes,” Int. J. Softw. Tools Technol. Transfer, vol. 15, no. 2, pp. 89-107, 2013.
39. D. Gay, P. Levis, R. Von Behren, M. Welsh, E. Brewer, and D. Culler, “The nesC language: A holistic approach to networked embedded systems,” ACM SIGPLAN Notices, vol. 38, pp. 1-11, 2003.
40. L. Grunske and P. Zhang, “Monitoring probabilistic properties,” in Proc. Eur. Softw. Eng. Conf. (ESEC)/Found. Softw. Eng. (FSE), 2009, pp. 183-192.
41. Z. Han and B. Krogh, “Reachability analysis of hybrid control systems using reduced-order models,” in Proc. Amer. Control Conf., 2004, vol. 2, pp. 1183-1189.
42. H. Hansson and B. Jonsson, “A logic for reasoning about time and reliability,” Formal Aspects Comput., vol. 6, no. 5, pp. 512-535, 1994.
43. J. Harrison, Theorem Proving With the Real Numbers, in Springer Science & Business Media, 2012.
44. N. He, P. Rümmer, and D. Kroening, “Test-case generation for embedded Simulink via formal concept analysis,” in Proc. Des. Autom. Conf. (DAC), 2011, pp. 224-229.
45. T. A. Henzinger, P.-H. Ho, and H. Wong-Toi, “HyTech: A model checker for hybrid systems,” in Proc. Comput. Aided Verificat., 1997, pp. 460-463.
46. A. Hinton, M. Kwiatkowska, G. Norman, and D. Parker, “PRISM: A tool for automatic verification of probabilistic systems,” in Proc. Tools Algorithms Construct. Anal. Syst., 2006, pp. 441-444.
47. G. J. Holzmann, “Basic spin manual,” Technical Report, Bell Laboratories, 1994 [Online]. Available: http://spinroot.com/spin/Doc/Manual.pdf
48. C Global Surveyor [Online]. Available: http://ti.arc.nasa.gov/tech/rse/vandv/cgs/, Accessed on: Nov. 2015.
49. Coverity [Online]. Available: http://www.coverity.com, Accessed on: Nov. 2015.
50. Klocwork [Online]. Available: http://www.klocwork.com, Accessed on: Nov. 2015.
51. Simulink Design Verifier Temporal Properties-MathWorks [Online]. Available: http://www.mathworks.com/examples/sldesignverifier/category/temporal-property specification, Accessed on: Nov. 2015.
52. Simulink Design Verifier Types of Model Coverage-MathWorks [Online]. Available: http://www.mathworks.com/help/slvnv/ug/types-of-model coverage.html, Accessed on: Nov. 2015.
53. Polyspace Static Analyzers [Online]. Available: http://www.mathworks.com/products/polyspace/?refresh=true, Accessed on: Nov. 2015.
54. Simulink Design Verifier-MathWorks [Online]. Available: http://www.mathworks.com/products/sldesignverifier/, Accessed on: Nov. 2015.
55. R. Huuck, A. Fehnker, S. Seefried, and J. Brauer, “Goanna: Syntactic software model checking,” in Proc. Autom. Technol. Verificat. Anal., 2008, pp. 216-221.
56. Z. Jiang, M. Pajic, and R. Mangharam, “Cyber-physical modeling of implantable cardiac medical devices,” Proc. IEEE, vol. 100, no. 1, pp. 122-137, Jan. 2012.
57. B. Johnson, Y. Song, E. Murphy-Hill, and R. Bowdidge, “Why don't software developers use static analysis tools to find bugs?,” in Proc. Int. Conf. Softw. Eng. (ICSE), 2013, pp. 672-681.
58. M. M. H. Khan, H. K. Le, H. Ahmadi, T. F. Abdelzaher, and J. Han, “Dustminer: Troubleshooting interactive complexity bugs in sensor networks,” in Proc. SenSys, 2008, pp. 99-112.
59. G. Klein et al., “Comprehensive formal verification of an OS micro-kernel,” ACM Trans. Comput. Syst. (TOCS), vol. 32, no. 1, p. 2, 2014.
60. G. Klein et al., “seL4: Formal verification of an OS kernel,” in Proc. Symp. Oper. Syst. Principles (SOSP), 2009, pp. 207-220.
61. N. Kosmatov, G. Petiot, and J. Signoles, “An optimized memory monitoring for runtime assertion checking of C programs,” in Proc. Runtime Verificat., 2013, pp. 167-182.
62. H. J. La and S. D. Kim, “A service-based approach to designing cyber physical systems,” in Proc. Int. Conf. Comput. Inf. Sci. (ICIS), 2010, pp. 895-900.
63. K. G. Larsen, P. Pettersson, and W. Yi, “UPPAAL in a nutshell,” Int. J. STTT, vol. 1, no. 1, pp. 134-152, 1997.
64. G. T. Leavens, A. L. Baker, and C. Ruby, “JML: A Java modeling language,” in Proc. Formal Underpinnings Java Workshop (OOPSLA), 1998, pp. 404-420.
65. E. A. Lee, “Cyber-physical systems-are computing foundations adequate,” in Proc. NSF Workshop Cyber-Phys. Syst. (CPS), vol. 2, 2006.
66. E. A. Lee, “Computing foundations and practice for cyber-physical systems: A preliminary report,” Univ. California, Berkeley, CA, USA, Tech. Rep. UCB/EECS-2007-72, 2007.
67. E. A. Lee, “Cyber physical systems: Design challenges,” in Proc. IEEE Int. Symp. Object Oriented Real-Time Distrib. Comput. (ISORC), 2008, pp. 363-369.
68. K. R. M. Leino, “Efficient weakest preconditions,” Inf. Process. Lett., vol. 93, no. 6, pp. 281-288, 2005.
69. K. R. M. Leino and W. Schulte, “A verifying compiler for a multi-threaded object-oriented,” Softw. Syst. Rel. Security, vol. 9, p. 351, 2007.
70. N. G. Leveson and C. S. Turner, “An investigation of the Therac-25 accidents,” Computer, vol. 26, no. 7, pp. 18-41, 1993.
71. J. Lin, S. Sedigh, and A. Miller, “Towards integrated simulation of cyber-physical systems: A case study on intelligent water distribution,” in Proc. Int. Conf. Dependable Auton. Secure Comput. (DASC), 2009, pp. 690-695.
72. G. Lipovszki and P. Aradi, “Simulating complex systems and processes in LabVIEW,” J. Math. Sci., vol. 132, no. 5, pp. 629-636, 2006.
73. L. Luo, T. He, G. Zhou, L. Gu, T. F. Abdelzaher, and J. A. Stankovic, “Achieving repeatability of asynchronous events in wireless sensor networks with envirolog,” Univ. Virginia, Charlottesville, VA, USA, Tech. Rep. ADA447048, 2006.
74. J. Magnetto Neff, “Grounded theory: A critical research methodology,” in Under Construction: Working at the Intersections of Composition Theory, Research, and Practice, Logan, Utah State, 1998, pp. 35-124.
75. O. Maler and D. Nickovic, “Monitoring temporal properties of continuous signals,” in Proc. Formal Techn. Modell. Anal. Timed Fault-Tolerant Syst., 2004, pp. 152-166.
76. R. Matinnejad, S. Nejati, and L. Briand, “Automated test suite generation for time-continuous simulink models,” Tech. Rep. TR-SnT-2015-7, 2015.
77. R. Mattolini and P. Nesi, “An interval logic for real-time system specification,” IEEE Trans. Softw. Eng., vol. 27, no. 3, pp. 208-227, Mar. 2001.
78. A. Miné, “The octagon abstract domain,” Higher-Order Symbolic Comput., vol. 19, no. 1, pp. 31-100, 2006.
79. S. Mitra, T. Wongpiromsarn, and R. M. Murray, “Verifying cyber-physical interactions in safety-critical systems,” IEEE Security & Privacy, vol. 11, no. 4, pp. 28-37, Jul./Aug. 2013.
80. E. Murphy-Hill, T. Zimmermann, C. Bird, and N. Nagappan, “The design of bug fixes,” in Proc. Int. Conf. Softw. Eng. (ICSE), 2013, pp. 332-341.
81. A. Murugesan, S. Rayadurgam, and M. Heimdahl, “Using models to address challenges in specifying requirements for medical cyber-physical systems,” in Proc. Int. Conf. Cyber-Phys. Syst. (ICCPS) Workshops, 2013, http://www.seas.upenn.edu/~zhihaoj/cps13/Murugesan.pdf
82. N. Bjoner, Z. Manna, H. Sipma, and T. Uribe, “Deductive verification of real-time systems using STeP,” Theor. Comput. Sci., vol. 253, no. 1, pp. 27-60, 2001.
83. T. Nipkow, L. C. Paulson, and M. Wenzel, Isabelle/HOL: A Proof Assistant for Higher-Order Logic, vol. 2283, Springer Science & Business Media, 2002.
84. J. Ouaknine and J. Worrell, “Some recent results in metric temporal logic,” in Proc. Formal Model. Anal. Timed Syst., 2008, pp. 1-13.
85. M. Pajic, Z. Jiang, I. Lee, O. Sokolsky, and R. Mangharam, “Safety-critical medical device development using the UPP2SF model,” ACM Trans. Embedded Comput. Syst., vol. 13, no. 4s, p. 127, 2014.
86. D. L. Parnas, “Really rethinking formal methods,” Computer, vol. 43, no. 1, pp. 28-34, 2010.
87. L. Pike, S. Niller, and N. Wegmann, “Runtime verification for ultra-critical systems,” in Proc. Runtime Verificat., 2012, pp. 310-324.
88. A. Pnueli, “The temporal logic of programs,” in Proc. 18th Annu. Symp. Found. Comput. Sci., 1977, pp. 46-57.
89. A. Pnueli, A. Zaks, and L. Zuck, “Monitoring interfaces for faults,” Electron. Notes Theor. Comput. Sci., vol. 144, no. 4, pp. 73-89, 2006.
90. R. R. Rajkumar, I. Lee, L. Sha, and J. Stankovic, “Cyber-physical systems: The next computing revolution,” in Proc. Des. Autom. Conf. (DAC), 2010, pp. 731-736.
91. N. Ramanathan, K. Chang, R. Kapur, L. Girod, E. Kohler, and D. Estrin, “Sympathy for the sensor network debugger,” in Proc. SenSys, 2005, pp. 255-267.
92. K. Romer and J. Ma, “PDA: Passive distributed assertions for sensor networks,” in Proc. Int. Conf. Inf. Process. Sensor Netw. (IPSN), 2009, pp. 337-348.
93. U. Sammapun, I. Lee, and O. Sokolsky, “RT-MaC: Runtime monitoring and checking of quantitative and probabilistic properties,” in Proc. Int. Conf. Embedded Real-Time Comput. Syst. Appl. (RTCSA), 2005, pp. 147-153.
94. A. Sangiovanni-Vincentelli, W. Damm, and R. Passerone, “Taming Dr. Frankenstein: Contract-based design for cyber-physical systems,” Eur. J. Control, vol. 18, no. 3, pp. 217-238, 2012.
95. R. Sasnauskas, O. Landsiedel, M. H. Alizai, C. Weise, S. Kowalewski, and K. Wehrle, “KleeNet: Discovering insidious interaction bugs in wireless sensor networks before deployment,” in Proc. Int. Conf. Inf. Process. Sensor Netw. (IPSN), 2010, pp. 186-196.
96. J. Shi, J. Wan, H. Yan, and H. Suo, “A survey of cyber-physical systems,” in Proc. Wireless Commun. Signal Process. (WCSP), 2011, pp. 1-6.
97. S. Sierla, B. M. O'Halloran, T. Karhela, N. Papakonstantinou, and I. Y. Tumer, “Common cause failure analysis of cyber-physical systems situated in constructed environments,” Res. Eng. Des., vol. 24, no. 4, pp. 375-394, 2013.
98. J. Sifakis, “A framework for component-based construction,” in Proc.
99. Int. Conf. Softw. Eng. Formal Methods (SEFM), 2005, pp. 293-299. [99] N. Simulator, “ns-2,” 1989.
100. A. P. Sistla, M. Žefran, and Y. Feng, “Runtime monitoring of stochastic cyber-physical systems with hybrid state,” in Proc. Runtime Verificat., 2012, pp. 276-293.
101. H. Siy and L. Votta, “Does the modern code inspection have value?,” in Proc. Int. Conf. Softw. Maintenance (ICSM), 2001, p. 281.
102. T. Sookoor, T. Hnat, P. Hooimeijer, W. Weimer, and K. Whitehouse, “Macrodebugging: Global views of distributed program execution,” in Proc. SenSys, 2009, pp. 141-154.
103. R. A. Thacker, K. R. Jones, C. J. Myers, and H. Zheng, “Automatic abstraction for verification of cyber-physical systems,” in Proc. Int. Conf. Cyper Phys. Syst. (ICCPS), 2010, pp. 12-21.
104. A. Tiwari and G. Khanna, “Series of abstractions for hybrid automata,” in Proc. Hybrid Syst. Comput. Control, 2002, pp. 465-478.
105. J. Tretmans and E. Brinksma, “Torx: Automated model-based testing,” 2003.
106. K. Wan, D. Hughes, K. L. Man, and T. Krilavicius, “Composition challenges and approaches for cyber physical systems,” in Proc. Int. Conf. Netw. Embedded Syst. Enterp. Appl. (NESEA), 2010, pp. 1-7.
107. K. Wan, K. Man, and D. Hughes, “Specification, analyzing challenges and approaches for cyber-physical systems (CPS),” Eng. Lett., vol. 18, no. 3, pp. 308, 2010.
108. J. Yang, M. L. Soffa, L. Selavo, and K. Whitehouse, “Clairvoyant: A comprehensive source-level debugger for wireless sensor networks,” in Proc. SenSys, 2007, pp. 189-203.
109. Y. Zhang, I.-L. Yen, F. B. Bastani, A. T. Tai, and S. Chau, “Optimal adaptive system health monitoring and diagnosis for resource constrained cyber-physical systems,” in Proc. Int. Symp. Softw. Reliab. Eng. (ISSRE), 2009, pp. 51-60.
110. X. Zheng, “Physically informed assertions for cyber physical systems development and debugging,” in Proc. PERCOM Workshops, 2014, pp. 181-183.