Hidden implementation dependencies in high assurance and critical computing systems

IEEE Transactions on Software Engineering

Volumn 32, Issue 10, 2006, Pages 790-811

  De Leon, Daniel Conte ^a,b   Alves Foss, Jim ^a,b  

^a IEEE   (United States)

^b UNIVERSITY OF IDAHO   (United States)

Author keywords

Critical systems; Data dependencies; Emergent properties; Formal frameworks; High assurance systems; Knowledge modeling; Set theory; Software engineering documentation; System development; System safety; Traceability; Work products

Indexed keywords

CRITICAL SYSTEMS; DATA DEPENDENCIES; EMERGENT PROPERTIES; FORMAL FRAMEWORKS; HIGH ASSURANCE SYSTEMS; KNOWLEDGE MODELING; SOFTWARE ENGINEERING DOCUMENTATION; SYSTEM DEVELOPMENT; SYSTEM SAFETY; WORK PRODUCTS;

COMPUTER SYSTEM RECOVERY; CONSTRAINT THEORY; ERROR ANALYSIS; SAFETY FACTOR; SECURITY OF DATA; SET THEORY;

COMPUTER AIDED SOFTWARE ENGINEERING;

EID: 33947124453     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2006.103     Document Type: Article

References (114)

1. J. Alves-Foss, D. Conte de Leon, and P.W. Oman, "Experiments in the Use of XML to Enhance Traceability between Object-Oriented Design Specifications and Source Code," Proc. 35th Hawaii Int'l Conf. System Sciences (HICSS 35), pp. 3959-3966, Jan. 2002.
2. K.M. Anderson, S.A. Sherba, and W. VanLepthien, "Towards Large-Scale Information Integration," Proc. 24th Int'l Conf. Software Eng. (ICSE '02), pp. 524-534, May 2002.
3. G. Antoniol, G. Canfora, G. Casazza, and A. De Lucia, "Information Retrieval Models for Recovering Traceability Links between Code and Documentation," Proc. 16th Int'l Conf. Software Maintenance (ICSM '00), pp. 40-51, Oct. 2000.
4. G. Antoniol, G. Canfora, G. Casazza, and A. De Lucia, "Maintaining Traceability Links During Object-Oriented Software Evolution," Software Practice and Experience, vol. 31, no. 4, pp. 331-355, Apr. 2001.
5. G. Antoniol, G. Canfora, G. Casazza, A. De Lucia, and E. Merlo, "Recovering Traceability Links between Code and Documentation," IEEE Trans. Software Eng., vol. 28, no. 10, pp. 970-983, Oct. 2002.
6. G. Antoniol, G. Canfora, and A. De Lucia, "Maintaining Traceability during Object-Oriented Software Evolution: A Case Study," Proc. 15th Int'l Conf. Software Maintenance (ICSM '99), pp. 211-219, Aug. 1999.
7. G. Antoniol, G. Canfora, A. De Lucia, G. Casazza, and E. Merlo, "Tracing Object-Oriented Code into Functional Requirements," Proc. Eighth Int'l Workshop Program Comprehension (IWPC '00), pp. 79-86, June 2000.
8. G. Antoniol, G. Canfora, A. De Lucia, and E. Merlo, "Recovering Code to Documentation Links in Object-Oriented Systems," Proc. Sixth Working Conf. Reverse Eng. (WCRE '99), pp. 136-144, Oct. 1999.
9. G. Antoniol, B. Caprile, A. Potrich, and P. Tonella, "Design-Code Traceability for Object-Oriented Systems," Annals of Software Eng., vol. 9, nos. 1-2, pp. 35-58, Mar. 2000.
10. G. Antoniol, B. Caprile, A. Potrich, and P. Tonella, "Design-Code Traceability Recovery: Selecting the Basic Linkage Properties," Science of Computer Programming, vol. 40, nos. 2-3, pp. 213-234, July 2001.
11. G. Antoniol, G. Casazza, and A. Cimitile, "Traceability Recovery by Modeling Programmer Behavior," Proc. Seventh Working Conf. Reverse Eng. (WCRE '00), pp. 240-247, Nov. 2000.
12. G. Antoniol, A. Potrich, P. Tonella, and R. Fiutem, "Evolving Object-Oriented Design to Improve Code Traceability," Proc. Seventh Int'l Workshop Program Comprehension (IWPC '99), pp. 151-160, May 1999.
13. The Graphviz: Graph Visualization Software, AT&T, http://www.graphviz.org/, Mar. 2006.
14. A. Avižienis, J.C. Laprie, B. Randell, and C. Landwehr, "Basic Concepts and Taxonomy of Dependable and Secure Computing," IEEE Trans. Dependable and Secure Computing, vol. 1, no. 1, pp. 11-33, Jan.-Mar. 2004.
15. A. Avižienis, J.C. Laprie, and B. Randell, "Fundamental Concepts of Computer Systems Dependability," Proc. Workshop Robot Dependability, May 2001.
16. G.J. Badros, "JavaML: A Markup Language for Java Source Code," Computer Networks, vol. 33, nos. 1-6, pp. 159-177, 2000.
17. T. Berners-Lee, "The Semantic Web," World Wide Web Consortium, http://www.w3.org/2002/Talks/04-sweb/Overview.html, 2002.
18. P. Borba and J.A. Goguen, "Refinement of Concurrent Object Oriented Programs," Formal Methods in Object Technology, S. Goldsack and S. Kent, eds. Springer-Verlag, Nov. 1995.
19. J. Cleland-Huang, "Toward Improved Traceability of Non-Functional Requirements," Proc. Third Int'l Workshop Traceability in Emerging Forms Software Eng./Int'l Conf. Automated Software Eng. (ASE '05), pp. 14-19, Nov. 2005.
20. J. Cleland-Huang, C.K. Chang, and M.J. Christensen, "Event-Based Traceability for Managing Evolutionary Change," IEEE Trans. Software Eng., vol. 29, no. 9, pp. 796-810, Sept. 2003.
21. J. Cleland-Huang, R. Settimi, O. BenKhadra, E. Berezhan, and S. Christina, "Goal-Centric Traceability for Managing Non-Functional Requirements," Proc. 27th Int'l Conf. Software Eng. (ICSE '05), pp. 362-371, May 2005.
22. J. Cleland-Huang, R. Settimi, C. Duan, and X. Zou, "Utilizing Supporting Evidence to Improve Dynamic Requirements Traceability," Proc. 13th IEEE Int'l Requirements Eng. Conf. (RE '05), pp. 135-144, Aug.-Sept. 2005.
23. CHISEL: Computer Human Interaction & Software Engineering Laboratory, http://www.thechiselgroup.org/, Mar. 2006.
24. D. Conte de Leon, "Completeness of Implementation Traceability for the Development of High Assurance and Critical Computing Systems," dissertation, Univ. of Idaho, Moscow, 2006.
25. D. Conte de Leon and J. Alves-Foss, "Experiments on Processing and Linking Semantically Augmented Requirement Specifications," Proc. 37th Hawaii Int'l Conf. System Sciences (HICSS 37), pp. 279-288, Jan. 2004.
26. B. Curtis, H. Krasner, and N. Iscoe, "A Field Study of the Software Design Process for Large Systems," Comm. ACM, vol. 31, no. 11, pp. 1268-1287, 1988.
27. R.I. Damper, "Emergence and Levels of Abstraction," Int'l J. Systems Science, vol. 31, no. 7, pp. 811-818, July 2000.
28. A. Egyed, "A Scenario-Driven Approach to Traceability," Proc. 23rd Int'l Conf. Software Eng. (ICSE '01), pp. 123-132, May 2001.
29. A. Egyed, "A Scenario-Driven Approach to Trace Dependency Analysis," IEEE Trans. Software Eng., vol. 29, no. 2, pp. 116-132, Feb. 2003.
30. A. Egyed and P. Grünbacher, "Towards Understanding Implications of Trace Dependencies among Quality Requirements," Proc. Second Int'l Workshop Traceability in Emerging Forms Software Eng./ Int'l Conf. Automated Software Eng. (ASE '03), Oct. 2003.
31. European Organization for Civil Aviation Equipment (EUROCAE), http://www.eurocae.org/, Mar. 2006.
32. M. Feather, A. Nikora, C. Heitmeyer, and N. Meade, "Workshop on Software Engingeering for High Assurance Systems," Proc. 25th Int'l Conf. Software Eng. (ICSE '03), May 2003.
33. M.A. Fecko and C.M. Lott, "Improving the Requirements Engineering Process for an Electronic Clearinghouse," Proc. 10th IEEE Int'l Requirements Eng. Conf. (RE '02), pp. 52-60, Sept. 2002.
34. A. Finkelstein, D. Gabbay, A. Hunter, J. Kramer, and B. Nuseibeh, "Inconsistency Handling in Multiperspeetive Specifications," IEEE Trans. Software Engineering, vol. 20, no. 8, pp. 569-578, Aug. 1994.
35. R. Fiutem and G. Antoniol, "Identifying Design-Code Inconsistencies in Object-Oriented Software: A Case Study," Proc. 14th Int'l Conf. Software Maintenance (ICSM '98), pp. 94-102, Nov. 1998.
36. FrontEndArt, FrontEndArt Ltd., http://wvw.frontendart.com/, 2006.
37. E.R. Gansner, E. Koutsofios, and S.C. North, "Drawing Graphs with Dot," http://www.graphviz.org/Documentation/dotguide.pdf, Feb. 2002.
38. E.R. Gansner and S.C. North, "An Open Graph Visualization System and Its Applications to Software Engineering," Software Practice and Experience, vol. 30, no. 11, pp. 1203-1233, Sept. 2000.
39. B. Ganter and R. Wille, Formal Concept Analysis, Mathematical Foundations. 1999.
40. J.A. Goguen, "FOOPS: A Functional Object-Oriented Programming System," Univ. of California, San Diego, La Jolla, http://www.cs.ucsd.edu/ users/goguen/sys/foops.html, Feb. 1999.
41. J.A. Goguen, "TOOR: A System for Tracing Object-Oriented Requirements," Univ. of California, San Diego, La Jolla, http://www.cs.ucsd.edu/users/goguen/sys/toor.html, Feb. 1999.
42. O. Gotel and A. Finkelstein, "An Analysis of the Requirements Traceability Problem," Proc. First IEEE Int'l Conf. Requirements Engineering (ICRE '94), pp. 94-101, Apr. 1994.
43. E. Greengrass, "Information Retrieval: A Survey," technical report, UMBC Center for Architectures for Data-Driven Information Processing (CADIP), http://www.csee.umbc.edu/cadip/readings/IR.report.l20600.book.pdf, Nov. 2000.
44. K.S. Hanks and J.C. Knight, "Improving Communication of Critical Domain Knowledge in High-Consequence Software Development: An Empirical Study," Proc. 21st Int'l System Safety Conf. (1SSC '03), Aug. 2003.
45. J.H. Hayes, A. Dekhtyar, and J. Osborne, "Improving Requirements Tracing via Information Retrieval," Proc. llth IEEE Int'l Requirements Eng. Conf. (RE '03), pp. 138-147, Sept. 2003.
46. J.H. Hayes, A. Dekhtyar, and S.K. Sundaram, "Advancing Candidate Link Generation for Requirements Tracing: The Study of Methods," IEEE Trans. Software Eng., vol. 32, no. 1, pp. 4-19, Jan. 2006.
47. J. Henrard and J. Hainaut, "Data Dependency Elicitation in Database Reverse Engineering," Proc. Fifth European Conf. Software Maintenance and Reeng. (CSMR '01), pp. 11-19, Mar. 2001.
48. "Graph EXchange Language," Institute of Software Technology (IST), Universität Koblenz-Landau (and others), Koblenz, Germany, http://www.gupro.de/GXL/, Feb. 2006.
49. IEEE Standard Glossary of Software Engineering Terminology, IEEE Standard 610.12-1990, 1990.
50. Functional Safety of Electrical/Electronic/Programmable Electronic Safety-related Systems, Int'l Electrotechnical Commission Standard IEC 61 508, parts 1-7, Jan. 1998.
51. U. Isaksen, J.P. Bowen, and N. Nissanke, "System and Software Safety in Critical Systems," technical report, Dept. of Computer Science, Univ. of Reading, Whiteknights, UK, Dec. 1996.
52. J.C. Knight, E.A. Strunk, VV.S. Greenwell, and K.S. Wasson, "Specification and Analysis of Data for Safety-Critical Systems," Proc. 22nd Int'l System Safety Conf. (ISSC '04), Aug. 2004.
53. J.C. Laprie, Dependability: Basic Concepts and Terminology. Springer-Verlag, 1992.
54. N.G. Leveson, M. de Villepin, M. Daouk, J. Bellingham, J. Srinivasan, N. Neogi, E. Bachelder, N. Piloni and G. Flynn, "A Safety and Human-Centered Approach to Developing New Air Traffic Management Tools," technical report, Aeronautics and Astronautics Dept., Massachusetts Inst. of Technology, and Eurocontrol Experimental Centre, Dec. 2001.
55. N.G. Leveson, "Completeness in Formal Specification Language Design for Process-Control Systems," Proc. Third Workshop Formal Methods in Software Practice, pp. 75-87, Mar. 2000.
56. N.G. Leveson, "Intent Specifications: An Approach to Building Human-Centered Specifications," IEEE Trans. Software Eng., vol. 26, no. 1, pp. 15-35, Jan. 2000.
57. N.G. Leveson, "Evaluating Accident Models Using Recent Aerospace Accidents, Part One: Event-Based Models," technical report, Software Eng. Research Laboratory, Massachusetts Inst. of Technology, Cambridge, June 2001.
58. N.G. Leveson, "The Role of Software in Spacecraft Accidents," AIAA J. Spacecraft and Rockets, vol. 41, no. 4, pp. 564-575, July 2004.
59. N.G. Leveson, "A Systems-Theoretic Approach to Safety in Software Intensive Systems," IEEE Trans. Dependable and Secure Computing, vol. 1, no. 1, pp. 66-86, Jan.-Mar. 2004.
60. N.G. Leveson, System Safety Engineering: Back to the future, draft of book, http://sunnyday.mit.edu/book2.pdf, June 2006.
61. N.G. Leveson, M. Daouk, N. Dulac, and K. Marais, "A Systems Theoretic Approach to Safety Engineering," technical report, Dept. of Aeronautics and Astronautics, Massachusetts Inst. of Technology, Cambridge, Oct. 2003.
62. N.G. Leveson, M.P.E. Heimdahl, and J.D. Reese, "Designing Specification Languages for Process Control Systems: Lessons Learned and Steps to the Future," Seventh ACM SIGSOFT Symp. Foundations of Software Eng., pp. 127-145, Sept. 1999.
63. A. Levy, Basic Set Theory. Springer-Verlag, 1999.
64. R.R. Lutz, "Analyzing Software Requirements Errors in Safety-Critical Embedded Systems," technical report, Dept. of Computer Science, Iowa State Univ. of Science and Technology, Ames, Aug. 1992.
65. R.R. Lutz, "Analyzing Software Requirements Errors in Safety-Critical Embedded Systems," Proc. First IEEE Int'l Symp. Requirements Eng. (RE '93), pp. 126-133, Jan. 1993.
66. R.R. Lutz and I.C. Mikulski, "Empirical Analysis of Safety-Related Anomalies During Operations," IEEE Trans. Software Eng., vol. 30, no. 3, pp. 172-180, Mar. 2004.
67. J.I. Maletic, E.V. Munson, A. Marcus, and T.N. Nguyen, "Using a Hypertext Model for Traceability Link Conformance Analysis," Proc. Second Int'l Workshop Traceability in Emerging Forms Software Eng./Int'l Conf. Automated Software Eng. (ASE '03), Oct. 2003.
68. E. Mamas and K. Kontogiannis, "Towards Portable Source Code Representations Using XML," Proc. Seventh Working Conf. Reverse Eng. (WCRE '00), pp. 172-182, Nov. 2000.
69. A. Marcus and J.I. Maletic, "Recovering Documentation-to-Source-Code Traceability Links Using Latent Semantic Indexing," Proc. 25th Int'l Conf. Software Eng. (ICSE '03), May 2003.
70. J. McLean and C. Heitmeyer, "High Assurance Computer Systems: A Research Agenda," technical report, Center for High Assurance Computer Systems, US Naval Research Laboratory, Washington, D.C., 1995.
71. J. Michaud, M.-A. Storey, and H.A. Muller, "Integrating Information Sources for Visualizing Java Programs," 17th Int'l Conf. Software Maintenance (ICSM '01), pp. 250-259, Nov. 2001.
72. F. Modugno, N.G. Leveson, J.D. Reese, K. Partridge, and S.D. Sandys, "Integrated Safety Analysis of Requirements Specifications," Proc. Third IEEE Int'l Symp. Requirements Eng. (RE '97), pp. 148-159, Jan. 1997.
73. B. Motik, U. Sattler, and R. Studer, "Query Answering for OWL-DL with Rules," Proc. Third. Int'l Semantic Web Conf. (ISWC '04), pp. 549-563, Nov. 2004.
74. F. Naishtat, Lógica para Computación. Editorial Universitaria de Buenos Aires (EUDEBA), 1986.
75. "Controlled Flight into Terrain, Korean Air Flight 801, Boeing 747-300 HL746S, Nimitz Hill, Guam, 06 August 1997," Aircraft Accident Report NTSB/AAR-00/01, US Nat'l Transportation Safety Board, Washington, D.C., 2000.
76. C. Nentwich, L. Capra, W. Emmerich, and A. Finkelstein, "Xlinkit: A Consistency Checking and Smart Link Generation Service," ACM Trans. Internet Technical, vol. 2, no. 2, pp. 151-185, May 2002.
77. C. Nentwich, W. Emmerich, and A. Finkelstein, "Static Consistency Checking for Distributed Specifications," Proc. 16th Int'l Conf. Automated Software Eng. (ASE '01), p. 115, Nov. 2001.
78. C. Nentwich, W. Emmerich, and A. Finkelstein, "Consistency Management with Repair Actions," Proc. 25th Int'l Conf. Software Eng. (ICSE '03), pp. 455-464, May 2003.
79. C. Nentwich, W. Emmerich, A. Finkelstein, and E. Ellmer, "Flexible Consistency Checking," ACM Trans. Software Eng. and Methodology, vol. 12, no. 1, pp. 28-63, Jan. 2003.
80. XML Metadata Interchange Specification (XMI), Object Management Group Standard 2.1, Mar. 2001.
81. F.A.C. Pinheiro and J.A. Goguen, "An Object-Oriented Tool for Tracing Requirements," IEEE Software, vol. 13, no. 2, pp. 52-64, Mar. 1996.
82. K. Pohl, "Pro-Art: Enabling Requirements Pre-Traceability," Proc. Second IEEE Int'l Conf. Requirements Eng. (ICRE '96), pp. 76-84, Apr. 1996.
83. K. Fohl, Process-Centered Requirements Engineering. John Willey and Sons, 1996.
84. K.R. Popper and J.C. Eccles, The Self and Its Brain. Springer-Verlag, 1977.
85. "Visual Prolog," Prolog Development Center, Broendby, Denmark, http://www.visual-prolog.com/, Feb. 2006.
86. Software Considerations in Airborne Systems and Equipment Certiftcalion. Radio Technical Commission for Aeronautics (RTCA) Standard DO-178B/ED-12B, errata issued on 26 Mar. 1999, Dec. 1992.
87. Final Annual Report for Clarification of DO-178B, Radio Technical Commission for Aeronautics (RTCA) Standard DO-248B, Dec. 2001.
88. B. Ramesh and M. Jarke, "Toward Reference Models of Requirements Traceability," IEEE Trans. Software Eng., vol. 27, no. 1, pp. 58-93, Jan. 2001.
89. "KAON2," Research Center for Information Technologies (FZI), University of Karlsruhe, Germany, and Univ. of Manchester, UK, http://kaon2.semanticiweb.org/, 2006.
90. RTCA Inc., Washington, D.C., http://www.rtca.org/, Mar. 2006.
91. RuleML, Rule Markup Initiative, http://www.ruleml.org/, 2006.
92. J. Rushby, "Critical Systems Properties: Survey and Taxonomy," Technical Report CSL-93-01, rev. Feb. 1994, Center for High Assurance Computer Systems, US Naval Research Laboratory, Washington, D.C., May 1994.
93. Architecture Analysis & Design Language (AADL), Soc. Automotive Eng. Int'l. Standard 1.0, SAE Embedded Computing Systems Committee, Nov. 2004.
94. S.A. Selberg and M.A. Austin, "Requirements Engineering and the Semantic Web," Technical Report TR 2003-20, Inst. for Systems Research, College Park, Md., 2003.
95. R. Settimi, J. Cleland-Huang, O. Ben Khadra, J. Mody, W. Lukasik, and C. DePalma, "Supporting Software Evolution through Dynamically Retrieving Traces to UML Artifacts," Proc. Seventh Inl'l Workshop Principles of Software Evolution/Int'l Requirements Eng. Conf. (RE '04), pp. 49-54, Sept. 2002.
96. S.A. Sherba, K.M. Anderson, and M. Faisal,' "A Framework for Mapping Traceability Relationships," Proc. Second Int'l Workshop Trnceability in Emerging Forms Software Eng./Int'l Conf. Automated Software Eng. (ASE '03), Oct. 2003.
97. R. Smullyan, Theory of Formal Systems. Princeton Univ. Press, 1961.
98. "Capability Maturity Model Integration for Systems Engineering, Software Engineering, Integrated Product and Process Development, and Supplier Sourcing," Technical Report CMU/SEI-2002-TR-012, Software Eng. Inst., Carnegie Mellon Univ., Pittsburgh, Pa., Mar. 2002.
99. J. Sun, J. Song Dong, J. Liu, and H. Wang, "A Formal Object Approach to the Design of ZML," Annals of Software Eng., vol. 13, nos. 1-4, pp. 329-356, 2002.
100. C. Taylor, J. Alves-Foss, and B. Rinker, "Merging Safety and Assurance: The Process of Dual Certification for Software," Proc. Systems and Software Technology Conf., Apr. 2002.
101. T. Tilley, "Formal Concept Analysis Applications to Requirements Engineering and Design," dissertation, Univ. of Queensland, Brisbane, Australia, Nov. 2003.
102. T. Tilley, "Towards an FCA Based Tool for Visualizing Formal Specifications," Using Conceptual Structures: Contributions to ICCS 2003, pp. 227-240, 2003.
103. T. Tilley, R. Cole, P. Becker, and P. Eklund, "A Survey of Formal Concept Analysis Support for Software Engineering Activities," Proc. First Int'l Conf. Formal Concept Analysis (IFFCA '03), Feb. 2003.
104. Software Eng. Research Laboratory, Univ. of Colorado at Boulder, http://www-serl.cs.colorado.edu/, 2006.
105. "Project Bauhaus," Universität Stuttgart, Germany, http://www.bauhaus-stuttgart.de/bauhaus/, 2006.
106. W. Van Lepthien and K.M. Anderson, "Unifying Structure, Behavior, and Data with Themis Types and Templates," Proc. 15th ACM Conf. Hypertext and Hypermedia (HT '04), pp. 256-265, Aug. 2004.
107. Mathematical Markup Language (MalhML) 2.0, W3C Recommendation, second ed., http://www.w3.org/TR/MathML2/, Oct. 2003.
108. XSL Transformations (XSLT), W3C Recommendation REC-xslt-19 991116, rev. version 1.0, http://www.w3.org/TR/xslt, Nov. 1999.
109. Extensible Markup Language (XML) 1.0, W3C Recommendation REC-xml-20 040 204, revised, third ed., Feb. 2004.
110. K.A. Weiss, N.G. Leveson, K. Lundqvist, N. Farid, and M. String-fellow, "An Analysis of Causation in Aerospace Accidents," Proc. Digital Avionics Systems Conf. (DASC '01), pp. 137-147, Oct. 2001.
111. A. Winter, B. Kullbach, and V. Riediger, "An Overview of the GXL Graph Exchange Language," Lecture Notes in Computer Science, vol.2269, pp. 324-336, May 2002.
112. "W3C," World Wide Web Consortium, http://www.w3.org/, 2006.
113. Z. Yu and V. Rajlich, "Hidden Dependencies in Program Comprehension and Change Propagation," Proc. Ninth Int'l Workshop Program Comprehension (IWPC '01), pp. 293-299, 2001.
114. "Emergent Properties," The Stanford Encyclopedia of Philosophy, E.N. Zalta, ed., Metaphysics Research Lab Center for the Study of Language and Information, http://plato.stanford.edu/entries/properties- emergent/, Mar. 2006.