Modeling software design diversity - A review

ACM Computing Surveys

Volumn 33, Issue 2, 2001, Pages 177-208

  Littlewood, Bev ^a   Popov, Peter ^a   Strigini, Lorenzo ^a  

^a CITY UNIVERSITY   (United Kingdom)

Author keywords

AT version software; Control systems; Design; Functional diversity, multiple version programming; Protection systems; Reliability; Safety; Software fault tolerance

Indexed keywords

COMPUTER HARDWARE; COMPUTER PROGRAMMING; CONTROL SYSTEM ANALYSIS; FAULT TOLERANT COMPUTER SYSTEMS; PROBABILITY; PROJECT MANAGEMENT; REAL TIME SYSTEMS; RELIABILITY; SPREADSHEETS; STATISTICAL METHODS;

FUNCTIONAL DIVERSITY; PROTECTION SYSTEMS; SOFTWARE DESIGN;

SOFTWARE ENGINEERING;

EID: 0003201474     PISSN: 03600300     EISSN: None     Source Type: Journal    
DOI: 10.1145/384192.384195     Document Type: Article

References (51)

1. ADAMS, E. N. 1984. Optimizing preventive service of software products. IBM J. Res. Devel. 28, 1, 2-14.
2. AMMANN, P. E. AND KNIGHT, J. C. 1988. Data diversity: An approach to software fault tolerance. IEEE Trans. Comput. C-37, 4, 418-425.
3. ANDERSON, T., BARRETT, P. A., HALLIWELL, D. N. AND MOULDING, M. R. 1985. An evaluation of software fault tolerance in a practical system. In Proceedings ofthe 15th IEEE International Symposium on Fault-Tolerant Computing (FTCS15). (Ann Arbor, MI.)
4. BABBAGE, C. 1974. On the mathematical powers of the calculating engine (unpublished manuscript, December 1837). In The Origins of Digital Computers: Selected Papers, B. Randell, Ed. SpringerVerlag, New York, 17-52.
5. BISHOP, P. G. 1988. The PODS diversity experiment. In Software Diversity in Computerized Control Systems, U. Voges, Ed. Springer-Verlag, New York, pp. 51-84.
6. BISHOP, P. G. AND PULLEN, F. D. 1988. PODS revisited-A study of software failure behavior. In Proceedings of the 18th International Symposium on Fault-Tolerant Computing. (Tokyo), IEEE Computer Society Press, Los Alamitos, Calif.
7. BLOUGH, D. M. AND SULLIVAN, G. 1990. A comparison of voting strategies for fault-tolerant distributed systems. In Ninth Symposium on Reliable Distributed Systems (SRDS-9) (Huntsville, AL), IEEE Computer Society.
8. BONDAVALLI, A., CHIARADONNA, S., Dl GlANDOMENICO, F. AND STRIGINI, L. 1999. A contribution to the evaluation of the reliability of iterativeexecution software. Soft. Test. Verif. Reliab. 9, 3, 145-166.
9. BRIERE, D. AND TRAVERSE, P. 1993. Airbus A320/A330/A340 electrical flight controls-A family of fault-tolerant systems. In Proceedings of the 23rd International Symposium on FaultTolerant Computing (FTCS-23). (Toulouse, France), IEEE Computer Society, Los Alamitos, Calif.
10. Dl GlANDOMENICO, F. AND SlRIGlNI, L. 1990. Adjudicators for diverse-redundant components. In Ninth Symposium on Reliable Distributed Systems (SRDS-9) (Huntsville, AL.), IEEE Computer Society Press, Los Alamitos, Calif.
11. DYER, M. 1992. The Cleanroom Approach to Quality Software Development. Software Engineering Practice. Wiley, New York.
12. ECKHARDT, D. E. AND LEE, L. D. 1985. A theoretical basis for the analysis of multiversion software subject to coincident errors. IEEE Trans. Softw. Eng. SE-11, 12, 1511-1517.
13. FAA 1985. Federal Aviation Administration, Advisors Circular AC 25 1309-1A.
14. HAGELIN, G. 1988. ERICSSON safety systems for railway control. In Software Diversity in Computerized Control Systems, U. Voges, Ed. Springer-Verlag, New York, pp. 11-21.
15. HUANG, Y., KlNTALA, C., KoLETTIS, N. AND FuLTON, N. D. 1995. Software rejuvenation: Analysis, module and applications. In 25th International Symposium on Fault Tolerant Computing (FTCS-25) (Pasadena), IEEE Computer Society Press, Los Alamitos, Calif.
16. HUGHES, R. P. 1987. A new approach to common cause failure. Reliab. Eng. 17, 211-236.
17. KANTZ, H. AND KOZA, C. 1995. The ELEKTRA railway signalling-system: Field experience with an actively replicated system with diversity. In Proceedings of the 25th IEEE Annual International Symposium on Fault -Tolerant Computing (FTCS-25) (Pasadena), IEEE Computer Society Press, Los Alamitos, Calif.
18. KERSKEN, M. AND SAGLIETTI, F. Eds. 1992. Software fault tolerance: Achievement and assessment strategies. Research Reports ESPRIT, SpringerVerlag, New York.
19. KNIGHT, J. C. AND AMMAN, P. E. 1985. An experimental evaluation of simple methods for seeding program errors. In Proceedings of the Eighth International Conference on Software Engineering, IEEE Computer Society Press, Los Alamitos, Calif.
20. KNIGHT, J. C. AND LEVESON, N. G. 1986. An experimental evaluation of the assumption of independence in multi-version programming. IEEE Trans. Softw. Eng. SE-12, 1, 96-109.
21. KNIGHT, J. C. AND LEVESON, N.G. 1990. A reply to the criticism of the Knight & Leveson experiment. ACM SIGSOFT Softw. Eng. Notes 15, 1, 2435.
22. LAPRIE, J. C., ARLAT, J., BEOUNES, C. AND KANOUN, K. 1990. Definition and analysis of hardwareand-software fault-tolerant architectures. IEEE Comput. 23, 7, 39-51.
23. LARYD, A. 1994. Operating experience of software in programmable equipment used in ABB Atom nuclear I&C application. In Advanced Control and Instrumentation Systems in Nuclear Power Plants. Design, Verification and Validation. IAEA/IWG/ATWR & NPPCI Technical Committee Meeting (Espoo, Finland).
24. LEE, I. AND IYER, R. K. 1995. Software dependability in the Tandem GUARDIAN system. IEEE Trans. Softw. Eng. 21, 5, 45567.
25. LINDEBERG, J. F. 1993. The Swedish state railways' experience with n-version programmed systems. In Directions in Safety-Critical Systems, F. Redmill and T. Anderson, Eds. SpringerVerlag, New York, p. 36.
26. LITTLEWOOD, B. 1996. The impact of diversity upon common mode failures. Reliab. Eng. Syst. Safety. 51, 101-113.
27. LlTTLEWOOD, B. POPOV, P., STRIGINI, L. AND SlIRYANE, N. 2000. Modelling the effects of combining diverse software fault removal techniques. IEEE Trans. Softw. Eng. SE-26,12,1157-1167.
28. LITTLEWOOD, B. AND MILLER, D. R. 1989. Conceptual modelling of coincident failures in multi-version software. IEEE Trans. Softw. Eng. SE-15, 12, 1596-1614.
29. LITTLEWOOD, B. AND STRIGINI, L. 1993. Validation of ultra-high dependability for software-based systems. Communi. ACM, 36, 11, (Nov.), 69-80.
30. LITTLEWOOD, B. AND STRIGINI, L. 1998. Guidelines for the statistical testing of software. Centre for Software Reliability, City University, London.
31. LlTTLEWOOD, B., POPOV, P., AND STRIGINI, L. 1999. A note on reliability estimation of functionally diverse systems. Reliab. Eng. Syst. Safety. 66, 9395.
32. LYU, M. R. Ed. 1995. Software Fault Tolerance. Wiley, New York, 337.
33. LYU, M. R. Ed. 1996. Handbook of Software Reliability Engineering. IEEE Computer Society Press and McGraw-Hill, New York.
34. MIGNEAULT, G. E. 1982. The Cost of Software Fault Tolerance Technical Report. NASA Langley Research Center, Hampton, Va.
35. MoD, 1996. Safety management requirements for defence systems. U.K. Ministry of Defence.
36. MoD, 1997. Requirements for safety related software in defence equipment. U.K. Ministry of Defence.
37. MONGARDI, G. 1993. Dependable computing for railway control systems. In Third IFIP International Working Conference on Dependable Computing for Critical Applications (DCCA-3) (Mondello, Italy).
38. MusA.J. D. 1993. Operational profiles in softwarereliability engineering. IEEE Softw. (March), 14-32.
39. NICOLA, V. F. AND GOYAL, A. 1990. Modeling of correlated failures and community error recovery in multiversion software. IEEE Trans. Softw. Eng. 16,3, 350-359.
40. POPOV, P. T. AND STRIGINI, L. 1998. Conceptual models for the reliability of diverse systems-New results. In Proceedings of the 28th International Symposium on Fault-Tolerant Computing (FTCS-28) (Munich, Germany) IEEE Computer Society Press, Los Alamitos, Calif.
41. POPOV, P., STRIGINI, L., AND PIZZA, M. 1998. The efficacy of diverse redundancy against design error: Some practical considerations. In Preprints of the INucE Third International Conference on Control and Instrumentation in Nuclear Installations (Edinburgh).
42. RTCA/EuroCAE, 1992. DO-178B, Software considerations in airborne systems and equipment certification.
43. SHOOJIAN, M. 1996. Avionics software problem occurrence rates. In ISSRE'96, Seventh International Symposium on Software Reliability Engineering (White Plains, NY).
44. SMITH, I. C., WALL, D. N, AND BALDWIN, J. A. 1991. DARTS-An experiment into cost of and diversity in safety critical computer systems. In IFAC/IFIP/EWICS/SRE Symposium on Safety of Computer Control Systems (SAFECOMP '91). (Trondheim, Norway), Pergamon Press.
45. STRIGINI, L. 1996. On testing process control software for reliability assessment: The effects of correlation between successive failures. Softw. Test. Verif. Reliab. 6,1, 36-48.
46. TRAVERSE, P. J. 1988. AIRBUS and ATR system architecture and spécification. In Software Diversity in Computerized Control Systems, U. Voges, Ed. Springer-Verlag, New York, pp. 95104.
47. TURNER, D. B., BURNS, R. D., AND HECHT, H. 1987. Designing micro-based systems for fail-safe travel. IEEE Spectrum 24, 2, 58-63.
48. VOCES, U. AND GMEINER, L. 1979. Software diversity in reactor protection systems: An experiment. In IFAC Workshop, SAFECOMP'79 (Stuttgart, Germany May 16-18).
49. VOCES, U. Ed. 1988. Software Diversity in Computerized Control Systems. Dependable Computing and Fault-Tolerance Series. Springer-Verlag, Wien, Austria.
50. VOCES, U. 1994. Software diversity. Reliab. Eng. Syst. Safety 43, 2,103-110.
51. YEH, Y. C. B. 1998. Design considerations in Boeing 777 fly-by-wire computers. In Third IEEE High-Assurance Systems Engineering Symposium (HASE). (Washington, DC) IEEE Computer Society Press, Los Alamitos, Calif.