The Use of Self Checks and Voting in Software Error Detection: An Empirical Study

IEEE Transactions on Software Engineering

Volumn 16, Issue 4, 1990, Pages 432-443

  Leveson, Nancy G ^a   Cha, Stephen S ^a   Knight, John C ^b   Shimeall, Timothy J ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF VIRGINIA   (United States)

^c NAVAL POSTGRADUATE SCHOOL   (United States)

Author keywords

Acceptance tests; assertions; error detection; N version programming; software fault tolerance; software reliability

Indexed keywords

COMPUTER PROGRAMMING;

ERROR DETECTION; N-VERSION VOTING; SELF-CHECKING; SOFTWARE ERROR DETECTION;

COMPUTER SOFTWARE;

EID: 0025414676     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/32.54295     Document Type: Article

References (29)

1. T. Anderson, P. A. Barrett, D. N. Halliwell, and M. R. Moulding, “An evaluation of software fault tolerance in a practical system,” in Dig. Papers FTCS-15: Fifteenth Annu. Symp. Fault-Tolerant Computing. Ann Arbor, Ml, June 1985, pp. 140–145.
2. T. Anderson and P. A. Lee. Fault Tolerance: Principles and Practice. Englewood Cliffs. NJ: Prentice-Hall International, 1981.
3. D. M. Andrews, “Using executable assertions for testing and fault tolerance,” in Proc. Ninth Int. Symp. Fault-Tolerant Computer Systems. June 1979, pp. 102–105.
4. A. Avizienis and J. P. J. Kelly, “Fault tolerance by design diversity: concepts and experiments,” Computer, vol. 17, no. 8, pp. 67–80. Aug. 1984.
5. J. P. Benson and S. H. Saib, “A software quality assurance experiment,” in Proc. Software Quality and Assurance Workshop. Nov. 1978, pp. 87–91.
6. P. Bishop. D. Esp, M. Barnes. P. Humphreys, G. Dahll. J. Lahti. and S. Yoshimura, “PODS—A project on diverse software,” IEEE Trans. Software Eng., vol. SE-12, no. 9, pp. 929–940. Sept. 1986.
7. S. S. Brilliant, “Testing software using multiple versions,” Ph.D. dissertation. Univ. Virginia. Sept. 1987.
8. S. S. Brilliant. J. C. Knight, and N. G. Leveson, “Analysis of faults in an N-version software experiment,” IEEE Trans. Software Eng., vol. 16, no. 2, pp. 238–247. Feb. 1990.
9. —, “The consistent comparison problem in N-vcrsion software,” IEEE Trans. Software Eng., vol. 15, no. 11, pp. 1481–1485. Nov. 1989.
10. L. Chen and A. Avizienis, “N-version programming: A fault-tolerance approach to reliability of software operation,” in Dig. Papers FTCS-8: Eighth Annu. Symp. Fault Tolerant Computing. Toulouse. France, June 1978, pp. 3–9.
11. J. R. Dunham, “Software errors in experimental systems having ultra-reliability requirements,” in Dig. Papers FTCS-16: Sixteenth Annu. Symp. Fault-Tolerant Computing. Vienna. Austria. July 1986, pp. 158–164.
12. L. Gmeiner and U. Voges, “Software diversity in reactor protection system: An experiment,” in Proc. IFAC Workshop SAFECOMP 79, 1979, pp. 75–79.
13. D. Gries. The Science Of Programming. New York: Springer-Verlag. 1981.
14. A. L. Hopkins, et al., “FTMP—A highly reliable fault-tolerant multiprocessor for aircraft,” Proc. IEEE. vol. 66, pp. 1221–1239. Oct. 1978.
15. J. P. J. Kelly et al., “Multi-version software development,” in Proc. IFAC Workshop Safecomp ’86. Sarlat, France. Oct. 1986, pp. 43–49.
16. J. C. Knight and N. G. Leveson, “An experimental evaluation of the assumption of independence in multi-version programming,” IEEE Trans. Software Eng., vol. se-12, pp. 96–109. Jan. 1986.
17. —, “An empirical study of failure probabilities in multi-version software,” in Dig. Papers FTCS-16: Sixteenth Annu. Symp. Fault-Tolerant Computing. Vienna. Austria. July 1986, pp. 165–170.
18. N. G. Leveson and P. R. Harvey, “Analyzing software safety,” IEEE Trans. Software Eng., vol. SE-9, no. 5, pp. 569–579. Sept. 1983.
19. N. G. Leveson. and T. J. Shimeall, “Safety assertions for process-control systems,” in Dig. Papers FTCS-13: Thirteenth Annu. Symp. Fault-Tolerant Computing. Milan, Italy. June 1983, pp. 236–240.
20. H. Partsch and R. Steinbrüsggen, “Program transformation systems,” ACM Comput. Surveys, vol. 15, no. 3, pp. 199–236. Sept. 1983.
21. C. V. Ramamoorthy, Y. K. Mok. E. B. Bastani, G. H. Chin, and K. Suzuki, “Application of a methodology for the development and validation of reliable process control software,” IEEE Trans. Software Eng., vol. SE-7, no. 6, pp. 537–555. Nov. 1981.
22. B. Randell, “System structure for software fault-tolerance,” IEEE Trans. Software Eng., vol. SE-1, no. 2, pp. 220–232, June 1975.
23. F. Saglietti and W. Ehrenberger, “Software diversity—Some considerations about its benefits and its limitations,” in Proc. Safecomp ’86. Sarlat. France, Oct. 1986, pp. 27–34.
24. R. D. Schliehting and F. B. Schneider, “Fail-stop processors: An approach to designing fault-tolerant computing systems,” ACM Trans. Comput. Syst., vol. 1, pp. 222–238. Aug. 1983.
25. K. R. Scott. J. W. Gault. D. F. McAllister, and J. Wiggs, “Experimental validation of six fault tolerant software reliability models,” in Dig. Papers FTCS-14: Fourteenth Annu. Symp. Fault-Tolerant Computing. Kissemmee. NY. 1984, pp. 102–107.
26. T. J. Shimeall and N. G. Leveson, “An empirical comparison of software fault tolerance and fault elimination,” in Proc. 2nd Workshop Software Testing. Verification, and Analysis. Banff. Alta., Canada. July 1988, pp. 180–187.
27. —s, “An empirical comparison of software fault tolerance and fault elimination,” Naval Postgraduate School. Monterey. CA, Tech. Rep. NPS52-89-D47. July 1989.
28. L. G. Stucki, “New directions in automated tools for improving software quality,” in Current Trends in Programming Methodology— volume II: Program Validation. Englewood Cliffs. NJ: Prentice-Hall, 1977, pp. 80–111.
29. J. H. Wensley et al., “SIFT, the design and analysis of a fault-tolerant computer for aircraft control,” Proc. IEEE. vol. 66, pp. 1240–1254, Oct. 1978.