Assessing the risk due to software faults: Estimates of failure rate versus evidence of perfection

Software Testing Verification and Reliability

Volumn 8, Issue 3, 1998, Pages 155-166

  Bertolino, Antonia ^a   Strigini, Lorenzo ^b  

^a ISTI CNR   (Italy)

^b CITY UNIVERSITY   (United Kingdom)

Author keywords

Program correctness; Software assessment; Software reliability and safety; Software safety standards; Statistical testing

Indexed keywords

COMPUTER SYSTEM RECOVERY; FAILURE ANALYSIS; RELIABILITY; RISK ASSESSMENT; STANDARDS; STATISTICAL TESTS;

SOFTWARE SAFETY STANDARDS;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 0032154066     PISSN: 09600833     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1099-1689(1998090)8:3<155::AID-STVR163>3.0.CO;2-B     Document Type: Article

References (24)

1. Barwise, J. (1989) 'Mathematical proofs of computer system correctness', Notices of the American Mathematical Society, 36, 844-851.
2. Bertolino, A. and Strigini, L. (1996a) 'Acceptance criteria for critical software based on testability estimates and test results', 15th International Conference on Computer Safety, Reliability and Security (SAFECOMP '96), Vienna, Austria, Springer, Berlin, Germany, pp. 83-94.
3. Bertolino, A. and Strigini, L. (1996b) 'On the use of testability measures for dependability assessment', IEEE Transactions on Software Engineering, 22(2), 97-108.
4. Bertolino, A. and Strigini, L. (1996c) 'Predicting software reliability from testing taking into account other knowledge about a program', Quality Week '96, San Francisco, Software Research Institute, San Francisco, California, U.S.A.
5. Delic, K. A., Mazzanti, F. and Strigini, L. (1997) 'Formalising engineering judgement on software dependability via belief networks', Sixth IFIP International Working Conference on Dependable Computing for Critical Applications, "Can We Rely on Computers?" (DCCA-6), Garmisch-Partenkirchen, Germany, IEEE Computer Society Press, Los Alamitos, California, U.S.A., pp. 291-305.
6. FAA (1985) Advisory Circular AC 25.1309-1A, Federal Aviation Administration.
7. Fetzer, J. H. (1988) 'Program verification: the very idea', Communications of the ACM, 31(9), 1048-1063.
8. Galves, A. and Gaudel, M.-C. (1998) 'Rare events in stochastic dynamical systems and failures in ultra-reliable reactive programs', 28th International Symposium on Fault-tolerant Computing (FTCS-98), Munich, Germany, IEEE Computer, Society Press, Los Alamitos, California, U.S.A., pp. 324-333.
9. Garman, J. R. (1981) 'The 'bug' heard round the world', ACM SIGSOFT Software Engineering Notes, 6(5), 3-10.
10. Hamlet, D. (1992) 'Are we testing for true reliability?', IEEE Software, 9(4), 21-27.
11. Hamlet, R. G. (1987) 'Probable correctness theory', Information Processing Letters, 25(1), 17-25.
12. Howden, W. E. and Huang, Y. (1995) 'Software trustability analysis', ACM Transactions on Software Engineering and Methodology, 4(1), 36-64.
13. IEC (1995) 'Functional safety: safety related systems', International Electrical Commission, Draft IEC 1508, IEC/SC65AAVG 9 and 10, Proposed Standard.
14. Lions, J. L. (1996) 'Report by the Inquiry Board on the Ariane 5 Flight 501 Failure', ESA/CNES.
15. Littlewood, B. and Strigini, L. (1993) 'Validation of ultra-high dependability for software-based systems', Communications of the ACM, 36(11), 69-80.
16. Littlewood, B. and Wright, D. (1995) 'A Bayesian model that combines disparate evidence for the quantitative assessment of system dependability', 14th International Conference on Computer Safety, Reliability and Security (SAFECOMP '95), Belgirate, Italy, Springer, Berlin, Germany, pp. 173-188.
17. Littlewood, B. and Wright, D. (1997) 'Some conservative stopping rules for the operational testing of safety-critical software', IEEE Transactions on Software Engineering, 23(11), 673-683.
18. Miller, K. W., Morell, L. J., Noonan, R. E., Park, S. K., Nicol, D. M., Murrill, B. W. and Voas, J. M. (1992) 'Estimating the probability of failure when testing reveals no failures', IEEE Transactions on Software Engineering, 18(1), 33-43.
19. Neil, M., Littlewood, B. and Fenton, N. (1996) 'Applying Bayesian belief networks to systems dependability assessment', Safety Critical Systems: The Convergence of High Tech and Human Factors: Proceedings of the 4th Safety-critical Systems Symposium, Leeds, U.K., Springer, Berlin, Germany, pp. 71-94.
20. Parnas, D. L., van Schouwen, A. J. and Kwan, S. P. (1990) 'Evaluation of safety-critical software', Communications of the ACM, 33(6), 636-648.
21. RTCA/EUROCAE (1993) 'Software considerations in airborne systems and equipment certification', Document RTCA DO-178B/EUROCAE ED-12B.
22. Strigini, L. (1996) 'On testing process control software for reliability assessment: the effects of correlation between successive failures', Software Testing, Verification and Reliability, 6(1), 36-48.
23. Strigini, L. and Fenton, N. (1996) 'Rigorously assessing software reliability and safety', ESA Software Product Assurance Workshop, Nordvjik, The Netherlands, European Space Agency, pp. 193-198.
24. Voas, J. M., Michael, C. C. and Miller, K. W. (1995) 'Confidently assessing a zero probability of software failure', High Integrity Systems, 1(3), 269-275.