On the use of testability measures for dependability assessment

IEEE Transactions on Software Engineering

Volumn 22, Issue 2, 1996, Pages 97-108

  Bertolino, Antonia ^a   Strigini, Lorenzo ^b  

^a ISTI CNR   (Italy)

^b CITY UNIVERSITY   (United Kingdom)

Author keywords

Bayesian inference; Error; Failure; Fault; Reliability assessment software testing; Test oracle; Testability; Ultra high reliability

Indexed keywords

EID: 0001916887     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/32.485220     Document Type: Article

References (31)

1. E.N. Adams, "Optimizing preventive service of software products," IBM J. of Research and Development, vol. 28, no. 1, pp. 2-14, Jan. 1984
2. P.E. Amman, S.S. Brilliant and J. Knight, "The effect of imperfect error detection on reliability assessment via life testing," IEEE Trans. on Software Engineering, vol. 20, no. 2, pp 142-148, Feb. 1994.
3. A. Avizienis, "The N-version approach to fault-tolerant software," IEEE Irans, on Software Engineering, vol. 11, no.12, pp. 1491-1501, 1985.
4. R. Bache and M. Müllerburg, "Measures of testability as a basis for quality assurance," Software Engineering J., vol. 5, pp. 86-92, Mar. 1990.
5. P.G. Bishop and F.D. Pullen, "Error masking: a source of failure dependency in multi-version programs," Proc. First IFIP Working Conf. Dependable Computing for Critical Applications, Santa Barbara, Calif.: Springer-Verlag, 1989, pp. 53-73.
6. A. Bondavalli, S. Chiaradonna, F. Di Giandomenico and L. Strigini, "Dependability analysis of iterative fault-tolerant software considering correlation," B. Randell, J.-C. Laprie, H. Kopetz, and B. Littlewood, eds., Predictably Dependable Computing Systems, Esprit Bask Research Series. Springer-Verlag, 1995, pp. 459-471.
7. R.S. Freedman, "Testability of software components," IEEE Trans. Software Engineering, vol. 17, no. 6, pp. 553-564, June 1991.
8. R.G. Hamlet, "Probable correctness theory," Information Processing Letters, vol. 25, no. 1, pp. 17-25, Apr. 1987.
9. D. Hamlet, "Are we testing for true reliability?" IEEE Software, pp. 21-27, July 1992.
10. D. Hamlet and R. Taylor, "Partition testing does not inspire confidence," IEEE Trans. on Software Engineering, vol. 16, no. 12, pp. 1402-1411, Dec. 1990.
11. D. Hamlet and J. Voas, "Faults on its sleeve: Amplifying software reliability testing," 1993 Int'l Symp. Software Testing and Analysis (ISSTA), Cambridge, Mass., pp. 89-98, June 28-30, 1993, ACM SIGSOFT Software Engineering Notes, vol. 18 no. 3, July 1993.
12. H. Hecht, "Fault-tolerant software," IEEE Trans. on Reliability, vol. 28, no. 3, pp. 227-232, Aug. 1979.
13. W.E. Howden and Y. Huang, "Analysis of testing methods using failure rate and testability models," Tech. Report CSE, Univ. of Calif, at San Diego, 1993.
14. W.E. Howden and Y. Huang, "Software trustability," Proc. Fifth Int'l Symp. Software Reliability Engineering, Monterey, Calif., pp. 143-151, Nov. 6-9, 1994.
15. ISO/IEC 9126, "Information technology - software product evaluation - quality characteristics and guidelines for their use," 1st edition, 1991.
16. Dependability: Basic Concepts and Associated Terminology, J.C. Laprie, ed., vol. 5. 265 pp., Dependable Computing and Fault-Tolerant Systems series, Wien: Springer-Verlag, 1992.
17. N.G. Leveson, "Safety assertions for process-control systems," Proc. 13th Int'l Symp. Fault-Tolerant Computing, Milano, Italy, pp. 232-40, 1983.
18. B. Littlewood and L. Strigini, "Validation of ultra-high dependability for software-based systems," Comm. ACM, vol. 36, no. 11, pp. 69-80, Nov. 1993.
19. Software Fault Tolerance. MR. Lyu, ed., 337 pp., Trends in Software series, John Wiley & Sons, 1995.
20. C. Maunder, The Hoard Designer's Guide to Testable Logic Circuit. Addison-Wesley, 1992.
21. K.W. Miller, L.J. Morell, R.E. Noonan, S.K. Park, D.M. Nicol, B.W. Murrill, and J.M. Voas, "Estimating the probability of failure when testing reveals no failures," IEEE Trans. on Software Engineering, vol. 18, no.1, pp 33-44, Jan. 1992.
22. J.D. Musa, "Operational profiles in software-reliability engineering," IEEE Software, pp. 14-32, Mar. 1993.
23. D.L. Parnas, A.J. van Schouwen, and S.P. Kwan, "Evaluation of safety-critical software," Comm. ACM, vol. 33, no.6, pp. 636-648, June 1990.
24. C. Rabejac, "On-line software error detection by executable assertions: From theory to practice," Proc. 14th Int'l Conf. Computer Safety, Reliability and Security SAFECOMP 95, Belgirate, Italy, 1995.
25. L. Strigini, "Engineering judgment in reliability and safety and its limits: What can we learn from research in psychology?" SHIP project Tech. Report T030, July 1994.
26. J.M. Voas, "PIE: A dynamic failure-based technique," IEEE Trans. on Software Engineering, vol. 18, pp. 717-727, no. 8, Aug. 1992.
27. J.M. Voas, C.C. Michael, and K.W. Miller, "Confidently assessing a zero probability of software failure," High Integrity Systems, vol. 1, no. 3, pp. 269-275, 1995.
28. J.M. Voas and K.W. Miller, "Improving the software development process using testability research," Proc. Third Int'l Symp. Software Reliability Engineering, Research Triangle Park, North Carolina, pp. 114-121, Oct. 7-10, 1992.
29. J.M. Voas and K.W. Miller, "Putting assertions in their place," Proc. Fifth Int'l Symp. Software Reliability Engineering, Monterey, Calif., pp.152-157, Nov. 6-9, 1994.
30. J.M. Voas and K.W. Miller, "Software testability: The new verification," IEEE Software, pp. 17-28, May 1995.
31. T.W. Williams and K.P. Parker, "Design for testability - a survey," Proc. IEEE, vol. 71, no. 1, pp. 98-112, Jan. 1983.