An extended fault class hierarchy for specification-based testing

ACM Transactions on Software Engineering and Methodology

Volumn 14, Issue 3, 2005, Pages 247-276

  Lau, Man F ^a   Yu, Yuen T ^b  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Fault class analysis; Software testing; Specification based testing; Test case generation

Indexed keywords

FAULT CLASS ANALYSIS; SOFTWARE TESTING; SPECIFICATION-BASED TESTING; TEST CASE GENERATION;

COMPUTER SOFTWARE; FORMAL LOGIC; HIERARCHICAL SYSTEMS; LOGIC DESIGN; PRODUCT DESIGN; SOFTWARE ENGINEERING;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 33646025729     PISSN: 1049331X     EISSN: 1049331X     Source Type: Journal    
DOI: 10.1145/1072997.1072998     Document Type: Article

References (50)

1. AMMANN, P., DING, W., AND XU, D. 2001. Using a model checker to test safety properties. In Proceedings of the 7th Annual International Conference on Eng. of Complex Computer Systems (ICECCS '01). 212-221.
2. AMMANN, P. E. AND BLACK, P. E. 2001. A specification-based coverage metric to evaluate test sets. Int. J. Reliab. Qual. Safety Eng. 8, 4 (Dec.), 275-299.
3. ATLEE, J. M. AND BUCKLEY, M. A. 1996. A logic-model semantics for SCR software requirements. In Proceedings of 1996 International Symposium on Software Testing and Analysis (ISSTA '96). 280-292.
4. ATLEE, J. M. AND GANNON, J. 1993. State-based model checking of event-driven system requirements. IEEE Trans. Softw. Eng. 19, 1 (Jan.), 24-40.
5. BLACK, P. E., OKUN, V., AND YESHA, Y. 2000a. Mutation of model checker specifications for test generation and evaluation. In Proceedings of Mutation 2000. 14-20.
6. BLACK, P. E., OKUN, V., AND YESHA, Y. 2000b. Mutation operators for specifications. In Proceedings of the 15th Automated Software Engineering Conference (ASE 2000). 81-88.
7. CHAN, W., ANDERSON, R. J., BEAME, P., BURNS, S., MODUGNO, F., NOTKIN, D., AND REESE, J. D. 1998. Model checking large software specifications. IEEE Trans. Softw. Eng. 24, 7 (July), 498-520.
8. CHANO, J., RICHARDSON, D. J., AND SANKAR, S. 1996. Structural specification-based testing with ADL. In Proceedings of 1996 International Symposium on Software Testing and Analysis (ISSTA '96). 62-70.
9. CHEN, T. Y. AND LAU, M. F. 1997. Two test data selection strategies towards testing of Boolean specifications. In Proceedings of the 21st International Computer Software and Application Conference (COMPSAC '97). 608-611.
10. CHEN, T. Y. AND LAU, M. F. 2001. Test case selection strategies based on Boolean specifications. Softw. Test. Verif. Reliab. 11, 3 (Sept.), 165-180.
11. CHEN, T. Y., LAU, M. F., AND YU, Y. T. 1999. MUMCUT: A fault-based strategy for testing Boolean specifications. In Proceedings of Asia-Pacific Software Engineering Conference (APSEC '99). 606-613.
12. CHEN, T. Y. AND YU, Y. T. 1994. On the relationship between partition and random testing. IEEE Trans. Softw. Eng. 20, 12 (Dec.), 977-980.
13. CHEN, T. Y. AND YU, Y. T. 1996. On the expected number of failures detected by subdomain testing and random testing. IEEE Trans. Softw. Eng. 22, 2 (Feb.), 109-119.
14. CHILENSKI, J. J. AND MILLER, S. P. 1994. Applicability of modified condition/decision coverage to software testing. IEE/BCS Softw. Eng. J. 9, 5 (Sept.), 193-200.
15. DARAN, M. AND THÉVENOD-FOSSE, P. 1996. Software error analysis: A real case study involving real faults and mutations. In Proceedings of 1996 International Symposium on Software Testing and Analysis (ISSTA '96). 158-171.
16. DEMILLO, R. A., LIPTON, R. J., AND SAYWARD, F. G. 1978. Hints on test data selection: Help for the practicing programmer. Computer 11, 4 (Apr.), 34-41.
17. DICK, J. AND FAIVRE, A. 1993. Automating the generation and sequencing of test cases from model-based specifications. In Proceedings of the First International Symposium of Formal Methods Europe (FME 1993). Lecture Notes in Computer Science, vol. 670. Springer, Berlin, Germany, 19-23.
18. DUPUY, A. AND LEVESON, N. 2000. An empirical evaluation of the MC/DC coverage criterion on the HETE-2 satellite software. In Proceedings of Digital Aviation Systems Conference (DASC 2000).
19. DURAN, J. W. AND NTAFOS, S. C. 1984. An evaluation of random testing. IEEE Trans. Softw. Eng. 10, 4 (July), 438-444.
20. ELBAUM, S., MALISHEVSKY, A. G., AND ROTHERMEL, G. 2002. Test case prioritization: A family of empirical studies. IEEE Trans. Softw. Eng. 28, 2 (Feb.), 159-182.
21. FOSTER, K. A. 1980. Error sensitive test cases analysis (ESTCA). IEEE Trans. Softw. Eng. 6, 2 (May), 258-264.
22. FOSTER, K. A. 1984. Sensitive test data for logic expressions. ACM SIGSOFT Softw. Eng. Notes 9, 2 (Apr.), 120-125.
23. GAHOANTINI, A. AND HEITMEYEH, C. 1999. Using model checking to generate tests from requirements specifications. In Proceedings of the 7th European Software Engineering Conference and the 7th ACM SIGSOFT Symposium on the Foundations of Software Engineering. Lecture Notes in Computer Science, vol. 1687. Springer, Berlin, Germany, 146-162.
24. GAHOANTINI, A. AND RICCOBENE, E. 2001. ASM-based testing: Coverage criteria and automatic test sequence generation. J. Univers. Comput. Sci. 7, 11 (Nov.), 1050-1167.
25. GARGANTINI, A. AND RICCOBENE, E. 2003. Automatic model driven animation of SCR specifications. In Proceedings of the Sixth International Conference on Fundamental Approaches to Software Engineering (FASE 2003). Lecture Notes in Computer Science, vol. 2621. Springer, Berlin, Germany, 294-309.
26. HEIMDAHL, M. P. AND LEVESON, N. G. 1996. Completeness and consistency in hierarchical state-based requirements. IEEE Trans. Softw. Eng. 22, 6 (June), 363-377.
27. HEITMEYER, C. AND BHARADWAJ, R. 2000. Applying the SCR requirements method to the light control case study. J. Univers. Comput. Sci. 6, 7 (Aug.), 650-678.
28. HIERONS, R. M. 1997. Testing from a Z specification. Softw. Test. Verif. Reliab. 7, 1 (Mar.), 19-33.
29. HIERONS, R. M. 2002. Comparing test sets and criteria in the presence of test hypotheses and fault domains. ACM Trans. Softw. Eng. Method. 11, 4 (Oct.), 427-448.
30. JONES, J. A. AND HARROLD, M. J. 2003. Test-suite reduction and prioritization for modified condition/decision coverage. IEEE Trans. Softw. Eng. 29, 3 (Mar.), 195-209.
31. KOBAYASHI, N., TSUCHIYA, T., AND KIKUNO, T. 2002. Non-specification-based approaches to logic testing for software. Inf. Softw. Tech. 44, 2 (Feb.), 113-121.
32. KUHN, D. R. 1999. Fault classes and error detection capability of specification-based testing. ACM Trans. Softw. Eng. Method. 8, 4 (Oct.), 411-424.
33. LAU, M. F. AND YU, Y. T. 2001. On the relationships of faults for Boolean specification based testing. In Proceedings of Australian Software Engineering Conference (ASWEC 2001). 21-28.
34. LEVESON, N. G., CHA, S. S., AND SHIMEALL, T. J. 1991. Safety verification of ADA programs using software fault trees. IEEE Softw. 8, 4 (July), 48-59.
35. LEVESON, N. G., HEIMDAHL, M. P. E., HILDRETH, H., AND REESE, J. D. 1994. Requirements specification for process-control systems. IEEE Trans. Softw. Eng. 20, 9 (Sept.), 684-707.
36. MADEIRA, H., COSTA, D., AND VIEIRA, M. 2000. On the emulation of software faults by software fault injection. In Proceedings of International Conference on Dependable Systems and Networks (DSN 2000). 417-426.
37. MYERS, G. J. 1979. The Art of Software Testing, 2nd ed. John Wiley, New York, NY.
38. OEFUTT, A. J., LEE, A., ROTHERMEL, G., UNTCH, R. H., AND ZAPF, C. 1996. An experimental determination of sufficient mutant operators. ACM Trans. Softw. Eng. Method. 5, 2 (Apr.), 99-118.
39. OPFUTT, A. J., LIU, S., ABDURAZIK, A., AND AMMANN, P. 2003. Generating test data from state-based specifications. Softw. Test. Verif. Reliab. 13, 1 (Mar.), 25-53.
40. PAHADKAR, A., TAI, K., AND VOUK, M. 1997. Specification-based testing using cause-effect graphs. Ann. Softw. Eng. 4, 133-157.
41. RICHARDSON, D. J. AND THOMPSON, M. C. 1993. An analysis of test data selection criteria using the RELAY model of fault detection. IEEE Trans. Softw. Eng. 19, 6 (June), 533-553.
42. RTCA/DO-178B. 1992. Software Considerations in Airborne Systems and Equipment Certification. RTCA, Inc., Washington, DC.
43. STOCK, P. AND CARRINGTON, D. 1996. A framework for specification-based testing. IEEE Trans. Softw. Eng. 22, 11 (Nov.), 777-793.
44. TAI, K. C. 1996. Theory of fault-based predicate testing for computer programs. IEEE Trans. Softw. Eng. 22, 8 (Aug.), 552-562.
45. TAI, K. C. AND SU, H. K. 1987. Test generation for Boolean expressions. In Proceedings of the 11th International Computer Software and Application Conference (COMPSAC '87). 278-284.
46. TSUCHIYA, T. AND KIKUNO, T. 2002. On fault classes and error detection capability of specification-based testing. ACM Trans. Softw. Eng. Method. 11, 1 (Jan.), 58-62.
47. VOUK, M. A., TAI, K. C., AND PARADKAR, A. 1994. Empirical studies of predicate-based software testing. In Proceedings of International Symposium on Software Reliability Engineering. 55-64.
48. WEYUKER, E. J., GORADIA, T., AND SINGH, A. 1994. Automatically generating test data from a Boolean specification. IEEE Trans. Softw. Eng. 20, 5 (May), 353-363.
49. YU, Y. T. AND LAU, M. F. 2002. Prioritization of test cases in MUMCUT test sets: An empirical study. In Proceedings of the 7th International Conference on Reliable Software Technologies - Ada-Europe 2002. Lecture Notes in Computer Science, vol. 2361. Springer, Berlin, Germany, 245-256.
50. YU, Y. T., LAU, M. F., AND CHEN, T. Y. 2003. Automatic generation of test cases from Boolean specifications using the MUMCUT strategy. Submitted for publication.