From MC/DC to RC/DC: Formalization and analysis of control-flow testing criteria

Formal Aspects of Computing

Volumn 18, Issue 1, 2006, Pages 42-62

  Vilkomir, Sergiy A ^a   Bowen, Jonathan P ^b  

^a UNIVERSITY OF LIMERICK   (Ireland)

^b LONDON SOUTH BANK UNIVERSITY   (United Kingdom)

Author keywords

Formal methods; MC DC; RC DC; Software testing criteria; Z notation

Indexed keywords

CHARACTERIZATION; COMPUTER SOFTWARE; DECISION THEORY; FORMAL LANGUAGES; SPECIFICATIONS;

FORMAL METHODS; MODIFIED CONDITION/DECISION COVERAGE (MC/DC); REINFORCED CONDITION/DECISION COVERAGE (RC/DC); SOFTWARE TESTING CRITERIA; Z NOTATION;

COMPUTER SYSTEMS;

EID: 32544455274     PISSN: 09345043     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00165-005-0084-7     Document Type: Article

References (60)

1. [AAD00] Abdurazik A, Amman P, Ding W, Offutt J (2000) Evaluation of three specification-based testing criteria. In: 6th IEEE international conference on engineering of complex computer systems (ICECCS2000). Tokyo
2. [AmB00] Ammann PE, Black PE (2000) Test generation and recognition with formal methods. The first international workshop on automated program analysis, testing and verification. Limerick
3. [Bis03] Bishop PG (2003) MC/DC based estimation and detection of residual faults in PLC logic networks. In: Supplementary proceedings 14th international symposium on software reliability engineering (ISSRE '03), Fast Abstracts, Denver, Colorado, USA, 17-20 November, pp 297-298
4. [Bow96] Bowen JP (1996) Formal specification and documentation using Z: a case study approach. International Thomson Computer Press, London
5. [Bow01] Bowen JP (2001) Experience teaching Z with tool and web support. ACM SIGSOFT Softw Eng Notes 26(2):69-75
6. [BBC02] Bowen JP, Bogdanov K, Clark J, Harman M, Hierons R, Krause P (2002) FORTEST: formal methods and testing. In: Proceedings of 26th annual international computer software and applications conference (COMPSAC 02), Oxford, UK, 26-29 August 2002. IEEE Computer Society Press, pp 91-101
7. [BoH99] Bowen JP, Hinchey MG (eds) (1999) Industrial-strength formal methods in practice. FACIT series, Springer, Berlin Heidelberg New York
8. [BoH04] Bowen JP, Hinchey MG (2004) Formal methods. In: Tucker AB (ed) Computer science handbook, 2nd edn, chap 106, Chapman & Hall/CRC, London, Boca Raton, pp 106-1-106-25.
9. [BCG00] Burton S, Clark J, Galloway A, McDermid J (2000) Automated V&V for high integrity systems, a target formal methods approach. In: Proceedings of the 5th NASA Langley formal methods workshop
10. [BCM00] Burton S, Clark J, McDermid J (2000) Testing, proof and automation: an integrated approach. In: Proceedings of the 1st international workshop of automated program analysis, testing and verification
11. [CaS94] Carrington D, Stocks P (1994) A tale of two paradigms: formal methods and software testing. In: Bowen JP, Hall JA (eds) Z user workshop, Cambridge, 1994, workshops in computing. Springer, Berlin Heidelberg New York, pp 51-68
12. [Cha00] Chapman R (2000) Industrial experience with SPARK. In: Proceedings of ACM SIGAda annual international conference (SIGAda 2000). Applied Physics Laboratory, Johns Hopkins University, Laurel, MD, USA, 12-16 November 2000
13. [ChM94] Chilenski J, Miller S (1994) Applicability of modified condition/decision coverage to software testing. Softw Eng J 9(5): 193-200
14. [ChN94] Chilenski J, Newcomb PH (1994) Formal specification tool for test coverage analysis. In: Proceedings of the 9th knowledge-based software engineering conference, 20-23 September 1994. pp 59-68
15. [ChR97] Chilenski J, Richey L (1997) Definition for a masking form of modified condition decision coverage (MCDC). Boeing Report
16. [Chi01] Chilenski J (2001) An investigation of three forms of the modified condition decision coverage (MCDC) criterion. Report DOT/FAA/AR-01/18
17. [Cod01]CodeTEST Tool Qualification for DO-178B (2001) Revision 1.0, Metrowerks
18. [DDC05] DDC-I, Inc (2005) The DACS-Object Coverage tools. MC/DC and the DACS-Object Coverage tools, http://www.ddci.com/news_mcdc.shtml
19. [DeW99] DeWalt M (1999) MCDC: a blistering love/hate relationship. FAA national software conference, Long Beach, CA, USA, 6-9 April 1999
20. [DuL00] Dupuy A, Leveson N (2000) An empirical evaluation of the MC/DC coverage criterion on the HETE-2 satellite software. In: Proceedings of the digital aviation systems conference (DASC), Philadelphia, USA
21. [FAA01] FAA Certification Authorities Software Team (CAST) (2001) Position Paper CAST-6, Rationale for accepting masking MC/DC in certification projects
22. [FrW93] Frankl PG, Weyuker EJ (1993) A formal analysis of the fault-detecting ability of testing methods. IEEE Trans Softw Eng 19(3):202-213
23. [Haw98] Haworth B (1998) Adequacy criteria for object testing. In: Proceedings of the 2nd international software quality week Europe 1998, Brussels
24. [Hay86] Hayes IJ (1986) Specification directed module testing. IEEE Trans Softw Eng SE-12(1):124-133
25. [HaV01] Hayhurst KJ, Veerhusen DS (2001) A practical approach to modified condition/decision coverage. In: 20th digital avionics systems conference (DASC), Daytona Beach, Florida, USA, 14-18 October 2001, vol 1, pp 1B2/1-1B2/10
26. [HVC01] Hayhurst KJ, Veerhusen DS, Chilenski JJ, Rierson LK (2001) A practical tutorial on modified condition/decision coverage, Report NASA/TM-2001-210876, NASA, USA
27. [Hor95] Hörcher H-M (1995) Improving software tests using Z specifications. In: Bowen JP, Hinchey MG (eds) ZLIM'95: the formal specification notation. Lecture Notes in Computer Science, vol 967. Springer, Berlin Heidelberg New York, pp 152-166
28. [ISO02] ISO/IEC (2002) Information technology - Z formal specification notation - syntax, type system and semantics. ISO/IEC 13568, International Organization for Standardization
29. [Jac97] Jacky, J (1997) The way of Z: practical programming with formal methods. Cambridge University Press, London
30. [JBW94] Jasper R, Brennan M, Williamson K, Currier B, Zimmerman D (1994) Test data generation and feasible path analysis. In: Proceedings of 1994 international symposium on software testing and analysis, Seattle, WA, USA, 17-19 August 1994, pp 95-107
31. [Jia98] Jia X (1998) ZTC: A type checker for Z notation. User's guide. Version 2.03, August 1998. Division of Software Engineering, School of Computer Science, Telecommunication and Information Systems, DePaul University, USA.
32. [JoH01] Jones J, Harrold M (2001) Test-suite reduction and prioritization for modified condition/decision coverage. In: Proceedings of the IEEE international conference on software maintenance (ICSM'01), Florence, Italy, 7-9 November 2001, pp 92-101
33. [KaB03] Kapoor K, Bowen JP (2003) Experimental evaluation of the variation in effectiveness for DC, FPC and MC/DC test criteria. In: Proceedings of ACM-IEEE 2003 international symposium on empirical software engineering (ISESE 2003), Rome, Italy, 30 September-1 October 2003. IEEE Computer Society Press, pp 185-194
34. [KaB05] Kapoor K, Bowen JP (2005) A formal analysis of MCDC and RCDC test criteria. Softw Test Verif Reliab 15(1):21-40
35. [KaC98] Kaufman AV, Chernonozhkin SK (1998) Testing criteria and a system for evaluation of the completeness of a test set. Prog Comput Softw 6:301-311
36. [Kuh99] Kuhn D (1999) Fault classes and error detection capability of specification-based testing. ACM Trans Softw Eng Methodol 8(4):411-424
37. [LDR00] LDRA Testbed Technical Description v7.0u (2000) Ashling Microsystems, Inc
38. [Li99] Li YY (1999) Structural test cases analysis and implementation. In: 42nd Midwest symposium on circuits and systems, vol 2, 8-11 August 1999, pp 882-885
39. [Mye79] Myers G (1979) The art of software testing. Wiley-Interscience, New York
40. [Nta88] Ntafos S (1988) A comparison of some structural testing strategies. IEEE Trans Softw Eng 14(6):868-874
41. [OXL99] Offutt AJ, Xiong Y, Liu S (1999) Criteria for generating specification-based tests. In: Proceedings of 5th IEEE international conference on engineering of complex computer systems (ICECCS'99), Las Vegas, Nevada, USA, 18-21 October 1999, pp 119-129
42. [PoC90] Podgurski P, Clarke L (1990) A formal model of program dependences and its implications for software testing, debugging and maintenance. IEEE Trans Softw Eng 16(9):965-979
43. [Pra84] Prather RE (1984) Theory of program testing - an overview. Bell Syst Tech J 62(10):3073-3105
44. [RaW85] Rapps S, Weyuker EJ (1985) Selecting software test data using data flow information. IEEE Trans Softw Eng SE-11(4):367-375
45. [Rop94] Roper M (1994) Software testing. McGraw-Hill, New York
46. [RTC92] RTCA (1992) Software considerations in airborne systems and equipment certification. DO-178B, RTCA, Washington DC
47. [Spi92] Spivey JM (1992) The Z notation: a reference manual, 2nd edn. Prentice Hall International Series in Computer Science, Prentice Hall, Englewood Cliffs
48. [StC96] Stocks P, Carrington D (1996) A framework for specification-based testing. IEEE Trans Softw Eng 22(11):777-793
49. [Tai96] Tai K-C (1996) Theory of fault-based predicate testing for computer programs. IEEE Trans Softw Eng 22(8):552-562
50. [VKB03] Vilkomir SA, Kapoor K, Bowen JP (2003) Tolerance of control-flow testing criteria. In: Proceedings of 27th IEEE annual international computer software and applications conference (COMPSAC 2003), Dallas, Texas, USA, 3-6 November 2003. IEEE Computer Society Press, pp 182-187
51. [ViB01] Vilkomir SA, Bowen JP (2001) Formalization of software testing criteria using the Z notation. In: Proceedings of COMPSAC 2001: 25th IEEE annual international computer software and applications conference, Chicago, Illinois, USA, 8-12 October 2001. IEEE Computer Society Press, pp 351-356
52. [ViB02a] Vilkomir SA, Bowen JP (2002) Reinforced condition/decision coverage (RC/DC): a new criterion for software testing. In: Bert D, Bowen JP, Henson M, Robinson K (eds) ZB2002: Formal specification and development in Z and B. Lecture Notes in Computer Science, vol 2272. Springer, Berlin Heidelberg New York, pp 295-313
53. [ViB02b] Vilkomir SA, Bowen JP (2002) Establishing formal regulatory requirements for safety-critical software certification. In: Proceedings of AQuIS 2002: 5th international conference on achieving quality in software and SPICE 2002: 2nd international conference on software process improvement and capability determination, Venice, Italy, 13-15 March 2002, pp 7-18
54. [ViK00] Vilkomir SA, Kharchenko VS (2000) An 'Asymmetric' approach to the assessment of safety-critical software during certification and licensing. In: Project control: the human factor. Proceedings of ESCOM-SCOPE 2000 conference, Munich, Germany, 18-20 April 2000, pp 467-475
55. [ViK99] Vilkomir SA, Kharchenko VS (1999) Methodology of the review of software for safety important systems. In: Safety and reliability. Proceedings of ESREL'99 - the 10th European conference on safety and reliability, Munich-Garching, Germany, vol 1, 13-17 September 1999, pp 593-596
56. [VoB92] Voznessensky V, Berkovich V (1992) WER 440 and VVER-1000: design features in comparison with western PWRS. In: International conference on design and safety of advanced nuclear power plants, Tokyo, vol 4
57. [WGS94] Weyuker E, Goradia T, Singh A (1994) Automatically generating test data from a Boolean specification. IEEE Trans Softw Eng 20(5):353-363
58. [Whi01] White AL (2001) Comments on modified condition/decision coverage for software testing. In: 2001 IEEE aerospace conference proceedings, 10-17 March 2001, Big Sky, Montana, USA, vol 6, pp 2821-2828
59. [WHH80] Woodward MR, Hedley D, Hennell MA (1980) Experience with path analysis and testing of programs. IEEE Trans Softw Eng SE-6(3):278-286
60. [ZHM97] Zhu H, Hall PA, May HR (1997) Software unit test coverage and adequacy. ACM Comput Surv 29(4):336-427