The economics of unit testing

Empirical Software Engineering

Volumn 11, Issue 1, 2006, Pages 5-31

  Ellims, Michael ^a,c,d   Bridges, James ^a   Ince, Darrel C ^b  

^a Pi Technology   (United Kingdom)

^b OPEN UNIVERSITY   (United Kingdom)

^c IEEE   (United Kingdom)

^d ACM   (United Kingdom)

Author keywords

Adequacy criteria; Software testing; Test effectiveness; Unit testing

Indexed keywords

SOFTWARE TESTING; TEST EFFECTIVENESS; UNIT TESTING;

BOUNDARY VALUE PROBLEMS; INFORMATION THEORY; PROJECT MANAGEMENT;

SOFTWARE ENGINEERING;

EID: 32944479444     PISSN: 13823256     EISSN: 15737616     Source Type: Journal    
DOI: 10.1007/s10664-006-5964-9     Document Type: Conference Paper

References (54)

1. Aitchison K, Goody K (2000, September) Effective bench testing of ECUs. Proceedings of ISATA 2000, Automotive Electronics. Dublin Ireland, pp 165-170
2. Anon (1992) Software Considerations in Airborne Systems and equipment certification, DO-178B. Washington DC, RTCA
3. Basili VR, Selby RW (1987) Comparing the effectiveness of software testing strategies. IEEE Trans Softw Eng 12(13):1278-1296
4. Brookes F (1995) The Mythical Man-month. Addison-Wesley, Reading, MA
5. Burr K, Young W (1998) Combinatorial test techniques: table-based automation, test generation and code coverage. Proceedings of the International Conference on Software Testing, Analysis, and Review (STAR'98). San Diego, USA, pp 26-28
6. Cohen DM, Dalal SR, Fredman ML, Patton GC (1997) The AETG system: an approach to testing based on combinatorial design. IEEE Trans Softw Eng 7(23):437-444
7. Dalal SR, Mallows CL (1998) Factor-covering designs for testing software. Technometrics 3(40):234-243
8. Davis M, Weyuker EJ (1988) Metric-based test-data adequacy criteria. Comput J 1(13):17-24
9. DeMillo RA, Offutt AJ (1993) Experimental results from an automatic test case generator. ACM Trans Softw Eng 2(2):109-127
10. Dunietz IS, Ehrlich WK, Szablak BD, Mallows CL, Iannino A (1997) Applying design of experiments to software testing. Proceedings of the 19th International Conference on Software Engineering (ICSE'97). ACM, Boston, USA, pp 205-215
11. Dupuy A, Leveson N (2000, October) An empirical evaluation of the MC/DC coverage criterion on the HETE-2 satellite software. Proc. Digital Aviation Systems Conference (DASC'00). Philadelphia
12. Ellims M (2000) Hardware in the loop testing. Proceedings ImechE Symposium IEE Control 2000. Cambridge, England
13. Ellims M, Jackson K (2000) ISO 9001: Making the right mistakes SAE Technical Paper Series 2000-01-0714. Detroit, USA
14. Ellims M, Parkins RP (1999) Unit Testing Techniques and Tool Support. SAE Technical Paper Series 1999-01-2842. Detroit, USA
15. Ellims M, Bridges J, Ince DC (2004, November) Unit testing in practice. 15th IEEE Int'l Symposium on Software Reliability Eng (ISSRE'04). Saint-Malo, France
16. Ellims M, Warnaby C, Wiseman M (2005) Automated functional testing of a battery control system. (Submitted to 12th International Conference Electronic Systems for Vehicles (Elektonik'05) Baden-Baden 6-7 October 2005.)
17. Fenton NE, Ohisson N (2000) Quantitative analysis of faults and failures in a complex software system. IEEE Trans Softw Eng 8(26):797-814
18. Frankl PG, Weyuker EJ (1983) A formal analysis of the fault-detecting ability of testing methods. IEEE Trans Softw Eng 3(19):202-213
19. Freedman RS (1991) Testability of software components. IEEE Trans Softw Eng 6(17):553-564
20. Garg P (1994) Investigating coverage-reliability relationship and sensitivity of reliability to errors in the operational profile. Proc. 1st International Conference on Software Testing Reliability and Quality Assurance. New Delhi, pp 21-35
21. Green TRG (1990) The nature of programming. In: Hoc JM, Green TRG, Samurcay R, Gilmore DJ (eds) Psychology of programming. Academic Press
22. Hamlet R (1994) Connecting test coverage to software dependability. Proc. 5th International Symposium on Software Reliability Engineering, pp 158-165
23. Hamlet R (1995). Implementing prototype testing tools. Softw Pract and Exp 4(25):347-371
24. Ince DC, Shepperd MJ (1993) Metrics their derivation and validation. Oxford University Press, Oxford
25. Jones JA, Harrold MJ (2003) Test-suite reduction and prioritization for modified condition/decision coverage. IEEE Trans Softw Eng 3(29):195-209
26. Jorgensen PC (1995) Software testing a craftsman's approach. CRC Press, Boca Raton
27. Kamsties E, Lott CM (1995) An empirical evaluation of three defect-detection techniques. In: Schafer W, Botella P (eds) Proc Fifth European Software Engineering Conference LNCS 989. Springer-Verlag, Berlin, pp 362-383
28. thAnnual NASA Goddard/IEE Software Engineering Workshop (SEW-27'02)
29. Kuhn DR, Wallace DR, Gallo AM (2004) Software fault interactions and implications for software testing. IEEE Trans Softw Eng 6(30):418-421
30. Laitenberger O (1998) Studying the effects of code inspection and structural testing on software quality. Fraunhofer Institute for Experimental Software Engineering. Technical Report ISERN-98-10
31. Lyu MR, Huang Z, Sze SKS, Cai X (2003) An empirical study on testing and fault tolerance for software reliability engineering. Proc. 14th International Symposium on Software Reliability Engineering, pp 119-130
32. Maximilien EM, Williams L (2003) Assessing test-driven development at IBM. Proc. 25th International Conference on Software Engineering, pp 564-569
33. McCabe TJA (1976) Complexity measure. IEEE Trans Softw Eng 4(2):202-213
34. McDermid JA, Rook P (1991) Software development process models. In: McDermid JA (ed) Software engineers reference book. Butterworth Heinemann, Oxford
35. Myers GJ (1978) A controlled experiment in program testing and code walkthroughs/inspections. Commun ACM 9(21):760-768
36. Natafos SA (1988) Comparison of some structural testing strategies. IEEE Trans Softw Eng 6(14):868-874
37. Nguyen T, Ourghanlian A (2003) Dependability assessment of safety-critical system software by static analysis methods. Proc. of the 2003 International Conference on Dependable Systems and Networks (DSN'03)
38. Parrish A, Zweben SH (1991) Analysis and refinement of software test data adequacy properties. IEEE Trans Softw Eng 6(17):565-581
39. Pressman RG, Ince DC (2000) Software engineering: a practitioner's approach (5th edition). McGraw Hill, New York
40. Richardson DJ, Thompson MC (1993) An analysis of test data selection criteria using the relay model of fault detection. IEEE Trans Softw Eng 6(19):533-553
41. Runeson P, Andrews A (2003) Detection or isolation of defects? An experimental comparison of unit testing and code inspection. Proceedings 14th International Symposium on Software Reliability Engineering, pp 3-13
42. Shooman M (1988) Software Engineering. McGraw Hill, Singapore
43. Sneed HM (1986) Data coverage testing in program testing. Proceedings Workshop on Software Testing. Banff Canada, pp 34-40
44. So SS, Cha SD, Shimeall TJ, Kwon YR (2002) An empirical evaluation of six methods to detect faults in software. Softw Test Qual Eng 12:155-171
45. Sommerville I (2004) Software engineering. Addison Wesley, Reading, MA
46. Tai KC (1980) Program testing complexity and test criteria, IEEE Trans Softw Eng 6(6):531-538
47. Tichy WF, Lukowicz P, Prechely L, Heinz EA (1995) Experimental evaluation in computer science: a quantitative study. J Syst Softw 28:9-18
48. Torkar R, Mankefors S, Hansson K, Jonsson (2003) A. An exploratory study of component reliability using unit testing. Proc 14th International Symposium on Software Reliability Engineering, pp 227-233
49. Voas JM, McGraw G (1998) Software fault injection: inoculating programs against errors. John Wiley and Sons, New York
50. Voas JM, Miller KW (1995) Software testability: the new verification. IEEE Softw (17)28:17-28
51. Wood M, Roper M, Brooks A, Miller J (1997) Comparing and combining software defect detection techniques: a replicated empirical study. Proc. 6th European Software Engineering Conference, pp 262-277
52. Woodward M, Hedley D, Hennell M (1980). Experience with path analysis and testing of programs. IEEE Trans Softw Eng 6(3):278-286
53. Zhu HA (1996) Formal analysis of the subsume relation between software test data adequacy criteria. IEEE Trans Softw Eng 22(4):248-255
54. Zhu H, Hall PAV, May JHR (1997) Software unit test coverage and adequacy. ACM Comput Surv 29(4):366-427