Software testing

Computer Science Handbook, Second Edition

Volumn , Issue , 2004, Pages 105-1-105-43

  Kapfhammer, Gregory M ^a  

^a ALLEGHENY COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85013042780     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (130)

1. R.T. Alexander, J.M. Bieman, and J. Viega. Coping with Java programming stress. IEEE Computer, 33(4): 30-38, April 2000.
2. K. Arnold, B. O’Sullivan, R.W. Scheifler, J. Waldo, and A. Wollrath. The Jini Specification. Addison-Wesley, Reading, MA, 1999.
3. M. Balcer, W. Hasling, and T. Ostrand. Automatic generation of test scripts from formal test specifications. In Proceedings of the ACM SIGSOFT Third Symposium on Software Testing, Analysis, and Verification, pages 210-218. ACM Press, 1989.
4. T. Ball. The limit of control flow analysis for regression test selection. In Proceedings of the International Symposium on Software Testing and Analysis, pages 134-142. ACM Press, March 1998.
5. K. Beck. Smalltalk Best Practice Patterns. Prentice Hall, 1997.
6. B. Beizer. Software Testing Techniques. Van Nostrong Reinhold, New York, 1990.
7. R.V. Binder. Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley, Boston, MA, 1999.
8. R. Biyani and P. Santhanam. TOFU: Test optimizer for functional usage. Software Engineering Technical Brief, 2(1), 1997.
9. J.P. Bowen and M.G. Hinchley. Ten commandments of formal methods. IEEE Computer, 28(4):56-63, April 1995.
10. F.P. Brooks Jr. The Mythical Man-Month. Addison-Wesley, Reading, MA, 1995.
11. B. Brykczynski. A survey of software inspection checklists. ACM SIGSOFT Software Engineering Notes, 24 (1):82, 1999.
12. M. Chan and S. Cheung. Applying white box testing to database applications. Technical Report HKUST- CS9901, Hong Kong University of Science and Technology, Department of Computer Science, February 1999a.
13. M. Chan and S. Cheung. Testing database applications with SQL semantics. In Proceedings of the 2nd International Symposium on Cooperative Database Systems for Advanced Applications, pages 363374, March 1999b.
14. D. Chays, S. Dan, P. G. Frankl, F. I. Vokolos, and E. J. Weyuker. A framework for testing database applications. In Proceedings of the 7th International Symposium on Software Testing and Analysis, pages 147-157, August 2000.
15. D. Chays and Y. Deng. Demonstration of AGENDA tool set for testing relational database applications. In Proceedings of the International Conference on Software Engineering, pages 802-803, May 2003.
16. D. Chays, Y. Deng, P.G. Frankl, S. Dan, F.I. Vokolos, and E.J. Weyuker. AGENDA: A test generator for relational database applications. Technical Report TR-CIS-2002-04, Department of Computer and Information Sciences, Polytechnic University, Brooklyn, NY, August 2002.
17. B. Choi, A. Mathur, and B. Pattison. PMothra: scheduling mutants for execution on a hypercube. In Proceedings of the Third ACM SIGSOFT Symposium on Software Testing, Analysis, and Verficiation, pages 58-65, December 1989.
18. L.A. Clarke. A system to generate test data symbolically. IEEE Transactions on Software Engineering, 2(3): 215-222, September 1976.
19. L.A. Clarke, A. Podgurski, D.J. Richardson, and S.J. Zeil. A comparison of data flow path selection criteria. In Proceedings of the 8th International Conference on Software Engineering, pages 244-251. IEEE Computer Society Press, 1985.
20. D.M. Cohen, S.R. Dalal, M.L. Fredman, and G.C. Patton. The combinatorial design approach to automatic test generation. IEEE Software, 13(5):83-87, September 1996.
21. D.M. Cohen, S.R. Dalal, M.L. Fredman, and G.C. Patton. The AETG system: an approach to testing based on combinatorial design. IEEE Transactions on Software Engineering, 23(7):437-443, July 1997.
22. B. Daou, R.A. Haraty, and N. Mansour. Regression testing of database applications. In Proceedings of the 2001 ACM Symposium on Applied Computing, pages 285-289. ACM Press, 2001.
23. R.A. DeMillo, D.S. Guindi, W.M. McCracken, A.J. Offutt, and K.N. King. An extended overview of the Mothra software testing environment. In Proceedings of the ACM SIGSOFT Second Symposium on Software Testing, Analysis, and Verficiation, pages 142-151, July 1988.
24. R.A. DeMillo, R. J. Lipton, and F.G. Sayward. Hints on test data selection: help for the practicing programmer. IEEE Computer, 11(4):34-41, April 1978.
25. R.A. DeMillo and A.J. Offutt. Constraint-based automatic test data generation. IEEE Transactions on Software Engineering, 17(9):900-910, September 1991.
26. E.W. Dijkstra. The structure of the THE multiprogramming system. Communications of the ACM, 11(5):341-346, 1968.
27. E. Duesterwald, R. Gupta, and M.L. Soffa. A demand-driven analyzer for data flow testing at the integration level. In Proceedings of the 18th International Conference on Software Engineering, pages 575-584. IEEE Computer Society Press, 1996.
28. W.K. Edwards. Core Jini. Prentice Hall PTR, Upper Saddle River, NJ, 1999.
29. S. Elbaum, A.G. Malishevsky, and G. Rothermel. Prioritizing test cases for regression testing. In Proceedings of the International Symposium on Software Testing and Analysis, pages 102-112. ACM Press, August 2000.
30. S. Elbaum, G. Rothermel, S. Kanduri, and A.G. Malishevsky. Selecting a cost-effective test case prioritization technique. Technical Report 03-01-01, Department of Computer Science and Engineering, University of Nebraska-Lincoln, January 2003.
31. Y. Endo, Z. Wang, J.B. Chen, and M. Seltzer. Using latency to evaluate interactive system performance. In Proceedings of the Second USENIX Symposium on Operating Systems Design and Implementation, pages 185-199. ACM Press, 1996.
32. D. Epema, M. Livny, R.V. Dantzig, X. Evers, and J. Pruyne. A worldwide flock of Condors: load sharing among workstation clusters. Journal on Future Generations of Computer Systems, 12(1):53-65, December 1996.
33. M. Fagan. Design and code inspections to reduce errors in program development. IBM Systems Journal, 15(3):182-211, 1976.
34. N. Fenton. Software measurement: a necessary scientific basis. IEEE Transactions on Software Engineering, 20(3):199-206, March 1994.
35. R. Ferguson and B. Korel. The chaining approach for software test data generation. ACM Transactions on Software Engineering and Methodology, 5(1):63-86, 1996.
36. M. Fisher, D. Jin, G. Rothermel, and M. Burnett. Test reuse in the spreadsheet paradigm. In Proceedings of the 13th International Symposium on Software Reliability Engineering, Annapolis, MD, November 2002a.
37. M. Fisher, M. Cao, G. Rothermel, C.R. Cook, and M.M. Burnett. Automated test case generation for spreadsheets. In Proceedings of the 24th International Conference on Software Engineering, pages 141-153. ACM Press, 2002b.
38. P.G. Frankl and S. Weiss. An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Transactions on Software Engineering, 19(8):774-787, August 1993.
39. P.G. Frankl and E.J. Weyuker. An applicable family of data flow testing criteria. IEEE Transactions on Software Engineering, 14(10):1483-1498, October 1988.
40. P.G. Frankl and E.J. Weyuker. A formal analysis of the fault-detecting ability of testing methods. IEEE Transactions on Software Engineering, 19(3):202-213, March 1993.
41. E. Freemen, S. Hupfer, and K. Arnold. JavaSpaces: Principles, Patterns, and Practice. Addison-Wesley, Inc., Reading, MA, 1999.
42. E. Gamma and K. Beck. JUnit: a cook’s tour. 2004. http://www.junit.org/.
43. M. Geller. Test data as an aid in proving program correctness. Communications of the ACM, 21(5):368-375, 1978.
44. A.K. Ghosh, M. Schmid, and F. Hill. Wrapping Windows NT software for robustness. In Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing, June 1999.
45. A.K. Ghosh, M. Schmid, and V. Shah. Testing the robustness of Windows NT software. In Proceedings of the Ninth International Symposium on Software Reliability Engineering, pages 231-235. IEEE Computer Society, November 1998.
46. N. Gupta, A.A. Mathur, and M.L. Soffa. Automated test data generation using an iterative relaxation method. In Proceedings of the 5th ACM SIGSOFT Symposium on the Foundations of Software Engineering, November 1998.
47. N. Gupta, A.P. Mathur, and M.L. Soffa. UNA based iterative test data generation and its evaluation. In Proceedings of the 14th International Conference on Automated Software Engineering, pages 224-232, October 1999.
48. J. Haddox, G.M. Kapfhammer, and C.C. Michael. An approach for understanding and testing third-party software components. In 48th Reliability and Maintainability Symposium, January 2002.
49. J. Haddox, G.M. Kapfhammer, C.C. Michael, and M. Schatz. Testing commercial-off-the-shelf components with software wrappers. In Proceedings of the 18th International Conference on Testing Computer Software, Washington, D.C., June 2001.
50. D. Hamlet. Foundations of software testing: dependability theory. In Proceedings of the 2nd ACM SIGSOFT Symposium on Foundations of Software Engineering, pages 128-139. ACM Press, 1994.
51. Hamlet and J. Maybee. The Engineering of Software. Addison-Wesley, Boston, MA, 2001.
52. M. Harder, J. Mellen, and M.D. Ernst. Improving test suites via operational abstraction. In Proceedings of the 24th International Conference on Software Engineering, pages 60-71. IEEE Computer Society Press, 2003.
53. M.J. Harrold and G. Rothermel. Performing data flow testing on classes. In Proceedings of the 2nd ACM SIGSOFT Symposium on Foundations of Software Engineering, pages 154-163. ACM Press, 1994.
54. M.J. Harrold and G. Rothermel. Aristotle: a system for research on and developement of program-analysis- based tools. Technical Report OSU-CISRC-3/97-TR17, The Ohio State University, Department of Computer and Information Science, March 1995.
55. M.J. Harrold and G. Rothermel. A coherent family of analyzable graphical representations for object- oriented software. Technical Report Technical Report OSU-CISRC-11/96-TR60, Department of Computer and Information Sciences, Ohio State University, November 1996.
56. M.J. Harrold and M.L. Soffa. Efficient computation of interprocedural definition-use chains. ACM Transactions on Programming Languages and Systems, 16(2):175-204, 1994.
57. R. Hightower. Java Tools for Extreme Programming: Mastering Open Source Tools, Including Ant, JUnit, and Cactus. John Wiley & Sons, New York, 2001.
58. A.E. Howe, A. von Mayrhauser, and R.T. Mraz. Test case generation as an AI planning problem. Automated Software Engineering: An International Journal, 4(1):77-106, January 1997.
59. C.J. Howell, G.M. Kapfhammer, and R.S. Roos. An examination of the run-time performance of GUI creation frameworks. In Proceedings of the 2nd ACM SIGAPP International Conference on the Principles and Practice of Programming in Java, Kilkenny City, Ireland, June 2003.
60. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering, pages 191-200. IEEE Computer Society Press, 1994.
61. IEEE. IEEE Standard Glossary of Software Engineering Terminology. ANSI/IEEE Std 610.12-1990,1996.
62. D. Jackson. Lecture 17: Case study: JUnit. 2003. http://ocw.mit.edu/6/6.170/f01/lecture-notes/index.html. R.E. Jeffries. Extreme testing. Software Testing and Quality Engineering, March/April 1999.
63. J.-M. Jezequel, D. Deveaux, and Y. Le Traon. Reliable objects: lightweight testing for OO languages. IEEE Software, 18(4):76-83, July/August 2001.
64. C. Kaner, J. Falk, and H.Q. Hguyen. Testing Computer Software. International Thompson Computer Press, London, U.K., 1993.
65. G.M. Kapfhammer. Automatically and transparently distributing the execution of regression test suites. In Proceedings of the 18th International Conference on Testing Computer Software, Washinton, D.C., June 2001.
66. G.M. Kapfhammer and M.L. Soffa. A family of test adequacy criteria for database-driven applications. In Proceedings of the 9th European Software Engineering Conference and the 11th ACM SIGSOFT Symposium on Foundations of Software Engineering. ACM Press, 2003.
67. S. Kim, J.A. Clark, and J.A. McDermid. The rigorous generation of Java mutation operators using HAZOP. In Proceedings of the 12th International Conference on Software and Systems Engineering and their Applications, December 1999.
68. S. Kim, J.A. Clark, and J.A. McDermid. Class mutation: mutation testing for object-oriented programs. In Proceedings of the Object-Oriented Software Systems, Net.ObjectDays Conference, October 2000.
69. P. Koopman and J. DeVale. The exception handling effectiveness of POSIX operating systems. IEEE Transactions on Software Engineering, 26(9):837-848, September 2000.
70. A.Korel. Automated test data generation for programs with procedures. In Proceedings of the International Symposium on Software Testing and Analysis, pages 209-215. ACM Press, 1996.
71. D.W. Krauser, A.P. Mathur, and V.J. Rego. High performance software testing on SIMD machines. IEEE Transactions on Software Engineering, 17(5):403-423, May 1991.
72. N.P. Krop, P.J. Koopman, and D.P. Siewiorek. Automated robustness testing of off-the-shelf software components. In Proceedings of the 28th Fault Tolerant Computing Symposium, pages 230-239, June 1998.
73. O. Laitenberger and C. Atkinson. Generalizing perspective-based inspection to handle object-oriented development artifacts. In Proceedings of the 21st International Conference on Software Engineering, pages 494-503. IEEE Computer Society Press, 1999.
74. Y. Lei and K.C. Tai. In-parameter-order: a test generation strategy for pairwise testing. In Proceedings of the High-Assurance Systems Engineering Symposium, pages 254-261, November 1998.
75. G.K.N. Leung and L.J. White. Insights into regression testing. In Proceedings of the International Conference on Software Maintenance, pages 60-69. IEEE Computer Society Press, October 1989.
76. N.G. Leveson. Safeware: System safety and computers. Addison-Wesley, Reading, MA, September 1995.
77. Y.-S. Ma, Y.-R. Kwon, and J. Offutt. Inter-class mutation operators for Java. In Proceedings of the Twelfth International Symposium on Software Reliability Engineering, November 2002.
78. B. Marick. When should a test be automated? In Proceedings of the 11th International Quality Week Conference, San Francisco, CA, May 26-29,1998.
79. B. Marick. How to misuse code coverage. In Proceedings of the 16th Interational Conference on Testing Computer Software, June 1999.
80. A.M. Memon. A Comprehensive Framework for Testing Graphical User Interfaces. Ph.D. thesis, University of Pittsburgh, Department of Computer Science, 2001.
81. A.M. Memon. GUI testing: pitfalls and process. IEEE Computer, 35(8):90-91, August 2002.
82. A.M. Memon, M.E. Pollack, and M.L. Soffa. Using a goal-driven approach to generate test cases for GUIs. In Proceedings of the 21st International Conference on Software Engineering, pages 257-266. IEEE Computer Society Press, 1999.
83. A.M. Memon, M.E. Pollock, and M.L. Soffa. Heirarchical GUI test case generation using automated planning. IEEE Transactions on Software Engineering, 27(2):144-155, 2001a.
84. A.M. Memon, M.L. Soffa, and M.E. Pollack. Coverage criteria for GUI testing. In Proceedings of the 8th European Software Engineering Conference and the 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 256-267. ACM Press, 2001b.
85. B.C. Michael, G. McGraw, and M. Schatz. Generating software test data by evolution. IEEE Transactions on Software Engineering, 27(12):1085—1110, December 2001.
86. A. Miller, L. Fredriksen, and B. So. An empirical study of the reliability of operating system utilities. Communications of the ACM, 33:32-44, December 1990.
87. B. Miller, D. Koski, C. Lee, V. Maganty, A. Natarajan, and J. Steidl. Fuzz revisited: a re-examiniation of the reliability of UNIX utilities and services. Technical Report 1268, University of Wisconsin-Madison, May 1998.
88. L.J. Morell. A theory of fault-based testing. IEEE Transactions on Software Engineering, 16(8):844-857, 1990.
89. B.A. Myers and M.B. Rosson. Survey on user interface programming. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 195-202. ACM Press, 1992.
90. R. Neapolitan and K. Naimipour. Foundations of Algorithms. Jones and Bartlett Publishers, Boston, MA, 1998.
91. F. Nielson, H.R. Nielson, and C. Hankin. Principles of Program Analysis. Springer-Verlag, Berlin, Germany, 1999.
92. S.C. Ntafos. A comparison of some structural testing strategies. IEEE Transactions on Software Engineering, 14(6):868-874, June 1988.
93. A.J. Offutt, A. Lee, G. Rothermel, R.H. Untch, and C. Zapf. An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering and Methodology, 5(2):99-118, 1996.
94. A.J. Offutt, G. Rothermel, and C. Zapf. An experimental evaluation of selective mutation testing. In Proceedings of the 15th International Conference on Software Engineering, pages 100-107, May 1993.
95. A.J. Offutt, R. Alexander, Y. Wu, Q. Xiao, and C. Hutchinson. A fault model for subtype inheritance and polymorphism. In Proceedings of the Twelfth International Symposium on Software Reliability Engineering, pages 84-95, November 2001.
96. A. K. Onoma, W.-T. Tsai, M. Poonawala, and H. Suganuma. Regression testing in an industrial environment. Communications of the ACM, 41(5):81-86, 1998.
97. T.J. Ostrand and M.J. Balcer. The category-partition method for specifying and generating fuctional tests. Communications of the ACM, 31(6):676-686, 1988.
98. A. Parrish and S.H. Zweben. Software test data adequacy properties. IEEE Transactions on Software Engineering, 17(6):565-581, June 1991.
99. A.S. Paul. SAGE: A static metric for testability under the PIE model. Technical Report 96-5, Allegheny College, Department of Computer Science, 1996.
100. C. Pavlopoulou and M. Young. Residual test coverage monitoring. In Proceedings of the 21st International Conference on Software Engineering, pages 277-284. IEEE Computer Society Press, 1999.
101. B. Pettichord. Seven steps to test automation success. In Proceedings of the International Conference on Software Testing, Analysis, and Review, San Jose, CA, November 1999.
102. B.V. Ramamoorty, S.F. Ho, and W.T. Chen. On the automated generation of program test data. IEEE Transactions on Software Engineering, 2(4):293-300, December 1976.
103. S. Rapps and E.J. Weyuker. Data flow analysis techniques for test data selection. In Proceedings of the 6th International Conference on Software Engineering, pages 272-278. IEEE Computer Society Press, 1982.
104. S. Rapps and E.J. Weyuker. Selecting software test data using data flow information. IEEE Transactions on Software Engineering, 11(4), April 1985.
105. B. Richardson, O. O’Malley, and C. Tittle. Approaches to specification-based testing. In Proceedings of the ACM SIGSOFT Third Symposium on Software Testing, Analysis, and Verification, pages 86-96. ACM Press, 1989.
106. G. Rothermel and M.J. Harrold. A framework for evaluating regression test selection techniques. In Proceedings of the Sixteenth International Conference on Software Engineering, pages 201-210. IEEE Computer Society Press, May 1994.
107. G. Rothermel and M.J. Harrold. Analyzing regression test selection techniques. IEEE Transactions on Software Engineering, 22(8):529-551, August 1996.
108. G. Rothermel and M.J. Harrold. A safe, efficient regression test selection technique. ACM Transactions on Software Engineering and Methodology, 6(2):173-210, April 1997.
109. G. Rothermel and M.J. Harrold. Empirical studies of a safe regression test selection technique. IEEE Transactions on Software Engineering, 24(6):401-419, June 1998.
110. G. Rothermel, L. Li, and M. Burnett. Testing strategies for form-based visual programs. In Proceedings of the 8th International Symposium on Software Reliability Engineering, pages 96-107, Albuquerque, NM, November 1997.
111. G. Rothermel, R.H. Untch, C. Chu, and M.J. Harrold. Test case prioritization: an empirical study. In Proceedings of the International Conference on Software Maintenance, pages 179-188, August 1999.
112. G.Rothermel, R.H. Untch, C. Chu, and M.J. Harrold. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering, 27(10):929-948, October 2001a.
113. G. Rothermel, M. Burnett, L. Li, C. Dupuis, and A. Sheretov. A methodology for testing spreadsheets. ACM Transactions on Software Engineering and Methodology, 10(1):110-147, January 2001b.
114. K.J. Rothermel, C.R. Cook, M.M. Burnett, J. Schonfeld, T.R.G. Green, and G. Rothermel. WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation. In Proceedings of the 22nd International Conference on Software Engineering, pages 230-239. ACM Press, 2000.
115. A. Sears. Layout appropriateness: a metric for evaluating user interface widget layout. IEEE Transactions on Software Engineering, 19(7):707-719, 1993.
116. F. Shull, I. Rus, and V. Basili. Improving software inspections by using reading techniques. In Proceedings of the 23rd International Conference on Software Engineering, pages 726-727. IEEE Computer Society, 2001.
117. I. Sommerville. Software Engineering. Addison-Wesley, 6th edition, August 2000.
118. J. Steven, P. Chandra, B. Fleck, and A. Podgurski. jRapture: a capture/replay tool for observation-based testing. In Proceedings of the International Symposium on Software Testing and Analysis, pages 158167. ACM Press, 2000.
119. T. Tsai and R. Iyer. Measuring fault tolerance with the FTAPE fault injection tool. In Proceedings of the 8th International Conference on Modeling Techniques and Tools for Computer Performance Evaluation, pages 26-40, 1995.
120. T. K. Tsai and N. Singh. Reliability testing of applications on Windows NT. In Proceedings of the International Conference on Dependable Systems and Networks, New York City, June 2000.
121. R. Vallee-Rai, L. Hendren, V. Sundaresan, P. Lam, E. Gagnon, and P. Co. Soot — a Java optimization framework. In Proceedings of CASCON 1999, pages 125-135,1999.
122. J.M. Voas. PIE: a dynamic failure-based technique. IEEE Transactions on Software Engineering, 18(8): 717-735, 1992.
123. F. Vokolos and P. Frankl. Pythia: a regression test selection tool based on textual differencing. In Third International Conference of Reliability, Quality, and Safety of Software Intensive Systems, May 1997.
124. E.J. Weyuker. Axiomatizing software test data adequacy. IEEE Transactions on Software Engineering, (12): 1128-1138, December 1986.
125. E.J. Weyuker, S.N. Weiss, and D. Hamlet. Comparison of program testing strategies. In Proceedings of the Symposium on Testing, Analysis, and Verification, pages 1-10. ACM Press, 1991.
126. J.A. Whittaker. What is software testing? and why is it so hard? IEEE Software, 17(1):70-76, January/February 2000.
127. J.A. Whittaker and J.M. Voas. Toward a more reliable theory of software reliability. IEEE Computer, 32(12): 36-42, December 2000.
128. W.E. Wong, J.R. Horgan, S. London, and H. Agrawal. A study of effective regression testing in practice. In Proceedings of the 8th International Symposium on Software Reliability Engineering, pages 230-238, November 1997.
129. M. Young and R.N. Taylor. Rethinking the taxonomy of fault detection techniques. In Proceedings of the 11th International Conference on Software Engineering, pages 53-62. ACM Press, 1989.
130. H. Zhu, P.A.V. Hall, and J. H.R. May. Software unit test coverage and adequacy. ACM Computing Surveys, 29(4):366-427, 1997.