Improving fault detection capability by selectively retaining test cases during test suite reduction

IEEE Transactions on Software Engineering

Volumn 33, Issue 2, 2007, Pages 108-123

  Jeffrey, Dennis ^a   Gupta, Neelam ^a  

^a University of Arizona   (United States)

Author keywords

Fault detection effectiveness; Software testing; Test suite minimization; Test suite reduction; Testing criteria

Indexed keywords

CODES (SYMBOLS); CONSTRAINT THEORY; HEURISTIC METHODS; OPTIMIZATION;

FAULT DETECTION; FAULT DETECTION EFFECTIVENESS; SOFTWARE TESTING; TEST SUITE MINIMIZATION; TEST SUITE REDUCTION;

SOFTWARE ENGINEERING;

EID: 33846855360     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2007.18     Document Type: Article

References (31)

1. H. Agrawal, "Efficient Coverage Testing Using Global Dominator Graphs," Proc. Workshop Program Analysis for Software Tools and Eng., pp. 11-20, Sept. 1999.
2. M. Balcer, W. Hasling, and T. Ostrand, "Automatic Generation of Test Scripts from Formal Test Specifications," Proc. Third Symp. Software Testing, Analysis, and Verification, pp. 210-218, Dec. 1989.
3. J. Black, E. Melachrinoudis, and D. Kaeli, "Bi-Criteria Models for All-Uses Test Suite Reduction," Proc. Int'l Conf. Software Eng., pp. 106-115, May 2004.
4. C. Boyapati, S. Khurshid, and D. Marinov, "Korat: Automated Testing Based on Java Predicates," Proc. Int'l Symp. Software Testing and Analysis, pp. 123-133, July 2002.
5. T.Y. Chen and M.F. Lau, "Dividing Strategies for the Optimization of a Test Suite," Information Processing Letters, vol. 60, no. 3, pp. 135-141, Mar. 1996.
6. V. Chvatal, "A Greedy Heuristic for the Set-Covering Problem," Math. Operations Research, vol. 4, no. 3, pp. 233-235, Aug. 1979.
7. T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein, Introduction to Algorithms, second ed. MIT Press, Sept. 2001.
8. M.R. Garey and D.S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness. Freeman and Company, 1979.
9. C. Ghezzi, M. Jazayeri, and D. Mandrioli, Fundamentals of Software Engineering, second ed. Prentice Hall, 2003.
10. M. Harder, J. Mellen, and M.D. Ernst, "Improving Test Suites via Operational Abstraction," Proc. Int'l Conf. Software Eng., pp. 60-71, May 2003.
11. M.J. Harrold, R. Gupta, and M.L. Soffa, "A Methodology for Controlling the Size of a Test Suite," ACM Trans. Software Eng. and Methodology, vol. 2, no. 3, pp. 270-285, July 1993.
12. M.P.E. Heimdahl and D. George, "Test-Suite Reduction for Model-Based Tests: Effects on Test Quality and Implications for Testing," Proc. 19th IEEE Int'l Conf. Automated Software Eng., pp. 176-185, Sept. 2004.
13. J.R. Horgan and S.A. London, "ATAC: A Data Flow Coverage Testing Tool for C," Proc. Symp. Assessment of Quality Software Development Tools, pp. 2-10, May 1992.
14. http://www.cse.iitk.ac.in/users/jalote/download/javacoverage/index.html, 2005.
15. http://www.cse.unl.edu/~galileo/sir, 2005.
16. http://www.cs.fiu.edu/~weiss/dsaa_java/Code/DataStructures, 2005.
17. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments on the Effectiveness of Dataflow- and Controlflow-Based Test Adequacy Criteria," Proc. 16th Int'l Conf. Software Eng., pp. 191-200, May 1994.
18. J.A. Jones and M.J. Harrold, "Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage," IEEE Trans. Software Eng., vol. 29, no. 3, pp. 195-209, Mar. 2003.
19. D. Leon and A. Podgurski, "A Comparison of Coverage-Based and Distribution-Based Techniques for Filtering and Prioritizing Test Cases," Proc. Int'l Symp. Software Reliability Eng., pp. 442-456, Nov. 2003.
20. A.J. Offutt, J. Pan, and J.M. Voas, "Procedures for Reducing the Size of Coverage-Based Test Sets," Proc. Int'l Conf. Testing Computer Software, pp. 111-123, June 1995.
21. S. Rapps and E.J. Weyuker, "Selecting Software Test Data Using Data Flow Information," IEEE Trans. Software Eng., vol. 11, no. 4, pp. 367-375, Apr. 1985.
22. G. Rothermel, M.J. Harrold, J. Ostrin, and C. Hong, "An Empirical Study of the Effects of Minimization on the Fault Detection Capabilities of Test Suites," Proc. Int'l Conf. Software Maintenance, pp. 34-43, Nov. 1998.
23. G. Rothermel, M.J. Harrold, J. von Ronne, and C. Hong, "Empirical Studies of Test-Suite Reduction," Software Testing, Verification, and Reliability, vol. 12, no. 4, pp. 219-249, Oct. 2002.
24. G. Rothermel, R.H. Untch, C. Chu, and M.J. Harrold, "Prioritizing Test Cases for Regression Testing," IEEE Trans. Software Eng., vol. 27, no. 10, pp. 929-948, Oct. 2001.
25. S. Sampath, V. Mihaylov, A. Souter, and L. Pollock, "A Scalable Approach to User-Session Based Testing of Web Applications through Concept Analysis," Proc. 19th IEEE Int'l Conf. Automated Software Eng., pp. 132-141, Sept. 2004.
26. G.W. Snedecor and W.G. Cochran, Statistical Methods, sixth ed. Iowa State Univ. Press, 1967.
27. A. Srivastava and J. Thiagrajan, "Effectively Prioritizing Tests in Development Environment," Proc. Int'l Symp. Software Testing and Analysis, pp. 97-106, July 2002.
28. S. Tallam and N. Gupta, "A Concept Analysis Inspired Greedy Algorithm for Test Suite Minimization," Proc. Workshop Program Analysis for Software Tools and Eng., Sept. 2005.
29. J. von Ronne, "Test Suite Minimization: An Empirical Investigation," university honors college thesis, OregonState Univ., June 1999.
30. F.I. Vokolos and P.G. Frankl, "Empirical Evaluation of the Textual Differencing Regression Testing Technique," Proc. Int'l Conf. Software Maintenance, pp. 44-53, Nov. 1998.
31. W.E. Wong, J.R. Horgan, S. London, and A.P. Mathur, "Effect of Test Set Minimization on Fault Detection Effectiveness," Software-Practice and Experience, vol. 28, no. 4, pp. 347-369, Apr. 1998.