A static approach to prioritizing JUnit test cases

IEEE Transactions on Software Engineering

Volumn 38, Issue 6, 2012, Pages 1258-1275

  Mei, Hong ^a,b   Hao, Dan ^a,b   Zhang, Lingming ^c   Zhang, Lu ^a,b   Zhou, Ji ^d   Rothermel, Gregg ^e,f  

^a PEKING UNIVERSITY   (China)

^b BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^c The University of Texas at Austin   (United States)

^d BAIDU INC   (China)

^e UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^f Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

call graph; JUnit; regression testing; Software testing; test case prioritization

Indexed keywords

CALL GRAPHS; CODE COVERAGE; CONTROL TECHNIQUES; COST-INCREASES; EMPIRICAL STUDIES; JAVA PROGRAM; JUNIT; LINES OF CODE; ON DYNAMICS; PRIORITIZATION; REGRESSION TESTING; STATIC APPROACH; TEST CASE; TEST CASE PRIORITIZATION;

JAVA PROGRAMMING LANGUAGE; XML;

SOFTWARE TESTING;

EID: 84870485125     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2011.106     Document Type: Article

References (44)

1. G. Rothermel, R. Untch, C. Chu, and M. Harrold, "Test Case Prioritization: An Empirical Study," Proc. Int'l Conf. Software Maintenance, pp. 179-188, 1999. (Pubitemid 30547719)
2. B. Beizer, Software Testing Techniques. Van Nostrand Reinhod, 1990.
3. H. Leung and L. White, "Insights into Regression Testing," Proc. Int'l Conf. Software Maintenance, pp. 60-69, 1989. (Pubitemid 20689453)
4. H. Do, G. Rothermel, and A. Kinner, "Empirical Studies of Test Cases Prioritization in a JUnit Testing Environment," Empirical Software Eng., vol. 11, pp. 33-70, 2006.
5. J.A. Jones and M.J. Harrold, "Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage," IEEE Trans. Software Eng., vol. 29, no. 3, pp. 195-209, Mar. 2003.
6. A. Srivastava and J. Thiagarajan, "Effectively Prioritizing Tests in Development Environment," Proc. Int'l Symp. Software Testing and Analysis, pp. 97-106, July 2002.
7. W. Wong, J. Horgan, S. London, H. Agrawal, and M. Bellcore, "A Study of Effective Regression Testing in Practice," Proc. Int'l Symp. Software Reliability Eng., pp. 264-274, 1997.
8. G. Rothermel, R.H. Untch, C. Chu, and M.J. Harrold, "Prioritizing Test Cases for Regression Testing," IEEE Trans. Software Eng., vol. 27, no. 10, pp. 929-948, Oct. 2001. (Pubitemid 33048252)
9. T. Ball and J.R. Larus, "Efficient Path Profiling," Proc. Int'l Symp. Microarchitecture, pp. 46-57, 1996.
10. M. Arnold and B.G. Ryder, "A Framework for Reducing the Cost of Instrumented Code," Proc. SIGPLAN Conf. Programming Language Design and Implementation, pp. 168-179, 2001.
11. M.M. Tikir and J.K. Hollingsworth, "Efficient Instrumentation for Code Coverage Testing," Proc. SIGPLAN Int'l Symp. Software Testing and Analysis, pp. 86-96, 2002.
12. D. Jeffrey and N. Gupta, "Improving Fault Detection Capability by Selectively Retaining Test Cases during Test Suite Reduction," IEEE Trans. Software Eng., vol. 33, no. 2, pp. 108-123, Feb. 2007. (Pubitemid 46223697)
13. S. Elbaum, A.G. Malishevsky, and G. Rothermel, "Test Case Prioritization: A Family of Empirical Studies," IEEE Trans. Software Eng., vol. 28, no. 2, pp. 159-182, Feb. 2002. (Pubitemid 34198321)
14. S. Elbaum, D. Gable, and G. Rothermel, "The Impact of Software Evolution on Code Coverage," Proc. Int'l Conf. Software Maintenance, pp. 169-179, 2001.
15. P.K. Chittimalli and M.J. Harrold, "Re-Computing Coverage Information to Assist Regression Testing," Proc. Int'l Conf. Software Maintenance, pp. 164-173, 2007.
16. T. Apiwattanapong, R. Santelices, P.K. Chittimalli, A. Orso, and M.J. Harrold, "MaTRIX: Maitenance-Oriented Testing Requirement Identifier and Examiner," Proc. Testing: Academic and Industrial Conf., pp. 137-146, 2006.
17. L. Zhang, J. Zhou, D. Hao, L. Zhang, and H. Mei, "Prioritizing JUnit Test Cases in Absence of Coverage Information," Proc. Int'l Conf. Software Maintenance, pp. 19-28, 2009.
18. M. Renieris and S.P. Reiss, "Fault Localization with Nearest Neighbor Queries," Proc. Int'l Conf. Automated Software Eng., pp. 30-39, 2003.
19. J.A. Jones, M.J. Harrold, and J. Stasko, "Visualization of Test Information to Assist Fault Localization," Proc. Int'l Conf. Software Eng., pp. 467-477, May 2002. (Pubitemid 35009133)
20. D. Hao, T. Xie, L. Zhang, X. Wang, H. Mei, and J. Sun, "Test Input Reduction for Result Inspection to Facilitate Fault Localization," J. Automated Software Eng., vol. 17, pp. 5-31, 2010.
21. D. Jeffrey and N. Gupta, "Test Case Prioritization Using Relevant Slices," Proc. Int'l Computer Software Applications Conf., pp. 411-420, 2006.
22. S. Elbaum, A. Malishevsky, and G. Rothermel, "Incorporating Varying Test Costs and Fault Severities into Test Case Prioritization," Proc. Int'l Conf. Software Eng., pp. 329-338, 2001. (Pubitemid 32485663)
23. J.-M. Kim and A. Porter, "A History-Based Test Prioritization Technique for Regression Testing in Resource Constrained Environments," Proc. Int'l Conf. Software Eng., pp. 119-129, May 2002. (Pubitemid 35009103)
24. L. Zhang, S. Hou, C. Guo, T. Xie, and H. Mei, "Time-Aware Test-Case Prioritization Using Integer Linear Programming," Proc. Int'l Symp. Software Testing and Analysis, pp. 213-224, 2009.
25. K.R. Walcott, M.L. Soffa, G.M. Kapfhammer, and R.S. Roos, "Time-Aware Test Suite Prioritization," Proc. Int'l Symp. Software Testing and Analysis, pp. 1-12, July 2006.
26. J. Dean, D. Grove, and C. Chambers, "Optimization of Object-Oriented Programs Using Static Class Hierarchy Analysis," Proc. European Conf. Object-Oriented Programming, pp. 77-101, 1995.
27. G.C. Murphy, D. Notkin, and E.S.-C. Lan, "An Empirical Study of Static Call Graph Extractors," Proc. Int'l Conf. Software Eng., pp. 90-99, 1996.
28. O. Lhotá k, "Comparing Call Graphs," Proc. Seventh ACM SIGPLAN-SIGSOFT Workshop Program Analysis for Software Tools and Eng., pp. 37-42, 2007. (Pubitemid 350183117)
29. F. Tip and J. Palsberg, "Scalable Propagation Based Call Graph Construction Algorithms," Proc. 15th ACM SIGPLAN Conf. Object-Oriented Programming Systems, Languages, and Applications, pp. 281-293, 2000. (Pubitemid 32396366)
30. D.F. Bacon, "Fast and Effective Optimization of Statically Typed Object-Oriented Languages," PhD thesis, Computer Science Division, Univ. of California, Berkeley, 1997.
31. O. Shivers, "Control-Flow Analysis of Higher-Order Languages," PhD thesis, Carnegie Mellon Univ., 1991.
32. D. Grove, G. DeFouw, J. Dean, and C. Chambers, "Call Graph Construction in Object-Oriented Languages," Proc. 12th ACM SIGPLAN Conf. Object-Oriented Programming Systems, Languages, and Applications, pp. 108-124, 1997.
33. D.F. Bacon and P.F. Sweeney, "Fast Static Analysis of C++ Virtual Function Calls," Proc. 11th ACM SIGPLAN Conf. Object-Oriented Programming Systems, Languages, and Applications, pp. 324-341, 1996. (Pubitemid 126669313)
34. H. Do, S. Elbaum, and G. Rothermel, "Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and Its Potential Impact," Empirical Software Eng., vol. 10, no. 4, pp. 405-435, 2005. (Pubitemid 41408554)
35. H. Do and G. Rothermel, "A Controlled Experiment Assessing Test Case Prioritization Techniques via Mutation Faults," Proc. Int'l Conf. Software Maintenance, pp. 411-420, 2005. (Pubitemid 43790954)
36. Y. Ma, J. Offutt, and Y. Kwon, "MuJava: An Automated Class Mutation System," J. Software Testing, Verification and Reliability, vol. 15, no. 2, pp. 97-133, 2005. (Pubitemid 40858060)
37. H. Do and G. Rothermel, "On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques," IEEE Trans. Software Eng., vol. 32, no. 9, pp. 733-752, Sept. 2006. (Pubitemid 44604891)
38. H. Do and G. Rothermel, "Using Sensitivity Analysis to Create Simplified Economic Models for Regression Testing," Proc. Int'l Symp. Software Testing and Analysis, pp. 51-62, 2008.
39. H. Do, S. Mirarab, L. Tahvildari, and G. Rothermel, "The Effects of Time Constraints on Test Case Prioritization:ASeries of Controlled Experiments," IEEE Trans. Software Eng., vol. 36, no. 5, pp. 593-617, Sept./Oct. 2010.
40. H. Srikanth, L. Williams, and J. Osborne, "System Test Case Prioritization of New and Regression Test Cases," Proc. Int'l Symp. Empirical Software Eng., pp. 64-73, 2005. (Pubitemid 44462593)
41. P. Tonella, P. Avesani, and A. Susi, "Using the Case-Based Ranking Methodology for Test Case Prioritization," Proc. Int'l Conf. Software Maintenance, pp. 123-133, 2006.
42. B. Korel, G. Koutsogiannakis, and L. Tahat, "Application of System Models in Regression Test Suite Prioritization," Proc. Int'l Conf. Software Maintenance, pp. 247-256, 2008.
43. Z. Ma and J. Zhao, "Test Case Prioritization Based on Analysis of Program Structure," Proc. Asia-Pacific Software Eng. Conf., pp. 471-478, 2008.
44. R. Bryce, S. Sampath, and A. Memon, "Developing a Single Model and Test Prioritization Strategies for Event-Driven Software" IEEE Trans. Software Eng., vol. 37, no. 1, pp. 48-64, Jan./Feb. 2011.