An empirical study of the effect of time constraints on the cost-benefits of regression testing

Proceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering

Volumn , Issue , 2008, Pages 71-82

  Do, Hyunsook ^a   Mirarab, Siavash ^b   Tahvildari, Ladan ^b   Rothermel, Gregg ^c  

^a North Dakota State U ^*  (United States)

^b UNIVERSITY OF WATERLOO   (Canada)

^c UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Empirical studies; Regression testing; Test case prioritization

Indexed keywords

COST-BENEFIT TRADEOFFS; COSTS AND BENEFITS; EMPIRICAL STUDIES; MODIFIED SOFTWARE; PRIORITIZATION; REGRESSION TESTING; SOFTWARE DEVELOPMENT PROCESS; TEST CASE; TEST CASE PRIORITIZATION; TESTING PROCESS; TIME CONSTRAINTS;

COST EFFECTIVENESS; COSTS; SOFTWARE ENGINEERING; SOFTWARE TESTING;

REGRESSION ANALYSIS;

EID: 77950490739     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1453101.1453113     Document Type: Conference Paper

References (33)

1. J. H. Andrews, L. C. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Int'l. Conf. Softw. Eng., pages 402-411, May 2005.
2. L. Briand and J. Wüst. Empirical studies of quality models in object-oriented systems. Adv. Comp., 56:98-167, 2002.
3. Y. Chen, D. Rosenblum, and K. Vo. TestTube: A system for selective regression testing. In Int'l. Conf. Softw. Eng., pages 211-220, May 1994.
4. S. R. Chidamber and C. F. Kemerer. Towards a metrics suite for object oriented design. In O.O. Prog. Sys., Langs., and Apps., pages 197-211, Nov. 1991.
5. M. S. Christian Collberg, Ginger Myles. An empirical study of Java bytecode programs. Technical Report TR04-11, Dept. of Computer Science, University of Arizona, 2004.
6. H. Do, S. Elbaum, and G. Rothermel. Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact. Int'l. J. Emp. Softw. Eng., 10(4):405-435, 2005.
7. H. Do and G. Rothermel. An empirical study of regression testing techniques incorporating context and lifetime factors and improved cost-benefit models. In Found. Softw. Eng., pages 141-151, Nov. 2006.
8. H. Do and G. Rothermel. On the use of mutation faults in empirical assessments of test case prioritization techniques. IEEE Trans. Softw. Eng., 32(9):733-752, 2006.
9. H. Do and G. Rothermel. Using sensitivity analysis to create simplified economic models for regression testing. In Int'l. Symp. Softw. Test. Anal., pages 51-61, July 2008.
10. S. Elbaum, A. Malishevsky, and G. Rothermel. Incorporating varying test costs and fault severities into test case prioritization. In Int'l. Conf. Softw. Eng., pages 329-338, May 2001.
11. S. Elbaum, A. G. Malishevsky, and G. Rothermel. Test case prioritization: A family of empirical studies. IEEE Trans. Softw. Eng., 28(2):159-182, Feb. 2002.
12. D. Jeffrey and N. Gupta. Test case prioritization using relevant slices. In Int'l. Comp. Softw. Appl. Conf., pages 411-420, Sept. 2006.
13. F. V. Jensen. Introduction to Bayesian Networks. Springer-Verlag New York, Inc., Secaucus, NJ, USA, 1996.
14. C. Jones. Applied Software Measurement: Assuring productivity and quality. McGraw-Hill, 1997.
15. J. Kim and A. Porter. A history-based test prioritization technique for regression testing in resource constrained environments. In Int'l. Conf. Softw. Eng., pages 119-129, May 2002.
16. A. Kinneer, M. Dwyer, and G. Rothermel. Sofya: A flexible framework for development of dynamic program analysis for Java software. Technical Report TR-UNL-CSE-2006-10006, University of Nebraska-Lincoln, Apr. 2006.
17. D. Leon and A. Podgurski. A comparison of coverage-based and distribution-based techniques for filtering and prioritizing test cases. In Int'l. Symp. Softw. Rel. Eng., pages 442-453, Nov. 2003.
18. Z. Li, M. Harman, and R. M. Hierons. Search algorithms for regression test case prioritization. IEEE Trans. Softw. Eng., 33(4):225-237, Apr. 2007.
19. A. Malishevsky, G. Rothermel, and S. Elbaum. Modeling the cost-benefits tradeoffs for regression testing techniques. In Conf. Softw. Maint., pages 204-213, Oct. 2002.
20. S. Mirarab and L. Tahvildari. A prioritization approach for software test cases on Bayesian Networks. In Found. App. Softw. Eng., LNCS 4422-0276, pages 276-290, Mar. 2007.
21. S. Mirarab and L. Tahvildari. An empirical study on Bayesian Network-based approach for test case prioritization. In Int'l. Conf. Softw. Test. Verif. Val., pages 278-287, Apr. 2008.
22. K. Onoma, W.-T. Tsai, M. Poonawala, and H. Suganuma. Regression testing in an industrial environment. Comm. ACM, 41(5):81-86, May 1988.
23. T. Ostrand and M. J. Balcer. The category-partition method for specifying and generating functional tests. Comm. ACM, 31(6):676-688, June 1988.
24. D. E. Perry and C. S. Stieg. Software faults in evolving a large, real-time system: A case study. In Eur. S.E. Conf., LNCS 717, pages 48-67, 1993.
25. F. L. Ramsey and D. W. Schafer. The Statistical Sleuth. Duxbury Press, 1st edition, 1997.
26. G. Rothermel and M. J. Harrold. Analyzing regression test selection techniques. IEEE Trans. Softw. Eng., 22(8):529-551, Aug. 1996.
27. G. Rothermel and M. J. Harrold. A safe, efficient regression test selection technique. ACM Trans. Softw. Eng. Meth., 6(2):173-210, Apr. 1997. (Pubitemid 127684922)
28. G. Rothermel, R. Untch, C. Chu, and M. J. Harrold. Test case prioritization. IEEE Trans. Softw. Eng., 27(10):929-948, Oct. 2001.
29. F. Shull et al. What we have learned about fighting defects. In Int'l. Softw. Metrics Symp., pages 249-258, June 2002.
30. A. Srivastava and J. Thiagarajan. Effectively prioritizing tests in development environment. In Int'l. Symp. Softw. Test. Anal., pages 97-106, July 2002.
31. T. Ostrand, E. Weyuker, and R. Bell. Predicting the location and number of faults in large software systems. IEEE Trans. Softw. Eng., 31(4), Apr. 2005.
32. A. Walcott, M. L. Soffa, G. M. Kapfhammer, and R. Roos. Time-aware test suite prioritization. In Int'l. Symp. Softw. Test. Anal., pages 1-12, July 2006.
33. W. Wong, J. Horgan, S. London, and H. Agrawal. A study of effective regression testing in practice. In Int'l. Symp. Softw. Rel. Engr., pages 230-238, Nov. 1997.