Understanding the effects of changes on the cost-effectiveness of regression testing techniques

Software Testing Verification and Reliability

Volumn 13, Issue 2, 2003, Pages 65-83

  Elbaum, Sebastian ^a   Kallakuri, Praveen ^a   Malishevsky, Alexey ^b   Rothermel, Gregg ^b   Kanduri, Satya ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^b Oregon State University   (United States)

Author keywords

Case study; Change integration; Regression testing; Software testing

Indexed keywords

COST EFFECTIVENESS; ENGINEERS; REGRESSION ANALYSIS; SCHEDULING;

CHANGE INTEGRATION; REGRESSION TESTING; SOFTWARE TESTING;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 0043206588     PISSN: 09600833     EISSN: None     Source Type: Journal    
DOI: 10.1002/stvr.263     Document Type: Article

References (40)

1. Ball T. On the limit of control flow analysis for regression test selection. Proceedings of the ACM International Symposium on Software Testing and Analysis, Clearwater Beach, FL, March 1998. ACM Press: New York, 1998; 134-142.
2. Chen Y, Rosenblum D, Vo K. TestTube: A system for selective regression testing. Proceedings 16th International Conference on Software Engineering, Sorrento, Italy, May 1994. IEEE Computer Society Press: Los Alamitos, CA, 1994; 211-220.
3. Fischer K, Raji F, Chruscicki A. A methodology for retesting modified software. Proceedings National Telecommunications Conference B-6-3, November 1981. IEEE Computer Society Press: Los Alamitos, CA, 1981; 1-6.
4. Hartmann J, Robson D. Techniques for selective revalidation. IEEE Software 1990; 16(1):31-38.
5. Leung H, White L. A study of integration testing and software regression at the integration level. Proceedings Conference on Software Maintenance, November 1990. IEEE Computer Society Press: Los Alamitos, CA, 1990; 290-300.
6. Rothermel G, Harrold MJ. A safe, efficient regression test selection technique. ACM Transactions on Software Engineering and Methodology 1997; 6(2):173-210.
7. Elbaum S, Malishevsky A, Rothermel G. Prioritizing test cases for regression testing. Proceedings of the International Symposium on Software Testing and Analysis, Portland, OR, August 2000. ACM Press: New York, 2000; 102-112.
8. Elbaum S, Malishevsky A, Rothermel G. Incorporating varying test costs and fault severities into test case prioritization. Proceedings of the 23rd International Conference on Software Engineering, May 2001. ACM Press: New York, 2001; 329-338.
9. Rothermel G, Untch R, Chu C, Harrold MJ. Test case prioritization. IEEE Transactions on Software Engineering 2001; 27(10):929-948.
10. Wong W, Horgan J, London S, Agrawal H. A study of effective regression testing in practice. Proceedings Eighth International Symposium on Software Reliability Engineering, November 1997. IEEE Computer Society Press: Los Alamitos, CA, 1997; 230-238.
11. Bible J, Rothermel G, Rosenblum D. Coarse- and fine-grained safe regression test selection. ACM Transactions on Software Engineering and Methodology 2001; 10(2):149-183.
12. Elbaum S, Malishevsky AG, Rothermel G. Test case prioritization: A family of empirical studies. IEEE Transactions on Software Engineering 2002; 28(2):159-182.
13. Graves T, Harrold MJ, Kim J-M, Porter A, Rothermel G. An empirical study of regression test selection techniques. Proceedings 20th International Conference on Software Engineering, Kyoto, Japan, April 1998. IEEE Computer Society Press: Los Alamitos, CA, 1998; 188-197.
14. Rothermel G, Harrold MJ. Empirical studies of a safe regression test selection technique. IEEE Transactions on Software Engineering 1998; 24(6):401-419.
15. Rothermel G, Harrold MJ, Dedhia J. Regression test selection for C++ programs. Software Testing, Verification, and Reliability 2000; 10(2):77-109.
16. Kim J-M, Porter A, Rothermel G. An empirical study of regression test application frequency. Proceedings 22nd International Conference on Software Engineering, June 2000. ACM Press: New York, 2000; 126-135.
17. Elbaum S, Gable D, Rothermel G. Understanding and measuring the sources of variation in the prioritization of regression test suites. Proceedings International Software Metrics Symposium, April 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001; 169-179.
18. Rothermel G, Elbaum S, Malishevsky A, Kallakuri P, Davia B. The impact of test suite granularity on the cost-effectiveness of regression testing. Proceedings of the 24th International Conference on Software Engineering, May 2002. ACM Press: New York, 2002; 230-240.
19. Leung H, White L. Insights into regression testing. Proceedings Conference on Software Maintenance, October 1989. IEEE Computer Society Press: Los Alamitos, CA, 1989; 60-69.
20. Onoma K, Tsai W-T, Poonawala M, Suganuma H. Regression testing in an industrial environment. Communications of the ACM 1998; 41(5):81-86.
21. Rothermel G, Harrold MJ. Analyzing regression test selection techniques. IEEE Transactions on Software Engineering 1996; 22(8):529-551.
22. Harrold MJ, Gupta R, Soffa ML. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering and Methodology 1993; 2(3):270-285.
23. Graves TL, Harrold MJ, Kim J-M, Porter A, Rothermel G. An empirical study of regression test selection techniques. ACM Transactions on Software Engineering and Methodology 2001; 10(2):184-208.
24. Harrold MJ, Jones J, Li T, Spoon S, Gujarathi A. Regression test selection for Java software. Proceedings of the ACM Conference on Object Oriented Programming Systems, Languages, and Applications, October 2001. ACM Press: New York, 2001; 312-326.
25. Leung H, White L. A cost model to compare regression test strategies. Proceedings Conference on Software Maintenance, October 1991. IEEE Computer Society Press: Los Alamitos, CA, 1991; 201-208.
26. Rosenblum D, Weyuker EJ. Using coverage information to predict the cost-effectiveness of regression testing strategies. IEEE Transactions on Software Engineering 1997; 23(3):146-156.
27. Yin RK. Case Study Research: Design and Methods (Applied Social Research Methods, vol. 5). Sage Publications: London, 1994.
28. Gupta R, Harrold MJ, Soffa M. An approach to regression testing using slicing. Proceedings Conference on Software Maintenance, November 1992. IEEE Computer Society Press: Los Alamitos, CA, 1992; 299-308.
29. Hutchins M, Foster H, Goradia T, Ostrand T. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. Proceedings 16th International Conference on Software Engineering, Sorrento, Italy, May 1994. IEEE Computer Society Press: Los Alamitos, CA, 1994; 191-200.
30. Balcer M, Hasling W, Ostrand T. Automatic generation of test scripts from formal test specifications. Proceedings of the 3rd Symposium on Software Testing, Analysis, and Verification, KeyWest, FL, December 1989. ACM Press: New York, 1989; 210-218.
31. Ostrand T, Balcer MJ. The category-partition method for specifying and generating functional tests. Communications of the ACM 1988; 31(6):676-686.
32. Ramey C, Fox B. Bash Reference Manual (2.2 edn). O'Reilly & Associates, Inc., Sebastopol, CA, 1998.
33. Wong WE, Horgan JR, London S, Mathur AP. Effect of test set size and block coverage on the fault detection effectiveness. Proceedings Fifth International Symposium on Software Reliability Engineering, November 1994. IEEE Computer Society Press: Los Alamitos, CA, 1994; 230-238.
34. Wong WE, Horgan JR, London S, Mathur AP. Effect of test set minimization on fault detection effectiveness. Proceedings of the 17th International Conference on Software Engineering, Seattle, Washington, April 1995. ACM Press, New York, 1995; 41-50.
35. Nikora AP, Munson JC. Software evolution and the fault process. Proceedings of the Twenty Third Annual Software Engineering Workshop, NASA/Goddard Space Flight Center. NASA/Goddard Space Flight Center: Greenbelt, MD, 1998.
36. Harrold MJ, Rothermel G. Aristotle: A system for research on and development of program analysis based tools. Technical Report OSU-CISRC-3/97-TR17, Ohio State University, March 1997.
37. Elbaum S, Munson J, Harrison M. CLIC: A tool for the measurement of software system dynamics. SETL Technical Report-TR-98-04, April 1998.
38. Hildebrandt R, Zeller A. Simplifying failure-inducing input. Proceedings of the International Symposium on Software Testing and Analysis, Portland, OR, August 2000. ACM Press: New York, 2000; 135-145.
39. Elrad T, Filman R, Bader A. Article series on aspect oriented programming. Communications of the ACM 2001; 44(10):29-97.
40. Mozilla. Reference: Mozilla tinderbox framework. http://tinderbox.mozilla.org [2002].