Test data regeneration: Generating new test data from existing test data

Software Testing Verification and Reliability

Volumn 22, Issue 3, 2012, Pages 171-201

  Yoo, S ^a   Harman, M ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

search based software testing; test data generation

Indexed keywords

AUTOMATED GENERATION; AUTOMATED TEST DATA GENERATION; EMPIRICAL EVALUATIONS; META-HEURISTIC SEARCH ALGORITHMS; MUTATION SCORE; ORDERS OF MAGNITUDE; SEARCH-BASED; TEST CASE; TEST DATA; TEST DATA GENERATION;

HEURISTIC METHODS; SOFTWARE TESTING;

DATA COMMUNICATION SYSTEMS;

EID: 84859902081     PISSN: 09600833     EISSN: 10991689     Source Type: Journal    
DOI: 10.1002/stvr.435     Document Type: Article

References (46)

1. Gallagher MJ, Narasimhan V,. ADTEST: A test data generation suite for ADA software systems. IEEE Transactions on Software Engineering 1997; 23 (8): 473-484. (Pubitemid 127828308)
2. Jones B, Sthamer HH, Eyres D,. Automatic structural testing using genetic algorithms. The Software Engineering Journal 1996; 11: 299-306. (Pubitemid 126804768)
3. McMinn P, Harman M, Binkley D, Tonella P,. The species per path approach to search-based test data generation. Proceedings of International Symposium on Software Testing and Analysis (ISSTA 06). ACM: New York, NY, U.S.A., 2006; 13-24.
4. Tracey N, Clark J, McDermid J, Mander K,. A search-based automated test-data generation framework for safety-critical systems. Systems Engineering for Business Process Change: New Directions. Springer: New York, NY, U.S.A., 2002; 174-213.
5. Jones B, Sthamer H, Yang X, Eyres D,. The automatic generation of software test data sets using adaptive search techniques. Proceedings of the Third International Conference on Software Quality Management. Seville, Spain, 1995; 435-444.
6. Tracey N, Clark J, Mander K,. Automated program flaw finding using simulated annealing. Proceedings of International Symposium on Software Testing and Analysis (ISSIA 1998). ACM: New York, NY, U.S.A., 1998; 73-81.
7. Pohlheim H, Wegener J,. Testing the temporal behavior of real-time software modules using extended evolutionary algorithms. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 1999). Morgan Kaufmann, 1999; 1795-1802.
8. Wegener J, Grochtmann M,. Verifying timing constraints of real-time systems by means of evolutionary testing. Real-Time Systems 1998; 15 (3): 275-298. (Pubitemid 128512931)
9. Wegener J, Sthamer H, Jones BF, Eyres DE,. Testing real-time systems using genetic algorithms. Software Quality 1997; 6: 127-135. (Pubitemid 127479282)
10. Harrold MJ, Jones JA, Li T, Liang D, Orso A, Pennings M, Sinha S, Spoon S,. Regression test selection for java software. ACM Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA 2001). ACM: New York, NY, U.S.A., 2001; 312-326. (Pubitemid 35009075)
11. Rothermel G, Harrold M, Ronne J, Hong C,. Empirical studies of test suite reduction. Software Testing, Verification and Reliability 2002; 4 (2): 219-249.
12. Rothermel G, Harrold M, von Ronne J, Hong C, Ostrin J,. Experiments to assess the cost benefits of test-suite reduction. Technical Report 99-60-09, Oregon State University, September 1999.
13. Rothermel G, Harrold MJ, Ostrin J, Hong C,. An empirical study of the effects of minimization on the fault detection capabilities of test suites. Proceedings of International Conference on Software Maintenance (ICSM 1998). IEEE Computer Society Press: Bethesda, MD, U.S.A., 1998; 34-43.
14. McMinn P,. Search-based software test data generation: A survey. Software Testing, Verification and Reliability 2004; 14 (2): 105-156.
15. Miller W, Spooner DL,. Automatic generation of floating-point test data. IEEE Transactions on Software Engineering 1976; 2 (3): 223-226.
16. Korel B,. Automated software test data generation. IEEE Transactions on Software Engineering 1990; 16 (8): 870-879. (Pubitemid 20738724)
17. Tracey N, Clark J, Mander K, McDermid J,. An automated framework for structural test-data generation. Proceedings of the 13th IEEE International Conference on Automated Software Engineering (ASE 1998). IEEE Computer Society Press: Honolulu, HI, U.S.A., 1998; 285-288.
18. Tracey N, Clark J, Mander K,. The way forward for unifying dynamic test-case generation: The optimisation-based approach. Proceedings of the International Workshop on Dependable Computing and its Applications (DCIA 1998). IFIP, 1998; 169-180.
19. Baresel A, Binkley DW, Harman M, Korel B,. Evolutionary testing in the presence of loop-assigned flags: A testability transformation approach. Proceedings of the International Symposium on Software Testing and Analysis (ISSTA 2004), 2004; 108-118. (Pubitemid 41121382)
20. Bottaci L,. Instrumenting programs with flag variables for test data search by genetic algorithms. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002). Morgan Kaufmann Publishers, 2002; 1337-1342.
21. Michael C, McGraw G, Schatz M,. Generating software test data by evolution. IEEE Transactions on Software Engineering 2001; 27 (12): 1085-1110. (Pubitemid 34035564)
22. Pargas RP, Harrold MJ, Peck RR,. Test-data generation using genetic algorithms. Software Testing, Verification and Reliability 1999; 9 (4): 263-282. (Pubitemid 30546633)
23. Wegener J, Baresel A, Sthamer H,. Evolutionary test environment for automatic structural testing. Information and Software Technology 2001; 43 (14): 841-854. (Pubitemid 33050964)
24. Sagarna R, Lozano JA,. Scatter search in software testing, comparison and collaboration with estimation of distribution algorithms. European Journal of Operational Research 2006; 169 (2): 392-412. (Pubitemid 41375698)
25. Sagarna R, Arcuri A, Yao X,. Estimation of distribution algorithms for testing object oriented software. Proceedings of the IEEE Congress on Evolutionary Computation (CEC 2007). IEEE Computer Society Press: Singapore, 2007; 438-444.
26. Lakhotia K, Harman M, McMinn P,. A multi-objective approach to search-based test data generation. Proceedings of the Ninth Annual Conference on Genetic and Evolutionary Computation (GECCO 2007). ACM: New York, NY, U.S.A., 2007; 1098-1105. (Pubitemid 47291668)
27. Offutt AJ, Jin Z, Pan J,. The dynamic domain reduction approach to test data generation. Software Practice and Experience 1999; 29 (2): 167-193.
28. Harman M, Hassoun Y, Lakhotia K, McMinn P, Wegener J,. The impact of input domain reduction on search-based test data generation. Proceedings of the Sixth Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering (ESEC-FSE 2007). ACM: New York, NY, U.S.A., 2007; 155-164.
29. Hierons R, Harman M, Fox C,. Branch-coverage testability transformation for unstructured programs. The Computer Journal 2005; 48 (4): 421-436. (Pubitemid 41386599)
30. Korel B, Harman M, Chung S, Apirukvorapinit P, Gupta R,. Data dependence based testability transformation in automated test generation. Proceedings of the 16th International Symposium on Software Reliability Engineering (ISSRE 05). IEEE Computer Society Press, 2005; 245-254. (Pubitemid 44733907)
31. Baudry B, Fleurey F, Jézéquel JM, Traon YL,. From genetic to bacteriological algorithms for mutation-based testing. Software Testing, Verification and Reliability 2005; 15 (2): 73-96. (Pubitemid 40858059)
32. Baudry B, Fleurey F, Jézéquel JM, Traon YL,. Automatic test case optimization: A bacteriologic algorithm. IEEE Software 2005; 22 (2): 76-82. (Pubitemid 40556024)
33. Baudry B, Fleurey F, Traon YL,. Improving test suites for efficient fault localization. Proceedings of the 28th International Conference on Software Engineering (ICSE 2006). ACM: New York, NY, U.S.A., 2006; 82-91. (Pubitemid 46600905)
34. Tlili M, Wappler S, Sthamer H,. Improving evolutionary real-time testing. Proceedings of the Eighth Annual Conference on Genetic and Evolutionary Computation (GECCO 2006). ACM: New York, NY, U.S.A., 2006; 1917-1924. (Pubitemid 44611575)
35. McMinn P,. IGUANA: Input generation using automated novel algorithms. A plug and play research tool. Technical Report CS-07-14, Department of Computer Science, University of Sheffield, 2007.
36. Cohen MB, Dwyer MB, Shi J,. Exploiting constraint solving history to construct interaction test suites. Proceedings of the Testing: Academic and Industrial Conference Practice and Research TechniquesâMUTATION (TAICPART-MUTATION 2007). IEEE Computer Society, 2007; 121-132.
37. Qu X, Cohen M, Woolf K,. Combinatorial interaction regression testing: A study of test case generation and prioritization. Proceedings of IEEE International Conference on Software Maintenance (ICSM 2007). IEEE Computer Society Press: Paris, France, 2007; 255-264.
38. Sthamer H,. The automatic generation of software test data using genetic algorithms. PhD Thesis, University of Glamorgan, 1996.
39. Budd TA,. Mutation analysis of program test data. PhD Thesis, Yale University, New Haven, CT, U.S.A., 1980.
40. Frankl PG, Weiss SN, Hu C,. All-uses vs mutation testing: An experimental comparison of effectiveness. Journal of Systems Software 1997; 38: 235-253. (Pubitemid 127384432)
41. Offutt AJ, Pan J, Tewary K, Zhang T,. An experimental evaluation of data flow and mutation testing. Software Practice and Experience 1996; 26 (2): 165-176. (Pubitemid 126594500)
42. Ma YS, Offutt J, Kwon YR,. Mujava: An automated class mutation system: Research articles. Software Testing, Verification and Reliability 2005; 15 (2): 97-133. DOI:. (Pubitemid 40858060)
43. Feldt R, Torkar R, Gorschek T, Afzal W,. Searching for cognitively diverse tests: Towards universal test diversity metrics. Proceedings of the First Workshop on Search-Based Software Testing (SBST 2008). IEEE Computer Society Press: Lillehammer, Norway, 2008; 178-186.
44. Levenshtein VI,. Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady 1966; 10: 707-710.
45. Harman M, McMinn P,. A theoretical and empirical analysis of evolutionary testing and hill climbing for structural test data generation. Proceedings of the International Symposium on Software Testing and Analysis (ISSIA 2007). ACM: New York, NY, U.S.A., 2007; 73-83. (Pubitemid 47317581)
46. Do H, Rothermel G,. On the use of mutation faults in empirical assessments of test case prioritization techniques. IEEE Transactions on Software Engineering 2006; 32 (9): 733-752. (Pubitemid 44604891)