An orchestrated survey of methodologies for automated software test case generation

Journal of Systems and Software

Volumn 86, Issue 8, 2013, Pages 1978-2001

  Anand, Saswat ^a   Burke, Edmund K ^b   Chen, Tsong Yueh ^c   Clark, John ^d   Cohen, Myra B ^e   Grieskamp, Wolfgang ^f   Harman, Mark ^g   Harrold, Mary Jean ^h   McMinn, Phil ⁱ  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF STIRLING   (United Kingdom)

^c SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^d UNIVERSITY OF YORK   (United Kingdom)

^e UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^f MICROSOFT RESEARCH   (United States)

^g UNIVERSITY COLLEGE LONDON   (United Kingdom)

^h GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

ⁱ UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Adaptive random testing; Combinatorial testing; Model based testing; Orchestrated survey; Search based software testing; Software testing; Symbolic execution; Test automation; Test case generation

Indexed keywords

ADAPTIVE RANDOM TESTING; COMBINATORIAL TESTING; MODEL BASED TESTING; SEARCH-BASED SOFTWARE TESTING; SYMBOLIC EXECUTION; TEST AUTOMATION; TEST CASE GENERATION;

RESEARCH; SURVEYS;

SOFTWARE TESTING;

EID: 84880168690     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2013.02.061     Document Type: Article

References (244)

1. F. Aarts, and F.W. Vaandrager Learning I/O automata P. Gastin, F. Laroussinie, CONCUR 2010 Springer 71 85
2. J.R. Abrial The B-Book: Assigning Programs to Meanings 1996 Cambridge University Press New York, NY, USA
3. K. Adamopoulos, M. Harman, and R.M. Hierons How to overcome the equivalent mutant problem and achieve tailored selective mutation using co-evolution Proceedings of the 2004 Conference on Genetic and Evolutionary Computation (GECCO'04) 2004 Springer 1338 1349 LNCS 3103/2004
4. W. Afzal, R. Torkar, and R. Feldt A systematic review of search-based testing for non-functional system properties Information and Software Technology 51 6 2009 957 976
5. A. Aho, A. Dahbura, D. Lee, and M. Uyar An optimization technique for protocol conformance test generation based on UIO sequences and rural Chinese postman tours S. Aggarwal, K. Sabnani, Protocol Specification, Testing, and Verification VIII, North-Holland 1988 75 86
6. L. de Alfaro, and T.A. Henzinger Interface automata ESEC/SIGSOFT FSE 2001 109 120
7. S. Ali, L.C. Briand, H. Hemmati, and R.K. Panesar-Walawege A systematic review of the application and empirical investigation of search-based test-case generation IEEE Transactions on Software Engineering 36 6 2010 742 762
8. N. Alshahwan, and M. Harman Automated web application testing using search based software engineering Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE'11) 2011 3 12
9. R. Alur, T.A. Henzinger, O. Kupferman, and M.Y. Vardi Alternating refinement relations D. Sangiorgi, R. de Simone, CONCUR 1998 Springer 163 178
10. S. Anand, P. Godefroid, and N. Tillmann Demand-driven compositional symbolic execution Proceedings of the 14th International Conference on Tools and Algorithms for the Construction and Analysis of Systems 2008 Springer 367 381
11. S. Anand, and M.J. Harrold Heap cloning: enabling dynamic symbolic execution of java programs Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE'11) 2011 33 42
12. S. Anand, A. Orso, and M.J. Harrold Type-dependence analysis and program transformation for symbolic execution Proceedings of the the 13th International Conference on Tools and Algorithms for the Construction and Analysis of Systems 2007 117 133
13. S. Anand, C.S. Pasareanu, and W. Visser Symbolic execution with abstraction International Journal on Software Tools for Technology Transfer 11 2009 53 67
14. G. Antoniol, M. Di Penta, and M. Harman The use of search-based optimization techniques to schedule and staff software projects: an approach and an empirical study Software - Practice and Experience 41 5 2011 495 519
15. A. Arcuri On the automation of fixing software bugs Proceedings of the Doctoral Symposium of the IEEE International Conference on Software Engineering (ICSE'08) 2008 ACM 1003 1006
16. A. Arcuri, and L. Briand Adaptive random testing: an illusion of effectiveness? Proceedings of the 20th International Symposium on Software Testing and Analysis 2011 265 275
17. A. Arcuri, and X. Yao Coevolving programs and unit tests from their specification Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE'07) 2007 ACM 397 400
18. A. Arcuri, and X. Yao A novel co-evolutionary approach to automatic software bug fixing Proceedings of the IEEE Congress on Evolutionary Computation (CEC'08) 2008 IEEE Computer Society 162 168
19. A. Baars, M. Harman, M. Hassoun, Y.K. Lakhotia, P. McMinn, P. Tonella, and T. Vos Symbolic search-based testing Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE'11) 2011 53 62
20. A. Bertolino Software testing research: achievements, challenges, dreams Proceedings of the 1st Workshop on Future of Software Engineering (FOSE'07) at ICSE 2007 2007 85 103
21. Binder, B.; 2012. Open Source Tools for Model-based Testing. http://www.robertvbinder.com/robertvbinder.com/open-source-tools-for-model- based-testing.
22. N. Bjørner, N. Tillmann, and A. Voronkov Path feasibility analysis for string-manipulating programs Proceedings of the International Conference on Tools and Algorithms for the Construction and Analysis of Systems 2009 307 321
23. P. Boonstoppel, C. Cadar, and D.R. Engler RWset: attacking path explosion in constraint-based test generation Proceedings of the International Conference on Tools and Algorithms for the Construction and Analysis of Systems 2008 351 366
24. M. Borges, M. d'Amorim, S. Anand, D. Bushnell, and C. Pasareanu Symbolic execution with interval constraint solving and meta-heuristic search Proceedings of the International Conference on Software Testing, Verification and Validation 2012 111 120
25. L. Bougé, N. Choquet, L. Fribourg, and M.C. Gaudel Test sets generation from algebraic specifications using logic programming Journal of Systems and Software 6 1986 343 360
26. F. Bouquet, C. Grandpierre, B. Legeard, F. Peureux, N. Vacelet, and M. Utting A subset of precise UML for model-based testing A-MOST 2007 ACM pp. 95-104
27. L.C. Briand, J. Feng, and Y. Labiche Using genetic algorithms and coupling measures to devise optimal integration test orders Proceedings of International Conference on Software Engineering and Knowledge Engineering (SEKE'02) 2002 43 50
28. Brinksma, E.; Grieskamp, W.; Tretmans, J.; 2005. 04371 summary - perspectives of model-based testing. In: Brinksma, E.; Grieskamp, W.; Tretmans, J.; (Eds.), Perspectives of Model-based Testing, Internationales Begegnungs- und Forschungszentrum für Informatik (IBFI), Schloss Dagstuhl, Germany, Dagstuhl, Germany. URL http://drops.dagstuhl.de/opus/volltexte/2005/364.
29. E. Brinksma, and J. Tretmans Testing transition systems: an annotated bibliography F. Cassez, C. Jard, B. Rozoy, M.D. Ryan, MOVEP 2000 Springer 187 195
30. R. Brownlie, J. Prowse, and M.S. Phadke Robust testing of AT&T PMX/StarMAIL using OATS AT & T Technical Journal 71 3 1992 41 47
31. Brucker, A.; Wolff, B.; 2012. On theorem prover-based testing. Formal Aspects of Computing, 1-3910.1007/s00165-012-0222-y.
32. Brumley, D.; Poosankam, P.; Song, D.X.; 0002, J.Z.; 2008. Automatic patch-based exploit generation is possible: Techniques and implications. In: Proceedings of the IEEE Symposium on Security and Privacy, pp. 143-157.
33. R. Bryce, and C. Colbourn Prioritized interaction testing for pair-wise coverage with seeding and constraints Journal of Information and Software Technology 48 10 2006 960 970
34. R.C. Bryce, and C.J. Colbourn One-test-at-a-time heuristic search for interaction test suites Proceedings of the Conference on Genetic and Evolutionary Computation (GECCO'07), Search Based Software Engineering Track 2007 258 269
35. K. Burroughs, A. Jain, and R.L. Erickson Improved quality of protocol testing through techniques of experimental design Supercomm/IC: Proceedings of IEEE International Conference on Communications 1994 745 752
36. C. Cadar, D. Dunbar, and D.R. Engler KLEE: Unassisted and automatic generation of high-coverage tests for complex systems programs Proceedings of the Symposium on Operating Systems Design and Implementation 2008 209 224
37. C. Cadar, P. Godefroid, S. Khurshid, C.S. Pasareanu, K. Sen, N. Tillmann, and W. Visser Symbolic execution for software testing in practice: preliminary assessment Proceedings of the International Conference on Software Engineering (ICSE'11) 2011 1066 1071
38. K.-Y. Cai Optimal software testing and adaptive software testing in the context of software cybernetics Information and Software Technology 44 14 2002 841 855
39. A. Calvagna, and A. Gargantini Combining satisfiability solving and heuristics to constrained combinatorial interaction testing Proceedings of the 3rd International Conference on Tests and Proofs (TAP'09) 2009 27 42
40. A. Calvagna, and A. Gargantini A formal logic approach to constrained combinatorial testing Journal of Automated Reasoning 45 2010 331 358
41. C. Campbell, W. Grieskamp, L. Nachmanson, W. Schulte, N. Tillmann, and M. Veanes Testing concurrent object-oriented systems with spec explorer J. Fitzgerald, I.J. Hayes, A. Tarlecki, FM 2005 Springer 542 547
42. M. Castro, M. Costa, and J.P. Martin Better bug reporting with better privacy Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'08) 2008 319 328
43. K.P. Chan, T.Y. Chen, and D. Towey Forgetting test cases Proceedings of the 30th Annual International Computer Software and Application Conference (COMPSAC'06) 2006 485 492
44. K.P. Chan, T.Y. Chen, and D. Towey Restricted random testing: adaptive random testing by exclusion International Journal of Software Engineering and Knowledge Engineering 16 4 2006 553 584
45. T.Y. Chen, G.R. Eddy, G. Merkel, and P.K. Wong Adaptive random testing through dynamic partitioning Proceedings of the 4th International Conference on Quality Software (QSIC'04) 2004 79 86
46. T.Y. Chen, F.-C. Kuo, and H. Liu Adaptive random testing based on distribution metrics Journal of Systems and Software 82 9 2009 1419 1433
47. T.Y. Chen, F.-C. Kuo, and R.G. Merkel On the statistical properties of testing effectiveness measures Journal of Systems and Software 79 5 2006 591 601
48. T.Y. Chen, F.-C. Kuo, R.G. Merkel, and S.P. Ng Mirror adaptive random testing Information and Software Technology 46 15 2004 1001 1010
49. T.Y. Chen, F.-C. Kuo, R.G. Merkel, and T.H. Tse Adaptive random testing: the ART of test case diversity Journal of Systems and Software 83 1 2010 60 66
50. T.Y. Chen, F.-C. Kuo, and Z.Q. Zhou On favourable conditions for adaptive random testing International Journal of Software Engineering and Knowledge Engineering 17 6 2007 805 825
51. T.Y. Chen, H. Leung, and I.K. Mak Adaptive random testing Proceedings of the 9th Asian Computing Science Conference LNCS 3321 2004 320 329
52. T.Y. Chen, and R. Merkel An upper bound on software testing effectiveness ACM Transactions on Software Engineering and Methodology 17 3 2008 16:1 16:27
53. T.Y. Chen, T.H. Tse, and Y.T. Yu Proportional sampling strategy: a compendium and some insights Journal of Systems and Software 58 1 2001 65 81
54. F. Chicano, and E. Alba Management of software projects with GAs Proceedings of the 6th Metaheuristics International Conference (MIC'05) 2005
55. V. Chipounov, V. Kuznetsov, and G. Candea S2e: a platform for in-vivo multi-path analysis of software systems Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'11) 2011 265 278
56. T. Chow Testing software design modeled by finite-state machines IEEE Transactions on Software Engineering 4 1978 178 187
57. I. Ciupa, A. Leitner, M. Oriol, and B. Meyer ARTOO: adaptive random testing for object-oriented software Proceedings of the 30th International Conference on Software Engineering (ICSE'08) 2008 71 80
58. Claessen, K.; Hughes, J.; 2000. QuickCheck: a lightweight tool for random testing of haskell programs. In: Odersky, M.; Wadler, P.; (Eds.), Proceedings of the 5th ACM SIGPLAN International Conference on Functional Programming (ICFP'00), ACM. pp. 268-279.
59. P. Clements, and L.M. Northrop Software Product Lines: Practices and Patterns 2001 Addison Wesley Boston, MA
60. W.G. Cochran, and G.M. Cox Experimental Designs 2nd ed. 1957 J. Wiley & Sons, Inc. New York
61. D.M. Cohen, S.R. Dalal, J. Parelius, and G.C. Patton The combinatorial design approach to automatic test generation IEEE Software 13 5 1996 83 88
62. D.M. Cohen, S.R. Dalal, M.L. Fredman, and G.C. Patton The AETG system: an approach to testing based on combinatorial design IEEE Transactions on Software Engineering 23 7 1997 437 444
63. M.B. Cohen, C.J. Colbourn, P.B. Gibbons, and W.B. Mugridge Constructing test suites for interaction testing Proceedings of the 25th International Conference on Software Engineering (ICSE'03) 2003 38 48
64. M.B. Cohen, C.J. Colbourn, J. Collofello, P.B. Gibbons, and W.B. Mugridge Variable strength interaction testing of components Proceedings of the 27th IEEE International Computer Software and Applications Conference (COMPSAC'03) 2003 413 418
65. M.B. Cohen, C.J. Colbourn, and A.C.H. Ling Augmenting simulated annealing to build interaction test suites Proceedings of the 14th IEEE International Symposium on Software Reliability Engineering (ISSRE'03) 2003 394 405
66. M.B. Cohen, M.B. Dwyer, and J. Shi Coverage and adequacy in software product line testing Proceedings of the ISSTA 2006 Workshop on the Role of Architecture for Testing and Analysis (ROSATEA'06) 2006 53 63
67. M.B. Cohen, M.B. Dwyer, and J. Shi Constructing interaction test suites for highly-configurable systems in the presence of constraints: a greedy approach IEEE Transactions on Software Engineering 34 5 2008 633 650
68. M.B. Cohen, P.B. Gibbons, W.B. Mugridge, and C.J. Colbourn Constructing test suites for interaction testing Proceedings of the 25th International Conference on Software Engineering (ICSE'03) 2003 IEEE Computer Society 38 48
69. T.E. Colanzi, W.K.G. Assunçáo, S.R. Vergilio, and A.T.R. Pozo Integration test of classes and aspects with a multi-evolutionary and coupling-based approach Proceedings of the 3rd International Symposium on Search Based Software Engineering (SSBSE'11) 2011 Springer
70. C.J. Colbourn Combinatorial aspects of covering arrays Le Matematiche (Catania) 58 2004 121 167
71. Colbourn, C.J.; 2012. Covering Array Tables. Available at http://www.public.asu.edu/ccolbou/src/tabby/catable.html.
72. C.J. Colbourn, M.B. Cohen, and R.C. Turban A deterministic density algorithm for pairwise interaction coverage Proceedings of the IASTED International Conference on Software Engineering 2004 345 352
73. C. Colbourn, and D. McClary Locating and detecting arrays for interaction faults Journal of Combinatorial Optimization 15 1 2008 17 48
74. J. Czerwonka Pairwise testing in real world Proceedings of the Pacific Northwest Software Quality Conference 2006 419 430
75. SMweb: a Web based service for automatic efficient test generation from functional requirements Proceedings of the 2nd IEEE Workshop on Industrial Strength Formal Specification Techniques (WIFT'98) 1998 84 85
76. H. Dan, and R.M. Hierons Conformance testing from message sequence charts Proceedings of the 4th IEEE International Conference on Software Testing, Verification and Validation (ICST'11) 2011 IEEE Computer Society 279 288
77. K. Derderian, R. Hierons, M. Harman, and Q. Guo Automated Unique Input-Output sequence generation for conformance testing of FSMs The computer Journal 49 3 2006 331 344
78. J. Dick, and A. Faivre Automating the generation and sequencing of test cases from model-based specifications J. Woodcock, P.G. Larsen, FME'93: Industrial-Strength Formal Methods, LNCS 670 1993 Springer 268 284
79. E. Dumlu, C. Yilmaz, M.B. Cohen, and A. Porter Feedback driven adaptive combinatorial testing Proceedings of the 2011 International Symposium on Software Testing and Analysis (ISSTA'11) 2011 243 253
80. I.S. Dunietz, W.K. Ehrlich, B.D. Szablak, C.L. Mallows, and A. Iannino Applying design of experiments to software testing Proceedings of the 19th International Conference on Software Engineering, (ICSE'97) 1997 205 215
81. B. Dutertre, and L. de Moura A fast linear-arithmetic solver for DPLL(T) Proceedings of the 18th International Conference on Computer Aided Verification (CAV'06) 2006 81 94
82. H. Ehrig, and B. Mahr Fundamentals of Algebraic Specification 1: Equations and Initial Semantics. volume 6 of Monographs in Theoretical Computer Science. An EATCS Series 1985 Springer
83. Ernits, J.P.; Kull, A.; Raiend, K.; Vain, J.; 2006. Generating tests from efsm models using guided model checking and iterated search refinement. In: (Havelund et al.; 2006). pp. 85-99.
84. ETSI, 2011. Requirements for Modelling Notations. Technical Report ES 202 951. ETSI.
85. R.A. Fisher The Design of Experiments 8th ed. 1971 Hafner Publishing Company New York
86. S. Fouché, M.B. Cohen, and A. Porter Incremental covering array failure characterization in large configuration spaces Proceedings of the 18th International Symposium on Software Testing and Analysis (ISSTA'09) 2009 177 187
87. Feijs, L.M.G.; Goga, N.; Mauw, S.; Tretmans, J.; 2002. Test selection, trace distance and heuristics. In: Schieferdecker, I.; König, H.; Wolisz, A.; (Eds.), Testing of Communicating Systems XIV, Applications to Internet Technologies and Services, Proceedings of the IFIP 14th International Conference on Testing Communicating Systems (TestCom 2002), pp. 267-282. Kluwer.
88. Frantzen, L.; Tretmans, J.; Willemse, T.A.C.; 2004. Test generation based on symbolic specifications. In: Grabowski and Nielsen (2005). pp. 1-15.
89. G. Fraser, and A. Zeller Mutation-driven generation of unit tests and oracles Proceedings of the 19th International Symposium on Software Testing and Analysis (ISSTA'10) 2010 ACM 147 158
90. G. Fraser, and A. Zeller Exploiting common object usage in test case generation Proceedings of the International Conference on Software Testing, Verification and Validation (ICST'11) 2011 IEEE 80 89
91. Free Software Foundation, 2012. GNU GCC Compiler Collection. Available at: http://gcc.gnu.org/.
92. G. Friedman, A. Hartman, K. Nagin, and T. Shiran Projected state machine coverage for software testing Proceedings of the 2002 International Symposium on Software Testing and Analysis (ISSTA'02) 2002 134 143
93. V. Ganesh, and D.L. Dill A decision procedure for bit-vectors and arrays Proceedings of the 19th International Conference on Computer Aided Verification (CAV'07) 2007 519 531
94. S.R. Ganov, C. Killmar, S. Khurshid, and D.E. Perry Test generation for graphical user interfaces based on symbolic execution Proceedings of the 3rd IEEE/ACM International Workshop on Automation of Software Test (AST'08) 2008 33 40
95. B.J. Garvin, M.B. Cohen, and M.B. Dwyer Evaluating improvements to a meta-heuristic search for constrained interaction testing Empirical Software Engineering (EMSE) 16 February (1) 2011 61 102
96. M.C. Gaudel Testing can be formal, too P.D. Mosses, M. Nielsen, M.I. Schwartzbach, TAPSOFT'95: Proceedings of the 6th International Joint Conference on Theory and Practice of Software Development, LNCS 915 1995 Springer 82 96
97. F. Glover, and G. Kochenberger Handbook of Metaheuristics 2003 Springer
98. P. Godefroid Compositional dynamic test generation Proceedings of the 34th annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL'07) 2007 47 54
99. P. Godefroid, A. Kiezun, and M.Y. Levin Grammar-based whitebox fuzzing Proceedings of the ACM SIGPLAN 2008 Conference on Programming Language Design and Implementation (PLDI'08) 2008 206 215
100. Godefroid, P.; Klarlund, N. and Sen, K.; 2005. DART: directed automated random testing. In: Sarkar, V.; Hall, M.W. (Eds.), Proceedings of the ACM SIGPLAN 2005 Conference on Programming Language Design and Implementation (PLDI'05), pp. 213-223. ACM.
101. P. Godefroid, M.Y. Levin, and D.A. Molnar Automated whitebox fuzz testing Proceedings of the 15th Annual Network and Distributed System Security Symposium (NDSS'08) 2008
102. P. Godefroid, and D. Luchaup Automatic partial loop summarization in dynamic test generation Proceedings of the 2011 International Symposium on Software Testing and Analysis (ISSTA'11) 2011 23 33
103. P. Godefroid, and A. Taly Automated synthesis of symbolic instruction encodings from I/O samples Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'12) 2012 441 452
104. M. Grechanik, C. Csallner, C. Fu, and Q. Xie Is data privacy always good for software testing? Proceedings of the IEEE 21st International Symposium on Software Reliability Engineering (ISSRE'10) 2010 368 377
105. Grieskamp, W.; 2006. Multi-paradigmatic model-based testing. In: (Havelund et al. 2006), pp. 1-19.
106. W. Grieskamp, Y. Gurevich, W. Schulte, and M. Veanes Generating finite state machines from abstract state machines Proceedings of the 2002 International Symposium on Software Testing and Analysis (ISSTA'02) 2002 112 122
107. Grieskamp, W.; Hierons, R.M.; Pretschner, A.; 2011. 10421 Summary - model-based testing in practice. In: Grieskamp, W.; Hierons, R.M.; Pretschner, A. (Eds.), Model-based Testing in Practice, Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Germany, Dagstuhl, Germany. URL http://drops.dagstuhl.de/opus/ volltexte/2011/2925.
108. W. Grieskamp, and N. Kicillof A schema language for coordinating construction and composition of partial behavior descriptions J. Whittle, L. Geiger, M. Meisinger, Proceedings of the 2006 International Workshop on Scenarios and State Machines: Models, Algorithms, and Tools (SCESM'06) 2006 ACM 59 66
109. W. Grieskamp, N. Kicillof, K. Stobie, and V.A. Braberman Model-based quality assurance of protocol documentation: tools and methodology. Software Testing Verification and Reliability (STVR) 21 2011 55 71
110. W. Grieskamp, N. Kicillof, and N. Tillmann Action machines: a framework for encoding and composing partial behaviors International Journal of Software Engineering and Knowledge Engineering 16 2006 705 726
111. W. Grieskamp, L. Nachmanson, N. Tillmann, and M. Veanes Test case generation from AsmL specifications E. Börger, A. Gargantini, E. Riccobene, Abstract State Machines 2003 Springer 413
112. Grieskamp, W.; Qu, X.; Wei, X.; Kicillof, N.; Cohen, M.B.; 2009. Interaction coverage meets path coverage by smt constraint solving. In: Núñez, M.; Baker, P.; Merayo, M.G.; (Eds.), Proceedings of the Joint Conference of the 21st IFIP International Conference on Testing of Communicating Systems and 9th International Workshop on Formal Approaches to Testing of Software (TESTCOM/FATES'09), LNCS 5826, pp. 97-112. Springer.
113. W. Grieskamp, N. Tillmann, and W. Schulte XRT - exploring runtime for.net - architecture and applications Electronic Notes on Theoretical Computer Science 144 2006 3 26
114. W. Grieskamp, N. Tillmann, and M. Veanes Instrumenting scenarios in a model-driven development environment Information & Software Technology 46 2004 1027 1036
115. C.D. Grosso, G. Antoniol, M.D. Penta, P. Galinier, and E. Merlo Improving network applications security: a new heuristic to generate stress testing data GECCO 2005: Proceedings of the 2005 conference on Genetic and evolutionary computation, vol. 1 2005 ACM 1037 1043
116. Groz, R.; Charles, O.; Renévot, J.; 1996. Relating conformance test coverage to formal specifications. In: Gotzhein, R.; Bredereke, J.; (Eds.), Proceedings of the IFIP TC6/6.1 International Conference on Formal Description Techniques IX/Protocol Specification, Testing and Verification XVI (FORTE'96), pp. 195-210. Chapman & Hall.
117. M. Harman Open problems in testability transformation Proceedings of the 1st International Workshop on Search Based Testing (SBT'08), Keynote paper 2008
118. M. Harman Software engineering meets evolutionary computation IEEE Computer 44 10 2011 31 39
119. M. Harman, F. Islam, T. Xie, and S. Wappler Automated test data generation for aspect-oriented programs Proceedings of the 8th International Conference on Aspect-oriented Software Development (AOSD'09) 2009 185 196
120. M. Harman, Y. Jia, and B. Langdon Strong higher order mutation-based test data generation Proceedings of the 8th European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE'11) 2011 ACM 212 222
121. M. Harman, and B.F. Jones Search based software engineering? Information and Software Technology 43 14 2001 833 839
122. M. Harman, S.G. Kim, K. Lakhotia, P. McMinn, and S. Yoo Optimizing for the number of tests generated in search based test data generation with an application to the oracle cost problem Proceedings of the 3rd International Workshop on Search-Based Software Testing (SBST'10) 2010 182 191
123. M. Harman, K. Lakhotia, and P. McMinn A multi-objective approach to search-based test data generation Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation(GECCO'07) 2007 ACM Press 1098 1105
124. Harman, M.; Mansouri, A.; Zhang, Y.; 2009. Search based software engineering: A comprehensive analysis and review of trends techniques and applications. Technical Report TR-09-03, Department of Computer Science, King's College London, April.
125. M. Harman, and P. McMinn A theoretical and empirical study of search based testing: local, global and hybrid search IEEE Transactions on Software Engineering 36 2 2010 226 247
126. Hartman, A.; 2002. Model-based Test Generation Tools. Technical Report. AGEDIS Consortium. http://www.agedis.de/documents/ModelBasedTestGenerationTools- cs.pdf.
127. A. Hartman, and L. Raskin Problems and algorithms for covering arrays Discrete Mathematics 284 2004 149 156
128. J. Hartmann, M. Vieira, H. Foster, and A. Ruder A UML-based approach to system testing Innovations in Systems and Software Engineering (ISSE) 1 1 2005 12 24
129. Helke, S.; Neustupny, T.; Santen, T.; 1997. Automating test case generation from Z specifications with Isabelle. In: Bowen, J.P.; Hinchey, M.G.; Till, D.; (Eds.), Proceedings of the 10th International Conference of Z Users on The Z Formal Specification Notation (ZUM'97), pp. 52-71. Springer.
130. H. Hemmati, A. Arcuri, and L. Briand Reducing the cost of model-based testing through test case diversity Proceedings of the 22nd IFIP International Conference on Testing Software and System (ICTSS'10) 2010 63 78
131. H. Hemmati, A. Arcuri, and L. Briand Empirical investigation of the effects of test suite properties on similarity-based test case selection Proceedings of the 4th International Conference on Software Testing, Verification and Validation (ICST'11) 2011 327 336
132. R.M. Hierons Reaching and distinguishing states of distributed systems SIAM Journal on Computing 39 2010 3480 3500
133. Hierons, R.M.; Merayo, M.G.; Núñez, M.; 2008. Implementation relations for the distributed test architecture. In: Suzuki, K.; Higashino, T.; Ulrich, A.; Hasegawa, T.; (Eds.), Testing of Software and Communicating Systems: Proceedings of the Joint Conference of the 20th IFIP TC 6/WG 6.1 International Conference on Testing of Software and Communicating Systems and the 8th International Workshop on Formal Approaches to Testing of Software (TestCom/FATES'08). LNCS 5047, pp. 200-215. Springer.
134. R.M. Hierons, and H. Ural The effect of the distributed test architecture on the power of testing Computer Journal 51 2008 497 510
135. B. Hnich, S. Prestwich, E. Selensky, and B. Smith Constraint models for the covering test problem Constraints 11 2006 199 219
136. Huima, A.; 2007. Implementing conformiq qtronic. In: Petrenko, A.; Veanes, M.; Tretmans, J.; Grieskamp, W.; (Eds.), Testing of Software and Communicating Systems: Proceedings of the Joint Conference of the 19th IFIP International Conference on Testing of Communicating Systems and 7th International Workshop on Formal Approaches to Testing of Software (TestCom/FATES'07), LNCS 4581, pp. 1-12. Springer.
137. J. Huo, and A. Petrenko Covering transitions of concurrent systems through queues Proceedings of the 16th IEEE International Symposium on Software Reliability Engineering, (ISSRE'05) 2005 335 345
138. Inkumsah, K.; Xie, T.; 2007. Evacon: a framework for integrating evolutionary and concolic testing for object-oriented programs. In: Stirewalt, R.E.K.; Egyed, A.; Fischer, B.; editors, Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE'07), pp. 425-428. ACM.
139. Iqbal, M.Z.; Arcuri, A.; Briand, L. 2011. Automated system testing of real-time embedded systems based on environment models. Technical Report 2011-2019, Simula Research Laboratory.
140. C. Jard, and T. Jéron TGV: theory, principles and algorithms International Journal on Software Tools for Technology Transfer (STTT) 7 2005 297 315
141. K. Jayaraman, D. Harvison, V. Ganeshan, and A. Kiezun A concolic whitebox fuzzer for Java Proceedings of the 1st NASA Formal Methods Symposium 2009 121 125
142. Jeannet, B.; Jéron, T.; Rusu, V.; Zinovieva, E.; 2005. Symbolic test selection based on approximate analysis. In: Halbwachs, N.; Zuck, L.D.; (Eds.), Proceedings of the 11th international conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'05), pp. 349-364. Springer.
143. M. Kaplan, T. Klinger, A.M. Paradkar, A. Sinha, C. Williams, and C. Yilmaz Less is more: A minimalistic approach to UML model-based conformance test generation Proceedings of The 1st IEEE International Conference on Software Testing Verification and Validation (ICST'08) 2008 IEEE Computer Society 82 91
144. Katara, M.; Kervinen, A.; 2006. Making model-based testing more agile: a use case driven approach. In: Bin, E.; Ziv, A.; Ur, S. (Eds.), Haifa Verification Conference, pp. 219-234. Springer.
145. K. Kähkönen, T. Launiainen, O. Saarikivi, J. Kauttio, K. Heljanko, and I. Niemelä LCT: an open source concolic testing tool for Java programs Proceedings of the 6th Workshop on Bytecode Semantics, Verification, Analysis and Transformation (Bycode'11) 2011 75 80
146. S. Khurshid, C. Pasareanu, and W. Visser Generalized symbolic execution for model checking and testing Proceedings of the 9th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'03) 2003 553 568
147. S. Khurshid, and Y.L. Suen Generalizing symbolic execution to library classes Proceedings of the 6th Workshop on Program Analysis for Software Tools and Engineering (PASTE'05) 2005 103 110
148. J.C. King A new approach to program testing Programming Methodology 1975 LNCS Vol. 23, pp. 278-290
149. D. Kuhn, J. Higdon, J. Lawrence, R. Kacker, and Y. Lei Combinatorial methods for event sequence testing Proceedings of the 5th IEEE International Conference on Software Testing, Verification and Validation (ICST'12) 2012 601 609
150. D. Kuhn, and V. Okun Pseudo-exhaustive testing for software Proceedings of the 30th NASA/IEEE Software Engineering Workshop (SEW'06) 2006 153 158
151. D. Kuhn, D.R. Wallace, and A.M. Gallo Software fault interactions and implications for software testing IEEE Transactions on Software Engineering 30 6 2004 418 421
152. V.V. Kuliamin, A.K. Petrenko, A. Kossatchev, and I.B. Burdonov The UniTesK approach to designing test suites Programming and Computer Software 29 2003 310 322
153. Kuo, F.-C.; 2006. On Adaptive Random Testing. Ph.D. Thesis. Faculty of Information and Communication Technologies, Swinburne University of Technology.
154. K. Lakhotia, M. Harman, and P. McMinn Handling dynamic data structures in search based testing Proceedings of the 10th annual conference on Genetic and evolutionary computation (GECCO'08) 2008 ACM Press 1759 1766
155. K. Lakhotia, P. McMinn, and M. Harman An empirical investigation into branch coverage for C programs using CUTE and AUSTIN Journal of Systems and Software 83 12 2010 2379 2391
156. K. Lakhotia, N. Tillmann, M. Harman, and J. de Halleux Flopsy - Search-based floating point constraint solving for symbolic execution Proceedings of the 23rd IFIP International Conference on Testing Software and Systems (ICTSS'10) 2010 142 157
157. Larsen, K.G.; Mikucionis, M.; Nielsen, B.; 2004. Online testing of real-time systems using UPPAAL. In: Grabowski and Nielsen (2005). pp. 79-94.
158. D. Lee, and M. Yannakakis Principles and methods of testing finite state machines - a survey Proceedings of the IEEE 1996 IEEE Computer Society Press 1090 1123 84(8)
159. B. Legeard, F. Peureux, and M. Utting Automated boundary testing from Z and B L.H. Eriksson, P.A. Lindsay, FME 2002: Formal Methods-Getting IT Right, LNCS 2391 2002 Springer 21 40
160. Legeard, B.; Utting, M.; 2010. Model-based testing -next generation functional software testing. Journal of Software Technology 12. http://journal.thedacs.com/issue/52/145.
161. Y. Lei, R. Kacker, D.R. Kuhn, V. Okun, and J. Lawrence Ipog-ipog-d: efficient test generation for multi-way combinatorial testing Software Testing Verification and Reliability 18 2008 125 148
162. Y. Lin, X. Tang, Y. Chen, and J. Zhao A divergence-oriented approach to adaptive random testing of Java programs Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering (ASE'09) 2009 221 232
163. M.-H. Liu, Y.-F. Gao, J.-H. Shan, J.-H. Liu, L. Zhang, and J.-S. Sun An approach to test data generation for killing multiple mutants Proceedings of the 22nd IEEE International Conference on Software Maintenance (ICSM'06) 2006 113 122
164. H. Liu, X. Xie, J. Yang, Y. Lu, and T.Y. Chen Adaptive random testing through test profiles Software: Practice and Experience 41 10 2011 1131 1154
165. K.K. Ma, Y.P. Khoo, J.S. Foster, and M. Hicks Directed symbolic execution Proceedings of the 18th International Conference on Static Analysis (SAS'11) 2011 95 111
166. Y.K. Malaiya Antirandom testing: Getting the most out of black-box testing Proceedings of the 6th International Symposium on Software Reliability Engineering (ISSRE'95 1995 86 95
167. R. Mandl Orthogonal Latin squares: an application of experiment design to compiler testing Communications of the ACM 28 10 1985 1054 1058
168. R. Majumdar, and I. Saha Symbolic robustness analysis Proceedings of the 30th IEEE Real-Time Systems Symposium (RTSS'09) 2009 355 363
169. R. Majumdar, and K. Sen Hybrid concolic testing Proceedings of the 29th International Conference on Software Engineering (ICSE'07) 2007 416 426
170. R. Majumdar, and R.G. Xu Directed test generation using symbolic grammars Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE'07) 2007 134 143
171. R. Majumdar, and R.G. Xu Reducing test inputs using information partitions Proceedings of the 21st International Conference on Computer Aided Verification (CAV'09) 2009 555 569
172. J. Mayer Lattice-based adaptive random testing Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE'05) 2005 333 336
173. McGregor, J.D.; 2001. Testing a software product line. Tech. Rep. No. cmu/sei-2001-tr-022, Carnegie Mellon Software Engineering Institute.
174. P. McMinn Search-based software test data generation: A survey Software Testing, Verification and Reliability 14 2 2004 105 156
175. P. McMinn Search-based software testing: past, present and future Proceedings of the 4th International Workshop on Search-Based Software Testing (SBST 2011) 2011 IEEE 153 163
176. P. McMinn, D. Binkley, and M. Harman Empirical evaluation of a nesting testability transformation for evolutionary testing ACM Transactions on Software Engineering Methodology 18 3 2009 11:1 11:27
177. P. McMinn, M. Harman, Y. Hassoun, K. Lakhotia, and J. Wegener Input domain reduction through irrelevant variable removal and its effect on local, global and hybrid search-based structural test data generation IEEE Transactions on Software Engineering 38 2 2012 453 477
178. P. McMinn, M. Shahbaz, and M. Stevenson Search-based test input generation for string data types using the results of web queries Proceedings of the 5th International Conference on Software Testing, Verification and Validation (ICST'12) 2012
179. P. McMinn, M. Stevenson, and M. Harman Reducing qualitative human oracle costs associated with automatically generated test data Proceedings of the 1st International Workshop on Software Test Output Validation (STOV'10) 2010 1 4
180. Merkel, R. G.; 2005. Analysis and Enhancements of Adaptive Random Testing. Ph.D. Thesis. School of Information Technology, Swinburne University of Technology.
181. C. Michael, G. McGraw, and M. Schatz Generating software test data by evolution IEEE Transactions on Software Engineering 27 12 2001 1085 1110
182. L.M. de Moura, and N. Bjørner Z3: an efficient SMT solver Proceedings of the 14th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'08) 2008 337 340
183. Nachmanson, L.; Veanes, M.; Schulte, W.; Tillmann, N.; Grieskamp, W.; 2004. Optimal strategies for testing nondeterministic systems. In: Avrunin, G.S.; Rothermel, G. (Eds.), Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA'04), pp. 55-64.
184. S. Naito, and M. Tsunoyama Fault detection for sequential machines by transition-tours Proceedings of the 11th annual International Symposium on Fault-Tolerant Computing (FTCS'81) 1981 238 243
185. M.N. Ngo, and H.B.K. Tan Detecting large number of infeasible paths through recognizing their patterns Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering 2007 215 224
186. C. Nguyen, A. Perini, P. Tonella, S. Miles, M. Harman, and M. Luck Evolutionary testing of autonomous software agents Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'09) 2009 521 528
187. C. Nie, and H. Leung A survey of combinatorial testing ACM Computing Surveys 43 2 2011 1 29
188. B. Nielsen, and A. Skou Automated test generation from timed automata International Journal on Software Tools for Technology Transfer (STTT) 5 2003 59 77
189. K. Nurmela Upper bounds for covering arrays by tabu search Discrete Applied Mathematics 138 1-2 2004 143 152
190. Offutt, A.J.; Abdurazik, A.; 1999. Generating tests from UML specifications. In: France, R.B.; Rumpe, B.; (Eds.), Proceedings of the 2nd International Conference on The Unified Modeling Language: Beyond the Standard (UML'99), pp. 416-429. Springer.
191. T.J. Ostrand, and M.J. Balcer The category-partition method for specifying and generating functional tests Communications of the ACM 31 1988 678 686
192. M. Papadakis, and N. Malevris Automatic mutation test case generation via dynamic symbolic execution Proceedings of the 21st International Symposium on Software Reliability Engineering (ISSRE'10) 2010
193. C.S. Pasareanu, P.C. Mehlitz, D.H. Bushnell, K. Gundy-Burlet, M.R. Lowry, S. Person, and M. Pape Combining unit-level symbolic execution and system-level concrete execution for testing NASA software International Symposium on Software Testing and Analysis (ISSTA'08) 2008 15 26
194. C.S. Pasareanu, and N. Rungta Symbolic PathFinder: Symbolic execution of Java bytecode Proceedings of the 25th IEEE/ACM International Conference on Automated Software Engineering (ASE'10) 2010 179 180
195. C.S. Pasareanu, N. Rungta, and W. Visser Symbolic execution with mixed concrete-symbolic solving Proceedings of 2011 International Symposium on Software Testing and Analysis (ISSTA'11) 2011 34 44
196. C.S. Pasareanu, and W. Visser A survey of new trends in symbolic execution for software testing and analysis International Journal on Software Tools for Technology Transfer 11 2009 339 353
197. L.C. Paulson Isabelle - a generic theorem prover (with a contribution by T. Nipkow) LNCS 828 1994 Springer
198. G. Perrouin, S. Sen, J. Klein, B. Baudry, and Y.L. Traon Automated and scalable t-wise test case generation strategies for software product lines Proceedings of the Third International Conference on Software Testing, Verification and Validation (ICST'10) 2010 459 468
199. M. Pezzè, and M. Young Software Testing and Analysis - Process, Principles and Techniques 2007 Wiley
200. N. Plat, and P.G. Larsen An overview of the iso/vdm-sl standard SIGPLAN Notice 27 1992 76 82
201. D. Qi, A. Roychoudhury, Z. Liang, and K. Vaswani Darwin: an approach for debugging evolving programs Proceedings of the 2009 Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering 2009 33 42
202. X. Qu, M.B. Cohen, and G. Rothermel Configuration-aware regression testing: an empirical study of sampling and prioritization Proceedings of the 2008 International Symposium on Software Testing and Analysis (ISSTA'08) 2008 75 85
203. X. Qu, M.B. Cohen, and K.M. Woolf Combinatorial interaction regression testing: a study of test case generation and prioritization Proceedings of the 23rd International Conference on Software Maintenance (ICSM'07) 2007 255 264
204. R.A. Santelices, P.K. Chittimalli, T. Apiwattanapong, A. Orso, and M.J. Harrold Test-suite augmentation for evolving software Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE'08) 2008 218 227
205. R.A. Santelices, and M.J. Harrold Exploiting program dependencies for scalable multiple-path symbolic execution Proceedings of the 2010 International Symposium on Software Testing and Analysis (ISSTA'10) 2010 195 206
206. P. Saxena, P. Poosankam, S. McCamant, and D. Song Loop-extended symbolic execution on binary programs Proceedings of the 2010 International Symposium on Software Testing and Analysis (ISSTA'10) 2009 225 236
207. I. Segall, R. Tzoref-Brill, and E. Farchi Using binary decision diagrams for combinatorial test design Proceedings of the 2011 International Symposium on Software Testing and Analysis (ISSTA'11) 2011 254 264
208. K. Sen, and G. Agha CUTE and jCUTE: concolic unit testing and explicit path model-checking tools Proceedings of the 18th International Conference on Computer Aided Verification (CAV'06) 2006 419 423
209. K. Sen, D. Marinov, and G. Agha CUTE: A concolic unit testing engine for C Proceedings of the 2005 Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering 2005 263 272
210. A. Shahbazi, A. Tappenden, and J. Miller Centroidal voronoi tessellations - a new approach to random testing IEEE Transactions on Software Engineering 39 2 2013 163 183
211. G.B. Sherwood Effective testing of factor combinations Proceedings of the 3rd International Conference on Software Testing, Analysis & Review (STAR'94) 1994 151 166
212. Souza, M.; Borges, M.; d'Amorim, M.; Pasareanu, C.S.; 2011. CORAL: solving complex constraints for symbolic pathfinder. In: Bobaru, M.G.; Havelund, K.; Holzmann, G.J.; Joshi, R. (Eds.), NASA Formal Methods - Third International Symposium (NFM'11), LNCS 6617, pp. 359-374. Springer.
213. Stardom, J.; 2001. Metaheuristics and the search for covering and packing arrays, Master's Thesis. Simon Fraser University.
214. L. Sterling, and E.Y. Shapiro The Art of Prolog - Advanced Programming Techniques 2nd ed. 1994 MIT Press
215. K.C. Tai, and Y. Lei A test generation strategy for pairwise testing IEEE Transactions on Software Engineering 28 1 2002 109 111
216. A. Tappenden, and J. Miller A novel evolutionary approach for adaptive random testing IEEE Transactions on Reliability 58 4 2009 619 633
217. Tappenden, A.; Miller, J.; 2013. Automated cookie collection testing. ACM Transactions on Software Engineering and Methodology, in press.
218. N. Tillmann, and J. de Halleux Pex-White box test generation for. NET. Proceedings of the 2nd International Conference on Tests and Proofs (TAP'08) 2008 134 153
219. A. Tomb, G.P. Brat, and W. Visser Variably interprocedural program analysis for runtime error detection Proceedings of the 2007 International Symposium on Software Testing and Analysis (ISSTA'07) 2007 97 107
220. P. Tonella Evolutionary testing of classes Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA'04) 2004 ACM 119 128
221. J. Tretmans Test Generation with Inputs, Outputs, and Repetitive Quiescence Software-Concepts and Tools 17 1996 103 120
222. J. Tretmans Model Based Testing with Labelled Transition Systems R. Hierons, J. Bowen, M. Harman, Formal Methods and Testing 2008 Springer-Verlag 1 38
223. J. Tretmans, and E. Brinksma TorX: Automated model based testing Proceedings of the 1st European Conference on Model-Driven Software: Foundations and Applications (ECMDA-FA'05) 2003 31 43
224. Y. Tung, and W.S. Aldiwan Automating test case generation for the new generation mission software system Proceedings of the IEEE Aerospace Conference 2000 431 437
225. Utting, M.; Legeard, B.; 2007. Practical Model-based Testing - A Tools Approach. Morgan Kaufmann.
226. M. Vasilevskii Failure diagnosis of automata Kibernetika 1973 98 108
227. Veanes, M.; Bjørner, N.; 2010. Alternating simulation and IOCO. In: Petrenko, A.; da Silva Simão, A.; Maldonado, J.C. (Eds.), Proceedings of the 22nd IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS'10), pp. 47-62. Springer.
228. M. Veanes, C. Campbell, W. Grieskamp, W. Schulte, N. Tillmann, and L. Nachmanson Model-based testing of object-oriented reactive systems with Spec Explorer R.M. Hierons, J.P. Bowen, M. Harman, Formal Methods and Testing 2008 Springer 39 76
229. Veanes, M.; Campbell, C.; Schulte, W.; 2007. Composition of model programs. In: Derrick, J.; Vain, J.; (Eds.), Proceedings of the 27th IFIP WG 6.1 International Conference on Formal Methods for Networked and Distributed Systems (FORTE'07), pp. 128-142. Springer.
230. M. Veanes, P. de Halleux, and N. Tillmann Rex: Symbolic regular expression explorer Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST'10) 2010 498 507
231. K.R. Walcott, M.L. Soffa, G.M. Kapfhammer, and R.S. Roos Time aware test suite prioritization Proceedings of the International Symposium on Software Testing and Analysis (ISSTA'06) 2006 ACM Press 1 12
232. J. Wegener, and O. Bühler Evaluation of different fitness functions for the evolutionary testing of an autonomous parking system Genetic and Evolutionary Computation Conference (GECCO 2004), LNCS 3103 2004 Springer 1400 1412
233. J. Wegener, and M. Grochtmann Verifying timing constraints of real-time systems by means of evolutionary testing Real-Time Systems 15 3 1998 275 298
234. E.J. Weyuker Translatability and decidability questions for restricted classes of program schemas SIAM Journal on Computing 8 4 1979 587 598
235. L.J. White, and E.I. Cohen A domain strategy for computer program testing IEEE Transactions on Software Engineering 6 3 1980 247 257
236. Wieczorek, S.; Stefanescu, A.; 2010. Improving testing of enterprise systems by model-based testing on graphical user interfaces. In: Sterritt, R.; Eames, B.; Sprinkle, J. (Eds.), Proceedings of the 2010 17th IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS'10), pp. 352-357.
237. C. Yilmaz, M.B. Cohen, and A. Porter Covering arrays for efficient fault characterization in complex configuration spaces IEEE Transactions on Software Engineering 31 1 2006 20 34
238. S. Yoo, M. Harman, P. Tonella, and A. Susi Clustering test cases to achieve effective and scalable prioritisation incorporating expert knowledge Proceedings of the 2009 ACM International Conference on Software Testing and Analysis (ISSTA 09) 2009 201 212
239. X. Yuan, M. Cohen, and A. Memon GUI interaction testing: Incorporating event context IEEE Transactions on Software Engineering 37 4 2011 559 574
240. Zhan, Y.; Clark, J.A.; 2005. Search-based mutation testing for simulink models. In: Beyer, H.-G.; O'Reilly, U.-M. (Eds.), Proceedings of the 2005 Genetic and Evolutionary Computation Conference (GECCO'05), pp. 1061-1068. ACM.
241. Y. Zhang, A. Finkelstein, and M. Harman Search based requirements optimisation: existing work and challenges Proceedings of the International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ'08), LNCS 5025 2008 Springer 88 94
242. P. Zhang, S.G. Elbaum, and M.B. Dwyer Automatic generation of load tests Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE'11) 2011 43 52
243. B. Zhou, H. Okamura, and T. Dohi Enhancing performance of random testing through Markov chain Monte Carlo methods IEEE Transactions on Computers 62 1 2013 186 192
244. H. Zhu, P.A.V. Hall, and J.H.R. May Software unit test coverage and adequacy ACM Computing Surveys 29 4 1997 366 427