Achievements, open problems and challenges for search based software testing

2015 IEEE 8th International Conference on Software Testing, Verification and Validation, ICST 2015 - Proceedings

Volumn , Issue , 2015, Pages

  Harman, Mark ^a   Jia, Yue ^a   Zhang, Yuanyuan ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

OPTIMIZATION; SOFTWARE ENGINEERING; VERIFICATION;

MULTI OBJECTIVE; NON FUNCTIONAL PROPERTIES; OPTIMISATION PROBLEMS; PROBLEMS AND CHALLENGES; SEARCH BASED SOFTWARE ENGINEERING (SBSE); SEARCH TECHNIQUE; SEARCH-BASED SOFTWARE TESTING; TEST STRATEGIES;

SOFTWARE TESTING;

EID: 84935073254     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICST.2015.7102580     Document Type: Conference Paper

References (130)

1. Anne Adams and Martina Angela Sasse. Users are not the enemy. Communications of the ACM, 42(12):40-46, December 1999.
2. Wasif Afzal, Richard Torkar, and Robert Feldt. A systematic review of search-based testing for non-functional system properties. Information and Software Technology, 51(6):957-976, 2009.
3. Wasif Afzal, Richard Torkar, Robert Feldt, and Greger Wikstrand. Search-based prediction of fault-slip-through in large software projects. In Second International Symposium on Search Based Software Engineering (SSBSE 2010), pages 79-88, Benevento, Italy, 7-9 September 2010.
4. Shaukat Ali, Lionel C. Briand, Hadi Hemmati, and Rajwinder Kaur Panesar-Walawege. A systematic review of the application and empirical investigation of search-based test-case generation. IEEE Transactions on Software Engineering, pages 742-762, 2010.
5. John Anvik, Lyndon Hiew, and Gail C. Murphy. Who should fix this bug? In 28th International Conference on Software Engineering (ICSE '06), pages 361-370, New York, NY, USA, 2006. ACM.
6. Andrea Arcuri, David Robert White, John A. Clark, and Xin Yao. Multi-objective improvement of software using co-evolution and smart seeding. In 7th International Conference on Simulated Evolution and Learning (SEAL 2008), pages 61-70, Melbourne, Australia, December 2008. Springer.
7. Nesa Asoudeh and Yvan Labiche. A multi-objective genetic algorithm for generating test suites from extended finite state machines. In Proceedings of the 5th International Symposium on Search Based Software Engineering (SSBSE '13), volume 8084, St. Petersburg, Russia, 24-26 August 2013. Springer.
8. Wesley Klewerton Guez Assuno, Thelma Elita Colanzi, Silvia Regina Vergilio, and Aurora Pozo. A multi-objective optimization approach for the integration and test order problem. Information Sciences, 267:119-139, May 2014.
9. Arthur Baars, Mark Harman, Youssef Hassoun, Kiran Lakhotia, Phil McMinn, Paolo Tonella, and Tanja Vos. Symbolic search-based testing. In 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), pages 53-62, Lawrence, Kansas, USA, 6th-10th November 2011.
10. Abhijeet Banerjee, Lee Kee Chong, Sudipta Chattopadhyay, and Abhik Roychoudhury. Detecting energy bugs and hotspots in mobile apps. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE'14, pages 588-598, New York, NY, USA, 2014. ACM.
11. André Baresel, Harmen Sthamer, and Joachim Wegener. Applying evolutionary testing to search for critical defects. In Proceedings of the 2004 Conference on Genetic and Evolutionary Computation (GECCO '04), volume 3103 of Lecture Notes in Computer Science, pages 1427-1428, Seattle, Washington, USA, 26-30 June 2004. Springer Berlin / Heidelberg.
12. Earl T. Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz, and Shin Yoo. The oracle problem in software testing: A survey. IEEE Transactions on Software Engineering, 2015. To appear.
13. Iain Bate and Usman Khan. WCET analysis of modern processors using multi-criteria optimisation. Empirical Software Engineering, 16(1):5-28, February 2011.
14. Olga Baysal, Michael W. Godfrey, and Robin Cohen. A bug you like: A framework for automated assignment of bugs. In International conference on program comprehension (ICPC '09), pages 297-298. IEEE Computer Society, 2009.
15. Karel P. Bergmann and Jörg Denzinger. Testing of precision agricultural networks for adversary-induced problems. In Proceeding of The 15th Annual Conference on Genetic and Evolutionary Computation (GECCO '13), pages 1421-1428, Amsterdam, The Netherlands, 6-10 July 2013. ACM.
16. Robert S. Boyer, Bernard Elspas, and Karl N. Levitt. SELECT- A formal system for testing and debugging programs by symbolic execution. In International Conference on Reliable Software, pages 234-245, New York, NY, USA, 1975. ACM.
17. Lionel Briand, Yvan Labiche, and Kathy Chen. A multi-objective genetic algorithm to rank state-based test cases. In Proceedings of the 5th International Symposium on Search Based Software Engineering (SSBSE '13), volume 8084, pages 66-80, St. Petersburg, Russia, 24-26 August 2013. Springer.
18. Lionel C. Briand, Jie Feng, and Yvan Labiche. Using genetic algorithms and coupling measures to devise optimal integration test orders. In Software Engineering and Knowledge Engineering (SEKE 02), pages 43-50, 2002.
19. Lionel C. Briand, Yvan Labiche, and Marwa Shousha. Using genetic algorithms for early schedulability analysis and stress testing in real-time systems. Genetic Programming and Evolvable Machines, 7(2):145-170, June 2006.
20. Renée C. Bryce and Charles Joseph Colbourn. One-test- At- A-time heuristic search for interaction test suites. In Proceedings of the 9th annual Conference on Genetic and Evolutionary Computation (GECCO '07), pages 1082-1089, London, England, 7-11 July 2007. ACM.
21. Cristian Cadar and Koushik Sen. Symbolic execution for software testing: Three decades later. Communications of the ACM, 56(2):82-90, February 2013.
22. Cristiano Calcagno, Dino Distefano, Peter W. O'Hearn, and Hongseok Yang. Compositional shape analysis by means of bi- Abduction. In Zhong Shao and Benjamin C. Pierce, editors, 36th Symposium on Principles of Programming Languages (POPL 2009), pages 289-300, Savannah, GA, USA, 2009. ACM.
23. Cristiano Calcagno, Dino Distefano, Peter W. O'Hearn, and Hongseok Yang. Compositional shape analysis by means of bi- Abduction. Journal of the ACM, 58(6):26:1-26:66, 2011.
24. Gerardo Canfora, Massimiliano Di Penta, Raffaele Esposito, and Maria Luisa Villani. An approach for QoS- Aware service composition based on genetic algorithms. In Hans-Georg Beyer and Una-May O'Reilly, editors, Genetic and Evolutionary Computation Conference, GECCO 2005, Proceedings, Washington DC, USA, June 25-29, 2005, pages 1069-1075. ACM, 2005.
25. Myra B. Cohen, Matthew B. Dwyer, and Jiangfan Shi. Interaction testing of highly-configurable systems in the presence of constraints. In Proceedings of the 2007 International Symposium on Software Testing and Analysis (ISSTA '07), pages 129-139, London, United Kingdom, 9-12 July 2007. ACM.
26. Thelma Elita Colanzi, Wesley Klewerton Guez Assuno, Silvia Regina Vergilio, and Aurora Trinidad Ramirez Pozo. Integration test of classes and aspects with a multi-evolutionary and coupling-based approach. In 3rd International Symposium on Search Based Software Engineering (SSBSE '11), Szeged, Hungary, 10-12 September 2011. Springer.
27. Thelma Elita Colanzi, Silvia Regina Vergilio, Wesley Klewerton Guez Assuncao, and Aurora Pozo. Search based software engineering: Review and analysis of the field in Brazil. Journal of Systems and Software, 86(4):970-984, April 2013.
28. H. David, E. Gorbatov, Ulf R. Hanebutte, R. Khanna, and C. Le. Rapl: Memory power estimation and capping. In Proceedings of the 2010 ACM/IEEE International Symposium on Low-Power Electronics and Design, ISLPED'10, pages 189-194, Aug 2010.
29. Richard A. De Millo, Richard J. Lipton, and Alan J. Perlis. Social processes and proofs of theorems and programs. Communications of the ACM, 22(5):271-280, May 1979.
30. An earlier version appeared in ACM Symposium on Principles of Programming Languages (POPL), Los Angeles, California, 1977 pp. 206-214.
31. Karnig Agop Derderian. Automated Test Sequence Generation for Finite State Machines using Genetic Algorithms. PhD thesis, School of Information Systems, Computing and Mathematics, Brunel University, 2006.
32. Edsger W. Dijkstra. On a political pamphlet from the middle ages (A response to the paper 'social processes and proofs of theorems and programs' by DeMillo, Lipton, and Perlis). ACM SIGSOFT, Software Engineering Notes, 3(2):14-17, 1978.
33. Richard M. Everson and Jonathan E. Fieldsend. Multiobjective optimization of safety related systems: An application to short-term conflict alert. IEEE Transactions on Evolutionary Computation, 10(2):187-198, April 2006.
34. Denzil Ferreira, Anind K. Dey, and Vassilis Kostakos. Understanding human-smartphone concerns: A study of battery life. In 9th International Conference on Pervasive Computing (Pervasive'11), pages 19-33, Berlin, Heidelberg, 2011. Springer-Verlag.
35. Javier Ferrer, Francisco Chicano, and Enrique Alba. Evolutionary algorithms for the multi-objective test data generation problem. Software: Practice and Experience, 42(11):1331-1362, November 2012.
36. James H. Fetzer. Program verification: the very idea. Communications of the ACM, 31(9):1048-1063, September 1988.
37. Gordon Fraser and Andrea Arcuri. EvoSuite: automatic test suite generation for object-oriented software. In 8th European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE '11), pages 416-419. ACM, September 5th-9th 2011.
38. Gordon Fraser and Andreas Zeller. Mutation-driven generation of unit tests and oracles. In International Symposium on Software Testing and Analysis (ISSTA 2010), pages 147-158, Trento, Italy, 2010. ACM.
39. Fabrcio G. Freitas and Jerffeson T. Souza. Ten years of search based software engineering: A bibliometric analysis. In 3rd International Symposium on Search based Software Engineering (SSBSE 2011), pages 18-32, 10th-12th September 2011.
40. Milos Gligoric, Alex Groce, Chaoqiang Zhang, Rohan Sharma, Mohammad Amin Alipour, and Darko Marinov. Comparing non- Adequate test suites using coverage criteria. In Mauro Pezzè and Mark Harman, editors, International Symposium on Software Testing and Analysis (ISSTA 2013), pages 302-313, Lugano, Switzerland, 2013. ACM.
41. Benny Godlin and Ofer Strichman. Regression verification: proving the equivalence of similar programs. Software Testing, Verification and Reliability, 23(3):241-258, 2013.
42. Concettina Del Grosso, Giuliano Antoniol, Massimiliano Di Penta, Philippe Galinier, and Ettore Merlo. Improving network applications security: a new heuristic to generate stress testing data. In Cconference on Genetic and evolutionary computation (GECCO 2005), volume 1, pages 1037-1043,Washington DC, USA, 25-29 June 2005. Association for Computer Machinery.
43. Shuai Hao, Ding Li, William G. J. Halfond, and Ramesh Govindan. Estimating mobile application energy consumption using program analysis. In Proceedings of the 2013 International Conference on Software Engineering, ICSE'13, pages 92-101, Piscataway, NJ, USA, 2013. IEEE Press.
44. Mark Harman. The current state and future of search based software engineering. In Lionel Briand and Alexander Wolf, editors, Future of Software Engineering 2007, pages 342-357, Los Alamitos, California, USA, 2007. IEEE Computer Society Press.
45. Mark Harman. Why source code analysis and manipulation will always be important (keynote). In 10th IEEE International Working Conference on Source Code Analysis and Manipulation, Timisoara, Romania, 2010.
46. Mark Harman. Making the case for MORTO: Multi objective regression test optimization. In 1st International Workshop on Regression Testing (Regression 2011), Berlin, Germany, March 2011.
47. Mark Harman and John Clark. Metrics are fitness functions too. In 10th International Software Metrics Symposium (METRICS 2004), pages 58-69, Los Alamitos, California, USA, September 2004. IEEE Computer Society Press.
48. Mark Harman, John Clark, and Mel Ó Cinnédie. Dynamic adaptive search based software engineering needs fast approximate metrics (keynote paper). In 4th International Workshop on Emerging Trends in Software Metrics (WeTSOM 2013), San Francisco, USA, May 2013.
49. Mark Harman, Yue Jia, Jens Krinke, Bill Langdon, Justyna Petke, and Yuanyuan Zhang. Search based software engineering for software product line engineering: a survey and directions for future work (keynote paper). In 18th International Software Product Line Conference (SPLC 14), pages 5-18, Florence, Italy, September 2014.
50. Mark Harman, Yue Jia, and William B. Langdon. Strong higher order mutation-based test data generation. In 8th European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE '11), pages 212-222, New York, NY, USA, September 5th-9th 2011. ACM.
51. Mark Harman, Yue Jia, William B. Langdon, Justyna Petke, Iman Hemati Moghadam, Shin Yoo, and Fan Wu. Genetic improvement for adaptive software engineering (keynote). In 9th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS 2014), pages 1-4, New York, NY, USA, 2014. ACM.
52. Mark Harman and Bryan F. Jones. Search based software engineering. Information and Software Technology, 43(14):833-839, December 2001.
53. Mark Harman, Kiran Lakhotia, and Phil McMinn. A multi-objective approach to search-based test data generation. In 9th annual conference on Genetic and evolutionary computation (GECCO 2007), pages 1098-1105, London, UK, July 2007. ACM Press.
54. Mark Harman, William B. Langdon, Yue Jia, David R. White, Andrea Arcuri, and John A. Clark. The GISMOE challenge: Constructing the pareto program surface using genetic programming to find better programs (keynote paper). In 27th IEEE/ACM International Conference on Automated Software Engineering (ASE 2012), pages 1-14, Essen, Germany, September 2012.
55. Mark Harman, William B. Langdon, and Westley Weimer. Genetic programming for reverse engineering (keynote paper). In Rocco Oliveto and Romain Robbes, editors, 20th Working Conference on Reverse Engineering (WCRE 2013), Koblenz, Germany, 14-17 October 2013. IEEE.
56. Mark Harman, Afshin Mansouri, and Yuanyuan Zhang. Search based software engineering: A comprehensive analysis and review of trends techniques and applications. Technical Report TR-09-03, Department of Computer Science, King's College London, April 2009.
57. Mark Harman, Afshin Mansouri, and Yuanyuan Zhang. Search based software engineering: Trends, techniques and applications. ACM Computing Surveys, 45(1):11:1-11:61, November 2012.
58. Mark Harman and Phil McMinn. A theoretical and empirical study of search based testing: Local, global and hybrid search. IEEE Transactions on Software Engineering, 36(2):226-247, 2010.
59. Mark Harman, Phil McMinn, Jerffeson Teixeira de Souza, and Shin Yoo. Search based software engineering: Techniques, taxonomy, tutorial. In Bertrand Meyer and Martin Nordio, editors, Empirical software engineering and verification: LASER 2009-2010, pages 1-59. Springer, 2012. LNCS 7007.
60. Rob Hierons, Kirill Bogdanov, Jonathan Bowen, Rance Cleaveland, John Derrick, Jeremy Dick, Marian Gheorghe, Mark Harman, Kalpesh Kapoor, Paul Krause, Gerald Luettgen, Tony Simons, Sergiy Vilkomir, Martin Woodward, and Hussein Zedan. Using formal methods to support testing. ACM Computing Surveys, 41(2), February 2009. Article 9.
61. Charles Anthony Richard Hoare. The engineering of software: A startling contradiction. In David Gries, editor, Programming Methodology, A Collection of Articles by Members of IFIP WG2. 3. Springer-Verlag, New York, NY, 1978.
62. Charles Anthony Richard Hoare. How did software get so reliable without proof? In FME '96: Industrial Benefit and Advances in Formal Methods: Third International Symposium of Formal Methods Europe, number 1051 in LNCS, pages 1-17. Springer-Verlag, March 1996.
63. Timo Hönig, Christopher Eibel, Rüdiger Kapitza, and Wolfgang Schröder-Preikschat. Seep: Exploiting symbolic execution for energyaware programming. In Proceedings of the 4th Workshop on Power-Aware Computing and Systems, HotPower'11, pages 4:1-4:5, New York, NY, USA, 2011. ACM.
64. Kobi Inkumsah and Tao Xie. Evacon: a framework for integrating evolutionary and concolic testing for object-oriented programs. In R. E. Kurt Stirewalt, Alexander Egyed, and Bernd Fischer 0002, editors, 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007), November 5-9, 2007, Atlanta, Georgia, USA, pages 425-428. ACM, 2007.
65. Yue Jia, Myra B. Cohen, Mark Harman, and Justyna Petke. Learning combinatorial interaction testing strategies using hyperheuristic search. Technical Report RN/13/17, University College London, 2013.
66. Yue Jia and Mark Harman. Constructing subtle faults using higher order mutation testing. In 8th International Working Conference on Source Code Analysis and Manipulation (SCAM'08), pages 249-258, Beijing, China, 2008. IEEE Computer Society.
67. James A. Jones, Mary Jean Harrold, and John Stasko. Visualization of test information to assist fault localization. In 24th International Conference on Software Engineering (ICSE '02), pages 467-477, New York, NY, USA, 2002. ACM.
68. James Cornelius King. A Program Verifier. PhD thesis, Carnegie Mellon University, 1969.
69. B. Korel. Automated software test data generation. IEEE Transactions on Software Engineering, 16(8):870-879, 1990.
70. Kiran Lakhotia, Mark Harman, and Hamilton Gross. AUSTIN: An open source tool for search based software testing of C programs. Journal of Information and Software Technology, 55(1):112-125, January 2013.
71. Kiran Lakhotia, Phil McMinn, and Mark Harman. Automated test data generation for coverage: Haven't we solved this problem yet? In 4th Testing Academia and Industry Conference-Practice And Research Techniques (TAIC PART'09), pages 95-104, Windsor, UK, 4th-6th September 2009.
72. Kiran Lakhotia, Nikolai Tillmann, Mark Harman, and Jonathan de Halleux. FloPSy-Search-based floating point constraint solving for symbolic execution. In 22nd IFIP International Conference on Testing Software and Systems (ICTSS 2010), pages 142-157, Natal, Brazil, November 2010. LNCS Volume 6435.
73. William B. Langdon and Mark Harman. Genetically improved CUDA C++ software. In 17th European Conference on Genetic Programming (EuroGP), Granada, Spain, April 2014. To Appear.
74. William B. Langdon and Mark Harman. Optimising existing software with genetic programming. IEEE Transactions on Evolutionary Computation (TEVC), 2014. To appear.
75. William B. Langdon, Mark Harman, and Yue Jia. Efficient multi objective higher order mutation testing with genetic programming. Journal of Systems and Software, 83(12):2416-2430, 2010.
76. Claire Le Goues, Stephanie Forrest, and Westley Weimer. Current challenges in automatic software repair. Software Quality Journal, 21(3):421-443, 2013.
77. Claire Le Goues, ThanhVu Nguyen, Stephanie Forrest, and Westley Weimer. GenProg: A generic method for automatic software repair. IEEE Transactions on Software Engineering, 38(1):54-72, 2012.
78. Raluca Lefticaru and Florentin Ipate. Automatic state-based test generation using genetic algorithms. In Proceedings of the 9th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC '07), pages 188-195, Timisoara, Romania, 26-29 September 2007. IEEE Computer Society.
79. Per Kristian Lehre and Xin Yao. Runtime analysis of (1+1) EA on computing unique input output sequences. In Proceedings of 2007 IEEE Congress on Evolutionary Computation (CEC '07), pages 1882-1889, Singapore, 25-28 September 2007. IEEE.
80. Ding Li, Yuchen Jin, Cagri Sahin, James Clause, and William G. J. Halfond. Integrated energy-directed test suite optimization. In Proceedings of the 2014 International Symposium on Software Testing and Analysis, ISSTA'14, pages 339-350, New York, NY, USA, 2014. ACM.
81. Ding Li, Angelica Huyen Tran, and William G. J. Halfond. Making web applications more energy efficient for OLED smartphones. In 36th International Conference on Software Engineering (ICSE 2014), pages 527-538, New York, NY, USA, 2014. ACM.
82. Francesco Logozzo and Thomas Ball. Modular and verified automatic program repair. In 27th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA), pages 133-146, 2012.
83. Irene Manotas, Christian Bird, Lori Pollock, and James Clause. An empirical study of practitioners' perspectives on green software engineering. Technical Report 2014/003, University of Delaware, 2014.
84. Irene Manotas, Lori Pollock, and James Clause. SEEDS: A software engineer's energy-optimization decision support framework. In 36th International Conference on Software Engineering, pages 503-514, New York, NY, USA, 2014. ACM.
85. Bogdan Marculescu, Robert Feldt, and Richard Torkar. Objective re-weighting to guide an interactive search based software testing system. In Machine Learning and Applications (ICMLA), pages 102-107. IEEE, 2013.
86. Phil McMinn. Search-based software test data generation: A survey. Software Testing, Verification and Reliability, 14(2):105-156, June 2004.
87. W. Miller and D. Spooner. Automatic generation of floating-point test data. IEEE Transactions on Software Engineering, 2(3):223-226, 1976.
88. Siavash Mirarab, Soroush Akhlaghi, and Ladan Tahvildari. Sizeconstrained regression test case selection using multi-criteria optimization. IEEE Transactions on Software Engineering, 38(4):936-956, July-Aug 2012.
89. I. M. Murwantara, B. Bordbar, and Leandro L. Minku. Measuring energy consumption for web service product configuration. In 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS'14), December 2014. To appear.
90. Hoang Duong Thien Nguyen, Dawei Qi, Abhik Roychoudhury, and Satish Chandra. SemFix: program repair via semantic analysis. In Betty H. C. Cheng and Klaus Pohl, editors, 35th International Conference on Software Engineering (ICSE 2013), pages 772-781, San Francisco, USA, May 18-26 2013. IEEE.
91. Jungsup Oh, Mark Harman, and Shin Yoo. Transition coverage testing for Simulink/Stateflow models using messy genetic algorithms. In Genetic Algorithms and Evolutionary COmputation Conference (GECCO 2011), pages 1851-1858, Dublin, Ireland, 2011.
92. Rosemary O'Keeffe. The health benefits of stress. The Boolean, 2014:125-129, June 2014.
93. Elmahdi Omar, Sudipto Ghosh, and Darrell Whitley. Comparing search techniques for finding subtle higher order mutants. In Conference on Genetic and Evolutionary Computation (GECCO 2014), pages 1271-1278. ACM, 2014.
94. Chris Parnin and Alessandro Orso. Are automated debugging techniques actually helping programmers? In International Symposium on Software Testing and Analysis (ISSTA '11), pages 199-209, New York, NY, USA, 2011. ACM.
95. Abhinav Pathak, Y. Charlie Hu, and Ming Zhang. Where is the energy spent inside my app?: Fine grained energy accounting on smartphones with eprof. In Proceedings of the 7th ACM European Conference on Computer Systems, EuroSys'12, pages 29-42, New York, NY, USA, 2012. ACM.
96. Justyna Petke, Myra B. Cohen, Mark Harman, and Shin Yoo. Efficiency and early fault detection with lower and higher strength combinatorial interaction testing. In European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, ESEC/FSE'13, pages 26-36, Saint Petersburg, Russian Federation, August 2013. ACM.
97. Justyna Petke, Mark Harman, William B. Langdon, and Westley Weimer. Using genetic improvement & code transplants to specialise a C++ program to a problem class. In 17th European Conference on Genetic Programming (EuroGP), Granada, Spain, April 2014. To Appear.
98. Gustavo Pinto, Fernando Castor, and Yu David Liu. Understanding energy behaviors of thread management constructs. In Proceedings of the 2014 ACM International Conference on Object Oriented Programming Systems Languages & Applications, OOPSLA'14, pages 345-360, New York, NY, USA, 2014. ACM.
99. Simon Poulding, Robert Alexander, John A. Clark, and Mark J. Hadley. The optimisation of stochastic grammars to enable costeffective probabilistic structural testing. In 15th Annual Conference on Genetic and Evolutionary Computation (GECCO '13), pages 1477-1484, New York, NY, USA, 2013. ACM.
100. Md. Mainur Rahman, Guenther Ruhe, and Thomas Zimmermann. Optimized assignment of developers for fixing bugs an initial evaluation for eclipse projects. In 3rd International Symposium on Empirical Software Engineering and Measurement (ESEM '09), pages 439-442, Washington, DC, USA, 2009. IEEE Computer Society.
101. Outi Räihä. A survey on search-based software design. Computer Science Review, 4(4):203-249, 2010.
102. Jian Ren, Mark Harman, and Massimiliano Di Penta. Cooperative coevolutionary optimization on software project staff assignments and job scheduling. In 3rd International Symposium on Search based Software Engineering (SSBSE 2011), pages 127-141, 10th-12th September 2011. LNCS Volume 6956.
103. Cagri Sahin, Philip Tornquist, Ryan McKenna, Zachary Pearson, and James Clause. How does code obfuscation impact energy usage? In Proceedings of the 30th International Conference on Software Maintenance and Evolution, ICSME'14, 2014.
104. Richard L. Sauder. A general test data generator for COBOL. In AFIPS Spring Joint Computer Conference, pages 317-323, New York, NY, USA, 1962. ACM.
105. Alan C. Schultz, John J. Grefenstette, and Kenneth A. De Jong. Test and evaluation by genetic algorithms. IEEE Expert (also IEEE Intelligent Systems and Their Applications), 8(5):9-14, 1993.
106. Jeffery Shelburg, Marouane Kessentini, and Daniel R. Tauritz. Regression testing for model transformations: A multi-objective approach. In Proceedings of the 5th International Symposium on Search Based Software Engineering (SSBSE '13), volume 8084, pages 209-223, St. Petersburg, Russia, 24-26 August 2013. Springer.
107. August Shi, ALex Gyori, Milos Gligoric, Andrey Zaytsev, and Darko Marinov. Balancing trade-offs in test-suite reduction. In 22nd International Symposium on Foundations of Software Engineering (FSE 2014), pages 246-256, New York, NY, USA, 2014. ACM.
108. Digvijay Singh, Peter A. H. Peterson, Peter L. Reiher, and William J. Kaiser. The atom leap platform for energy-efficient embedded computing: Architecture, operation, and system implementation. Technical report, University of California, Los Angeles, December 2010.
109. Pavel Somavat and Vinod Namboodiri. Energy consumption of personal computing including portable communication devices. Journal of Green Engineering, 1(4):447-475, 2011.
110. Jerry Swan, Michael G. Epitropakis, and John R. Woodward. Gen-o-fix: An embeddable framework for dynamic adaptive genetic improvement programming. Technical Report CSM-195, Computing Science and Mathematics, University of Stirling, Stirling FK9 4LA, Scotland, January 2014.
111. Nikolai Tillmann, Jonathan de Halleux, and Tao Xie. Transferring an automated test generation tool to practice: From Pex to Fakes and Code Digger. In 29th ACM/IEEE International Conference on Automated Software Engineering (ASE), pages 385-396, 2014.
112. Vivek Tiwari, Sharad Malik, and Andrew Wolfe. Power analysis of embedded software: A first step towards software power minimization. In Proceedings of the 1994 IEEE/ACM International Conference on Computer- Aided Design, ICCAD'94, pages 384-390, Los Alamitos, CA, USA, 1994. IEEE Computer Society Press.
113. Marouane Tlili, Stefan Wappler, and Harmen Sthamer. Improving evolutionary real-time testing. In Proceedings of the 8th annual Conference on Genetic and Evolutionary Computation (GECCO '06), pages 1917-1924, Seattle, Washington, USA, 8-12 July 2006. ACM.
114. Nigel Tracey, John Clark, John McDermid, and Keith Mander. A search-based automated test-data generation framework for safetycritical systems. In Peter Henderson, editor, Systems engineering for business process change: new directions, pages 174-213. Springer-Verlag New York, Inc., New York, NY, USA, 2002.
115. Alan M. Turing. Checking a large routine. In Report of a Conference on High Speed Automatic Calculating Machines, pages 67-69, Cambridge, England, June 1949. University Mathematical Laboratory.
116. Bryan Walsh. The surprisingly large energy footprint of the digital economy [UPDATE]. Time Magazine, August 14th 2013.
117. Joachim Wegener and Oliver Bühler. Evaluation of different fitness functions for the evolutionary testing of an autonomous parking system. In Genetic and Evolutionary Computation Conference (GECCO 2004), pages 1400-1412, Seattle, Washington, USA, June 2004. LNCS 3103.
118. Joachim Wegener and Oliver Bühler. Evaluation of different fitness functions for the evolutionary testing of an autonomous parking system. In Proceedings of the 2004 Conference on Genetic and Evolutionary Computation (GECCO '04), volume 3103 of Lecture Notes in Computer Science, pages 1400-1412, Seattle,Washington, USA, 26-30 June 2004. Springer Berlin / Heidelberg.
119. Joachim Wegener and Frank Mueller. A comparison of static analysis and evolutionary testing for the verification of timing constraints. Real-Time Systems, 21(3):241-268, November 2001.
120. David R. White, John Clark, Jeremy Jacob, and Simon Poulding. Searching for resource-efficient programs: Low-power pseudorandom number generators. In 2008 Genetic and Evolutionary Computation Conference (GECCO 2008), pages 1775-1782, Atlanta, USA, July 2008. ACM Press.
121. David Robert White, Andrea Arcuri, and John A. Clark. Evolutionary improvement of programs. IEEE Transactions on Evolutionary Computation (TEVC), 15(4):515-538, 2011.
122. S. Xanthakis, C. Ellis, C. Skourlas, A. Le Gall, S. Katsikas, and K. Karapoulios. Application of genetic algorithms to software testing. In 5th International Conference on Software Engineering and its Applications, pages 625-636, Toulouse, France, 1992.
123. Hongseok Yang, Oukseh Lee, Josh Berdine, Cristiano Calcagno, Byron Cook, Dino Distefano, and Peter W. O'Hearn. Scalable shape analysis for systems code. In Aarti Gupta and Sharad Malik, editors, 20th International Conference on Computer Aided Verification (CAV 2008), volume 5123 of Lecture Notes in Computer Science, pages 385-398, Princeton, NJ, USA, 2008. Springer.
124. Thaise Yano, Eliane Martins, and Fabiano Luis de Sousa. A multiobjective evolutionary algorithm to obtain test cases with variable lengths. In Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation (GECCO '11), pages 1875-1882, Dublin, Ireland, 12-16 July 2011. ACM.
125. Shin Yoo and Mark Harman. Using hybrid algorithm for pareto efficient multi-objective test suite minimisation. Journal of Systems and Software, 83(4):689-701, 2010.
126. Shin Yoo and Mark Harman. Regression testing minimisation, selection and prioritisation: A survey. Journal of Software Testing, Verification and Reliability, 22(2):67-120, 2012.
127. Shin Yoo, Mark Harman, and David Clark. Fault localization prioritization: Comparing information theoretic and coverage based approaches. ACM Transactions on Software Engineering and Methodology, 22(3 (Article 19)), July 2013.
128. Shin Yoo, Xiaoyuan Xie, Fei-Ching Kuo, Tsong Yueh Chen, and Mark Harman. No pot of gold at the end of program spectrum rainbow: Greatest risk evaluation formula does not exist. Technical Report RN/14/14, University College London, 2014.
129. Yuan Zhan and John A. Clark. A search-based framework for automatic testing of MATLAB/simulink models. Journal of Systems and Software, 81(2):262-285, February 2008.
130. Yuanyuan Zhang, Mark Harman, and Afshin Mansouri. The SBSE repository: A repository and analysis of authors and research articles on search based software engineering. crestweb. cs. ucl. ac. uk/resources/sbse repository/.