A systematic mapping study on non-functional search-based software testing

20th International Conference on Software Engineering and Knowledge Engineering, SEKE 2008

Volumn , Issue , 2008, Pages 488-493

  Afzal, Wasif ^a   Torkar, Richard ^a   Feldt, Robert ^a  

^a BLEKINGE INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

NON-FUNCTIONAL; OPTIMIZATION TECHNIQUES; SEARCH-BASED SOFTWARE TESTING; SELECTION CRITERIA; SYSTEMATIC MAPPING STUDIES; SYSTEMATIC MAPS; TEST CASE DESIGNS; TEST GENERATIONS;

KNOWLEDGE ENGINEERING; OPTIMIZATION; SOFTWARE ENGINEERING;

SOFTWARE TESTING;

EID: 79952453274     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (55)

1. O. Abdellatif-Kaddour, P. Thevenod-Fosse, and H. Waeselynck. Property-Oriented Testing based on Simulated Annealing. In Proceedings of ACS/IEEE International Conference on Computer Systems and Applications (AICCSA' 2003), Tunis (Tunisie), 2003.
2. J. T. Alander, T. Mantere, and G. Moghadampour. Searching Protection Relay Response Time Extremes using Genetic Algorithm - Software Quality by Optimization. In Proceedings of the 4th International Conference on Advances in Power System Control, Operation and Management, APSCOM-97, Hong Kong, November 1997.
3. E. Alba and F. Chicano. Finding Safety Errors with ACO. In Proceedings of 9th Annual Conference on Genetic and Evolutionary Computation, ACM, New York, USA, 2007.
4. J. Bailey, D. Budgen, M. Turner, B. Kitchenham, P. Brereton, and S. Linkman. Evidence Relating to Object-Oriented Software Design: A Survey. In Proceedings of First International Symposium on Empirical Software Engineering and Measurement, IEEE, 2007.
5. A. Baresel, H. Pohlheim, and S. Sadeghipour. Structural and Functional Sequence Test of Dynamic and State-Based Software with Evolutionary Algorithms. In Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2003), Lecture Notes in Computer Science (LNCS 2724), Springer-Verlag, Berlin, Germany, 2003.
6. S. Boukif, H. Sahraoui, and G. Antoniol. Simulated Annealing for Software Quality Prediction. In Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, ACM, New York, USA, 2006.
7. L. C. Briand, Y. Labiche, and M. Shousha. Stress Testing Real-Time Systems with Genetic Algorithms. In Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, GECCO 05, Washington, DC, USA, June 25- 29 2005.
8. R. C. Bryce and C. J. Colbourn. One-Test-at-a-Time Heuristic Search for Interaction Test Suits. In Proceedings of the 2007 Conference on Genetic and Evolutionary Computation, GECCO 07, London, UK, July 7-11, 2007.
9. J. Budynek, E. Bonabeau, and B. Shargel. Evolving Computer Intrusion Scripts for Vulnerability Assessment and Log Analysis. In Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, GECCO 05, pages 153-160, Washington, DC, USA, June 25-29, 2005.
10. E. K. Burke and G. Kendall. Search Methodologies - Introductory Tutorials in Optimization and Decision Support Techniques. Springer Science and Business Media, New York, USA, 2005.
11. G. Canfora, M. D. Penta, R. Esposito, and M. L. Villani. Search-based Testing of Service Level Agreements. In Proceedings of the Conference on Genetic and Evolutionary Computation, GECCO '07, London, UK, July 7-11, 2007.
12. G. Canfora, M. D. Penta, R. Esposito, and M. L. Villani. An Approach for QoS-aware Service Composition based on Genetic Algorithms. In GECCO 05: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, Washington, DC, USA, June 25-29, 2005.
13. M. B. Cohen, C. J. Colbourn, and A. C. H. Ling. Constructing Strength Three Covering Arrays with Augmented Annealing. Discrete Mathematics, 2003.
14. M. B. Cohen, P. B. Gibbons, W. B. Mugridge, and C. J. Colbourn. Constructing Test Suites for Interaction Testing. In Proceedings of the 25th International Conference on Software Engineering (ICSE 03), IEEE, 2003.
15. M. B. Cohen, P. B. Gibbons, W. B. Mugridge, C. J. Colbourn, and J. S. Collofello. Variable Strength Interaction Testing of Components. In Proceedings of the 27th Annual International Computer Software and Applications Conference (COMPSAC 03), IEEE, 2003.
16. Y. S. Dal, M. Xie, K. L. Poh, and B. Yang. Optimal Testing- Resource Allocation with Genetic Algorithm for Modular Software Systems. The Journal of Systems and Software, 66(1), 2003.
17. K. Derdarian, R. M. Hierons, M. Harman, and Q. Guo. Input Sequence Generation for Testing of Communicating Finite State Machines (CFSMs). In Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2004), Lecture Notes in Computer Science (LNCS 3103), Springer- Verlag, Berlin, Germany, 2004.
18. G. Dozier, D. Brown, J. Hurley, and K. Cain. Vulnerability Analysis of Immunity-Based Intrusion Detection Systems Using Evolutionary Hackers. In Proceedings of the 2004 Conference on Genetic and Evolutionary Computation, GECCO 04, Seattle, Washington, USA, June 26-30, 2004.
19. N. E. Fenton and S. L. Pfleeger. Sofware Metrics - A Rigorous and Practical Approach, 2nd Edition. International Thomson Computer Press, Boston, USA, 1996.
20. D. G. Firesmith. Common Concepts Underlying Safety, Security, and Survivability Engineering. Technical Note CMU/SEI-2003-TN-033, Carnegie Mellon Software Engineering Institute, 2003.
21. H. G. Gross. A Prediction System for Dynamic Optimization-based Execution Time Analysis. In Proceedings of First International Workshop on Software Engineering using Metaheuristic Innovative Algorithms (SEMINAL), ICSE 2001, Toronto, 2001.
22. H. G. Gross. An Evaluation of Dynamic, Optimizationbased Worst-case Execution Time Analysis. In Proceedings of the International Conference on Information Technology: Prospects and Challenges in the 21st Century, Kathmandu, Nepal, 2003.
23. H. G. Gross, B. F. Jones, and D. E. Eyres. Structural Performance Measure of Evolutionary Testing Applied to Worstcase Timing of Real-time Systems. Proceedings of IEE Software, 147(2), 2000.
24. C. Grosso, G. Antoniol, M. D. Penta, P. Galinier, and E. Merlo. Improving Network Applications Security: A New Heuristic to Generate Stress Testing Data. In Proceedings of the Annual Conference on Genetic and Evolutionary Computation, GECCO 05, ACM, New York, USA, 2005.
25. C. D. Grosso, G. Antoniol, E. Merlo, and P. Galinear. Detecting Buffer Overow via Automatic Test Input Data Generation. Computers and Operations Research, Elsevier, 2007.
26. A. G. H. Pohlheim, M. Conrad. Evolutionary Safety Testing of Embedded Control Software by Automatically Generating Compact Test Data Sequences. In SAE 2005 World Congress Exhibition, Detroit, MI, USA, April 2005.
27. M. Harman. The Current State and Future of Search-based Software Engineering. In Proceedings of Future of Software Engineering (FOSE 07) at 29th International Conference on Software Engineering. IEEE Computer Society, USA, 2007.
28. M. Harman and B. Jones. Search-based Software Engineering. Information and Software Technology, 43(14), 2001.
29. IEEE Std 830-1998. IEEE Recommended Practice for Software Requirements Specifications, 1998.
30. International Standard. ISO/IEC 9126-1:2001 Software Engineering Product Quality Part 1: Quality Model, 2001.
31. H. G. Kayacik, M. Heywood, and A. N. Zincir-Heywood. On Evolving Buffer Overflow Attacks Using Genetic Programming. In Proceedings of the 2006 Conference on Genetic and Evolutionary Computation, GECCO 06, Seattle, Washington, USA, July 8-12, 2006.
32. H. G. Kayacik, A. N. Zincir-Heywood, and M. Heywood. Evolving Successful Stack Overflow Attacks for Vulnerability Testing. In Proceedings of the 21st Annual Computer Security Applications Conference (ACSAC 2005), IEEE, 2005.
33. H. G. Kayacik, A. N. Zincir-Heywood, and M. Heywood. Automatically Evading IDS Using GP Authored Attacks. In Proceedings of the IEEE Computational intelligence in Security and Defense Applications - CISDA 2007, pages 153- 160, April 2007.
34. B. Kitchenham. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01, Keele University and University of Durham, UK, 2007.
35. J. Koljonen, M. Mannila, and M. Wanne. Testing the Performance of a 2D Nearest Point Algorithm with Genetic Algorithm Generated Gaussian Distributions. Expert Systems with Applications, 32(3), 2007.
36. P. McMinn. Search-Based Software Test Data Generation: A Survey. Software Testing, Verification and Reliability, 14(2), 2004.
37. F. Mueller and J.Wegener. A Comparison of Static Analysis and Evolutionary Testing for the Verication of Timing Constraints. In Proceedings of the 4th IEEE Real-Time Technology and Applications Symposium, Denver, USA, June 1998.
38. K. J. Nurmela. Upper Bounds for Covering Arrays by Tabu Search. Discrete Applied Mathematics, Elsevier, 2003.
39. M. OSullivan, S. Vossner, and J.Wegener. Testing Temporal Correctness of Real-Time Systems - A NewApproach using Genetic Algorithms and Cluster Analysis. In Proceedings of the 6th European Conference on Software Testing, Analysis Review (EuroSTAR 1998), Munich, Germany, 1998.
40. H. Pohlheim and J.Wegener. Testing the Temporal Behavior of Real-Time Software Modules using Extended Evolutionary Algorithms. In Proceedings of Genetic and Evolutionary Computation Conference (GECCO), 1999.
41. P. Puschner and R. Nossal. Testing the Results of Static Worst-Case Execution-Time Analysis. In Proceedings of the 19th IEEE Real-Time Systems Symposium (RTSS '98), Madrid, Spain, December 1998.
42. A. C. Schultz, J. J. Grefenstette, and K. A. D. Jong. Adaptive Testing of Controllers for Autonomous Vehicles. In Proceedings of the 1992 Symposium on Autonomous Underwater Vehicle Technology. IEEE, 1992.
43. A. C. Schultz, J. J. Grefenstette, and K. A. D. Jong. Learning to Break Things: Adaptive Testing of Intelligent Controllers. Naval Research Laboratory, Oxford University Press, 1995.
44. A. Sheta. Reliability Growth Modeling for Software Fault Detection Using Particle Swarm Optimization. In IEEE Congress on Evolutionary Computation. IEEE, 2006.
45. T. Shiba, T. Tsuchiya, and T. Kikuno. Using Artificial Life Techniques to Generate Test Cases for Combinatorial Testing. In Proceedings of the 28th Annual International Computer Software and Applications Conference (COMPSAC 04), IEEE, 2004.
46. J. Stardom. Metaheuristics and the Search for Covering and Packing Arrays. Masters Thesis, Simon Fraser University, 2001.
47. M. Tlili, S. Wappler, and H. Sthamer. Improving Evolutionary Real-Time Testing. In Proceedings of the 2006 Conference on Genetic and Evolutionary Computation, GECCO 06, Seattle, Washington, USA, July 8-12 2006.
48. N. Tracey, J. Clark, and K. Mander. The Way Forward for Unifying Dynamic Test Case Generation: The Optimisation - Based Approach. In International Workshop on Dependable Computing and Its Applications, IFIP, 1998.
49. N. J. Tracey, J. Clark, J. McDermid, and K.Mander. Integrating Safety Analysis with Automatic Test Data Generation for Software Safety Verification. In Proceedings of the 17th International Conference on System Safety, IEEE, August 1999.
50. K. R. Walcott, M. Soffa, G. M. Kapfhammer, and R. Roos. TimeAware Test Suite Prioritization. In Proceedings of the 2006 International Symposium on Software Testing and Analysis, ACM, New York, USA, 2006.
51. J. Wegener, K. Grimm, M. Grochtmann, H. Sthamer, and B. Jones. Systematic Testing of Real-time Systems. In Proceedings of the 4th European Conference on Software Testing, Analysis Review (EuroSTAR 1996), Amsterdam, Netherlands, December 1996.
52. J. Wegener and M. Grochtmann. Verifying Timing Constraints of Real-Time Systems by Means of Evolutionary Testing. Real-time Systems, 1998.
53. J.Wegener, R. Pitschinetz, and H. Sthamer. Automated Testing of Real-Time Tasks. In Proceedings of the 1st International Workshop on Automated Program Analysis, Testing and Verification, Limerick, Ireland, June 2000.
54. J. Wegener, H. Sthamer, B. F. Jones, and D. E. Eyres. Testing Real-time Systems Using Genetic Algorithms. Software Quality Journal, 6(2):127-135, June 1997.
55. Y. Zhan and J. Clark. Search-based Automatic Test-Data Generation at an Architectural Level. In Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2004), Lecture Notes in Computer Science (LNCS 3103), Springer-Verlag, Berlin, Germany, 2004.