Behaviourally adequate software testing

Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012

Volumn , Issue , 2012, Pages 300-309

  Fraser, Gordon ^a   Walkinshaw, Neil ^b  

^a SAARLAND UNIVERSITY   (Germany)

^b UNIVERSITY OF LEICESTER   (United Kingdom)

Author keywords

search based software engineering; search based testing; test adequacy; test case generation

Indexed keywords

BESTEST; MODEL EVALUATION FRAMEWORK; SEARCH-BASED; SEARCH-BASED SOFTWARE ENGINEERING; STATISTICAL LEARNING THEORY; TEST ADEQUACY; TEST CASE GENERATION; TEST EXECUTION; TEST GENERATIONS; TEST SET GENERATION; TEST SETS; THEORETICAL TERMS;

SOFTWARE ENGINEERING;

SOFTWARE TESTING;

EID: 84862315035     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICST.2012.110     Document Type: Conference Paper

References (27)

1. J. B. Goodenough and S. L. Gerhart, "Toward a theory of test data selection," in Proceedings of the international conference on Reliable software. ACM, 1975, pp. 493-510.
2. E. Weyuker, "Assessing test data adequacy through program inference," ACM Transactions on Programming Languages and Systems, vol. 5, no. 4, pp. 641-655, 1983.
3. L. Valiant, "A theory of the learnable," Communications of the ACM, vol. 27, no. 11, pp. 1134-1142, 1984.
4. N. Walkinshaw, "Assessing test adequacy for black-box systems without specifications," in Proceedings of the International Conference on Testing Systems and Software (ICTSS'11), 2011.
5. M. Ernst, "Static and dynamic analysis: Synergy and duality,"in WODA 2003: ICSE Workshop on Dynamic Analysis, 2003, pp. 24-27.
6. H. Zhu, P. Hall, and J. May, "Inductive inference and software testing," Software Testing, Verification, and Reliability, vol. 2, no. 2, pp. 69-81, 1992.
7. H. Zhu, "A formal interpretation of software testing as inductive inference," Software Testing, Verification and Reliability, vol. 6, no. 1, pp. 3-31, 1996. (Pubitemid 126642876)
8. J. Cherniavsky and C. Smith, "A recursion theoretic approach to program testing," IEEE Transactions on Software Engineering, vol. 13, 1987.
9. F. Bergadano and D. Gunetti, "Testing by means of inductive program learning," ACM Transactions on Software Engineering and Methodology, vol. 5, no. 2, pp. 119-145, 1996. (Pubitemid 126418671)
10. K. Romanik, "Approximate testing and its relationship to learning," Theoretical Computer Science, vol. 188, no. 1-2, pp. 175-194, 1997.
11. L. Briand, Y. Labiche, Z. Bawar, and N. Spido, "Using machine learning to refine category-partition test specifications and test suites," Information and Software Technology, vol. 51, pp. 1551-1564, 2009.
12. N. Walkinshaw, J. Derrick, and Q. Guo, "Iterative refinement of reverse-engineered models by model-based testing," in Formal Methods (FM), ser. LNCS. Springer, 2009, pp. 305-320.
13. N. Walkinshaw, K. Bogdanov, J. Derrick, and J. Paris, "Increasing functional coverage by inductive testing: A case study," in International Conference on Testing Software and Systems (ICTSS), ser. LNCS, 2010.
14. T. Mitchell, Machine Learning. McGraw-Hill, 1997.
15. P. McMinn, "Search-based software test data generation: A survey," Software Testing, Verification and Reliability, vol. 14, no. 2, pp. 105-156, 2004.
16. G. Fraser and A. Arcuri, "Evolutionary generation of whole test suites," in International Conference On Quality Software (QSIC). Los Alamitos, CA, USA: IEEE Computer Society, 2011, pp. 31-40.
17. A. Arcuri, "It really does matter how you normalize the branch distance in search-based software testing," 2011.
18. J. R. Quinlan, C4. 5: Programs for Machine Learning. San Mateo, CA: MK, 1993.
19. -, "Learning with Continuous Classes," in 5th Australian Joint Conference on Artificial Intelligence, 1992, pp. 343-348.
20. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The weka data mining software: an update,"SIGKDD Explor. Newsl., vol. 11, pp. 10-18, November 2009.
21. K. Ghani and J. A. Clark, "Strengthening inferred specifications using search based testing," in Proceedings of the International Workshop on Search-based Software Testing. IEEE Computer Society, 2008, pp. 187-194.
22. C. Schneckenburger and J. Mayer, "Towards the determination of typical failure patterns," in 4th International Workshop on Software Quality Assurance, co-located with ESEC/FSE'07 (SOQUA'07). ACM, 2007, pp. 90-93.
23. E. Dorrer, "F-distribution," Commun. ACM, vol. 11, no. 2, pp. 116-117, 1968.
24. H. Sthamer, "The automatic generation of software test data using genetic algorithms," Ph.D. dissertation, University of Glamorgan, Pontyprid, Wales, UK, April 1996.
25. H. Do, S. Elbaum, and G. Rothermel, "Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact," Empirical Software Engineering, vol. 10, pp. 405-435, October 2005. (Pubitemid 41408554)
26. A. Arcuri and L. Briand, "A practical guide for using statistical tests to assess randomized algorithms in software engineering,"in ACM/IEEE International Conference on Software Engineering (ICSE), 2011, pp. 1-10.
27. A. Vargha and H. D. Delaney, "A critique and improvement of the CL common language effect size statistics of McGraw and Wong," Journal of Educational and Behavioral Statistics, vol. 25, no. 2, pp. 101-132, 2000.