Sound empirical evidence in software testing

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2012, Pages 178-188

  Fraser, Gordon ^a   Arcuri, Andrea ^b  

^a SAARLAND UNIVERSITY   (Germany)

^b SIMULA RESEARCH LABORATORY   (Norway)

Author keywords

class corpus; environment; search based software engineering; security exception; test case generation; unit testing

Indexed keywords

CLASS CORPUS; ENVIRONMENT; SEARCH-BASED SOFTWARE ENGINEERING; SECURITY EXCEPTION; TEST CASE GENERATION; UNIT TESTING;

DATA COMMUNICATION SYSTEMS; JAVA PROGRAMMING LANGUAGE; RESEARCH; SOFTWARE ENGINEERING; SOFTWARE TESTING;

OPEN SYSTEMS;

EID: 84864258149     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2012.6227195     Document Type: Conference Paper

References (54)

1. J. H. Andrews, A. Groce, M. Weston, and R. G. Xu. Random test run length and effectiveness. In IEEE/ACM Int. Conference on Automated Software Engineering (ASE), pages 19-28, 2008.
2. J. H. Andrews, S. Haldar, Y. Lei, and F. C. H. Li. Tool support for randomized unit testing. In Proceedings of the 1st International Workshop on Random Testing, RT '06, pages 36-45, New York, NY, USA, 2006. ACM.
3. J. H. Andrews, F. C. H. Li, and T. Menzies. Nighthawk: a two-level genetic-random unit test data generator. In Proceedings of the 22nd IEEE/ACM Int. Conference on Automated Software Engineering, ASE '07, pages 144-153, New York, NY, USA, 2007. ACM.
4. J. H. Andrews, T. Menzies, and F. C. Li. Genetic algorithms for randomized unit testing. IEEE Transactions on Software Engineering (TSE), 37(1):80-94, 2011.
5. A. Arcuri, M. Z. Iqbal, and L. Briand. Black-box system testing of real-time embedded systems using random and search-based testing. In IFIP International Conference on Testing Software and Systems (ICTSS), pages 95-110, 2010.
6. A. Arcuri, M. Z. Iqbal, and L. Briand. Random testing: Theoretical results and practical implications. IEEE Transactions on Software Engineering (TSE), 2011. doi:10.1109/TSE.2011.121.
7. A. Arcuri and X. Yao. Search based software testing of object-oriented containers. Information Sciences, 178(15):3075-3095, 2008.
8. L. Baresi, P. L. Lanzi, and M. Miraz. Testful: an evolutionary test approach for java. In IEEE International Conference on Software Testing, Verification and Validation (ICST), pages 185-194, 2010.
9. C. Boyapati, S. Khurshid, and D. Marinov. Korat: automated testing based on java predicates. In Proceedings of the 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA '02, pages 123-133, New York, NY, USA, 2002. ACM.
10. F. Charreteur and A. Gotlieb. Constraint-based test input generation for java bytecode. In Proceedings of the 2010 IEEE 21st International Symposium on Software Reliability Engineering, ISSRE '10, pages 131-140, Washington, DC, USA, 2010. IEEE Computer Society.
11. I. Ciupa, A. Leitner, M. Oriol, and B. Meyer. Artoo: adaptive random testing for object-oriented software. In ACM/IEEE International Conference on Software Engineering (ICSE), pages 71-80, 2008.
12. I. Ciupa, A. Pretschner, A. Leitner, M. Oriol, and B. Meyer. On the predictability of random tests for object-oriented software. In IEEE International Conference on Software Testing, Verification and Validation (ICST), pages 72-81, 2008.
13. C. Csallner and Y. Smaragdakis. JCrasher: an automatic robustness tester for Java. Softw. Pract. Exper., 34:1025-1050, 2004.
14. C. Csallner and Y. Smaragdakis. Check 'n' crash: combining static checking and testing. In Proceedings of the 27th international conference on Software engineering, ICSE '05, pages 422-431, New York, NY, USA, 2005. ACM.
15. C. Csallner, Y. Smaragdakis, and T. Xie. DSD-Crasher: A hybrid analysis tool for bug finding. ACM Trans. Softw. Eng. Methodol., 17:8:1-8:37, May 2008.
16. M. d'Amorim, C. Pacheco, T. Xie, D. Marinov, and M. D. Ernst. An empirical comparison of automated generation and classification techniques for object-oriented unit testing. In IEEE/ACM Int. Conference on Automated Software Engineering (ASE), pages 59-68, 2006.
17. G. Fraser and A. Arcuri. Evolutionary generation of whole test suites. In International Conference On Quality Software (QSIC), pages 31-40, Los Alamitos, CA, USA, 2011. IEEE Computer Society.
18. G. Fraser and A. Arcuri. Evosuite: Automatic test suite generation for object-oriented software. In ACM Symposium on the Foundations of Software Engineering (FSE), 2011.
19. G. Fraser and A. Zeller. Mutation-driven generation of unit tests and oracles. IEEE Transactions on Software Engineering, 99(PrePrints), 2011.
20. J. Galeotti, N. Rosner, C. López Pombo, and M. Frias. Analysis of invariants for efficient bounded verification. In ACM Int. Symposium on Software Testing and Analysis (ISSTA), pages 25-36, 2010.
21. H. Hemmati, A. Arcuri, and L. Briand. Empirical investigation of the effects of test suite properties on similarity-based test case selection. In IEEE International Conference on Software Testing, Verification and Validation (ICST), pages 327-336, 2011.
22. K. Inkumsah and T. Xie. Improving structural testing of object-oriented programs via integrating evolutionary testing and symbolic execution. In IEEE/ACM Int. Conference on Automated Software Engineering (ASE), pages 297-306, 2008.
23. H. Jaygarl, S. Kim, T. Xie, and C. K. Chang. Ocat: object capture-based automated testing. In Proceedings of the 19th International Symposium on Software Testing and Analysis, ISSTA '10, pages 159-170, New York, NY, USA, 2010. ACM.
24. V. G. Karthick Jayaraman, David Harvison and A. Kiezun. jfuzz: A concolic whitebox fuzzer for Java. In Proceedings of NASA Formal Methods Workshop (NFM 2009), 2009.
25. J. Malburg and G. Fraser. Combining search-based and constraint-based testing. In IEEE/ACM Int. Conference on Automated Software Engineering (ASE), 2011.
26. D. Marinov and S. Khurshid. Testera: A novel framework for testing java programs. In IEEE/ACM Int. Conference on Automated Software Engineering (ASE), 2001.
27. P. McMinn. Search-based software test data generation: A survey. Software Testing, Verification and Reliability, 14(2):105-156, 2004.
28. C. Oriat. Jartege: A Tool for Random Generation of Unit Tests for Java Classes. In Quality of Software Architectures and Software Quality, volume 3712/2005 of Lecture Notes in Computer Science, pages 242-256, Heidelberg, 2005. Springer Berlin.
29. C. Pacheco and M. D. Ernst. Eclat: Automatic generation and classification of test inputs. In ECOOP 2005 - Object-Oriented Programming, 19th European Conference, pages 504-527, Glasgow, Scotland, July 27-29, 2005.
30. C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball. Feedback-directed random test generation. In ACM/IEEE International Conference on Software Engineering (ICSE), pages 75-84, 2007.
31. C. S. Pǎsǎreanu, P. C. Mehlitz, D. H. Bushnell, K. Gundy-Burlet, M. Lowry, S. Person, and M. Pape. Combining unitlevel symbolic execution and system-level concrete execution for testing nasa software. In Proceedings of the 2008 Int. Symposium on Software Testing and Analysis, ISSTA '08, pages 15-26, New York, NY, USA, 2008. ACM.
32. J. C. B. Ribeiro, M. A. Zenha-Rela, and F. F. de Vega. Test case evaluation and input domain reduction strategies for the evolutionary testing of object-oriented software. Information and Software Technology, 51(11):1534-1548, 2009.
33. J. C. B. Ribeiro, M. A. Zenha-Rela, and F. F. de Vega. Enabling object reuse on genetic programming-based approaches to object-oriented evolutionary testing. In Proceedings of the European Conference on Genetic Programming (EuroGP), pages 220-231, 2010.
34. K. Sen and G. Agha. Cute and jcute: Concolic unit testing and explicit path model-checking tools. In T. Ball and R. Jones, editors, Computer Aided Verification, volume 4144 of Lecture Notes in Computer Science, pages 419-423. Springer Berlin / Heidelberg, 2006.
35. K. Sen, D. Marinov, and G. Agha. CUTE: a concolic unit testing engine for C. In ESEC/FSE-13: Proc. of the 10th European Software Engineering Conf. held jointly with 13th ACM SIGSOFT Int. Symposium on Foundations of Software Engineering, pages 263-272. ACM, 2005.
36. R. Sharma, M. Gligoric, A. Arcuri, G. Fraser, and D. Marinov. Testing container classes: Random or systematic? In Fundamental Approaches to Software Engineering (FASE), 2011.
37. A. J. Simons. JWalk: a tool for lazy, systematic testing of java classes by design introspection and user interaction. Automated Software Engg., 14:369-418, December 2007.
38. M. Staats and C. Pasareanu. Parallel symbolic execution for structural test generation. In ACM Int. Symposium on Software Testing and Analysis (ISSTA), pages 183-194, 2010.
39. K. Taneja and T. Xie. Diffgen: Automated regression unittest generation. In Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering, ASE '08, pages 407-410, Washington, DC, USA, 2008. IEEE Computer Society.
40. S. Thummalapenta, J. de Halleux, N. Tillmann, and S. Wadsworth. Dygen: automatic generation of high-coverage tests via mining gigabytes of dynamic traces. In Proceedings of the 4th international conference on Tests and proofs, TAP'10, pages 77-93, Berlin, Heidelberg, 2010. Springer- Verlag.
41. S. Thummalapenta, T. Xie, N. Tillmann, J. de Halleux, and W. Schulte. MSeqGen: object-oriented unit-test generation via mining source code. In Proceedings 7th European Software Engineering Conference and ACM SIGSOFT Symposium on the Foundations of Software Engineering, ESEC/FSE '09, pages 193-202. ACM, 2009.
42. N. Tillmann and W. Schulte. Parameterized unit tests. In Proceedings of the 10th European Software Engineering Conference Held Jointly with 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, ESEC/FSE-13, pages 253-262, New York, NY, USA, 2005. ACM.
43. P. Tonella. Evolutionary testing of classes. In ACM Int. Symposium on Software Testing and Analysis (ISSTA), pages 119-128, 2004.
44. W. Visser, C. S. Pasareanu, and R. Pelànek. Test input generation for java containers using state matching. In ACM Int. Symposium on Software Testing and Analysis (ISSTA), pages 37-48, 2006.
45. W. Visser, C. S. Pǎsǎreanu, and S. Khurshid. Test input generation with java pathfinder. In Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA '04, pages 97-107, New York, NY, USA, 2004. ACM.
46. W. Visser, C. S. Pǎsǎreanu, and R. Pelánek. Test input generation for java containers using state matching. In Proceedings of the 2006 International Symposium on Software Testing and Analysis, ISSTA '06, pages 37-48, New York, NY, USA, 2006. ACM.
47. T. Vos, A. Baars, F. Lindlar, P. Kruse, A. Windisch, and J. Wegener. Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool. In IEEE International Conference on Software Testing, Verification and Validation (ICST), pages 175-184, 2010.
48. S. Wappler and J. Wegener. Evolutionary unit testing of object-oriented software using strongly-typed genetic programming. In Genetic and Evolutionary Computation Conference (GECCO), pages 1925-1932, 2006.
49. X. Xiao, T. Xie, N. Tillmann, and J. de Halleux. Precise identification of problems for structural test generation. In Proceeding of the 33rd International Conference on Software Engineering, ICSE '11, pages 611-620, New York, NY, USA, 2011. ACM.
50. T. Xie, D. Marinov, and D. Notkin. Rostra: A framework for detecting redundant object-oriented unit tests. In IEEE/ACM Int. Conference on Automated Software Engineering (ASE), pages 196-205, 2004.
51. T. Xie, D. Marinov, W. Schulte, and D. Notkin. Symstra: A framework for generating object-oriented unit tests using symbolic execution. In Proceedings of the 11th Int. Conference on Tools and Algorithms for the Construction and Analysis of Systems, pages 365-381, 2005.
52. T. Xie and D. Notkin. Tool-assisted unit-test generation and selection based on operational abstractions. Automated Software Engg., 13:345-371, July 2006.
53. L. Zhang, T. Xie, L. Zhang, N. Tillmann, J. de Halleux, and H. Mei. Test generation via dynamic symbolic execution for mutation testing. In Proceedings of the 2010 IEEE International Conference on Software Maintenance, ICSM '10, pages 1-10, Washington, DC, USA, 2010. IEEE Computer Society.
54. S. Zhang, D. Saff, Y. Bu, and M. D. Ernst. Combined static and dynamic automated test generation. In ISSTA 2011, Proceedings of the 2011 International Symposium on Software Testing and Analysis, Toronto, Canada, July 19-21, 2011.