An empirical investigation into branch coverage for C programs using CUTE and AUSTIN

Journal of Systems and Software

Volumn 83, Issue 12, 2010, Pages 2379-2391

  Lakhotia, Kiran ^a   McMinn, Phil ^b   Harman, Mark ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Automated test data generation; Concolic testing; Search based testing; Symbolic execution

Indexed keywords

AUTOMATED TEST DATA GENERATION; BASELINE DATA; BRANCH COVERAGE; C PROGRAMS; CONCOLIC TESTING; EMPIRICAL INVESTIGATION; EMPIRICAL STUDIES; NON-TRIVIAL; OPEN SOURCE APPLICATION; SEARCH-BASED; SYMBOLIC EXECUTION;

AUTOMATION; COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA COMMUNICATION SYSTEMS; SOFTWARE TESTING;

TESTING;

EID: 78049327633     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2010.07.026     Document Type: Conference Paper

References (50)

1. A. Baresel, and H. Sthamer Evolutionary testing of flag conditions Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2003), vol. 2724 of LNCS 2003 Springer-Verlag Chicago 2442 2454
2. A. Baresel, D. Binkley, M. Harman, and B. Korel Evolutionary testing in the presence of loop-assigned flags: a testability transformation approach Proceedings of the International Symposium on Software Testing and Analysis (ISSTA 2004) 2004 ACM Boston, MA, USA 43 52
3. B. Baudry, F. Fleurey, J.-M. Jézéquel, and Y.L. Traon From genetic to bacteriological algorithms for mutation-based testing Software Testing, Verification and Reliability 15 2 2005 73 96 http://dx.doi.org/10.1002/ stvr.313
4. Binkley, D., Harman, M., Lakhotia, K., in press. FlagRemover: a testability transformation for loop assigned flags. Transactions on Software Engineering and Methodology.
5. B. Botella, A. Gotlieb, and C. Michel Symbolic execution of floating-point computations Software Testing, Verification and Reliability 16 2 2006 97 121
6. L. Bottaci Instrumenting programs with flag variables for test data search by genetic algorithms Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002) 2002 Morgan Kaufmann Publishers New York 1337 1342
7. O. Buehler, and J. Wegener Evolutionary functional testing of an automated parking system International Conference on Computer, Communication and Control Technologies and The 9th International Conference on Information Systems Analysis and Synthesis 2003 Orlando, FL, USA
8. J. Burnim, and K. Sen Heuristics for scalable dynamic test generation ASE 2008 IEEE 443 446
9. Cadar, C., Engler, D.R., 2005. Execution generated test cases: how to make systems code crash itself. Model Checking Software, 12th International SPIN Workshop, San Francisco, CA, USA, August 22-24, 2005. Proceedings, vol. 3639 of Lecture Notes in Computer Science, Springer, 2005, pp. 2-23.
10. A. Chakrabarti, and P. Godefroid Software partitioning for effective automated unit testing EMSOFT 2006 ACM 262 271
11. J. Clark, J.J. Dolado, M. Harman, R.M. Hierons, B. Jones, M. Lumkin, B. Mitchell, S. Mancoridis, K. Rees, M. Roper, and M. Shepperd Reformulating software engineering as a search problem IEE Proceedings - Software 150 3 2003 161 175
12. M.B. Cohen, P.B. Gibbons, W.B. Mugridge, and C.J. Colbourn Constructing test suites for interaction testing Proceedings of the 25th International Conference on Software Engineering (ICSE-03) 2003 IEEE Computer Society Piscataway, NJ 38 48
13. C. Csallner, N. Tillmann, and Y. Smaragdakis Dysy: dynamic symbolic execution for invariant inference ICSE 2008 ACM 281 290
14. R. Ferguson, and B. Korel The chaining approach for software test data generation ACM Transactions on Software Engineering and Methodology 5 1 1996 63 86
15. P. Godefroid, N. Klarlund, and K. Sen DART: directed automated random testing ACM SIGPLAN Notices 40 6 2005 213 223
16. P. Godefroid Compositional dynamic test generation POPL 2007 ACM 47 54
17. P. Godefroid Random testing for security: blackbox vs. whitebox fuzzing RT'07: Proceedings of the 2nd International Workshop on Random Testing 2007 ACM New York, NY, USA 1 11
18. Grep, G., http://www.gnu.org/software/grep/.
19. M. Harman, and J. Clark Metrics are fitness functions too 10th International Software Metrics Symposium (METRICS 2004) 2004 IEEE Computer Society Press Los Alamitos, CA, USA 58 69
20. Harman, M., McMinn, P., 2010. A theoretical and empirical study of search based testing: local, global and hybrid search. IEEE Transactions on Software Engineering 36 (2), 226-247.
21. M. Harman, L. Hu, R. Hierons, J. Wegener, H. Sthamer, A. Baresel, and M. Roper Testability transformation IEEE Transactions on Software Engineering 30 1 2004 3 16
22. M. Harman, L. Hu, R.M. Hierons, J. Wegener, H. Sthamer, A. Baresel, and M. Roper Testability transformation IEEE Transactions on Software Engineering 30 1 2004 3 16
23. M. Harman, Y. Hassoun, K. Lakhotia, P. McMinn, and J. Wegener The impact of input domain reduction on search-based test data generation ESEC/SIGSOFT FSE 2007 ACM 155 164
24. M. Harman The current state and future of search based software engineering Future of Software Engineering 2007 (FOSE 2007) 2007 IEEE Computer Society 342 357 (Pubitemid 47484936)
25. Harrold, M.J., Rothermel, G. http://pleuma.cc.gatech.edu/aristotle/Tools/ subjects/.
26. K. Inkumsah, and T. Xie Evacon: a framework for integrating evolutionary and concolic testing for object-oriented programs Proc. 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007) 2007 425 428
27. J.C. King Symbolic execution and program testing Communications of the ACM 19 7 1976 385 394
28. B. Korel Automated software test data generation IEEE Transactions on Software Engineering 16 8 1990 870 879 (Pubitemid 20738724)
29. K. Lakhotia, M. Harman, and P. McMinn Handling dynamic data structures in search based testing GECCO'08: Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation 2008 ACM Atlanta, GA, USA 1759 1766
30. Li, Z., Harman, M., Hierons, R., 2007. Meta-heuristic search algorithms for regression test case prioritization. IEEE Transactions on Software Engineering 33(4), 225-237.
31. R. Majumdar, and K. Sen Hybrid concolic testing ICSE 2007 IEEE Computer Society 416 426
32. P. McMinn, M. Harman, D. Binkley, and P. Tonella The species per path approach to search-based test data generation Proceedings of the International Symposium on Software Testing and Analysis (ISSTA 2006) 2006 ACM Portland, Maine, USA 13 24
33. P. McMinn Search-based software test data generation: a survey Software Testing, Verification and Reliability 14 2 2004 105 156
34. McMinn, P., 2007. IGUANA: Input Generation Using Automated Novel Algorithms. A Plug and Play Research Tool. Tech. Re CS-07-14, Department of Computer Science, University of Sheffield.
35. C.C. Michael, G. McGraw, and M. Schatz Generating software test data by evolution IEEE Transactions on Software Engineering 27 12 2001 1085 1110
36. W. Miller, and D. Spooner Automatic generation of floating-point test data IEEE Transactions on Software Engineering 2 3 1976 223 226
37. G.C. Necula, S. McPeak, S.P. Rahul, and W. Weimer CIL: intermediate language and tools for analysis and transformation of C programs Lecture Notes in Computer Science 2304 2002 213 228
38. R. Pargas, M. Harrold, and R. Peck Test-data generation using genetic algorithms Software Testing, Verification and Reliability 9 4 1999 263 282
39. K. Sen, and G. Agha CUTE and jCUTE: concolic unit testing and explicit path model-checking tools Proceedings of the International Conference on Computer Aided Verification (CAV 2006) 2006 419 423
40. K. Sen, D. Marinov, and G. Agha CUTE: a concolic unit testing engine for C ESEC/SIGSOFT FSE 2005 ACM 263 272
41. N. Tillmann, and J. de Halleux Pex-white box test generation for.NET TAP, vol. 4966 of Lecture Notes in Computer Science 2008 Springer 134 153
42. P. Tonella Evolutionary testing of classes Proceedings of the International Symposium on Software Testing and Analysis 2004 ACM Press Boston, USA 119 128
43. VIM, http://www.vim.org/.
44. K.R. Walcott, M.L. Soffa, G.M. Kapfhammer, and R.S. Roos Time aware test suite prioritization International Symposium on Software Testing and Analysis (ISSTA 06) 2006 ACM Press Portland, Maine, USA 1 12
45. S. Wappler, A. Baresel, and J. Wegener Improving evolutionary testing in the presence of function-assigned flags Testing: Academic & Industrial Conference, Practice and Research Techniques (TAIC PART07) 2007 IEEE Computer Society Press 23 28
46. J. Wegener, and F. Mueller A comparison of static analysis and evolutionary testing for the verification of timing constraints Real-time Systems 21 3 2001 241 268
47. J. Wegener, A. Baresel, and H. Sthamer Evolutionary test environment for automatic structural testing Information and Software Technology 43 14 2001 841 854
48. N. Williams, B. Marre, P. Mouy, and M. Roger Pathcrawler: automatic generation of path tests by combining static and dynamic analysis EDCC, vol. 3463 of Lecture Notes in Computer Science 2005 Springer 281 292
49. T. Xie, N. Tillmann, P. de Halleux, and W. Schulte Fitness-guided path exploration in dynamic symbolic execution Proc. the 39th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2009) 2009
50. S. Yoo, and M. Harman Pareto efficient multi-objective test case selection ISSTA'07: Proceedings of the 2007 International Symposium on Software Testing and Analysis 2007 ACM New York, NY, USA 140 150