Automatic generation of valid and invalid test data for string validation routines using web searches and regular expressions

Science of Computer Programming

Volumn 97, Issue P4, 2015, Pages 405-425

  Shahbaz, Muzammil ^a   McMinn, Phil ^a   Stevenson, Mark ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Regular expressions; Test data generation; Web searches

Indexed keywords

DIGITAL STORAGE; INFORMATION RETRIEVAL; MODEL CHECKING; PATTERN MATCHING; QUERY PROCESSING; WEBSITES;

AUTOMATIC GENERATION; DYNAMIC SYMBOLIC EXECUTIONS; HANDLING CONSTRAINTS; IMPLEMENTATION ERROR; REGULAR EXPRESSIONS; SEARCH-BASED TESTING; TEST DATA GENERATION; WEB SEARCHES;

AUTOMATIC PROGRAMMING;

EID: 84922683788     PISSN: 01676423     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.scico.2014.04.008     Document Type: Conference Paper

References (41)

1. S. Anand, E. Burke, T.Y. Chen, J. Clark, M.B. Cohen, W. Grieskamp, M. Harman, M.J. Harrold, and P. McMinn An orchestrated survey on automated software test case generation J. Syst. Softw. 86 8 2013 1978 2001
2. P. McMinn, M. Shahbaz, and M. Stevenson Search-based test input generation for string data types using the results of web queries Proceedings of the 5th International Conference on Software Testing, Verification and Validation (ICST) 2012 IEEE Computer Society 141 150
3. M. Shahbaz, P. McMinn, and M. Stevenson Automated discovery of valid test strings from the web using dynamic regular expressions collation and natural language processing Proceedings of the 12th International Conference on Quality Software (QSIC) 2012 79 88
4. C.S. Pəsəreanu, and W. Visser A survey of new trends in symbolic execution for software testing and analysis Int. J. Softw. Tools Technol. Transf. 11 4 2009 339 353
5. M. Harman, and P. McMinn A theoretical and empirical study of search-based testing: local, global and hybrid search IEEE Trans. Softw. Eng. 36 2010 226 247
6. A.P. Mathur Foundations of Software Testing 1st edition 2008 Addison-Wesley Professional
7. S. Afshan, P. McMinn, and M. Stevenson Evolving readable string test inputs using a natural language model to reduce human oracle cost Proceedings of the International Conference on Software Testing, Verification and Validation (ICST) 2013 352 361
8. R.L. Glass Frequently forgotten fundamental facts about software engineering IEEE Softw. 18 3 2001 112
9. C.S. Pəsəreanu, P.C. Mehlitz, D.H. Bushnell, K. Gundy-Burlet, M. Lowry, S. Person, and M. Pape Combining unit-level symbolic execution and system-level concrete execution for testing NASA software Proceedings of the International Symposium on Software Testing and Analysis (ISSTA) 2008 ACM 15 26
10. P. Tonella Evolutionary testing of classes SIGSOFT Softw. Eng. Notes 29 4 2004 119 128
11. S. Butler, M. Wermelinger, Y. Yu, and H. Sharp Improving the tokenisation of identifier names ECOOP 2011 - Object-Oriented Programming Lecture Notes in Computer Science vol. 6813 2011 Springer 130 154
12. D. Jurafsky, and J. Martin Speech and Language Processing 2nd edition 2008 Prentice Hall
13. K. Toutanova, D. Klein, C.D. Manning, and Y. Singer Feature-rich part-of-speech tagging with a cyclic dependency network Proceedings of the North American Chapter of the Association for Computational Linguistics on Human Language Technology 2003 Association for Computational Linguistics 173 180
14. L. Shen, G. Satta, and A. Joshi Guided learning for bidirectional sequence classification Annual Meeting-Association for Computational Linguistics, vol. 45 2007 760
15. K. Atkinson Spell checking oriented word lists (SCOWL) http://wordlist.sourceforge.net/
16. Jazzy http://sourceforge.net/projects/jazzy
17. ModeShape library http://www.jboss.org/modeshape
18. Bing search engine http://www.bing.com
19. Introducing Bing API Version 2.0 http://www.bing.com/developers/s/APIBasics.html
20. JSoup http://www.jsoup.org
21. RegExLib Regular expression library http://regexlib.com/
22. D. Goldberg Genetic Algorithms in Search, Optimization, and Machine Learning, Artificial Intelligence 1989 Addison-Wesley
23. Xeger A Java library for generating random text from regular expressions http://code.google.com/p/xeger/
24. Chemical Abstracts Service Check digit verification of CAS registry numbers http://www.cas.org/content/chemical-substances/checkdig
25. Apache Commons validator http://commons.apache.org/validator/
26. Internet Assigned numbers authority, MIME media types http://www.iana.org/assignments/media-types/index.html
27. D. LaLiberte, and M. Shapiro The path URN specification http://tools.ietf.org/html/draft-ietf-uri-urn-path-00 1995
28. Cabinet Office's UK Data Standards Catalogue, Government Data Standards Catalogue, 2001.
29. N. Jussien, G. Rochart, and X. Lorca The CHOCO constraint programming solver Workshop on Open-Source Software for Integer and Constraint Programming (OSSICP) 2008 1 10
30. B. Beizer Software Testing Techniques 1990 International Thomson Computer Press
31. J. Hayes, and J. Offutt Input validation analysis and testing Empir. Softw. Eng. 11 4 2006 493 522
32. N. Li, T. Xie, N. Tillmann, J. de Halleux, and W. Schulte Reggae: automated test generation for programs using complex regular expressions Proceedings of the 24th IEEE/ACM International Conference on Automated Software Engineering (ASE) 2009 IEEE 515 519
33. R. Majumdar, and R.-G. Xu Directed test generation using symbolic grammars Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE) 2007 ACM 134 143
34. P. Godefroid, M.Y. Levin, and D. Molnar Sage: whitebox fuzzing for security testing Queue 10 1 2012 20:20 20:27
35. S. Elbaum, S. Karre, and G. Rothermel Improving web application testing with user session data Proceedings of the 25th International Conference on Software Engineering 2003 IEEE Computer Society 49 59
36. M. Bozkurt, and M. Harman Automatically generating realistic test input from web services Proceedings of the 6th International Symposium on Service Oriented System Engineering (SOSE) 2011 IEEE 13 24
37. R. DeMilli, and A.J. Offutt Constraint-based automatic test data generation IEEE Trans. Softw. Eng. 17 9 1991 900 910
38. A. Kiezun, V. Ganesh, P.J. Guo, P. Hooimeijer, and M.D. Ernst Hampi: a solver for string constraints Proceedings of the 18th International Symposium on Software Testing and Analysis (ISSTA) 2009 ACM 105 116
39. P. Hooimeijer, and W. Weimer Strsolve: solving string constraints lazily Autom. Softw. Eng. 19 4 2012 531 559
40. I. Ghosh, N. Shafiei, G. Li, and W.-F. Chiang Jst: an automatic test generation tool for industrial Java applications with strings Proceedings of the 35th International Conference on Software Engineering (ICSE) 2013 IEEE Press 992 1001
41. N. Tracey, J. Clark, K. Mander, and J. McDermid Automated test data generation for exception conditions Softw. Pract. Exp. 30 1 2000 61 79