Puzzle-based automatic testing: Bringing humans into the loop by solving puzzles

2012 27th IEEE/ACM International Conference on Automated Software Engineering, ASE 2012 - Proceedings

Volumn , Issue , 2012, Pages 140-149

  Chen, Ning ^a   Kim, Sunghun ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Code coverage; Human computation; Testing

Indexed keywords

AUTOMATIC TEST GENERATION; AVERAGE SPEED; BRANCH COVERAGE; CODE COVERAGE; COMPLEX CONSTRAINT SOLVING; CONSTRAINT SOLVING; HUMAN COMPUTATION; OPEN SOURCE PROJECTS; PATH CONDITION; TEST COVERAGE; TEST GENERATIONS; TEST INPUTS; TESTING ENVIRONMENT; AUTOMATIC TESTING ENVIRONMENTS; STATE-OF-THE-ART TECHNIQUES;

AUTOMATIC TESTING; TESTING; LOGIC PROGRAMMING;

SOFTWARE ENGINEERING;

EID: 84866938660     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2351676.2351697     Document Type: Conference Paper

References (34)

1. D. Babic and A. J. Hu. Calysto: scalable and precise extended static checking. In Proc. ICSE, New York, NY, USA, 2008. ACM.
2. C. Boyapati, S. Khurshid, and D. Marinov. Korat: automated testing based on Java predicates. In Proc. ISSTA, 2002.
3. S. Chandra, S. J. Fink, and M. Sridharan. Snugglebug: a powerful approach to weakest preconditions. In Proc. PLDI, 2009.
4. L. A. Clarke. A system to generate test data and symbolically execute programs. IEEE Trans. Softw. Eng., 2(3):215-222, 1976.
5. O. Consortium. Asm. http://asm.objectweb.org.
6. S. Cooper, A. Treuille, J. Barbero, A. Leaver-Fay, K. Tuite, F. Khatib, A. C. Snyder, M. Beenen, D. Salesin, D. Baker, and Z. Popovíc. The challenge of designing scientific discovery games. In Proc. FDG, 2010.
7. R. Cytron, J. Ferrante, B. K. Rosen, M. N. Wegman, and F. K. Zadeck. Efficiently computing static single assignment form and the control dependence graph. ACM Trans. Program. Lang. Syst., 13(4):451-490, 1991.
8. B. Daniel and M. Boshernitsan. Predicting effectiveness of automatic testing tools. In Proc. ASE, ASE '08, pages 363-366, Washington, DC, USA, 2008.
9. L. M. de Moura and N. Bjørner. Z3: An efficient SMT solver. In Proc. 14th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, pages 337-340, 2008.
10. R. A. DeMillo and A. J. Offutt. Constraint-based automatic test data generation. IEEE Trans. Softw. Eng., 17(9):900-910, 1991.
11. W. Dietl, S. Dietzel, M. D. Ernst, N. Mote, B. Walker, S. Cooper, T. Pavlik, and Z. Popovíc. Verification games: Making verification fun. In FTfJP'2012: 14th Workshop on Formal Techniques for Java-like Programs, Beijing, China, June 2012.
12. E. Dijkstra. A Discipline of Programming. Prentice Hall, Englewood Cliffs, 1976.
13. B. Dutertre and L. de Moura. System description: Yices 1.0. In Proc. SMT-COMP, 2006.
14. I. Erete and A. Orso. Optimizing constraint solving to better support symbolic execution. In Proc. CSTVA, pages 310 -315, March 2011.
15. P. Godefroid, N. Klarlund, and K. Sen. DART: Directed automated random testing. In Proc. PLDI, pages 213-223, 2005.
16. A. Gotlieb, B. Botella, and M. Rueher. Automatic test data generation using constraint solving techniques. In Proc. ISSTA, ISSTA '98, pages 53-62, 1998.
17. F. Heidenreich, J. Johannes, M. Seifert, and C. Wende. Closing the gap between modelling and java. In SLE, volume 5969 of Lecture Notes in Computer Science, pages 374-383. Springer, 2009.
18. IBM. T.J. Watson Libraries for Analysis (WALA). Online manual. http://wala.sf.net.
19. H. Jaygarl, S. Kim, T. Xie, and C. K. Chang. OCAT: Object Capture-based Automated Testing. In Proc. ISSTA, July 2010.
20. C. C. Michael, G. McGraw, and M. A. Schatz. Generating software test data by evolution. IEEE Trans. Softw. Eng., 27:1085-1110, December 2001.
21. M. G. Nanda and S. Sinha. Accurate interprocedural null-dereference analysis for Java. In Proc. ICSE, pages 133-143, Washington, DC, USA, 2009. IEEE Computer Society.
22. C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball. Feedback-directed random test generation. In Proc. ICSE, pages 75-84, Minneapolis, MN, USA, May 23-25, 2007.
23. R. Pandita, T. Xie, N. Tillmann, and J. de Halleux. Guided test generation for coverage criteria. In Proc. ICSM, Sept. 2010.
24. C.-S. Park and K. Sen. Randomized active atomicity violation detection in concurrent programs. In Proc. FSE, SIGSOFT '08/FSE-16, pages 135-145, New York, NY, USA, 2008. ACM.
25. C. S. P̌ašareanu, N. Rungta, and W. Visser. Symbolic execution with mixed concrete-symbolic solving. In Proc. ISSTA, ISSTA '11, pages 34-44, New York, NY, USA, 2011. ACM.
26. K. Sen and G. Agha. CUTE and jCUTE: Concolic unit testing and explicit path model-checking tools. In Proc. CAV, 2006.
27. K. Sen, D. Marinov, and G. Agha. CUTE: A concolic unit testing engine for C. In Proc. ESEC/FSE, pages 263-272, 2005.
28. S. Thummalapenta, T. Xie, N. Tillmann, P. de Halleux, and W. Schulte. MSeqGen: Object-oriented unit-test generation via mining source code. In Proc. ESEC/FSE, August 2009.
29. N. Tillmann and J. de Halleux. Pex-white box test generation for .NET. In Proc. TAP, pages 134-153, 2008.
30. N. Tillmann, J. de Halleux, and T. Xie. Pex4fun: Teaching and learning computer science via social gaming. In Proc. CSEET, CSEET '11, 2011.
31. L. von Ahn and L. Dabbish. Labeling images with a computer game. In Proc. CHI, April 2004.
32. E. Y. C. Wong, A. T. S. Chan, and H.-V. Leong. Efficient management of XML contents over wireless environment by Xstream. In Proc. SAC, pages 1122-1127, 2004.
33. X. Xiao, T. Xie, N. Tillmann, and J. de Halleux. Precise identification of problems for structural test generation. In Proc. ICSE, May 2011.
34. L. Zhang, T. Xie, L. Zhang, N. Tillmann, J. de Halleux, and H. Mei. Test generation via dynamic symbolic execution for mutation testing. In Proc. ICSM, Sept. 2010.