Future of developer testing: Building quality in code

Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research, FoSER 2010

Volumn , Issue , 2010, Pages 415-419

  Xie, Tao ^a   Tillmann, Nikolai ^b   De Halleux, Jonathan ^b   Schulte, Wolfram ^b  

^a North Carolina State University   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Developer testing; Human factors; Software testing; Specifications

Indexed keywords

BUILDING QUALITY; DEVELOPER TESTING; DYNAMIC SYMBOLIC EXECUTIONS; FUTURE DIRECTIONS; HUMAN FACTORS; INTEGRATION TESTING; PARAMETERIZED UNIT TESTING; POSITION PAPERS; SOFTWARE VERIFICATION;

COMPUTER SOFTWARE SELECTION AND EVALUATION; ENGINEERING RESEARCH; HUMAN ENGINEERING; QUALITY ASSURANCE; SOFTWARE TESTING; SPECIFICATIONS; VERIFICATION;

SOFTWARE RELIABILITY;

EID: 79951645594     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1882362.1882447     Document Type: Conference Paper

References (49)

1. Agitar AgitarOne. http://www.agitar.com/.
2. CodePro AnalytiX. http://old.instantiations.com/codepro/analytix/default. htm.
3. Developer testing. http://www.developertesting.com/.
4. Microsoft Research. CHESS. http://research.microsoft.com/projects/chess/.
5. Microsoft Research. Code Contracts. http://research.microsoft.com/ projects/contracts.
6. Microsoft Research. Pex. http://research.microsoft.com/projects/pex/.
7. Microsoft Research. Pex for Fun. http://www.pexforfun.com/.
8. Parasoft Jtest. http://www.parasoft.com/jsp/products/home.jsp?product= Jtest.
9. P. Ammann and J. Offutt. Introduction to Software Testing. Cambridge University Press, 2008.
10. K. Beck. Test Driven Development: By Example. Addison-Wesley, 2003.
11. N. E. Beckman, A. V. Nori, S. K. Rajamani, and R. J. Simmons. Proofs from tests. In Proc. International Symposium on Software Testing and Analysis (ISSTA 2008), pages 3-14, 2008.
12. S. Berner, R. Weber, and R. K. Keller. Enhancing software testing by judicious use of code coverage information. In Proc. International Conference on Software Engineering (ICSE 2007), pages 612-620, 2007. (Pubitemid 47430695)
13. M. Boshernitsan, R. Doong, and A. Savoia. From Daikon to Agitator: lessons and challenges in building a commercial tool for developer testing. In Proc. International Symposium on Software Testing and Analysis (ISSTA 2006), pages 169-180, 2006.
14. L. A. Clarke. A system to generate test data and symbolically execute programs. IEEE Transactions on Software Engineering, 2(3):215-222, 1976.
15. C. Csallner, N. Tillmann, and Y. Smaragdakis. DySy: dynamic symbolic execution for invariant inference. In Proc. International Conference on Software Engineering (ICSE 2008), pages 281-290, 2008.
16. J. de Halleux and N. Tillmann. Moles: tool-assisted environment isolation with closures. In Proc. International Conference on Objects, Models, Components, Patterns (TOOLS 2010), pages 253-270, 2010.
17. M. D. Ernst, J. Cockrell, W. G. Griswold, and D. Notkin. Dynamically discovering likely program invariants to support program evolution. IEEE Transaction on Software Engineering, 27(2):99-123, 2001. (Pubitemid 32254259)
18. R. S. Freedman. Testability of software components. IEEE Transaction on Software Engineering, 17(6):553-564, 1991.
19. P. Godefroid, N. Klarlund, and K. Sen. DART: Directed automated random testing. In Proc. ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2005), pages 213-223, 2005.
20. B. S. Gulavani, T. A. Henzinger, Y. Kannan, A. V. Nori, and S. K. Rajamani. SYNERGY: a new algorithm for property checking. In Proc. ACM SIGSOFT Symposium on the Foundations of Software Engineering (FSE 2006), pages 117-127, 2006. (Pubitemid 47129390)
21. J. V. Guttag and J. J. Horning. The algebraic specification of abstract data types. Acta Informatica, 10:27-52, 1978.
22. M. Harman, H. Muccini, W. Schulte, and T. Xie. 10111 executive summary - practical software testing: Tool automation and human factors. In M. Harman, H. Muccini, W. Schulte, and T. Xie, editors, Practical Software Testing : Tool Automation and Human Factors, number 10111 in Dagstuhl Seminar Proceedings, Dagstuhl, Germany, 2010. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik Germany.
23. C. A. R. Hoare. An axiomatic basis for computer programming. Communications of the ACM, 12(10):576-580, 1969.
24. J. Jacky, M. Veanes, C. Campbell, and W. Schulte. Model-Based Software Testing and Analysis with C#. Cambridge University Press, 2007.
25. J. A. Jones, M. J. Harrold, and J. Stasko. Visualization of test information to assist fault localization. In Proc. International Conference on Software Engineering (ICSE 2002), pages 467-477, 2002. (Pubitemid 35009133)
26. A. Kiezun, V. Ganesh, P. J. Guo, P. Hooimeijer, and M. D. Ernst. HAMPI: a solver for string constraints. In Proc. International Symposium on Software Testing and Analysis (ISSTA 2009), pages 105-116, 2009.
27. J. C. King. Symbolic execution and program testing. Communications of the ACM, 19(7):385-394, 1976.
28. S. Kong, N. Tillmann, and J. de Halleux. Automated testing of environment-dependent programs - a case study of modeling the file system for Pex. In Proc. International Conference on Information Technology: New Generations (ITNG 2009), pages 758-762, 2009.
29. J. Lawrance, S. Clarke, M. Burnett, and G. Rothermel. How well do professional developers test with code coverage visualizations? an empirical study. In Proc. IEEE Symposium on Visual Languages and Human-Centric Computing (VLHCC 2005), pages 53-60, 2005. (Pubitemid 44131250)
30. T. Mackinnon, S. Freeman, and P. Craig. Endo-testing: Unit testing with mock objects. In Extreme Programming Examined. Addison-Wesley, 2001.
31. M. R. Marri, T. Xie, N. Tillmann, J. de Halleux, and W. Schulte. An empirical study of testing file-system-dependent software with mock objects. In Proc. International Workshop on Automation of Software Test (AST 2009), Business and Industry Case Studies, pages 149-153, 2009.
32. E. Martin, J. Hwang, T. Xie, and V. Hu. Assessing quality of policy properties in verification of access control policies. In Proc. Annual Computer Security Applications Conference (ACSAC 2008), pages 163-172, 2008.
33. B. Meyer. Object-Oriented Software Construction. Prentice Hall, 1988.
34. M. Musuvathi, S. Qadeer, T. Ball, G. Basler, P. A. Nainar, and I. Neamtiu. Finding and reproducing heisenbugs in concurrent programs. In Proc. USENIX Symposium on Operating Systems Design and Implementation (OSDI 2008), pages 267-280, 2008.
35. P. Saxena, P. Poosankam, S. McCamant, and D. Song. Loop-extended symbolic execution on binary programs. In Proc. International Symposium on Software Testing and Analysis (ISSTA 2009), pages 225-236, 2009.
36. K. Sen, D. Marinov, and G. Agha. CUTE: A concolic unit testing engine for C. In Proc. the 5th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2005), pages 263-272, 2005. (Pubitemid 43218836)
37. Y. Song, S. Thummalapenta, and T. Xie. UnitPlus: Assisting developer testing in Eclipse. In Proc. the Eclipse Technology eXchange Workshop at OOPSLA 2007 (ETX 2007), pages 26-30, 2007.
38. K. Taneja, Y. Zhang, and T. Xie. MODA: Automated test generation for database applications via mock objects. In Proc. IEEE/ACM International Conference on Automated Software Engineering (ASE 2010), short paper, 2010.
39. S. Thummalapenta, T. Xie, N. Tillmann, P. de Halleux, and W. Schulte. MSeqGen: Object-oriented unit-test generation via mining source code. In Proc. the 7th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2009), pages 193-202, 2009.
40. N. Tillmann and J. de Halleux. Pex-white box test generation for .NET. In Proc. International Conference on Tests & Proofs (TAP 2008), pages 134-153, 2008. (Pubitemid 351642008)
41. N. Tillmann, P. de Halleux, and T. Xie. Parameterized unit testing: Theory and practice. In Proc. International Conference on Software Engineering (ICSE 2010), Companion Volume, Tutorial, pages 483-484, 2010.
42. N. Tillmann and W. Schulte. Parameterized unit tests. In Proc. the 5th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2005), pages 253-262, 2005. (Pubitemid 43218835)
43. M. Veanes, P. de Halleux, and N. Tillmann. Rex: Symbolic regular expression explorer. In Proc. IEEE International Conference on Software Testing, Verification and Validation (ICST 2010), pages 498-507, 2010.
44. G. Venolia, R. DeLine, and T. LaToza. Software development at microsoft observed. Technical Report MSR-TR-2005-140, Microsoft Research, Redmond, WA, October 2005.
45. X. Xiao, T. Xie, N. Tillmann, and P. de Halleux. Issue analysis for residual structural coverage in dynamic symbolic execution. Technical Report TR-2010-7, North Carolina State University Department of Computer Science, Raleigh, NC, March 2010.
46. T. Xie. Improving automation in developer testing: State of the practice. Technical Report TR-2009-6, North Carolina State University Department of Computer Science, Raleigh, NC, February 2009.
47. T. Xie, J. de Halleux, N. Tillmann, and W. Schulte. Teaching and training developer-testing techniques and tool support. In Proc. Annual ACM Conference on Systems, Programming, Languages, and Applications: Software for Humanity (SPLASH 2010), Educators' and Trainers' Symposium, 2010.
48. T. Xie, N. Tillmann, P. de Halleux, and W. Schulte. Fitness-guided path exploration in dynamic symbolic execution. In Proc. Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2009), pages 359-368, June-July 2009.
49. H. Zhu, P. A. V. Hall, and J. H. R. May. Software unit test coverage and adequacy. ACM Computing Surveys, 29(4):366-427, 1997. (Pubitemid 127583222)