From daikon to agitator: Lessons and challenges in building a commercial tool for developer testing

Proceedings of the 2006 International Symposium on Software Testing and Analysis, ISSTA 2006

Volumn 2006, Issue , 2006, Pages 169-179

  Boshernitsan, Marat ^a   Doong, Roongko ^a   Savoia, Alberto ^a  

^a Agitar Software Inc   (United States)

Author keywords

Automated testing tools; Developer testing; Dynamic invariant detection; Software agitation; Technology transfer; Test input generation; Unit testing

Indexed keywords

AUTOMATION; COSTS; SOFTWARE ENGINEERING; TECHNOLOGY TRANSFER;

AUTOMATED TESTING TOOLS; DEVELOPER TESTING; DYNAMIC INVARIANT DETECTION; SOFTWARE AGITATION; TEST-INPUT GENERATION; UNIT TESTING;

SOFTWARE TESTING;

EID: 34247326075     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1146238.1146258     Document Type: Conference Paper

References (38)

1. R. S. Arnold. Sotware restructuring. In Proceedings of the IEEE, volume 77, pages 607-617, 1989.
2. K. Beck and E. Gamma. Test infected: Programmers love writing tests. In Java Report, volume 3, pages 37-50, 1998.
3. R. E. Brooks. Commercial reality. Psychology of Programming Interest Group Mailing List, March 2005. http://www.mail-archive.com/discuss@ppig.org/ msg00958.html.
4. J. deRaeve and S. P. McCarron. Automated test generation technology. Technical report, X/Open Company Ltd., 1997. http://adl.opengroup.org/documents/ Archive/adl10rep.pdf.
5. Eclipse.org. Eclipse platform: technical overview, 2003. http://eclipse.org/white-papers/eclipse-overview.pdf.
6. M. D. Ernst. Dynamically discovering likely program invariants. PhD thesis, University of Washington, 2000.
7. M. D. Ernst, J. Cockrell, W. G. Griswold, and D. Notkin. Dynamically discovering likely program invariants to support program evolution. In ICSE '99: 21st International Conference on Software Engineering, pages 213-224, 1999.
8. M. Fowler. Refactoring: improving the design of existing code. Object Technology Series. Addison-Wesley, 1999.
9. P. Godefroid, N. Klarlund, and K. Sen. DART: directed automated random testing. In PLDI '05: 2005 ACM SIGPLAN Conference on Programming Language Design and Implementation, pages 213-223, 2005.
10. W. G. Griswold and D. Notkin. Automated assistance for program restructuring. ACM Transactions on Software Engineering and Methodology, 2(3):228-269, July 1993.
11. M. Harder, J. Mellen, and M. D. Ernst. Improving test suites via operational abstraction. In ICSE '08: 27th International Conference on Software Engineering, pages 60-73, 2003.
12. J. Henkel and A. Diwan. Discovering algebraic specifications from Java classes. In ECOOP '03: European Conference on Object-Oriented Programming, pages 431-456, 2003.
13. Hybernate.org. Relational persistence for Java and .NET. http://www.hibernate.org/.
14. D. Ingalls. Fabrik: A visual programming environment. In OOPSLA '88: International Conference on Object-Oriented Programming, Systems, Languages, and Applications, volume 23, pages 176-190, Nov. 1988.
15. JUnit. http://www.junit.org.
16. G. J. Myers. The Art of Software Testing. Wiley - Interscience, New York, 1979.
17. NUnit. http://www.nunit.org.
18. W. F. Opdyke. Refactoring object-oriented frameworks. PhD thesis, University of Illinois at Urbana-Champaign, 1992.
19. C. Pacheco and M. D. Ernst. Eclat: Automatic generation and classification of test inputs. In ECOOP '05: European Conference on Object-Oriented Programming, pages 504-527, 2005.
20. S. G. Parker, D. M. Weinstein, and C. R. Johnson. The SCIRun computational steering software system. In E. Arge, A. M. Bruaset, and H. P. Langtangen, editors, Modern Software. Tools in Scientific Computing. Birkhauser Press, 1997.
21. J. H. Perkins and M. D. Ernst. Efficient incremental algorithms for dynamic detection of likely invariants. In SIGSOFT '04/FSE-12: Proceedings of the 12th A CM SIGSOFT International Symposium on Foundations of Software Engineering, pages 23-32, New York, NY, USA, 2004. ACM Press.
22. N. H. Petschenik. Building awareness of system testing issues. In ICSE '85: 8th International Conference on Software Engineering, pages 182-188, Los Alamitos, CA, USA, 1985. IEEE Computer Society Press.
23. Robby, M. B. Dwyer, and J. Hatcliff. Bogor: an extensible and highly-modular software model checking framework. In ESEC/FSE-11: Proceedings of the 9th European Software Engineering Conference/11th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 267-276, New York, NY, USA, 2003. ACM Press.
24. T. Robschink and G. Snelting. Efficient path conditions in dependence graphs. In ICSE '02: Proceedings of the 24th International Conference on Software Engineering, pages 478-488, New York, NY, USA, 2002. ACM Press.
25. D. Saff and M. D. Ernst. An experimental evaluation of continuous testing during development. In ISSTA '04: Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, pages 76-85, New York, NY, USA, 2004. ACM Press.
26. S. Sankar and R. Hayes. Specifying and testing software components using ADL. Technical Report SMLI TR-94-23, Sun Microsystems Laboratories, April 1994. http://research.sun.com/techrep/1994/smli_tr-94-23.pdf.
27. K. Sen, D. Marinov, and G. Agha. CUTE: a concolic unit testing engine for C. In ESEC/FSE-13: 10th European Software Engineering Conference/13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 263-272, 2005.
28. SpringFramework.org. Spring application framework, http://www. springframework.org/.
29. Sun Microsystems. Java platform, Enterprise Edition. http://java.sun.com/ javaee/.
30. The Apache Software Foundation. Apache Struts Project, http://struts. apache.org/.
31. The Jakarta, Project. Commons collections. http://jakarta.apache.org/ commons/collections/.
32. D. Thomas and A. Hunte. Mock objects. IEEE Software, 19(3):22-24, 2002.
33. N. Tillmann and W. Schulte. Parameterized unit tests. In ESEC/FSE-13: 10th European Software Engineering Conference/13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 253-262, 2005.
34. R. Vanmegen and D. B. Meyerhoff. Costs and benefits of early defect detection - experiences from developing client-server and host applications. Software Quality Journal, 4(4):247-256, 1995.
35. W. Visser, G. S. Pasareanu, and S. Khurshid. Test input generation with Java PathFinder. In ISSTA '04: Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, pages 97-107, New York, NY, USA, 2004. ACM Press.
36. T. Xie, D. Marinov, W. Schulte, and D. Notkin. Symstra: A framework for generating object-oriented unit tests using symbolic execution. In TACAS '05: 11th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, volume 3440 of LNCS, pages 365-381. Springer-Verlag, Apr. 2005.
37. T. Xie and D. Notkin. Tool-assisted unit test selection based on operational violations. In ASE '03: International Conference on Automated Software Engineering, pages 40-48, 2003.
38. T. Xie and D. Notkin. Automatically identifying special and common unit tests for object-oriented programs. In ISSRE '05: International Symposium on Software Reliability Engineering, pages 277-287, 2005.