Operational definition and automated inference of test-driven development with Zorro

Automated Software Engineering

Volumn 17, Issue 1, 2010, Pages 57-85

  Kou, Hongbing ^a   Johnson, Philip M ^a   Erdogmus, Hakan ^b  

^a University of Hawai'i at Manoa   (United States)

^b Kalemun Research   (Canada)

Author keywords

Hackystat; Process measurement; Test driven development

Indexed keywords

AUTOMATED RECOGNITION; DESIGN ISSUES; DESIGN QUALITY; EMPIRICAL EVALUATIONS; EMPIRICAL STUDIES; OPERATIONAL DEFINITION; PROCESS MEASUREMENTS; REAL WORLD SETTING; SOFTWARE DEVELOPMENT; TEST CASE; TEST DRIVEN DEVELOPMENT;

AUTOMATION; COMPUTER SOFTWARE; PRODUCTIVITY; RESEARCH; SOFTWARE DESIGN; TESTING;

TIME DIVISION MULTIPLEXING;

EID: 73349111587     PISSN: 09288910     EISSN: 15737535     Source Type: Journal    
DOI: 10.1007/s10515-009-0058-8     Document Type: Conference Paper

References (44)

1. Beck, K.: Extreme Programming Explained: Embrace Change. Addison Wesley, Massachusetts (2000)
2. K. Beck 2001 Aim, fire IEEE Softw. 18 5 87 89 10.1109/52.951502 10.1109/52.951502
3. Beck, K.: Test-Driven Development by Example. Addison Wesley, Massachusetts (2003)
4. (Pubitemid 46634470)
5. T. Bhat N. Nagappan 2006 Evaluating the efficacy of test-driven development: industrial case studies ISESE '06: Proceedings of the 2006 ACM/IEEE International Symposium on International Symposium on Empirical Software Engineering ACM Press New York 356 363 10.1145/1159733.1159787 10.1145/1159733.1159787 Bhat, T., Nagappan, N.: Evaluating the efficacy of test-driven development: industrial case studies. In: ISESE '06: Proceedings of the 2006 ACM/IEEE International Symposium on International Symposium on Empirical Software Engineering, pp. 356-363. ACM Press, New York (2006). doi: 10.1145/1159733.1159787 (Pubitemid 46634470)
6. M.I.K. Bill Curtis J. Over 1992 Process modeling Commun. ACM 35 9 75 90 10.1145/130994.130998 (Pubitemid 23584400)
7. Cook, J.E.: Process discovery and validation through event-data analysis. Ph.D. Thesis, University of Colorado (1996)
8. Cook J.E., Wolf A.L. Automating process discovery through event-data analysis ICSE '95: Proceedings of the 17th International Conference on Software Engineering ACM New York. 10.1145/225014.225021
9. J.E. Cook A.L. Wolf 1995 Automating process discovery through event-data analysis ICSE '95: Proceedings of the 17th International Conference on Software Engineering ACM New York 73 82 10.1145/225014.225021 10.1145/225014.225021 Cook, J.E., Wolf, A.L.: Automating process discovery through event-data analysis. In: ICSE '95: Proceedings of the 17th International Conference on Software Engineering, pp. 73-82. ACM, New York (1995). doi: 10.1145/225014.225021
10. L. Damm L. Lundberg 2006 Results from introducing component-level test automation and test-driven development J. Syst. Softw. 79 7 1001 1014 10.1016/j.jss.2005.10.015 (Pubitemid 43765969)
11. Edwards S.H. 2004 Using software testing to move students from trial-and-error to reflection-in-action Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education 26-30 ACM New York. 10.1145/971300.971312
12. S.H. Edwards 2004 Using software testing to move students from trial-and-error to reflection-in-action Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education ACM New York 26 30 10.1145/971300. 971312 10.1145/971300.971312 Edwards, S.H.: Using software testing to move students from trial-and-error to reflection-in-action. In: Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education, pp. 26-30. ACM, New York (2004). doi: 10.1145/971300.971312
13. H. Erdogmus M. Morisio M. Torchiano 2005 On the effectiveness of the test-first approach to programming IEEE Trans. Softw. Eng. 31 3 226 237 10.1109/TSE.2005.37 10.1109/TSE.2005.37 (Pubitemid 40890004)
14. Friedman-Hill, E.: JESS in Action. Mannig, Greenwich (2003)
15. B. George L. Williams 2003 An initial investigation of test-driven development in industry ACM Symp. Appl. Comput. 3 1 23
16. B. George L. Williams 2004 A structured experiment of test-driven development Inf. Softw. Technol. 46 5 337 342 10.1016/j.infsof.2003.09.011
17. Geras, A., Smith, M., Miller, J.: A prototype empirical evaluation of test driven development. In: Software Metrics, 10th International Symposium on (METRICS'04), pp. 405. IEEE Computer Society, Chicago (2004)
18. Gupta, A., Jalote, P.: An experimental evaluation of the effectiveness of test-driven development. In: ESEM 2007, 1st International Symposium on Empirical Software Engineering and Measurement, pp. 285-294. IEEE Computer Society, Chicago (2007)
19. D. Janzen H. Saiedian 2005 Test-driven development:concepts, taxonomy, and future direction Computer 38 9 43 50 10.1109/MC.2005.314 10.1109/MC.2005.314 (Pubitemid 41387802)
20. Janzen, D., Saiedian, H.: Does test-driven development really improve software design quality. In: IEEE Software, pp. 77-84 (2008)
21. Jeffries, R.: Extreme Programming Installed. Addison-Wesley, Upper Saddle River (2000)
22. Jensen, C., Scacchi, W.: Process modeling across the web information infrastructure. In: Special Issue on ProSim 2004, The Fifth International Workshop on Software Process Simulation and Modeling, Edinburgh, Scotland (2004)
23. Jensen, C., Scacchi, W.: Experience in discovering, modeling, and reenacting open source software development processes. In: Proceedings of the International Software Process Workshop (2005)
24. Johnson, P.M., Paulding, M.G.: Understanding HPCS development through automated process and product measurement with Hackystat. In: Second Workshop on Productivity and Performance in High-End Computing (P-PHEC) (2005). http://csdl.ics.hawaii.edu/techreports/04-22/04-22.pdf
25. Johnson, P.M., Kou, H., Agustin, J.M., Zhang, Q., Kagawa, A., Yamashita, T.: Practical automated process and product metric collection and analysis in a classroom setting: lessons learned from Hackystat-UH. In: Proceedings of the 2004 International Symposium on Empirical Software Engineering, Los Angeles, CA (2004). http://csdl.ics.hawaii.edu/techreports/03-12/03-12.pdf
26. Johnson, P.M., Kou, H., Paulding, M.G., Zhang, Q., Kagawa, A., Yamashita, T.: Improving software development management through software project telemetry. In: IEEE Software (2005). http://csdl.ics.hawaii.edu/techreports/04- 11/04-11.pdf
27. Kaufmann R., Janzen D. Implications of test-driven development: A pilot study OOPSLA '03: Companion of the 18th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications 298-299 ACM New York. 10.1145/949344.949421
28. R. Kaufmann D. Janzen 2003 Implications of test-driven development: a pilot study OOPSLA '03: Companion of the 18th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications ACM New York 298 299 10.1145/949344.949421 10.1145/949344.949421 Kaufmann, R., Janzen, D.: Implications of test-driven development: a pilot study. In: OOPSLA '03: Companion of the 18th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, pp. 298-299. ACM, New York (2003). doi: 10.1145/949344.949421
29. Kellner, M., Feiler, P., Finkelstein, A., Katayama, T., Osterweil, L., Penedo, M., Rombach, H.: Ispw-6 software process example. In: Proceedings of the First International Conference on the Software Process, Pittsburgh, PA (1991)
30. Kou, H.: Eclipse screen recorder (2006). http://csdl.ics.hawaii.edu/ Tools/Esr/
31. Kou, H.: Automated inference of software development behaviors: Design, implementation and validation of Zorro for test-driven development. Ph.D. Thesis, University of Hawaii, Department of Information and Computer Sciences (2007). http://csdl.ics.hawaii.edu/techreports/07-04/07-04.pdf
32. Kou, H., Johnson, P.M.: Automated recognition of low-level process: a pilot validation study of Zorro for test-driven development. In: Proceedings of the 2006 International Workshop on Software Process, Shanghai, China (2006). http://csdl.ics.hawaii.edu/techreports/06-02/06-02.pdf
33. Madeyski, L., Szala, L.: The impact of test-driven development on software development productivity-an empirical study. In: Abrahamsson, P., Badoo, N., Margaria, T., Messanarz, R. (eds.) Software Process Improvement, 9th International Conference on Agile Processes in Software Engineering and Extreme Programming. Lecture Notes in Computer Science, vol. 4764, pp. 200-211. Springer, Heidelberg (2007)
34. Maximilien, E.M., Williams, L.: Accessing test-driven development at IBM. In: Proceedings of the 25th International Conference in Software Engineering, p. 564. IEEE Computer Society, Washington (2003)
35. Mishali, O., Dubinsky, Y., Katz, S.: The tdd-guide training and guidance tool for test-driven development. In: Abrahamsson, P., Baskerville, R., Conboy, K., Fitzgerald, B., Morgan, L., Wang, X. (eds.) XP 2008: 9th International Conference on Agile Processes in Software Engineering and Extreme Programming. Lecture Notes in Business Information Processing, vol. 9, pp. 63-72. Springer, Heidelberg (2008)
36. Muller, M.M., Hagner, O.: Experiment about test-first programming. In: Empirical Assessment in Software Engineering (EASE). IEEE Computer Society, Los Alamitos (2002)
37. Pančur, M., Ciglarič, M., Trampuš, M., Vidmar, T.: Towards empirical evaluation of test-driven development in a university environment. In: Proceedings of EUROCON 2003. IEEE, New York (2003)
38. Sanchez, J., Williams, L., Maximillien, E.: On the sustained use of test-driven development practice at ibm. In: Agile 2007 Conference, pp. 5-14 (2007)
39. Siniaalto, M., Abrahamsson, P.A.: Comparative case study on the impact of test-driven development on program design and test coverage. In: ESEM 2007, 1st International Symposium on Empirical Software Engineering and Measurement, pp. 275-284. IEEE Computer Society, Los Alamitos (2007)
40. S.M. Sutton D. Heimbigner L.J. Osterwell 1995 APPL/A: a language for software process programming ACM Trans. Softw. Eng. Methodol. 4 3 221 286 10.1145/214013.214017
41. Turnu, I., Melis, M., Cau, A.: Introducing tdd on a free libre open source software project: a simulation experiment. In: QUTE-SWAP Workshop. ACM, New York (2004)
42. Wang, Y., Erdogmus, H.: The role of process measurement in test-driven development. In: XP/Agile Universe, pp. 32-42 (2004)
43. Wege, C.: Automated support for process assessment in test-driven development. Ph.D. Thesis, Eberhard-Karls-Universit at Tubingen (2004)
44. Williams, L., Maximilien, E.M., Vouk, M.: Test-driven development as a defect-reduction practice. In: Proceedings of the 14th International Symposium on Software Reliability Engineering (ISSRE'03), pp. 298-299. ACM, New York (2003)