Empirical studies of agile software development: A systematic review

Information and Software Technology

Volumn 50, Issue 9-10, 2008, Pages 833-859

  Dybå, Tore ^a   Dingsøyr, Torgeir ^a  

^a SINTEF ICT   (Norway)

Author keywords

Agile software development; Empirical software engineering; Evidence based software engineering; Extreme programming; Research synthesis; Scrum; Systematic review; XP

Indexed keywords

COMPUTATIONAL METHODS; HUMAN COMPUTER INTERACTION; SOFTWARE RELIABILITY; SPECIFICATION LANGUAGES;

AGILE SOFTWARE DEVELOPMENT; EMPIRICAL SOFTWARE ENGINEERING; EVIDENCE-BASED SOFTWARE ENGINEERING; EXTREME PROGRAMMING; RESEARCH SYNTHESIS; SCRUM; SYSTEMATIC REVIEW;

SOFTWARE ENGINEERING;

EID: 44649189162     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2008.01.006     Document Type: Review

References (68)

1. North American and European Enterprise Software and Services Survey, Business Technographics Ed., 2005.
2. P. Abrahamsson, O. Salo, J. Ronkainen, J. Warsta, Agile software development methods: review and analysis, VTT Technical report, 2002.
3. Abrahamsson P., Warsta J., Siponen M.T., and Ronkainen J. New directions on agile methods: a comparative analysis. Proceedings of the 25th International Conference on Software Engineering (ICSE'03) (2003), IEEE Press
4. Ackoff R.L. Alternative types of planning. Ackoff's Best: His Classic Writings on Management (1999), Wiley, New York 104-114
5. Anderson A., Beattie R., Beck K., Bryant D., Dearment M., Fowler M., Fronczak M., Garzaniti R., Gore D., Hacker B., Hendrickson C., Jeffries R., Joppie D., Kim D., Kowalsky P., Mueller D., Murasky T., Nutter R., Pantea A., and Thomas D. Chrysler goes to extremes. Distributed Computing Magazine October (1998) 24-28
6. Aoyama M. Web-based agile software development. IEEE Software 15 6 (1998) 56-65
7. Atkins D., Best D., Briss P.A., Eccles M., Falck-Ytter Y., Flottorp S., Guyatt G.H., Harbour R.T., Haugh M.C., Henry D., Hill S., Jaeschke R., Leng G., Liberati A., Magrini N., Mason J., Middleton P., Mrukowicz J., O'connell D., D Oxman A., Phillips B., Schünemann H.J., Edejer T.T.-T., Varonen H., Vist G.E., Williams Jr. J.W., and Stephanie Z. Grading quality of evidence and strength of recommendations. BMJ 328 1490 (2004)
8. Avison D., Lau F., Myers M., and Nielsen P.A. Action research. Communications of the ACM 42 1 (1999) 94-97
9. Beck K. Extreme Programming Explained: Embrace Change (2000), Addison-Wesley. 0-201-61641-6
10. Beck K. Extreme Programming Explained: Embrace Chage. second ed. (2004), Addison-Wesley. 978-0321278654
11. Boehm B. Get ready for agile methods, with care. IEEE Computer 35 1 (2002) 64-69
12. Boehm B., and Turner R. Balancing Agility and Discipline: A Guide for the Perplexed (2003), Addison-Wesley, Boston. 978-0321186126
13. Britten N., Campbell R., Pope C., Donovan J., Morgan M., and Pill R. Using meta ethnography to synthesise qualitative research: a worked example. Journal of Health Services Research and Policy 7 4 (2002) 209-215
14. Checkland P., and Scholes J. Soft Systems Methodology in Action (1990), Wiley, Chichester. 0-471-98605-4
15. Cockburn A. Selecting a project's methodology. IEEE Software 17 4 (2000) 64-71
16. Cockburn A. Crystal Clear: A Human-Powered Methodology for Small Teams (2004), Addison-Wesley. 0-201-69947-8
17. Cohen D., Lindvall M., and Costa P. An introduction to agile methods. In: Zelkowitz M.V. (Ed). Advances in Computers, Advances in Software Engineering vol. 62 (2004), Elsevier, Amsterdam
18. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20 (1960) 37-46
19. K. Conboy, B. Fitzgerald, Toward a conceptual framework of agile methods: a study of agility in different disciplines, in: Proceedings of XP/Agile Universe, Springer Verlag, 2004.
20. Dittrich Y., John M., Singer J., and Tessem B. For the special issue on qualitative software engineering research. Information and Software Technology 49 6 (2007) 531-539
21. Dybå T. Improvisation in small software organizations. IEEE Software 17 5 (2000) 82-87
22. Dybå T., Arisholm E., Sjøberg D., Hannay J., and Shull F. Are two heads better than one? On the effectiveness of pair-programming. IEEE Software 24 6 (2007) 10-13
23. T. Dybå, T. Dingsøyr, G.K. Hanssen, Applying systematic reviews to diverse study types: an experience report, in: Proceedings of the 1st International Symposium on Empirical Software Engineering and Measurement (ESEM'07), IEEE Computer Society, Madrid, Spain, 2007, pp. 225-234.
24. Dybå T., Kitchenham B., and Jørgensen M. Evidence-based software engineering for practitioners. IEEE Software 22 1 (2005) 58-65
25. Edmondson A.C., and Mcmanus S.E. Methodological fit in management field research. Academy of Management Review 32 4 (2007) 1155-1179
26. Erdogmus H., Morisio M., and Torchiano M. On the effectiveness of the test-first approach to programming. IEEE Transactions on Software Engineering 31 3 (2005) 226-237
27. Erickson J., Lyytinen K., Siau K., and Modeling A. Agile software development, and extreme programming: the state of research. Journal of Database Management 16 4 (2005) 88-100
28. Gilb T. Competitive Engineering: A Handbook for Systems Engineering, Requirements Engineering, and Software (2005), Elsevier Butterworth-Heinemann, Oxford. 0-7506-6507-6
29. Greenhalgh T. How to Read a Paper. second ed. (2001), BMJ Publishing Group, London
30. Gunasekaran A. Agile manufacturing: A framework for research and development. International Journal of Production Economics 62 1-2 (1999) 87-105
31. J.P.T. Higgins, S. Green (Eds.), Cochrane Handbook for Systematic Reviews of Interventions, Version 5.0.0 (updated February 2008), The Cochrane Collaboration, 2008. Available from: .
32. Humphrey W.S. PSP: A Self-Improvement Process for Software Engineers (2005), Addison-Wesley. 978-0321305497
33. M. Höst, P. Runeson, Checklists for software engineering case study research, in: Proceedings of the First International Symposium on Empirical Software Engineering and Measurement, IEEE, Madrid, Spain, 2007, pp. 479-481.
34. G. Keefer, Extreme Programming Considered Harmful for Reliable Software Development 2.0, AVOCA GmbH, Online Report, 2003.
35. K.S. Khan, G. Ter Riet, J. Glanville, A.J. Sowden, J. Kleijnen, Undertaking Systematic Review of Research on Effectiveness, CRD's Guidance for those Carrying Out or Commissioning Reviews, CRD Report Number 4, second ed., NHS Centre for Reviews and Dissemination, University of York, 2001.
36. B.A. Kitchenham, Guidelines for performing Systematic Literature Reviews in Software Engineering Version 2.3, Keele University and University of Durham, EBSE Technical Report, 2007.
37. Kitchenham B.A., Pfleeger S.L., Pickard L.M., Jones P.W., Hoaglin D.C., El Emam K., and Rosenberg J. Preliminary guidelines for empirical research in software engineering. IEEE Transactions on Software Engineering 28 8 (2002) 721-734
38. Krutchen P. The Rational Unified Process: An Introduction. third ed. (2003), Addison-Wesley, Boston
39. Landis J.R., and Koch G.G. The measurement of observer agreement for categorical data. Biometrics 33 1 (1977) 159-174
40. Larman C., and Basili V.R. Iterative and incremental development: a brief history. IEEE Computer 36 6 (2003) 47-56
41. Mcavoy J., and Butler T. The impact of the Abilene Paradox on double-loop learning in an agile team. Information and Software Technology 49 6 (2007) 552-563
42. Mcbreen P. Questioning Extreme Programming (2003), Pearson Education, Boston, MA, USA. 0-201-84457-5
43. Merisalo-Rantanen H., Tuure T., and Matti R. Is extreme programming just old wine in new bottles: a comparison of two cases. Journal of Database Management 16 4 (2005) 41-61
44. Meso P., and Jain R. Agile software development: adaptive systems principles and best practices. Information Systems Management 23 3 (2006) 19-30
45. Miles M.B., and Huberman M. Qualitative Data Analysis: An Expanded Sourcebook. second ed. (1994), Sage Publications. 0803955405
46. Nerur S., and Balijepally V. Theoretical reflections on agile development methodologies. Communications of the ACM 50 3 (2007) 79-83
47. Nerur S., Mahapatra R., and Mangalaraj G. Challenges of migrating to agile methodologies. Communications of the ACM May (2005) 72-78
48. Noblit G.W., and Hare R.D. Meta-Ethnography: Synthesizing Qualitative Studies (1988), Sage Publications, London
49. Ohno T. Toyota Production System: Beyond Large-scale Production (1988), Productivity Press, New York, USA. 0-915299-14-3
50. Palmer S.R., and Felsing J.M. A Practical Guide to Feature-driven Development (2002), Prentice Hall, Upper Saddle River, NJ. 0-13-067615-2
51. Paulk M.C., Weber C.V., Curtis B., and Chrissis M.B. The Capability Maturity Model: Guidelines for Improving the Software Process (1995), Addison-Wesley, Boston. 0-201-54664-7
52. Poppendieck M., and Poppendieck T. Lean Software Development - An Agile Toolkit for Software Development Managers (2003), Addison-Wesley, Boston. 0-321-15078-3
53. Rajlich V. Changing the paradigm of software engineering. Communications of the ACM 49 8 (2006) 67-70
54. Riemenschneider C.K., Hardgrave B.C., and Davis F.D. Explaining software developer acceptance of methodologies: a comparison of five theoretical models. IEEE Transactions on Software Engineering 28 12 (2002) 1135-1145
55. Sanchez L.M., and Nagi R. A review of agile manufacturing systems. International Journal of Production Research 39 16 (2001) 3561-3600
56. Schwaber K., and Beedle M. Agile Software Development with Scrum (2001), Prentice Hall, Upper Saddle River
57. Shadish W.R., Cook T.D., and Campbell D.T. Experimental and Quasi-Experimental Designs for Generalized Causal Inference (2002), Houghton Mifflin Company, Boston
58. Sjøberg D., Dybå T., and Jørgensen M. The Future of Empirical Methods in Software Engineering Research. Future of Software Engineering (FOSE'07) (2007), IEEE 358-378
59. Sjøberg D., Hannay J.E., Hansen O., Kampenes V.B., Karahasanovic A., Liborg N.-K., and Rekdal A.C. A survey of controlled experiments in software engineering. IEEE Transactions on Software Engineering 31 9 (2005) 733-753
60. Stapleton J. DSDM: Business Focused Development. second ed. (2003), Pearson Education. 978-0321112248
61. Stephens M., and Rosenberg D. Extreme Programming Refactored: The Case Against XP (2003), Apress, Berkeley, CA. 1-59059-096-1
62. Strauss A., and Corbin J. Basics of Qualitative Research. second ed. (1998), Sage Publications. 0-8039-5939-7
63. Takeuchi H., and Nonaka I. The new product development game. Harvard Business Review January (1986) 137-146
64. Turk D., France R., and Rumpe B. Assumptions underlying agile software-development processes. Journal of Database Management 16 4 (2005) 62-87
65. Wenger E. Communities of Practice: Learning, Meaning and Identity (1998), Cambridge University Press, Cambridge, UK. 0-521-43017-8
66. Williams L., and Cockburn A. Agile software development: it's about feedback and change. IEEE Computer 36 6 (2003) 39-43
67. Womack J.P., Jones D.T., and Roos D. The Machine that Changed the World: The Story of Lean Production - Toyota's Secret Weapon in the Global Car Wars that is Now Revolutionizing World Industry (2007), Free Press. 978-0743299794
68. Ågerfalk P., and Fitzgerald B. Flexible and distributed software processes: old petunias in new bowls?. Communications of the ACM 49 10 (2006) 27-34