Measuring and predicting software productivity: A systematic map and review

Information and Software Technology

Volumn 53, Issue 4, 2011, Pages 317-343

  Petersen, Kai ^a,b  

^a BLEKINGE INSTITUTE OF TECHNOLOGY   (Sweden)

^b ERICSSON RESEARCH   (Sweden)

Author keywords

Efficiency; Measurement; Performance; Prediction; Software development; Software productivity

Indexed keywords

COMPUTER SOFTWARE; DATA ENVELOPMENT ANALYSIS; EFFICIENCY; FORECASTING; MAPPING; MEASUREMENT; RISK ASSESSMENT; SOFTWARE DESIGN; SOFTWARE ENGINEERING; STATISTICAL PROCESS CONTROL;

ANALYSIS AND SYNTHESIS; CLASSIFICATION SCHEME; CORRECTIVE ACTIONS; PERFORMANCE; PRODUCTIVITY MEASURE; PRODUCTIVITY MEASUREMENTS; SOFTWARE PRODUCTIVITY; SOFTWARE PRODUCTIVITY MEASUREMENT;

PRODUCTIVITY;

EID: 79951812187     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2010.12.001     Document Type: Review

References (72)

1. N.E. Fenton, and S.L. Pfleeger Software Metrics: A Rigorous and Practical Approach second ed. 1997 PWS London
2. B. Kitchenham, S. Charters, Guidelines for performing systematic literature reviews in software engineering, Tech. Rep. EBSE-2007-01, Software Engineering Group, School of Computer Science and Mathematics, Keele University, July 2007.
3. T. Dyb, T. Dingsøyr, G.K. Hanssen, Applying systematic reviews to diverse study types: an experience report, in: Proceedings of the First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007), 2007, pp. 225-234.
4. K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson, Systematic mapping studies in software engineering, in: Proceedings of the 10th International Conference on Evaluation and Assessment in Software Engineering (EASE 2008), 2008, pp. 1-10.
5. K. Petersen, Supplementary Material to: A Systematic Review of Performance Measurement of Software Development, 2010 < http://sites.google. com/site/kaipetersen79/SP.pdf >.
6. B. Kitchenham What's up with software metrics? - A preliminary mapping study Journal of Systems and Software 83 1 2010 37 51 (1991) 293-321
7. J. Dale, and H. van der Zee Software productivity metrics: who needs them? Information and Software Technology 34 11 1992 731 738
8. W. Scacchi Understanding software productivity: a knowledge-based approach International Journal of Software Engineering and Knowledge Engineering 1 3 1991 293 321
9. K. Petersen, C. Wohlin, Context in industrial software engineering research, in: Proceedings of the 3rd International Symposium on Empirical Software Engineering (ESEM 2009), 2009, pp. 401-404.
10. M. Ivarsson, and T. Gorschek A method for evaluating rigor and industrial relevance of technology evaluations Empirical Software Engineering 2011 10.1007/s10664-010-9146-4
11. S.L. Lough, A taxonomy of computer attacks with applications to wireless networks, Ph.D. Thesis, Virginia Polytechnic Institute and State University, 2001.
12. B. Kitchenham, S.L. Pfleeger, L. Pickard, P. Jones, D.C. Hoaglin, K.E. Emam, and J. Rosenberg Preliminary guidelines for empirical research in software engineering IEEE Transactions on Software Engineering 28 8 2002 721 734
13. M. Dixon-Woods, S. Agarwal, D. Jones, B. Young, and A. Sutton Synthesising qualitative and quantitative evidence: a review of possible methods Journal of Health Services Research and Policy 10 1 2005 45 53
14. D. Pfahl, and G. Ruhe Immos: a methodology for integrated measurement, modelling and simulation Software Process: Improvement and Practice 7 3-4 2002 189 210
15. S.L. Pfleeger Model of software effort and productivity Information and Software Technology 33 3 1991 224 231
16. J. Cohen Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences 2003 L. Erlbaum Associates Mahwah, NJ
17. K. Maxwell, L.V. Wassenhove, and S. Dutta Software development productivity of european space, military, and industrial applications IEEE Transactions on Software Engineering 22 10 1996 706 718 (Pubitemid 126771687)
18. W.D. Yu, D.P. Smith, S.T. Huang, Software productivity measurements, in: Proceedings of the 15th International Conference on Computer Software and Applications Conference (COMPSAC 1991), 1991, pp. 558-564.
19. B.W. Boehm Software Engineering Economics 1981 Prentice-Hall Englewood Cliffs, NJ
20. H.S. Bok, and K. Raman Software engineering productivity measurement using function points: a case study Journal of Information Technology 15 2000 79 90
21. B.A. Kitchenham, D.R. Jeffery, and C. Connaughton Misleading metrics and unsound analyses IEEE Software 24 2 2007 73 78 (Pubitemid 46510297)
22. igdem Gencel, and O. Demirörs Functional size measurement revisited ACM Transactions on Software Engineering Methodology 17 3 2008
23. V. Chatman Change-points: a proposal for software productivity measurement Journal of Systems and Software 31 1 1995 71 91
24. E. Stensrud, and I. Myrtveit Identifying high performance erp projects IEEE Transactions on Software Engineering 29 5 2003 398 416
25. D. Liping, Y. Qiusong, S. Liang, T. Jie, and W. Yongji Evaluation of the capability of personal software process based on data envelopment analysis Proceedings of the International Software Process Workshop (SPW 2005) 2005 Springer-Verlag Berlin, Germany
26. I. Stamelos, L. Angelis, P. Dimou, and E. Sakellaris On the use of bayesian belief networks for the prediction of software productivity Information and Software Technology 45 1 2003 51 60
27. V. Kadary, On application of earned value index to software productivity metrics in embedded computer systems, in: Proceedings of the Conference on Computer Systems and Software Engineering (CompEuro 92), 1992, pp. 666-670.
28. R.S. Kaplan, and D.P. Norton The Balanced Scorecard: Translating Strategy into Action 1996 Harvard Business School Press Boston, Mass.
29. M.O. Searcoid Metric Spaces 2006 Springer New York
30. L. R.W. Numrich, V.R. Hochstein, and Basili A metric space for productivity measurement in software development Proceedings of the Second International Workshop on Software Engineering for High Performance Computing System Applications (SE-HPCS 2005) 2005 ACM New York, NY, USA 13 16
31. D. Raffo, J. Vandeville, and R.H. Martin Software process simulation to achieve higher cmm levels Journal of Systems and Software 46 2-3 1999 163 172
32. P. Donzelli, and G. Iazeolla A hybrid software process simulation model Software Process: Improvement and Practice 6 2 2001 97 109
33. P. Donzelli, G. Iazeolla, A software process simulator for software product and process improvement, in: Proceedings of the 1st International Conference on Product Focused Software Process Improvement (PROFES 1999), 1999, pp. 525-538.
34. K. Khosrovian, D. Pfahl, V. Garousi, Gensim 2.0: a customizable process simulation model for software process evaluation, in: Proceedings of the International Conference on Software Process (ICSP 2008), 2008, pp. 294-306. (Pubitemid 351775454)
35. J. Münch, O. Armbrust, Using empirical knowledge from replicated experiments for software process simulation: A practical example, in: Proceedings of the International Symposium on Empirical Software Engineering (ISESE 2003), 2003, pp. 18-27.
36. M.T. Baldassarre, N. Boffoli, D. Caivano, G. Visaggio, Improving dynamic calibration through statistical process control, in: Proceedings of the 21st IEEE International Conference on Software Maintenance (ICSM 2005), 2005, pp. 273-282. (Pubitemid 43790941)
37. B. Kitchenham, and E. Mendes Software productivity measurement using multiple size measures IEEE Transactions on Software Engineering 30 12 2004 1023 1035 (Pubitemid 41166496)
38. R. Wieringa, N.A.M. Maiden, N.R. Mead, and C. Rolland Requirements engineering paper classification and evaluation criteria: a proposal and a discussion Requirements Engineering 11 1 2006 102 107 (Pubitemid 43118937)
39. C. Wohlin, P. Runeson, M. Höst, M.C. Ohlsson, B. Regnell, and A. Wesslen Experimentation in Software Engineering: An Introduction (International Series in Software Engineering) 2000 Springer
40. K.M. Eisenhardt Building theories from case study research Academy of Management Review 14 4 1989 532 550
41. R.K. Yin Case Study Research: Design and Methods third ed. 2003 Sage Publications
42. B. Somekh Action Research: A Methodology for Change and Development 2006 Open University Press Maidenhead
43. D.R. Jeffery Software development productivity model for mis environments Journal of Systems and Software 7 2 1987 115 125 (Pubitemid 17603979)
44. G.R. Finnie, and G.E. Wittig Effect of system and team size on 4gl software development productivity South African Computer Journal 11 1994 18 25
45. S. Morasca, G. Russo, An empirical study of software productivity, in: Proceedings of the 25th International Computer Software and Applications Conference (COMPSAC 2001), 2001, pp. 317-322. (Pubitemid 33068636)
46. L.R. Foulds, M. Quaddus, M. West, Structural equation modeling of large-scale information system application development productivity: the hong kong experience, in: Proceedings of the 6th IEEE/ACIS International Conference on Computer and Information Science (ACIS-ICIS 2007), 2007, pp. 724-731.
47. M. Arnold, and P. Pedross Software size measurement and productivity rating in a large-scale software development department Proceedings of the 20th International Conference on Software Engineering (ICSE 1998) 1998 IEEE Computer Society 490 493
48. R.D. Banker, S.M. Datar, and C.F. Kemerer Model to evaluate variables impacting the productivity of software maintenance projects Management Science 37 1 1991 1 18
49. M.A. Mahmood, K.J. Pettingell, and A.L. Shaskevich Measuring productivity of software projects: a data envelopment approach Decision Sciences 27 1 1996 57 81
50. Z.J. Yang, and J.C. Paradi Dea evaluation of a y2k software retrofit program IEEE Transactions on Engineering Management 51 3 2004 279 287
51. B. Kitchenham The question of scale economies in software - why cannot researchers agree? Information and Software Technology 44 1 2002 13 24 (Pubitemid 34110234)
52. M. Asmild, J.C. Paradi, and A. Kulkarni Using data envelopment analysis in software development productivity measurement Software Process Improvement and Practice 11 6 2006 561 572 (Pubitemid 46032842)
53. L. Ruan, Y. Wang, Q. Wang, M. Li, Y. Yang, L. Xie, D. Liu, H. Zeng, S. Zhang, J. Xiao, L. Zhang, M.W. Nisar, J. Dai, Empirical study on benchmarking software development tasks, in: Proceedings of the International Conference on Software Process (ICSP 2007), 2007, pp. 221-232. (Pubitemid 350259754)
54. R. Li, W. Yongji, W. Qing, S. Fengdi, Z. Haitao, Z. Shen, Arimammse: an integrated arima-based software productivity prediction method, in: Proceedings of the 30th International Conference on Computer Software and Applications Conference (COMPSAC 2006), vol. 2, 2006, pp. 135-138. (Pubitemid 46661720)
55. W.S. Humphrey, and N.D. Singpurwalla Predicting (individual) software productivity IEEE Transactions on Software Engineering 17 2 1991 196 207
56. B. List, R.M. Bruckner, J. Kapaun, Holistic software process performance measurement from the stakeholders' perspective, in: Proceedings of the 16th International Workshop on Database and Expert Systems Applications (DEXA 2005), 2005, pp. 941-947.
57. J.L. Romeu A simulation approach for the analysis and forecast of software productivity Computers and Industrial Engineering 9 2 1985 165 174
58. C.Y. Lin, T. Abdel-Hamid, and J.S. Sherif Software-engineering process simulation model (seps) Journal of Systems and Software 38 3 1997 263 277 (Pubitemid 127384434)
59. N. Hanakawa, S. Morisaki, K. Matsumoto, A learning curve based simulation model for software development, in: Proceedings of the 20th International Conference on Software Engineering (ICSE 1998), 1998, pp. 350-359.
60. D. Raffo Evaluating the impact of process improvements quantitatively using process modeling Proceedings of the Conference of the Center for Advanced Studies on Collaborative research (CASCON 1993) 1993 IBM Press 290 313
61. D. Raffo, W. Harrison, and J. Vandeville Coordinating models and metrics to manage software projects Software Process: Improvement and Practice 5 2-3 2000 159 168
62. D.M. Raffo, W. Harrison, and J. Vandeville Software process decision support: making process tradeoffs using a hybrid metrics, modeling and utility framework Proceedings of the 14th International Conference on Software Engineering and Knowledge Engineering (SEKE 2002) 2002 ACM New York, NY, USA 803 809
63. L.H. Putman, and W. Myers Software Metrics: A Practitioner's Guide to Improved Product Development 1993 Chapman and Hall London
64. K. Beck Embracing change with extreme programming IEEE Computer 32 10 1999 70 77
65. C. Larman Agile and Iterative Development: A Manager's Guide 2003 Pearson Education
66. A.S. Koch, Agile software development: evaluating the methods for your organization, Artech House, Boston, 2005.
67. K. Petersen, and C. Wohlin A comparison of issues and advantages in agile and incremental development between state of the art and an industrial case Journal of Systems and Software 82 9 2009 1479 1490
68. S. Biffl Value-Based Software Engineering first ed. 2005 Springer New York, NY
69. C. Robson Real World Research: A Resource for Social Scientists and Practitioner-Researchers second ed. 2002 Blackwell Oxford
70. P. Runeson, and M. Höst Guidelines for conducting and reporting case study research in software engineering Empirical Software Engineering 14 2 2009 131 164
71. F.M. Wolf Meta-Analysis: Quantitative Methods for Research Synthesis 1986 Sage Publications
72. D. Budgen, B.A. Kitchenham, S.M. Charters, M. Turner, P. Brereton, and S.G. Linkman Presenting software engineering results using structured abstracts: a randomised experiment Empirical Software Engineering 13 4 2008 435 468