How does project size affect cost estimation error? Statistical artifacts and methodological challenges

International Journal of Project Management

Volumn 30, Issue 7, 2012, Pages 839-849

  Jørgensen, Magne ^a,b   Halkjelsvik, Torleif ^b   Kitchenham, Barbara ^c  

^a SIMULA RESEARCH LABORATORY   (Norway)

^b UNIVERSITY OF OSLO   (Norway)

^c KEELE UNIVERSITY   (United Kingdom)

Author keywords

Cost estimation; Magnitude bias; Non random samples; Random error; Regression analysis; Statistical artifacts

Indexed keywords

ACTUAL COST; COST ESTIMATIONS; COST OVERRUNS; EMPIRICAL STUDIES; ESTIMATED COSTS; MAGNITUDE BIAS; NON-RANDOM SAMPLES; OBSERVATIONAL STUDY; PROJECT SIZE; STATISTICAL ARTIFACTS;

PROJECT MANAGEMENT; RANDOM ERRORS; REGRESSION ANALYSIS;

COST ESTIMATING;

COST; ERROR ANALYSIS; ESTIMATION METHOD; PROJECT MANAGEMENT; STATISTICAL ANALYSIS;

EID: 84865400212     PISSN: 02637863     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijproman.2012.01.007     Document Type: Article

References (51)

1. Anatolyev S., Kosenok G. Tests in contingency tables as regression tests. Economics letters 2009, 105:189-192.
2. Anda B.C.D., Sjøberg D.I.K., Mockus A. Variability and reproducibility in software engineering: a study of four companies that developed the same system. IEEE Transactions of Software Engineering 2009, 35(3):409-429.
3. Barker F., Soh Y.C., Evans R.J. Properties of the geometric mean functional relationship. Biometrics 1988, 44:279-281.
4. Berk R.A. An introduction to sample selection bias in sociological data. American Sociological Review 1983, 48:386-398.
5. Bertisen J., Davis G.A. Bias and error in mine project capital cost estimation. Engineering economist 2008, 53(2):118-139.
6. Blomquist N. On the bias caused by regression towards the mean in studying the relation between change and initial value. Journal of clinical peridontology 1986, 13:34-37.
7. Brenner L. Should observed overconfidence be dismissed as a statistical artifact? Critique of Erev, Wallste, and Budesco (1994). Psychological Review 2000, 107(4):947-949.
8. Campbell D.T., Kenny D.A. A Primer on Regression Artifacts 1999, The Guilford Press, New York.
9. Carrol R.J., Ruppert D. The use and misuse of orthogonal regression in linear errors-in-variables models. The American Statistician 1996, 50(1):1-6.
10. Clarke K.A. The phantom menace: omitted variable bias in econometric research. Conflict Management and Peace Science 2005, 22:341-352.
11. Creedy, G. D. 2006. Risk factors leading to cost overrun in the delivery of highway construction projects. Queensland University of Technology. Doctoral thesis.
12. Cronbach L.J., Gleser G.C., Nanda H., Rajaratnam N. The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles 1972, John Wiley & Sons, New York.
13. Dantata N.A., Touran A., Schneck D.C. Trends in U.S. rail transit project cost overrun. Transportation Research Board 2006 Annual Meeting 2006, Washington, DC.
14. Delgodo-Rodriguez M., Llorca J. Bias. Journal of Epidemiologic Community Health 2004, 58:635-641.
15. Flyvbjerg B., Skamris Holm M.K., Buhl S.L. What causes cost overrun in transport infrastructure projects?. Transport review 2004, 24(1):3-18.
16. Friedman M. Do old fallacies ever die?. Journal of economic literature 1992, 30:2129-2132.
17. Fuller W.A. Measurement Error Methods 1987, John Wiley & Sons.
18. Galton F. Natural Inheritance 1889, Macmillan and company, London.
19. Gray A., MacDonell S.G., Shepperd M.J. Factors systematically associated with errors in subjective estimates of software development effort: the stability of expert judgment. IEEE 6th International Metrics Symposium 1999, IEEE Computer Society, Boca Raton, Fl.
20. Greene W. Econometric Analysis 2003, 5th edition, Prentice Hall, New Jersey.
21. Grieco D., Hogarth R.M. Overconfidence in absolute and relative performance: the regression hypothesis and Bayesian updating. Journal of Economic Psychology 2009, 30:756-771.
22. Griliches Z. Estimating the results to scholloing: some econometric problems. Econometric 1977, 45:1-22.
23. Grimstad S., Jorgensen M. Inconsistency of expert judgment-based estimates of software development effort. Journal of Systems and Software 2007, 80(11):1770-1777.
24. Halkjelsvik T., Jørgensen M., Teigen K.H. To read two pages, I need 5 minutes, but give me 5 minutes and I will read four: how to change productivity estimates by inverting the question. Applied Cognitive Psychology 2001, 25:314-323.
25. Hatton L. How accurately do engineers predict software maintenance tasks?. IEEE Computer 2007, 40(2):64-69.
26. Hausman J. Mismeasured variables in econometric analysis: problems from the right and problems from the left. Journal of Economic Perspectives 2001, 15(4):57-67.
27. Hays W.L. Statistics 1981, Holt, Rinehart & Winston, New York.
28. Heemstra F.J., Kusters R.J. Function point analysis: evaluation of a software cost estimation model. European Journal of Information Systems 1991, 1(4):223-237.
29. Hill J., Thomas L.C., Allen D.E. Experts' estimates of task durations in software development projects. International Journal of Project Management 2000, 18(1):13-21.
30. Hinze J., Selstead G., Mahoney J.P. Cost overruns on state of Washington construction contracts. Transportation Research Record 1992, 87-93. (Washington).
31. Jørgensen M. A review of studies on expert estimation of software development effort. Journal of Systems and Software 2004, 70(1-2):37-60.
32. Jørgensen M., Indahl U., Sjøberg D.I.K. Software effort estimation by analogy and "regression toward the mean". Journal of Systems and Software 2003, 68(3):253-262.
33. Kahneman D., Tversky A. On the psychology of prediction. Psychological Review 1973, 80(4):237-251.
34. Kendall M.G. Regression, structure and functional relationship. Part I. Biometrika 1951, 38(1/2):11-25.
35. Larman C., Basili V. Iterative and incremental development: a brief history. IEEE Computer 2003, 47-56. (June).
36. Marais M.L., Wecker W.E. Correcting for omitted-variables and measurement-error bias in regression with an application to the effect of lead in IQ. Journal of the American Statistical Association 1998, 93(442):494-505.
37. Moløkken-Østvold K., Jorgensen M., Tanilkan S.S., Gallis H., Lien A.C., Hove S.E., IEEE computer, s A survey on software estimation in the Norwegian industry. 10th International Symposium on Software Metrics 2004, IEEE Computer Soc, Chicago, IL.
38. Odec J. Cost overruns in road construction - what are their sizes and determinants?. Transport policy 2004, 11:43-53.
39. Oldham P.D. A note on the analysis of repeated measurements of the same subjects. Journal of chronic diseases 1962, 15:969-977.
40. Reichardt C.S. Regression facts and artifacts. Evaluation and Program Planning 2000, 23:411-414.
41. Roy M.M., Christenfeld N.J.S. Effect of task length on remembered and predicted duration. Psychonomic Bulleting & Review 2008, 15:202-207.
42. Sauer C., Gemino A., Blaize H.R. The impact of size and volatility on IT project performance. Communications of the ACM 2007, 50(11):79-84.
43. Smith J.E., Winkler R.L. The optimizer's curse: skepticism and postdecision surprise in decision analysis. Management Science 2006, 52(3):311-322.
44. Staats, B. R., Milkman, K. L. and Fox, C. R. submitted for publication. The Team Scaling Fallacy: Underestimating The Declining Efficiency of Larger Teams.
45. Stiegler S.M. Regression towards the mean, historically considered. Statistical methods in medical research 1997, 6:103-114.
46. van Oorschot K.E., Bertrand J.W.M., Rutte C.G. Field studies into the dynamics of product development tasks. International Journal of Operations & Production Management 2005, 25(8):720-739.
47. Wampold B.E., Freund R. Use of multiple regression in counseling psychology research: a flexible data-analytic strategy. Journal of counseling psychology 1987, 34(4):372-382.
48. Whiteside M.M., Narayanan A. Reverse regression, collinearity, and employment discrimination. Journal of Business & Economic Statistics 1989, 7(3):403-406.
49. Winship C., Radbill L. Sampling weights and regression analysis. Sociological Methods & Research 1994, 23(2):230-257.
50. Yang B., Hu H.J., Jia L.X. A study of uncertainty in software cost and its impact on optimal software release time. IEEE Transactions on Software Engineering 2008, 34(6):813-825.
51. Yang D., Wang Q., Li M.S., Yang Y., Ye K., Du J., ACM A survey on software cost estimation in the Chinese software industry. ACM/IEEE International Symposium on Empirical Software Engineering and Measurement 2008, Assoc Computing Machinery, Kaiserslautern, GERMANY.