Better sure than safe? Over-confidence in judgement based software development effort prediction intervals

Journal of Systems and Software

Volumn 70, Issue 1-2, 2004, Pages 79-93

  Jørgensen, Magne ^a   Teigen, Karl Halvor ^b   Moløkken, Kjetil ^a  

^a SIMULA RESEARCH LABORATORY   (Norway)

^b UNIVERSITY OF OSLO   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER PROGRAMMING; COMPUTER SOFTWARE MAINTENANCE; COMPUTERS; LARGE SCALE SYSTEMS; PERSONNEL; PLANNING; PROBABILITY; PRODUCT DESIGN; PROJECT MANAGEMENT; SOCIETIES AND INSTITUTIONS;

EFFORT ESTIMATION; SOFTWARE DEVELOPERS; SOFTWARE SOLUTIONS;

SOFTWARE ENGINEERING;

EID: 0346694424     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0164-1212(02)00160-7     Document Type: Article

References (37)

1. Alpert M., Raiffa H. A progress report on the training of probability assessors. Kahneman D., Slovic P., Tversky A. Judgment Under Uncertainty: Heuristics and Biases. 1982;294-305 Cambridge University Press, Cambridge.
2. Angelis L., Stamelos I. A simulation tool for efficient analogy based cost estimation. Empirical Software Engineering. 5:2000;35-68.
3. Arkes H.R. Overconfidence in judgmental forecasting. Armstrong J.S. Principles of Forecasting: A Handbook for Researchers and Practitioners. 2001;495-515 Kluwer Academic Publishers.
4. Blattberg R.C., Hoch S.J. Database models and managerial intuition: 50% model. + 50% manager Management Science. 36:1990;887-899.
5. Bongaarts J., Bulatao R.A. Beyond Six Billion: Forecasting the World's Population. 2000;National Academy Press.
6. Brehmer B. In one word: Not from experience. Acta Psychologica. 45:1980;223-241.
7. Connolly T., Dean D. Decomposed versus holistic estimates of effort required for software writing tasks. Management Science. 43(7):1997;1029-1045.
8. Conte S.D., Dunsmore H.E., Shen V.Y. Software Engineering Metrics and Models. 1986;Benjamin/Cummings Publishing Company Inc.
9. Dawes R.M. Rational Choice in an Uncertain World. 1988;Harcourt Brace & Company.
10. Ericsson K.A., Krampe R.T., Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. Psychological Review. 100(3):1993;363-406.
11. Fewster R., Mendes E. Measurement, prediction and risk analysis for Web applications. International Software Metrics Symposium, London, England. 2001;338-348 IEEE Computer Society, Los Alamitos, CA.
12. Fischhof B. Hindsight ◇ foresight: The effect of outcome knowledge on judgement under uncertainty. Journal of Experimental Psychology: Human Perception and Performance. 1:1975;288-299.
13. Gray A., MacDonnell S., Shepperd M. Factors systematically associated with errors in subjective estimates of software development effort: the stability of expert judgment. Sixth International Software Metrics Symposium. 1999;216-227 IEEE Computer Society, Los Alamitos, CA, USA.
14. Hammond K.R. Human Judgement and Social Policy. 1996;Oxford University Press, New York.
15. Henrion M., Fischer G.W., Mullin T. Divide and conquer? Effects of decomposing on the accuracy and calibration of subjective probability distributions. Organizational Behavior and Human Decision Processes. 55:1993;207-227.
16. Höst, M., Wohlin, C., 1998. An experimental study of individual subjective effort estimations and combinations of the estimates. In: International Conference on Software Engineering, Kyoto, Japan, pp. 322-339.
17. Jørgensen, M., 1997. An empirical evaluation of the MkII FPA estimation model. In: Norwegian Informatics Conference, Voss, Norway, Tapir, Oslo, pp. 7-18.
18. Jørgensen, M., Moløkken, K., in press. Situational and Task Characteristics Systematically Associated With Accuracy of Software Development Effort Estimates, IRMA 2003 conference.
19. Jørgensen M., Sjøberg D.I.K. Impact of software effort estimation on software work. Journal of Information and Software Technology. 43:2001;939-948.
20. Jorgensen M., Sjoberg D.I.K. Learning from experience in a software maintenance environment. Journal of Software Maintenance. 14:2002;123-146.
21. Jørgensen, M., Sjøberg, D.I.K., in press. An effort prediction interval approach based on the empirical distribution of previous estimation accuracy. Journal of Information and Software Technology.
22. Jørgensen, M., Teigen, K.H., 2002. Uncertainty intervals versus interval uncertainty: an alternative method for eliciting effort prediction intervals in software development projects. In: Proceedings of the International Conference on Project Management (ProMac), Singapore, pp. 343-352.
23. Kahneman D., Lovallo D. Timid choices and bold forecasts: A cognitive perspective on risk taking. Management Science. 39(1):1993;17-31.
24. Kahnemann D., Slovic P., Tversky A. Judgement Under Uncertainty: Heuristics and Biases. 1982;Cambridge University Press.
25. Känsälä K. Integrating risk assessment with cost estimation. IEEE Software. (May/June):1997;61-67.
26. Keren G., Teigen K.H. Why is. p=.90 better than p=.70 ? preference for definitive predictions by lay consumers of probability judgments Psychonomic Bulletin and Reviews. 8(2):2001;191-202.
27. Lichtenstein S., Fischhoff B., Phillips L.D. Calibration of probabilities: The state of the art to 1980. Kahneman D., Slovic P., Tversky A. Judgment Under Uncertainty: Heuristics and Biases. 1982;Cambridge University Press, Cambridge.
28. McClelland A.G.R., Bolger F. The calibration of subjective probabilities: theories and models 1980-94. Wright G., Ayton P. Subjective Probability. 1994;John Wiley, Chichester.
29. McConnel S. Software Project Survival Guide. 1998;Microsoft Press.
30. Miyazaki Y., Takanou A., Nozaki H., Nakagawa N., Okada K. Method to estimate parameter values in software prediction models. Information and Software Technology. 33(3):1991;239-243.
31. Miyazaki Y., Terakado M., Ozaki K. Robust regression for developing software estimation models. Journal of Systems Software. 27(1):1994;3-16.
32. Moder J.J., Phillips C.R., Davis E.W. Project Management with CPM, PERT and Precedence Diagramming. 1995;Blitz Publishing Company, Wisconsin, USA.
33. Myrtveit I., Stensrud E. A controlled experiment to assess the benefits of estimating with analogy and regression models. IEEE Transactions on Software Engineering. 25:1999;510-525.
34. Nasa, 1990. Manager's handbook for software development. Goddard Space Flight Center, Greenbelt, Md, Nasa Software Engineering Laboratory.
35. Stamelos I., Agnelis L. Managing uncertainty in portfolio cost estimation. Information and Software Technology. 43:2001;759-768.
36. Wright G., Ayton P. Subjective Probability. 1994;John Wiley, West Sussex, England.
37. Yaniv I., Foster D.P. Precision and accuracy of judgmental estimation. Journal of Behavioral Decision Making. 10:1997;21-32.