Confidence in software cost estimation results based on MMRE and PRED

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2008, Pages 63-70

  Korte, Marcel ^a   Port, Dan ^b  

^a UNIVERSITY OF APPLIED SCIENCES AND ARTS DORTMUND   (Germany)

^b UNIVERSITY OF HAWAII   (United States)

Author keywords

Bootstrapping; Calibration; Confidence; Cost estimation; Cost model; MMRE; Model selection; Parameters; PRED; Standard error

Indexed keywords

COBALT; COMPUTER SOFTWARE SELECTION AND EVALUATION; COSTS; MODELS; POPULATION STATISTICS; SOFTWARE ENGINEERING; STANDARDS; TECHNICAL PRESENTATIONS;

BOOTSTRAPPING; CONFIDENCE; COST ESTIMATION; COST MODEL; MMRE; MODEL SELECTION; PARAMETERS; PRED; STANDARD ERROR;

MODAL ANALYSIS;

EID: 57049111199     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1370788.1370804     Document Type: Conference Paper

References (28)

1. K. Moløkken, M. Jørgensen, "A Review of Surveys on Software Effort Estimation," International Symposium on Empirical Software Engineering, Rome, Italy, 2003
2. I. Myrtweit, E. Stensrud, M. Shepperd, "Reliability and Validity in Comparative Studies of Software Prediction Models," IEEE Transactions on Software Engineering, Vol. 31, No. 5, 2005
3. T. Menzies, Z. Chen, J. Hihn, K. Lum, "Selecting Best Practices for Effort Estimation," IEEE Transactions on Software Engineering, Vol. 32, No. 11, 2006
4. M. Shepperd "Evaluating Software Project Prediction Systems," 11th IEEE International Software Metrics Symposium, Como, Italy, 2005
5. T. Menzies, D. Port, Z. Chen, J. Hihn, S. Stukes, "Validation Methods for Calibrating Software Effort Models," Proceedings of the 27th international conference on Software engineering, 2005
6. I. Wieczorek, M. Ruhe, "How valuable is company-specific data compared to multi-company data for software cost estimation?," Proceeding for the Eights IEEE Symposium on Software Metrics (METRICS 02), 2002
7. Ch. Mooney, Robert Duval, "Bootstrapping: A Nonparametrie Approach to Statistical Inference," Sage Publications; 1. edition (1993)
8. B. Efron (1979). "Bootstrap methods: Another look at the jackknife," The Annals of Statistics, 7, 1-26
9. T. Foss, E. Stensrud, B. Kitehenham, I. Myrtveit, "A simulation study of the Model Evaluation Criterium MMRE," IEEE Transactions on Software Engineering, Vol. 20, No. 11, 2003
10. M. Shepperd, G. Kadoda, "using Simulation to Evaluate Prediction Techniques," Proc. Fifth Int'l Software Metrics Symp., 2001
11. B. Boehm. Software Engineering Economics. Prentice Hall, 1981
12. J.M. Desharnais, "Analyse statistique de la productivitie des projets informatique a partie de la technique des point des fonction," masters thesis, Univ. of Montreal, 1989.
13. M. Jørgensen, "How Much Does a Vacation Cost? or What is a Software Cost Estimate?," ACM SIGSOFT Software Engineering Notes, P. 5, Vol. 28, No. 6, 2003
14. S. D. Conte, H. E. Dunsmore, and V. Y. Shen, "Software engineering metrics and models," Benjamin-Cummings Publishing, 1986
15. M. Jørgensen, "Experience with the accuracy of software maintenance task effort prediction models," IEEE Transactions on Software Engineering, Vol. 21, No. 8, 1995
16. G. Boetticher, T. Menzies, and T. Ostrand. The PROMISE Repository of Empirical Software Engineering Data, 2007. http://promisedata.org/repository.
17. B. Kitchenham, L. Pickard, S. MacDonell, M. Sheppard, "What accuracy statistics Teally measure," Proceedings of the IEEE, Vol. 148, No. 3, 2001
18. M. Jørgensen, M. Shepperd,: "A Systematic Review of Software Development Cost Estimation Studies," IEEE Trans. Software Eng., Vol. 33, No. 1, 2007
19. M. Shepperd, C. Schofield, "Estimating Software Effort using Anologies," IEEE Transactions on Software Engineering, 1997
20. G. Hood, http://www.cse.csiro.au/poptools, 01/19/2008
21. http://en.wikipedia.org/wiki/Vysochanskii-Petunin-inequality, 01/19/2008
22. R. Larsen, M. Marx, "An Introduction to Mathematical Statistics and its Applications," Second Edition, Prentice Hall, 1986
23. L. Briand, T. Langley, and I. Wieczorek. "A replicated assessment and comparison of common software cost modeling techniques," in Proceedings of the 22nd International Conference on Software Engineering, Limerick, Ireland, 2000, pp. 377-386.
24. K. Lum, J. Hihn, T. Menzies, "Studies in Software Cost Model Behavior: Do We Really Understand Cost Model Performance?," Proceedings of the ISPA International Conference 2006, Seattle, WA
25. COCOMO81 dataset, http://promisedata.org/repository/#coc81, 12/29/2007
26. COCOMONASA dataset, http://promisedata.org/repository/#cocomonasa-v1, 01 /19/2008
27. NASA93 dataset, http://promisedata.org/repository/#nasa93, 12/29/2007
28. Desharnis dataset, http://promisedata.org/repository/#desharnais, 12/29/2007