Chapter 4 The Use of Simulation Techniques for Hybrid Software Cost Estimation and Risk Analysis

Advances in Computers

Volumn 74, Issue , 2008, Pages 115-174

  Kläs, Michael ^a   Trendowicz, Adam ^a   Wickenkamp, Axel ^a   Münch, Jürgen ^a   Kikuchi, Nahomi ^b   Ishigai, Yasushi ^c  

^a FRAUNHOFER IESE   (Germany)

^b OKI ELECTRIC INDUSTRY CO   (Japan)

^c Information technology Promotion Agency Japan   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 47849108735     PISSN: 00652458     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0065-2458(08)00604-9     Document Type: Review

References (107)

1. Ahmed M.A., Saliu M.O., and AlGhamdi J. Adaptive fuzzy logic-based framework for software development effort prediction. Information and Software Technology 47 1 (January 2005) 31-48
2. Aguilar-Ruiz J.S., Ramos I., Riquelme J.C., and Toro M. An evolutionary approach to estimating software development projects. Information and Software Technology 43 (2001) 875-882
3. Angelis L., Stamelos I., and Morisio M. Building a software cost estimation model based on categorical data. Proceedings of the IEEE 7th International Symposium on software Metrics, England, UK (2001) 4-15
4. Avramidis A.N., and Wilson J.R. Correlation-induction techniques for estimating quantiles in simulation experiments. Proceedings of The Winter Simulation Conference, IEEE Press (1995)
5. Avramidis A. N., and Wilson J. R., Correlation-induction techniques for estimating quantiles in simulation experiments. Technical Report 95-05, Department of Industrial Engineering. North Carolina State University, Raleigh, North Carolina.
6. Basili V.R., and Rombach H.D. The TAME project: towards improvement-oriented software environments. IEEE Transactions on Software Engineering 14 6 (June 1988) 758-773
7. Beck K., and Fowler M. Planning Extreme Programming (October 2000), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA
8. Boehm B.W., Abts C., Brown A.W., Chulani S., Clark B.K., Horowitz E., Madachy R., Refer D., and Steece B. Software Cost Estimation with COCOMO II (2000), Prentice Hall PTR, Upper Saddle River, NJ, USA
9. Boehm B., Abts C., and Chulani S. Software development cost estimation approaches - a survey. Annals of Software Engineering 10 (2000), Springer, Netherlands 177-205
10. Boehm B.W. Software Engineering Economics (1981), Prentice Hall PTR, Upper Saddle River, NJ, USA
11. Breiman L., Friedman J., Ohlsen R., and Stone C. Classification and Regression Trees (1984), Wadsworth & Brooks/Cole Advanced Books & Software, Monterey, CA, USA
12. Briand L.C., and Wieczorek I. Software resource estimation. In: Marciniak J.J. (Ed). Encyclopedia of Software Engineering. Encyclopedia of Software Engineering Volume 2 (2002), John Wiley & Sons, Inc., New York, NY, USA 1160-1196
13. Briand L., Langley T., and Wieczorek I. A replicated assessment and comparison of common software cost modeling techniques. Proceedings of the 22nd International Conference on Software Engineering, Limerick, Ireland (2000)
14. Briand L.C., El Emam K., and Bomarius F. CoBRA: A hybrid method for software cost estimation, benchmarking and risk assessment. Proceedings of the 20th International Conference on Software Engineering (1998) 390-399
15. Briand L.C., Basili V.R., and Thomas W.M. A pattern recognition approach for software engineering data analysis. IEEE Transactions on Software Engineering 18 11 (November 1992) 931-942
16. Burgess C.J., and Lefley M. Can genetic programming improve software effort estimation? A comparative evaluation. Information and Software Technology 43 14 (2001) 813-920
17. Calzolari F., Tonella P., and Antoniol G. Maintenance and testing effort modeled by linear and nonlinear dynamic systems. Information and Software Technology 43 8 (July 2001) 477-486
18. Chulani S., Boehm B.W., and Steece B. Bayesian analysis of empirical software engineering cost models. IEEE Transactions on Software Engineering 25 4 (July/August 1999) 573-583
19. Cuelenaere A.M.E., van Genuchten M.J.I.M., and Heemstra F.J. Calibrating software cost estimation model: Why and how. Information and Software Technology 29 10 (December 1987) 558-567
20. De Lucia A., Pompella E., and Stefanucci S. Assessing effort estimation models for corrective maintenance through empirical studies. Information and Software Technology 47 (2004) 3-15
21. Dolado J.J. On the problem of the software cost function. Information and Software Technology 43 (2001) 61-72
22. Elkjaer M. Stochastic budget simulation. International Journal of Project Management 18 2 (April 2000) 139-147
23. Fenton N., Marsh W., Neil M., Cates P., Forey S., and Tailor M. Making resource decisions for software projects. Proceedings of the 26th International Conference on Software Engineering (May 2004) 397-406
24. Ferens D.V., and Christensen D.S. Does calibration improve predictive accuracy?. Cross-Talk: The Journal of Defense Software Engineering 4 (April 2000) 14-17
25. Feller W. An Introduction to Probability - Theory and Its Application (1971), John Wiley & Sons, NY
26. Garratt P.W., and Hodgkinson A.C. A neurofuzzy cost estimator. Proceedings of the 3rd International Conference Software Engineering and Applications, Arizona, USA (October 1999) 401-406
27. Gartner Inc. press releases, Gartner Survey of 1,300 CIOs Shows IT Budgets to Increase by 2.5 Percent in 2005, 14th January 2005. http://www.gartner.com/press_releases/pr2005.html
28. Gartner Inc. press releases, Gartner Says Worldwide IT Services Revenue Grew 6.7 Percent in 2004, 8th February 2005. http://www.gartner.com/press_releases/pr2005.html
29. Gray A., and MacDonell S. Applications of fuzzy logic to software metric models for development effort estimation. Proceedings of the Annual Meeting of the North American Fuzzy Information Processing Society, Syracuse NY, USA (1997) 394-399
30. Guo Tong, Li Aiqun, and Miao Changqing. Monte Carlo numerical simulation and its application in probability analysis of long span bridge. Journal of Southeast University (English Edition) 21 4 (December 2005) 469-473 China
31. Hayashi I., and Iwatsuki N. Universal FFT and its application. Journal of the Japan Society of Precision Engineering 25 1 (1990) 70-75
32. Heiat A. Comparison of artificial neural network and regression models for estimating software development effort. Information and Software Technology 44 15 (December 2002) 911-922
33. Helton J.C., and Davis F.J. Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems. Reliability Engineering and System Safety 81 1 (2003) 23-69
34. Hörts M., and Wohlin C. A subjective effort estimation experiment. Information and Software Technology 39 11 (1997) 755-762
35. Huang S.-J., Lin C.-Y., and Chiu N.-H. Fuzzy decision tree approach for embedding risk assessment information into software cost estimation model. Journal of Information Science and Engineering 22 2 (March 2006) 297-313
36. Huang X., Capretz L.F., Ren J., and Ho D.A. Neuro-fuzzy model for software cost estimation. Proceedings of the 3rd International Conference on Quality Software (2003)
37. Idri A., Abran A., Khoshgoftaar T., and Robert S. Estimating software project effort by analogy based on linguistic values. Proceedings of the 8th International Symposium on Software Metrics, IEEE computer Society, Ottawa, Canada (June 2002) 21-30
38. Idri A., Kjiri L., and Abran A. COCOMO cost model using fuzzy logic. Proceeding of the 7th International Conference on Fuzzy Theory & Technology, Atlantic City, New Jersey (February-March 2000)
39. Jensen R.W., Putnam L.H., and Roetzheim W. Software estimating models: Three viewpoints. Cross-Talk, The Journal of Defense Software Engineering 2 (February 2006) 23-29
40. Jensen R.W. An improved macro-level software development resource estimation model. Proceedings of the 5th International Society of Parametric Analysts Conference, St. Louis, MO (April 1983) 88-92
41. Jensen R.W. A macro-level software development cost estimation methodology. Proceedings of the 14th Asilomar Conference on Circuits, Systems and Computers, Pacific Grove, CA (November 1980)
42. Johnson P.M., Moore C.A., Dane J.A., and Brwer R.S. Empirically guided software effort guesstimation. IEEE Software 17 6 (November/December 2000) 51-56
43. Jones T.C. Estimating Software Costs (1998), McGraw-Hill, Inc., Hightstown, NJ, USA
44. Jørgensen M. Practical guidelines for better support of expert judgment-based software effort estimation. IEEE Software 22 3 (May/June 2005) 57-63
45. Jørgensen M. Realism in effort estimation uncertainty assessments: it matters how you ask. IEEE Transactions on Software Engineering 30 4 (April 2004) 209-217
46. Jørgensen M. Experience with the accuracy of software maintenance task effort prediction models. IEEE Transactions on Software Engineering 21 8 (1995) 674-681
47. Jørgensen M., and Shepperd M. A systematic review of software development cost estimation studies. IEEE Transactions on Software Engineering 33 1 (2007) 33-53
48. Kadoda G., Cartwright M., and Shepperd M. Issues on the effective use of CBR technology for software project prediction. Proceedings of the 4th International Conference on Case-Based Reasoning: Case-Based Reasoning Research and Development (August 2001) 276-290
49. Kalos M.H., and Whitlock P.A. Monte Carlo Methods-Volume I: Basics (1986), A Wiley-Interscience Publication, NY
50. Kitchenham B.A., Pickard L., Linkman S.G., and Jones P. A framework for evaluating a software bidding model. Information and Software Technology 47 11 (May 2005) 747-760
51. Kitchenham B., Pickard L.M., Linkman S., and Jones P.W. Modeling software bidding risks. IEEE Transactions on Software Engineering 29 6 (June 2003) 542-554
52. Kitchenham B. A procedure for analyzing unbalanced datasets. IEEE Transactions on Software Engineering 24 4 (1998) 278-301
53. Kitchenham B. Empirical studies of the assumptions that underline software cost-estimation models. Information and Software Technology 34 4 (1992) 211-218
54. L'Ecuyer P. Efficiency improvement and variance reduction. Proceedings of The Winter Simulation Conference (1994)
55. Lee A., Cheng C.H., and Balakrishnan J. Software development cost estimation: integrating neural network with cluster analysis. Information and Management 34 1 (August 1998) 1-9
56. Li J., and Ruhe G. A comparative study of attribute weighting heuristics for effort estimation by analogy. Proceedings of the International Symposium on Empirical Software Engineering, Rio de Janeiro, Brazil (2006) 66-74
57. Liang T., and Noore A. Multistage software estimation. Proceedings of the 35th Southeastern Symposium on System Theory (March 2003) 232-236
58. Loève M. 3.print. Graduate texts in mathematics. 4. ed. (1987), Springer, New York (45)
59. Lother M., and Dumke R. Point metrics. Comparison and analysis. Dumke/Abran: Current Trends in Software Measurement (2001), Shaker Publication, Aachen, Germany 228-267
60. MacDonell S.G. Establishing relationships between specification size and software process effort in CASE environments. Information and Software Technology 39 1 (1997) 35-45
61. MacDonell S.G., and Gray A.R. Alternatives to regression models for estimating software projects. Proceedings of the IFPUG Fall Conference, Dallas TX (1996)
62. Mair C., and Shepperd M.J. An investigation of rule induction based prediction systems. Proceeding of the IEEE ICSE Workshop on Empirical Studies of Software Development and Evolution (May 1999)
63. McKay M.D., Beckman R.J., and Conover W.J. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21 2 (1979) 239-245
64. Mendes E., Watson I., Chris T., Nile M., and Steve C. A comparative study of cost estimation models for web hypermedia applications. Empirical Software Engineering 8 2 (2003) 163-196
65. Menzies T., Port D., Chen Z., Hihn J., and Stukes S. Validation methods for calibrating software effort models. Proceedings of the 27th International Conference on Software Engineering (May 2005) 587-595
66. Miyazaki Y., Terakado M., Ozaki K., and Nozaki H. Robust regression for developing software estimation models. Journal of Systems and Software 27 (1994) 3-16
67. Moløkken-Østvold K.J., and Jørgensen M. Group processes in software effort estimation. Empirical Software Engineering 9 4 (December 2004) 315-334
68. Mukhopadhyay T., Vicinanza S.S., and Prietula M.J. Examining the feasibility of a case-based reasoning model for software effort estimation. MIS Quarterly 16 2 (June 1992) 155-171
69. Musilek P., Pedrycz W., and Succi G. Software cost estimation with fuzzy models. ACM SIGAPP Applied Computing Review 8 2 (2000) 24-29
70. Ohsugi N., Tsunoda M., Monden A., and Matsumoto K. Applying collaborative filtering for effort estimation with process metrics. Proceedings of the 5th International Conference on Product Focused Software Process Improvement, Kyoto, Japan (April 2004) 274-286 3009
71. Owen A.B. Monte Carlo variance of scrambled equidistribution quadrature. Journal on Numerical Analysis 34 5 (1997) 1884-1910
72. Pawlak Z. Rough Sets: Theoretical Aspects of Reasoning About Data (1991), Kluwer Academic Publishers, Boston, MA, USA
73. Pendharkar P.C., Subramanian G.H., and Rodger J.A. A probabilistic model for predicting software development effort. IEEE Transactions on Software Engineering 31 7 (July 2005) 615-624
74. Putnam L.H., and Myers W. Five Core Metrics (2003), Dorset House, New York
75. Putnam L.H., and Myers W. What we have learned. Cross-Talk: The Journal of Defense Software Engineering 6 (June 2000) 21-24
76. Reifer D.J. SoftCost-R: User experiences and lessons learned at the age of one. Journal of Systems and Software 7 4 (December 1987) 279-286
77. @RISK 4.5 User's Guide (October, 2004), Palisade Corporation
78. Rodriguez D., Cuadrado-Gallego J.J., and Aguilar J. Using genetic algorithms to generate estimation models. Proceedings of the International Workshop on Software Measurement and Metrik Kongress, Potsdam, Germany (2006)
79. Samson B., Ellison D., and Dugard P. Software cost estimation using an Albus perceptron (CMAC). Information and Software Technology 39 1 (1997) 55-60
80. Sentas P., Angelis L., Stamelos I., and Bleris G.L. Software productivity and effort prediction with ordinal regression. Journal of Information & Software Technology 47 1 (January 2005) 17-29
81. Shan Y., McKay R.I., Lokan C.J., and Essam D.L. Software project effort estimation using genetic programming. Proceedings of the International Conference on Communications, Circuits and Systems, Chengdu, China (July 2002) 1108-1112
82. Shepperd M., and Cartwright M. Predicting with sparse data. IEEE Transactions on Software Engineering 27 11 (2001) 987-998
83. Shepperd M., and Kadoda G. Comparing software prediction techniques using simulation. IEEE Transactions on Software Engineering 27 11 (November 2001) 1014-1022
84. Shepperd M., and Schofield C. Estimating software project effort using analogies. IEEE Transactions on Software Engineering 23 12 (1997) 736-743
85. Shin M., and Goel A.L. Empirical data modeling in software engineering using radial basis functions. IEEE Transactions on Software Engineering 26 6 (June 2000) 567-576
86. Shukla K.K. Neuro-genetic prediction of software development effort. Information and Software Technology 42: (2000) 701-713
87. Smith R.K., Hale J.E., and Parrish A.S. An empirical study using task assignment patterns to improve the accuracy of software effort estimation. IEEE Transactions on Software Engineering 27 3 (March 2001) 264-271
88. Sobol I.M. The Monte Carlo Method (1974), The University of Chicago Press, Chicago
89. Song Q., Shepperd M., and Mair C. Using grey relational analysis to predict software effort with small data sets. Proceedings of the 11th IEEE International Software Metrics Symposium, Como, Italy (2005) 35-45
90. Spector P. Summated Rating Scale Construction (1992), Sage Publications, Newbury Park, CA, USA
91. Srinivasan K., and Fisher D. Machine learning approaches to estimating software development effort. IEEE Transactions on Software Engineering 21 2 (1995) 126-137
92. Stamelos I., and Angelis L. Managing uncertainty in project portfolio cost estimation. Information and Software Technology 43: 13 (November 2001) 759-768
93. Stamelos I., Angelis L., and Sakellaris E. BRACE: Bootstrap based analogy cost estimation. Proceedings of the 12th European Software Control Metrics, London, UK (April 2001) 17-23
94. StatSoft Inc. Statistica 7 Data Miner. http://www.statsoft.com
95. Stroud A.H. Approximate Calculation of Multiple Integrals (1971), Prentice-Hall, New Jersey
96. Taff L.M., Brochering J.W., and Hudgins W.R. Estimeetings: Development estimates and a front-end process for a large project. IEEE Transactions on Software Engineering 17 8 (1991) 839-849
97. Trendowicz A., Heidrich J., Münch J., Ishigai Y., Yokoyama K., and Kikuchi N. Development of a hybrid cost estimation model in an iterative manner. Proceeding to 28th International Conference on Software Engineering ICSE, Shanghai, China (2006)
98. The Standish Group. CHAOS Chronicles (2005), The Standish Group International, Inc., West Yarmouth, MA
99. Vose D. Quantitative Risk Analysis. A Guide to Monte Carlo Simulation Modelling (1996), John Wiley & Sons, Chichester
100. Walkerden F., and Jeffery R. An empirical study on analogy-based software effort estimation. Empirical Software Engineering 4 (1999) 135-158
101. Walkerden F., and Jeffery R. Software cost estimation: A review of models, process, and practice. Advances in Computers 44 (1997) 59-125
102. Wieczorek I. Improved software cost estimation - a robust and interpretable modelling method and a comprehensive empirical investigation. Empirical Software Engineering 7 2 (2002) 177-180
103. Wohlin C., Runeson P., Höst M., Ohlsson M., Regnell B., and Wesslen A. Experimentation in Software Engineering. An Introduction (2000), Kluwer Academic Publishers, Boston
104. Xu Z., and Khoshgoftaar T.M. Identification of fuzzy models of software cost estimation. Fuzzy Sets and Systems 145 1 (2004) 141-163
105. Yang D., Wan Y., Tang Z., Wu S., He M., and Li M. COCOMO-U: An extension of COCOMO II for cost estimation with uncertainty. In: Wang Q., et al. (Ed). Software Process Change, SPW/ProSim. LNCS 3966 (2006), Springer-Verlag, Berlin, Heidelberg 32-141
106. Zadeh L.A. Fuzzy sets. Information and Control 8 (April 1965) 338-353
107. Zou T., Mahadevan S., Mourelatos Z., and Meernik P. Reliability analysis of automotive body-door subsystem. Reliability Engineering & System Safety 78 3 (December 2002) 315-324