Analogy-based software development effort estimation: A systematic mapping and review

Information and Software Technology

Volumn 58, Issue , 2015, Pages 206-230

  Idri, Ali ^a   Amazal, Fatima Azzahra ^a   Abran, Alain ^b  

^a ENSIAS   (Morocco)

^b ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

Author keywords

Analogy; Case based reasoning; Mapping study; Software development effort estimation; Systematic literature review

Indexed keywords

CASE BASED REASONING; FUZZY LOGIC; GENETIC ALGORITHMS; MAPPING;

ANALOGY; CLASSIFICATION CRITERION; ENGINEERING COMMUNITY; ESTIMATION TECHNIQUES; MAPPING STUDIES; SOFTWARE DEVELOPMENT EFFORT; SOFTWARE DEVELOPMENT EFFORT PREDICTIONS; SYSTEMATIC LITERATURE REVIEW;

SOFTWARE DESIGN;

EID: 85027945931     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2014.07.013     Document Type: Review

References (91)

1. J. Wen, S. Li, Z. Lin, Y. Huc, C. Huang, Systematic literature review of machine learning based software development effort estimation models, Inf. Softw. Technol. 54 (1) (2012) 41-59.
2. M. Jørgensen, M. Shepperd, A systematic review of software development cost estimation studies, IEEE Trans. Software Eng. 33 (1) (2007) 33-53.
3. M. Shepperd, C. Schofield, Estimating software project effort using analogies, IEEE Trans. Software Eng. 23 (11) (1997) 736-743.
4. M. Azzeh, D. Neagu, P. Cowling, Software effort estimation based on weighted fuzzy grey relational analysis, in: Proceedings of the 5th International Conference on Predictor Models in Software Engineering, Vancouver, British Columbia, Canada, 2009, pp. 1-10.
5. Y.F. Li, M. Xie, T.N. Goh, A study of project selection and feature weighting for analogy-based software cost estimation, J. Syst. Softw. 82 (2) (2009) 241-252.
6. M. Azzeh, A replicated assessment and comparison of adaptation techniques for analogy-based effort estimation, Emp. Softw. Eng. 17 (1-2) (2012) 90-127.
7. J. Li, G. Ruhe, A. Al-Emran, M. Richter, A flexible method for software effort estimation by analogy, Emp. Softw. Eng. 12 (1) (2007) 65-106.
8. M. Azzeh, D. Neagu, P. Cowling, Analogy-based software effort estimation using fuzzy numbers, J. Syst. Softw. 84 (2) (2011) 270-284.
9. Y.F. Li, M. Xie, T.N. Goh, A study of the non-linear adjustment for analogy based software cost estimation, Emp. Softw. Eng. 14 (6) (2009) 603-643.
10. N.-H. Chiu, S.-J. Huang, The adjusted analogy-based software effort estimation based on similarity distances, J. Syst. Softw. 80 (4) (2007) 628-640.
11. L. C. Briand, T. Langley, I. Wieczorek, A replicated assessment and comparison of common software cost modeling techniques, in: Proceedings of the 22nd International Conference on Software Engineering, Limerick, Ireland, 2000, pp. 377-386.
12. I. Myrtveit, E. Stensrud, A controlled experiment to assess the benefits of estimating with analogy and regression models, IEEE Trans. Softw. Eng. 25 (4) (1999) 510-525.
13. C. Mair, M. Shepperd, The consistency of empirical comparisons of regression and analogy-based software project cost prediction, in: Proceedings of the 4th International Symposium on Empirical Software Engineering, Noosa Heads, Australia, 2005, pp. 509-518.
14. B. Kitchenham, S. Charters, Guidelines for Performing Systematic Literature Reviews in Software Engineering, Tech. Rep. EBSE-2007-01, Keele University and University of Durham, 2007.
15. B. Kitchenham, D. Budgen, O.P. Brereton, The value of mapping studies - A participant-observer case study, in: Proceedings of the 14th International Conference on Evaluation and Assessment in Software Engineering, Keele University, UK, 2010, pp. 1-9.
16. B. Kitchenham, E. Mendes, G. H. Travassos, A systematic review of cross vs. within company cost estimation studies, in: Proceedings of the Empirical Assessment in Software Engineering (EASE) Conference, 2006, pp. 89-98.
17. J. P. Higgins, S. Green, Cochrane Handbook for Systematic Reviews of Interventions, Version 5.0.2 [updated September 2009], The Cochrane Collaboration, 2009 〈http://www.cochrane-handbook.org〉.
18. Computer science conference rankings CORE, 2011 〈http://lamp.infosys.deakin.edu.au/era/?page=cforse110〉.
19. A. Fernandez, E. Insfran, S. Abrahão, Usability evaluation methods for the web: a systematic mapping study, Inf. Softw. Technol. 53 (8) (2011) 789-817.
20. R.J. Light, D.B. Pillemer, Summing Up: The Science of Reviewing Research, Harvard University Press, Cambridge, MA, USA, 1984.
21. J.W. Keung, Empirical evaluation of analogy-X for software cost estimation, in: Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, Kaiserslautern, Germany, 2008, pp. 294-296.
22. J.W. Keung, B. Kitchenham, Optimising project feature weights for analogy-based software cost estimation using the Mantel correlation, in: Proceedings of the 14th Asia-Pacific Software Engineering Conference, Aichi, Japan, 2007, pp. 222-229.
23. J.W. Keung, B. Kitchenham, Experiments with analogy-X for software cost estimation, in: Proceedings of the 19th Australian Conference on Software Engineering, 2008, pp. 229-238.
24. J.W. Keung, B. Kitchenham, D.R. Jeffery, Analogy-X: providing statistical inference to analogy-based software cost estimation, IEEE Trans. Softw. Eng. 34 (4) (2008) 471-484.
25. L. Angelis, I. Stamelos, A simulation tool for efficient analogy based cost estimation, Emp. Softw. Eng. 5 (1) (2000) 35-68.
26. N. Mittas, M. Athanasiades, L. Angelis, Improving analogy-based software cost estimation by a resampling method, Inf. Softw. Technol. 50 (3) (2008) 221-230.
27. I. Stamelos, L. Angelis, Managing uncertainty in project portfolio cost estimation, Inf. Softw. Technol. 43 (13) (2001) 759-768.
28. I. Stamelos, L. Angelis, M. Morisio, E. Sakellarisc, G.L. Bleris, Estimating the development cost of custom software, Inform. Manage. 40 (8) (2003) 729-741.
29. M. Azzeh, D. Neagu, P. Cowling, Software project similarity measurement based on fuzzy C-means, in: Proceedings of the International Conference on Software Process, Leipzig, Germany, 2008, pp. 123-134.
30. M. Azzeh, D. Neagu, P. Cowling, Improving analogy software effort estimation using fuzzy feature subset selection algorithm, in: Proceedings of the 4th International Workshop on Predictor Models in Software Engineering, Leipzig, Germany, 2008, pp. 71-78.
31. M. Azzeh, D. Neagu, P. Cowling, Fuzzy grey relational analysis for software effort estimation, Emp. Softw. Eng. 15 (1) (2010) 60-90.
32. A. Idri, A. Abran, A fuzzy logic based set of measures for software project similarity validation and possible improvement, in: Proceedings of the 7th International Symposium on Software Metrics, London, UK, 2001, pp. 85-96.
33. A. Idri, A. Abran, Evaluating software project similarity by using linguistic quantifier guided aggregations, in: Proceedings of the Joint 9th IFSA World Congress and 20th NAFIPS International Conference, Vancouver, British Columbia, Canada, 2001, pp. 470-475.
34. A. Idri, A. Abran, T. M. Khoshgoftaar, Estimating software project effort by analogy based on linguistic values, in: Proceedings of the Eighth IEEE Symposium on Software Metrics, 2002, pp. 21-30.
35. A. Idri, T.M. Khosgoftaar, A. Abran, Investigating soft computing in case-based reasoning for software cost estimation, Eng. Intell. Syst. 10 (3) (2002) 147-157.
36. A. Idri, A. Zahi, E. Mendes, A. Abran, Software cost estimation by fuzzy analogy for Web hypermedia applications, in: Proceedings of the International Conference on Software Process and Product Measurement, Cadiz, Spain, 2006, pp. 53-62.
37. A. Idri, A. Zakrani, A. Abran, Functional equivalence between radial basis function neural networks and fuzzy analogy in software cost estimation, in: Proceedings of the 3rd IEEE international Conference in Information and Communication Technologies: From Theory to Application, Damas, Syria, 2008, pp. 1-5.
38. R. Premraj, M. Shepperd, M. Cartwright, Meta-data to guide retrieval in CBR for software cost prediction, in: Proceedings of the 8th UK Workshop on Case-based Reasoning, 2003, pp. 26-37.
39. S.-J. Huang, N.-H. Chiu, Optimization of analogy weights by genetic algorithm for software effort estimation, Inf. Softw. Technol. 48 (11) (2006) 1034-1045.
40. D. Milios, I. Stamelos, C. Chatzibagias, Global optimization of analogy-based software cost estimation with genetic algorithms, in: Proceedings of EANN/AIAI (2), 2011, pp. 350-359.
41. J.M. Desharnais, Analyse statistique de la productivité des projets de développement en informatique à partir de la technique des points de fonction, Master's thesis, University of Montreal, 1989.
42. International Software Benchmarking Standards Group (ISBSG), 〈http://www.isbsg.org〉.
43. A.J. Albrecht, J.E. Gaffney, Software function, source lines of code, and development effort prediction: a software science validation, IEEE Trans. Softw. Eng. 9 (6) (1983) 639-648.
44. B.W. Boehm, Software Engineering Economics, Prentice Hall PTR, New Jersey, 1981.
45. C.F. Kemerer, An empirical validation of software cost estimation models, Commun. ACM 30 (5) (1987) 416-429.
46. K.D. Maxwell, Applied Statistics for Software Managers, Prentice-Hall, Upper Saddle River, 2002.
47. A. Abran, P.N. Robillard, Function point analysis: an empirical study of its measurement processes, IEEE Trans. Softw. Eng. 22 (12) (1996) 895-910.
48. G. Boetticher, T. Menzies, T. Ostrand, PROMISE Repository of empirical software engineering data repository, West Virginia University, Department of Computer Science 〈http://promisedata.org/〉.
49. L.C. Briand, K. El Emam, D. Surmann, I. Wieczorek, K.D. Maxwell, An assessment and comparison of common software cost estimation modeling techniques, in: Proceedings of the 21st International Conference on Software Engineering, Los Angeles, CA, 1999, pp. 313-323.
50. M. Shepperd, G. Kadoda, Comparing software prediction techniques using simulation, IEEE Trans. Softw. Eng. 27 (11) (2001) 1014-1022.
51. S.G. MacDonell, M.J. Shepperd, Combining techniques to optimize effort predictions in software project management, J. Syst. Softw. 66 (2) (2003) 91-98.
52. M. Jørgensen, Forecasting of software development work effort: evidence on expert judgment and formal models, Int. J. Forecast. 23 (3) (2007) 449-462.
53. M. Shepperd, C. Schofield, B. Kitchenham, Effort estimation using analogy, in: Proceedings of the 18th International Conference on Software Engineering, Berlin, 1996, pp. 170-178.
54. T. Mukhopadhyay, S. Steven, M. Vicinanza, J. Prietula, Examining the feasibility of a case-based reasoning model for software effort estimation, MIS Quart. 16 (2) (1992) 155-171.
55. S. Schulz, CBR-Works, in: Proceedings of the 7th German Workshop on Case-Based Reasoning, Heidelberg, German, 1999, pp. 3-5.
56. I. Stamelos, L. Angelis, E. Sakellaris, BRACE: bootstrap-based analogy cost estimation, in: Proceedings of the 12th European Software Control Metrics, 2001, pp. 17-23.
57. M. Auer, S. Biffl, Increasing the accuracy and reliability of analogy-based cost estimation with extensive project feature dimension weighting, in: Proceedings of the 2004 International Symposium on Empirical Software Engineering, 2004, pp. 147-155.
58. E. Kocaguneli, T. Menzies, A. Bener, J.W. Keung, Exploiting the essential assumptions of analogy-based effort estimation, IEEE Trans. Softw. Eng. 38 (2) (2012) 425-438.
59. R. Bisio, F. Malabocchia, Cost estimation of software projects through case-based reasoning, in: Proceedings of the First International Conference on Case-Based Reasoning Research and Development, 1995, pp. 11-22.
60. F. Walkerden, R. Jeffery, An empirical study of analogy-based software effort estimation, Emp. Softw. Eng. 4 (2) (1999) 135-158.
61. J.W. Keung, Theoretical maximum prediction accuracy for analogy-based software cost estimation, in: Proceedings of the 15th Asia-Pacific Software Engineering Conference, Beijing, China, 2008, pp. 495-502.
62. T. Foss, E. Stensrud, B. Kitchenham, I. Myrtveit, A simulation study of the model evaluation criterion MMRE, IEEE Trans. Softw. Eng. 29 (11) (2003) 985-995.
63. H. Al-Sakran, Software cost estimation model based on integration of multiagent and case-based reasoning, J. Comp. Sci. 2 (3) (2006) 276-282.
64. M. Auer, A. Trendowicz, B. Graser, E. Haunschmid, S. Biffl, Optimal project feature weights in analogy-based cost estimation: improvement and limitations, IEEE Trans. Softw. Eng. 32 (2) (2006) 83-92.
65. M. Azzeh, Adjusted case-based software effort estimation using bees optimization algorithm, in: Proceedings of the 15th International Conference on Knowledge-based and Intelligent Information and Engineering Systems, 2011, pp. 315-324.
66. M. Azzeh, Model tree based adaption strategy for software effort estimation by analogy, in: Proceedings of the 2011 IEEE 11th International Conference on Computer and Information Technology, 2011, pp. 328-335.
67. M. Jørgensen, U. Indahl, D. Sjøb, Software effort estimation by analogy and "regression toward the mean", J. Syst. Softw. 68 (3) (2003) 253-262.
68. G. Kadoda, M. Cartwright, L. Chen, M. Shepperd, Experiences using case-based reasoning to predict software project effort, in: Proceedings of the Conference on Evaluation and Assessment in Software Engineering, Keele University, UK, 2000, pp. 23-28.
69. Y. Kamei, J. W. Keung, A. Monden, K.-I. Matsumoto, An over-sampling method for analogy-based software effort estimation, in: Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, Kaiserslautern, Germany, 2008, pp. 312-314.
70. C. Kirsopp, E. Mendes, R. Premraj, M. Shepperd, An empirical analysis of linear adaptation techniques for case-based prediction, in: Proceedings of the 5th International Conference on Case-Based Reasoning: Research and Development, 2003, pp. 231-245.
71. C. Kirsopp, M. Shepperd, J. Hart, Search heuristics, case-based reasoning and software project effort prediction, in: Proceedings of the Genetic and Evolutionary Computation Conference, 2002, pp. 1367-1374.
72. E. Kocaguneli, T. Menzies, How to find relevant data for effort estimation, in: Proceedings of the 2011 International Symposium on Empirical Software Engineering and Measurement, Banff, Canada, 2011, pp. 255-264.
73. M. V. Kosti, N. Mittas, L. Angelis, DD-EbA: An algorithm for determining the number of neighbors in cost estimation by analogy using distance distributions, in: Proceedings of the 3D Artificial Intelligence Techniques in Software Engineering Workshop, Larnaca, Cyprus, 2010.
74. T. K. Le-Do, K.-A. Yoon, Y.-S. Seo, D.-H. Bae, Filtering of inconsistent software project data for analogy-based effort estimation, in: Proceedings of the 2010 IEEE 34th Annual Computer Software and Applications Conference, Seoul, Korea, 2010, pp. 503-508.
75. S. Letchmunan, M. Roper, M. Wood, Investigating effort prediction of webbased applications using CBR on the ISBSG dataset, in: Proceedings of the 14th International Conference on Evaluation and Assessment in Software Engineering, 2010, pp. 15-24.
76. J. Li, A. Al-Emran, G. Ruhe, Impact analysis of missing values on the prediction accuracy of analogy-based software effort estimation method AQUA, in: Proceedings of the First International Symposium on Empirical Software Engineering and Measurement, Madrid, Spain, 2007, pp. 126-135.
77. J. Li, G. Ruhe, Decision support analysis for software effort estimation by analogy, in: Proceedings of the 3d International Workshop on Predictor Models in Software Engineering, 2007.
78. J. Li, G. Ruhe, Analysis of attribute weighting heuristics for analogy-based software effort estimation method AQUA+, Emp. Softw. Eng. 13 (1) (2008) 63-96.
79. Y.F. Li, M. Xie, T.N. Goh, A study of analogy-based sampling for interval based cost estimation for software project management, in: Proceedings of the 4th IEEE International Conference on Management of Innovation and Technology, Bangkok, Thailand, 2008, pp. 281-286.
80. Y.F. Li, M. Xie, T.N. Goh, A study of mutual information-based feature selection for case-based reasoning in software cost estimation, Expert Syst. Appl. 36 (3) (2009) 5921-5931.
81. E. Mendes, S. Counsell, N. Mosley, Towards the prediction of development effort for hypermedia applications, in: Proceedings of the 12th ACM Conference on Hypertext and Hypermedia, 2000, pp. 249-258.
82. E. Mendes, S. Counsell, N. Mosley, Measurement and effort prediction for Web applications, in: Proceeding of Web Engineering, Software Engineering and Web Application Development, 2001, pp. 295-310.
83. E. Mendes, N. Mosley, Further investigation into the use of CBR and stepwise regression to predict development effort for web hypermedia applications, in: Proceedings of the 2002 International Symposium on Empirical Software Engineering, 2002, pp. 79-90.
84. E. Mendes, N. Mosley, S. Counsell, A replicated assessment of the use of adaptation rules to improve web cost estimation, in: Proceedings of the 2003 International Symposium on Empirical Software Engineering, 2003, pp. 100-109.
85. E. Mendes, I. Watson, C. Triggs, N. Mosley, S. Counsell, A comparative study of cost estimation models for web hypermedia applications, Emp. Softw. Eng. 8 (2) (2003) 163-196.
86. N. Mittas, L. Angelis, Combining regression and estimation by analogy in a semi-parametric model for software cost estimation, in: Proceedings of the First Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, Kaiserslautern, Germany, 2008, pp. 70-79.
87. N. Mittas, L. Angelis, LSEbA: least squares regression and estimation by analogy in a semi-parametric model for software cost estimation, Emp. Softw. Eng. 15 (5) (2010) 523-555.
88. N. Ohsugi, A. Monden, N. Kikuchi, M. D. Barker, Is this cost estimate reliable? - The relationship between homogeneity of analogues and estimation reliability, in: Proceedings of the First International Symposium on Empirical Software Engineering and Measurement, Madrid, Spain, 2007, pp. 384-392.
89. A. Tosun, B. Turhan, A.B. Bener, Feature weighting heuristics for analogy-based effort estimation models, Expert Syst. Appl. 36 (7) (2009) 10325-10333.
90. M. Tsunoda, A. Monden, T. Kakimoto, K. Matsumoto, An empirical evaluation of outlier deletion methods for analogy-based cost estimation, in: Proceedings of the 7th International Conference on Predictive Models in Software Engineering, Banff, Canada, 2011.
91. J. Wen, S. Li, L. Tang, Improve analogy-based software effort estimation using principal components analysis and correlation weighting, in: Proceedings of the 16th Asia-Pacific Software Engineering Conference, Penang, Malaysia, 2009, pp. 179-186.