Software effort estimation as a multiobjective learning problem

ACM Transactions on Software Engineering and Methodology

Volumn 22, Issue 4, 2013, Pages

  Minku, Leandro L ^a   Yao, Xin ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Ensembles of learning machines; Multiobjective evolutionary algorithms; Software effort estimation

Indexed keywords

BASE MODELS; ENSEMBLES OF LEARNING MACHINES; MODEL CREATION; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; MULTI-OBJECTIVE LEARNING; OPTIMISATIONS; PERFORMANCE MEASURE; SOFTWARE EFFORT ESTIMATION;

LEARNING SYSTEMS;

EVOLUTIONARY ALGORITHMS;

EID: 84884946446     PISSN: 1049331X     EISSN: 15577392     Source Type: Journal    
DOI: 10.1145/2522920.2522928     Document Type: Article

References (62)

1. AGARWAL, R., KUMAR, M., MALLICK, Y. S., BHARADWAJ, R. M., AND ANANTWAR, D. 2001. Estimating software projects. Softw. Eng. Notes 16, 4, 60-67.
2. BASKELES, B., TURHAN, B., AND BENER, A. 2007. Software effort estimation using machine learning methods. In Proceedings of ISCIS'07. 1-6.
3. BISHOP, C. M. 2005. Neural Networks for Pattern Recognition. Oxford University Press, UK.
4. BOEHM, B. 1981. Software Engineering Economics. Prentice-Hall, Englewood Cliffs, NJ.
5. BOEHM, B., ABTS, C., BROWN, A. W., CHULANI, S., CLARK, B. K., HOROWITZ, E., MADACHY, R., REIFER, D. J., AND STEECE, B. 2000. Software Cost Estimation with COCOMO II. Prentice-Hall, Englewood Cliffs, NJ.
6. BRAGA, P. L., OLIVEIRA, A., RIBEIRO, G., AND MEIRA, S. 2007. Bagging predictors for estimation of software project effort. In Proceedings of IJCNN'07. 1595-1600.
7. BREIMAN, L. 1996. Bagging predictors. Mach. Learn. 24, 2, 123-140.
8. BROWN, G.,WYATT, J., HARRIS, R., AND YAO, X. 2005. Diversity creation methods: A survey and categorisation. Inf. Fusion 6, 5-20.
9. CARTWRIGHT, M. H., SHEPPERD, M. J., AND SONG, Q. 2003. Dealing with missing software project data. In Proceedings of METRICS'03. 154-165.
10. CHANDRA, A. AND YAO, X. 2006. Ensemble learning using multi-objective evolutionary algorithms. J. Math. Modell. Algor. 5, 4, 417-445.
11. CHEN, H. AND YAO, X. 2009. Regularized negative correlation learning for neural network ensembles. IEEE Trans. Neural Netw. 20, 12, 1962-1979.
12. CHULANI, S., BOHEM, B., AND STEECE, B. 1999. Bayesian analysis of empirical software engineering cost models. IEEE Trans. Softw. Eng. 25, 4, 573-583.
13. COHEN, J. 1992. A power primer. Psych. Bull. 112, 155-159.
14. DEB, K., PRATAP, A., AGARWAL, S., AND MEYARIVAN, T. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evalut. Computa. 6, 2, 182-197.
15. DEJAEGER, K., VERBEKE, W., MARTENS, D., AND BAESENS, B. 2012. Data mining techniques for software effort estimation: A comparative study. IEEE Trans. Softw. Eng. 38, 2, 375-397.
16. DEM?SAR, J. 2006. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Rese. 7, 130.
17. DOLADO, J. 2000. A validation of the component-based method for software size estimation. IEEE Trans. Softw. Eng. 26, 1006-1021.
18. DOLADO, J. 2001. On the problem of the software cost function. Info. Softw. Tech. 43, 61-72.
19. FINNOFF, W.,HERGERT, F., AND ZIMMERMANN, H. G. 1993. Improving model selection by nonconvergent methods. Neural Netw. 6, 771-783.
20. FOSS, T., STENSRUD, E., KITCHENHAM, B., AND MYRTVEIT, I. 2003. A simulation study of the model evaluation criterion mmre. IEEE Trans. Softw. Eng. 29, 11, 985-995.
21. GRUSCHKE, T. M. AND JØRGENSEN, M. 2008. The role of outcome feedback in improving the uncertainty assessment of software development effort estimates. ACM Trans. Softw. Eng. Meth. 17, 4, 20:1-20:35.
22. HALL, M., FRANK, E., HOLMES, G., PFAHRINGER, B., REUTEMANN, P., AND WITTEN, I. H. 2009. The weka data mining software: An update. SIGKDD Explorations 11, 1, 10-18.
23. HARMAN, M. AND CLARK, J. 2004. Metrics are fitness functions too. In Proceedings of METRICS'04. 172-183.
24. HARTIGAN, J. A. 1975. Clustering Algorithms. John Wiley & Sons, New York.
25. HEIAT, A. 2002. Comparison of artificial neural network and regression models for estimating software development effort. Info. Softw. Tech. 44, 911-922.
26. ISBSG. 2011. The International Software Benchmarking Standards Group. http://www.isbsg.org.
27. JØRGENSEN, M. AND SHEPPERD, M. 2007. A systematic review of software development cost estimation studies. IEEE Trans. Softw. Eng. 33, 1, 33-53.
28. JØRGENSEN, M. AND GRIMSTAD, S. 2011. The impact of irrelevant and misleading information on software development effort estimates: A randomized controlled field experiment. IEEE Trans. Softw. Eng. 37, 5, 695-707.
29. KHARE, V., YAO, X., AND DEB, K. 2003. Performance scaling of multi-objective evolutionary algorithms. In Proceedings of the 2nd International Conference on Evolutionary Multi-Criterion Optimization (EMO'03), C. M. Fonseca, P. J. Fleming, E. Zitzler, K. Deb, and L. Thiele, Eds., Lecture Notes in Computer Science, vol. 2632. Springer-Verlag, 376-390.
30. KOCAGUNELI, E., BENER, A., AND KULTUR, Y. 2009. Combining multiple learners induced on multiple datasets for software effort prediction. In Proceedings of ISSRE'07.
31. KOCAGUNELI, E., MENZIES, T., AND KEUNG, J. 2012. On the value of ensemble effort estimation. IEEE Trans. Softw. Eng. 38, 6, 1403-1416.
32. KULTUR, Y., TURHAN, B., AND BENER, A. 2009. Ensemble of neural networks with associative memory (ENNA) for estimating software development costs. Knowl. Based Syst. 22, 395-402.
33. KUNCHEVA, L. I. ANDWHITAKER, C. J. 2003. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machi. Learn. 51, 181-207.
34. LEGG, S., HUTTER, M., AND KUMAR, A. 2004. Tournament versus fitness uniform selection. In Proceedings of the Congress of Evolutionary Computation (CEC). 2144-2151.
35. LIU, Y. AND YAO, X. 1999a. Ensemble learning via negative correlation. Neur. Netw. 12, 1399-1404.
36. LIU, Y. AND YAO, X. 1999b. Simultaneous training of negatively correlated neural networks in an ensemble. IEEE Trans. Syst. Man Cybernetics -Part B: Cybernetics 29, 6, 716-725.
37. LUKASIEWYCZ, M., GLA, M., REIMANN, F., AND HELWIG, S. 2011. Opt4j: The meta-heuristic optimisation framework for java. http://opt4j.sourceforge.net.
38. MENZIES, T., CHEN, Z., HIHN, J., AND LUM, K. 2006. Selecting best practices for effort estimation. IEEE Trans. Softw. Eng. 32, 11, 883-895.
39. MENZIES, T. AND SHEPPERD, M. EDS. 2012. Empirical Software Engineering: Special issue on Repeatable Results in Software Engineering Prediction. 17, 1/2:1-17.
40. MILLER, B. L. AND GOLDBERG, D. E. 1995. Genetic algorithms, tournament selection, and the effects of noise. Complex Syst. 9, 3, 193-212.
41. MINKU, L. L. 2011. Machine learning for software effort estimation. The 13th CREST OpenWorkshop Future Internet Testing (FITTEST) & Search Based Software Engineering (SBSE), http://crest.cs.ucl.ac.uk/cow/13/slides/ presentation leandro.pdf
42. MINKU, L. L. AND YAO, X. 2011. A principled evaluation of ensembles of learning machines for software effort estimation. In Proceedings of PROMISE'11.
43. MINKU, L. L. AND YAO, X. 2013. Ensembles and locality: Insight on improving software effort estimation. Inf. Softw. Technol. 55, 8, 1512-1528.
44. MOHAGHEGHI, P., ANDA, B., AND CONRADI, R. 2005. Effort estimation of use cases for incremental large-scale software development. In Proceedings of ICSE. 303-311.
45. MONTGOMERY, D. C. 2004. Design and Analysis of Experiments 6th Ed. John Wiley and Sons.
46. PRADITWONG, K., HARMAN, M., AND YAO, X. 2011. Software module clustering as a multi-objective search problem. IEEE Trans. Softw. Eng. 37, 2, 264-282.
47. PRADITWONG, K. AND YAO, X. 2006. A new multi-objective evolutionary optimisation algorithm: the two-archive algorithm. In Proceedings of the International Conference on Computational Intelligence and Security (CIS'06). Vol. 1, 286-291.
48. ROSENTHAL, R. 1994. The Handbook of Research Synthesis. Vol. 236, Sage, New York.
49. SEO, Y.-S., YOON, K.-A., AND BAE, D.-H. 2008. An empirical analysis of software effort estimation with outlier elimination. In Proceedings of the PROMISE. 25-32.
50. SHAN, Y., MCKAY, R. J., LOKAN, C. J., AND ESSAM, D. L. 2002. Software project effort estimation using genetic programming. In Proceedings of the ICCCAS & WESINO EXPO. Vol. 2. 1108-1112.
51. SHEPPERD, M. AND SCHOFIELD, C. 1997. Estimating software project effort using analogies. IEEE Trans. Softw. Eng. 23, 12, 736-743.
52. SHIRABAD, J. S. AND MENZIES, T. 2005. The PROMISE Repository of Software Engineering Databases. School of Information Technology and Engineering, University of Ottawa, Canada, http://promise. site.uottawa.ca/SERepository.
53. SRINIVAS, N. AND DEB, K. 1994. Multiobjective optimization using nondominated sorting in genetic algorithms. Evolut. Comput. 2, 221-248.
54. SRIVASAN, K. AND FISHER, D. 1995. Machine learning approaches to estimating software development effort. IEEE Trans. Softw. Eng. 21, 2, 126-137.
55. TAN, H. B. K., ZHAO, Y., AND ZHANG, H. 2006. Estimating LOC for information systems from their conceptual data models. In Proceedings of ICSE. 321-330.
56. TAN, H. B. K., ZHAO, Y., AND ZHANG, H. 2009. Conceptual data model-based software size estimation for information systems. ACM Trans. Softw. Eng. Meth. 19, 2, 4:1-4:37.
57. TRONTO, I. F. B., SILVA, J. D. S., AND SANT'ANNA, N. 2007. Comparison of artificial neural network and regression models in software effort estimation. In Proceedings of IJCNN'07. 771-776.
58. WANG, Z., TANG, K., AND YAO, X. 2010. Multi-objective approaches to optimal testing resource allocation in modular software systems. IEEE Trans. Reliability 59, 3, 563-575.
59. WITTIG, G. E. AND FINNIE, G. R. 1994. Using artificial neural networks and function points to estimate 4GL software development effort. Austral. J. Info. Syst. 1, 2, 87-94.
60. WITTIG, G. E. AND FINNIE, G. R. 1997. Estimating software development effort with connectionist models. Inf. Softw. Tech. 39, 469-476.
61. ZHAO, Y. AND ZHANG, Y. 2008. Comparison of decision tree methods for finding active objects. Adv. Space 41, 1955-1959.
62. ZITZLER, E., LAUMANNS, M., AND THIELE, L. 2002. SPEA2: Improving the strength pareto evolutionary algorithm. In Proceedings of the Conference on Evolutionary Methods for Design, Optimization and Control with Applications to Industrial Problems (EUROGEN'02), 95-100.