A comparison of techniques for developing predictive models of software metrics

Information and Software Technology

Volumn 39, Issue 6, 1997, Pages 425-437

  Gray, Andrew R ^a   MacDonell, Stephen G ^a  

^a UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

Analysis techniques; Metrics; Predictive models

Indexed keywords

FUZZY SETS; MATHEMATICAL MODELS; NEURAL NETWORKS; REGRESSION ANALYSIS;

PREDICTIVE MODELS; SOFTWARE METRICS;

SOFTWARE ENGINEERING;

EID: 0031170604     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0950-5849(96)00006-7     Document Type: Article

References (71)

1. L.H. Putnam, A general empirical solution to the macro software sizing and estimating problem, IEEE Trans. Soft. Eng., 4 (1978) 345-361.
2. B.W. Boehm, Software Engineering Economics, Prentice-Hall, Englewood Cliffs, NJ, 1981.
3. L.C. Briand, V.R. Basili and W.M. Thomas, A pattern recognition approach for software data analysis, IEEE Trans. Soft. Eng., 18 (1992) 931-942.
4. D.R. Jeffery and G. Low, Calibrating estimation tools for software development, Soft. Eng. Journal, 5 (1990) 215-221.
5. C.F. Kemerer, An empirical validation of software cost estimation models, Comm. ACM, 30 (1987) 416-429.
6. S.G. MacDonell and A.R. Gray, A review of model building techniques found in software metrics literature, in preparation.
7. R.E. Courtney and D.A. Gustafson, Shotgun correlations in software measures, Software Eng. Journal, 8 (1993) 5-13.
8. M.C. Lovell, Data mining, The Review of Economics and Statistics, LXV (1983) 1-12.
9. R.R. Picard and K.N. Berk, Data splitting, The American Statistician, 44 (1990) 140-147.
10. R.D. Snee, Validation of regression models: Methods and examples, Technometrics, 19 (1977) 415-428.
11. D.M. Allen, The prediction sum of squares as a criterion for selecting predictor variables, Technical Report No. 23, Dept. Statistics, University of Kentucky, 1971.
12. B. Efron, Bootstrap methods: Another look at the jack-knife, Annals of Statistics, 7 (1979) 1-26.
13. G.A. Young, Bootstrap: More than a stab in the dark?, Statistical Science, 9 (1994) 382-415.
14. D. Coupal and P.N. Robillard, Factor analysis of source code metrics, J. Systems Software, 12 (1990) 263-269.
15. R.A. Mata-Toledo and D.A. Gustafson, A factor analysis of software complexity measures, J. Systems Software, 17 (1992) 267-273.
16. G.H. Subramanian and S. Breslawski, Dimensionality reduction in software development effort estimation, J. Systems Software, 21 (1993) 187-196.
17. G.W. Stewart, Collinearity and least squares regression, Statistical Science, 2 (1987) 68-100.
18. S.G. MacDonell, Quantitative functional complexity analysis of commercial software systems, Unpublished Ph.D. Thesis, University of Cambridge, Cambridge, UK, 1993.
19. Y. Miyazaki, M. Terakado and K. Ozaki, Robust regression for developing software estimation models, J. Systems Software, 27 (1994) 3-16.
20. P.J. Rousseeuw, Least median of squares regression, J. American Statistical Association, 79 (1984) 871-880.
21. D.L. Massart, L. Kaufman, P.J. Rousseeuw and A. Leroy, Least median of squares: A robust method for outlier and model error detection in regression and calibration, Analytica Chimica Acta, 187 (1986) 171-179.
22. P.J. Rousseeuw and A.M. Leroy, Robust Regression and Outlier Detection, John Wiley, New York, 1987.
23. T.P. Hettmansperger and S.J. Sheather, A cautionary note on the method of least median squares, The American Statistician, 46 (1992) 79-83.
24. P.J. Rousseeuw and B.C. van Zomeren, Unmasking multivariate outliers and leverage points, J. American Statistical Association, 85 (1990) 633-639.
25. S.C. Chatterjee and A.S. Hadi, Influential observations, high leverage points, and outliers in linear regression, Statistical Science, I (1986) 379-416.
26. J.W. Sheppard and W.R. Simpson, Using a competitive learning neural network to evaluate software complexity, in Proc. 1990 ACM SIGSMALL/PC Symp. Small Systems, 1990, pp. 262-267.
27. N. Karunanithi, D. Whitley and Y.K. Malaiya, Prediction of software reliability using connectionist models, IEEE Trans. Soft. Eng., 18 (1992) 563-574.
28. J. Hakkarainen, P. Laamanen and R. Rask, Neural networks in specification level software size estimation, in: Proc. 26th Hawaii Int. Conf. System Sciences, 1993, pp. 626-634.
29. G. Wittig, Estimating software development effort with connectionist models, Working Paper Series 33/95, Monash University, 1995.
30. S. Kumar, B.A. Krishna and P.S. Satsangi, Fuzzy systems and neural networks in software engineering project management, J. Applied Intelligence, 4 (1994) 31-52.
31. G.E. Wittig and G.R. Finnie, Using artificial neural networks and function points to estimate 4GL software development effort, Australian Journal of Information Systems, 1(2) (1994) 87-94.
32. K. Srinivasan and D. Fisher, Machine learning approaches to estimating software development effort, IEEE Trans. Soft. Eng, 21 (1995) 126-137.
33. T.M. Khoshgoftaar and D.L. Lanning, A neural network approach for early detection of program modules having high risk in the maintenance phase, J. Systems Software, 29 (1995) 85-91.
34. S.A. Sherer, Software fault prediction, J. Systems Software, 29 (1995) 97-105.
35. W.S. Sarle, Neural networks and statistical models, in: Proc. 19th Annual SAS Users Group Int. Conf., 1994, pp. 1538-1550.
36. A.R. Gray and S.G. MacDonell, Guidelines for the development of neural network-based software metric models, in preparation.
37. E.Y. Li, Applications artificial neural networks and their business applications, Information and Management, 27 (1994) 303-313.
38. B. Cheng and D.M. Titterington, Neural networks: A review from a statistical perspective, Statistical Science, 9 (1994) 2-54.
39. K. Hornik, M. Stinchcombe and H. White, Multilayer feedforward networks are universal approximators, Neural Networks, 2 (1989) 359-366.
40. H. White, Connectionist nonparametric regression: Multilayer feedforward networks can learn arbitrary mappings, Neural Networks, 3 (1990) 535-549.
41. R.S. Sutton, Two problems with backpropagation and other steepest-descent learning procedures for networks, in Proc. 8th Ann. Conf. Cognitive Science Society, 1989, pp. 823-831.
42. N. Baba, A new approach for finding the global minimum of error function in neural networks, Neural Networks, 2 (1989) 367-373.
43. P. Baldi and K. Hornik, Neural networks and principal component analysis: Learning from examples without local minima, Neural Networks, 2 (1989) 53-58.
44. L.F.A. Wessels and E. Barnard, Avoiding false local minima by proper initialization of connections, IEEE Trans. Neural Networks, 3 (1992) 899-905.
45. T. Denoeux and R. Lengellé, Initializing back propagation networks with prototypes, Neural Networks, 6 (1993) 351-363.
46. N. Weymaere and J.-P. Martens, On the initialisation and optimisation of multilayer perceptrons, IEEE Trans. Neural Networks (1994) 738-751.
47. J. Diederich, An explanation component for a connectionist inference system, in Proc. 9th European Conf. Artificial Intelligence, 1990, pp.222-227.
48. R. Davis, B.G. Buchanan and E. Shortliffe, Production rules as a representation for a knowledge-based consultation program, Artificial Intelligence, 8 (1977) 15-45.
49. A. Robins, Catastrophic forgetting, rehearsal and pseudorehearsal, Connection Science, 7 (1995) 123-146.
50. F.B. Bastani, G. DiMarco and A. Pasquini, Experimental evaluation of a fuzzy-set based measure of software correctness using program mutation, in Proc. 15th Int. Conf. Software Engineering, 1993, pp. 45-54.
51. T. Munakata and Y. Jani, Fuzzy systems: An overview, Comm. ACM, 37 (1994) 69-76.
52. B. Kosko, Fuzzy systems as universal approximators, IEEE Trans. Computers, 43 (1994) 1329-1333.
53. L.-X. Wang and J.M. Mendel, Generating fuzzy rules by learning from examples, IEEE Trans. Systems, Man, and Cybernetics, 22 (1992) 1414-1427.
54. J.L. Castro, Fuzzy logic controllers are universal approximators, IEEE Trans. Systems, Man, and Cybernetics, 25 (1995) 629-635.
55. R.J.-S. Jang, ANFIS: Adaptive-network-based fuzzy inference system, IEEE Trans. Systems, Man, and Cybernetics, 23 (1993) 665-685.
56. S. Horikawa, T. Furnuhashi and Y. Ucikawa, On fuzzy modelling using fuzzy neural networks with the back-propagation algorithm, IEEE Trans. Neural Networks, 3 (1992) 801-806.
57. J.J. Buckley and Y. Hayashi, Can fuzzy neural nets approximate continuous fuzzy functions, Fuzzy Sets and Systems, 61 (1994) 43-51.
58. C.L. Ramsey and V.R. Basili, An evaluation of expert systems for software engineering management, IEEE Trans. Soft. Eng., 15 (1989) 747-759.
59. A. Lakhotia, Rule-based approach to computing module cohesion, in Proc. 15th Int. Conf. Software Engineering, 1993, pp. 35-44.
60. B. Griech and J.-CH. Pomerol, Design and implementation of a knowledge-based decision support system for estimating software development work-Effort, J. Systems Integration, 4 (1994) 171-184.
61. D.W. Aha, Case-based learning algorithms, in Proc. DARPA Case-Based Reasoning Workshop, Morgan Kaufmann, Washington, DC, 1991, pp. 147-158.
62. T. Mukhopadhyay, S.S. Vicinanza and M.J. Prietula, Examining the feasibility of a case-based reasoning model for software effort estimation, MIS Quarterly, 16 (1992) 155-171.
63. S. Vicinanza, T. Mukhopadhyay and M. Prietula, Software effort estimation: An exploratory study of expert performance, Information Systems Research, 2 (1991) 243-262.
64. L. Breiman, J.H. Friedman, R.A. Olshen and C.J. Stone, Classification and Regression Trees, Chapman and Hall, New York, 1993.
65. R.W. Selby and A.A. Porter, Learning from examples: Generation and evaluation of decision trees for software resource analysis, IEEE Trans. Soft. Eng., 14 (1988) 1743-1757.
66. A.A. Porter and R.W. Selby, Evaluating techniques for generating metric-based classification trees, J. Systems Software, 12 (1990) 209-218.
67. S.G. MacDonell and A.R. Gray, Alternatives to regression models for estimating software projects, in Proceedings of the IFPUG Fall Conference, IFPUG, Westerville, OH, 1996, pp. 279.1-279.15.
68. J-M. Desharnais, Analyse statistique de la productivitie des projects de development en informatique apartir de la technique des points des fonction, Masters Thesis, Université du Montreal, 1989.
69. B. Samson, D. Ellison and P. Dugard, Software cost estimation using an albus perceptron (CMAC), To appear in Information and Software Technology.
70. M. Jorgensen, Experience with the accuracy of software maintenance task effort prediction models, IEEE Trans. Soft. Eng., 21 (1995) 674-681.
71. M. Shepperd, C. Schofield and B. Kitchenham, Effort estimation using analogy, in Proc. 18th Int. Conf. on Software Engineering, IEEE Computer Society Press, Los Alamitos, CA, 1996, pp. 170-178.