Genetic programming for cross-release fault count predictions in large and complex software projects

Evolutionary Computation and Optimization Algorithms in Software Engineering: Applications and Techniques

Volumn , Issue , 2010, Pages 94-126

  Afzal, Wasif ^a   Torkar, Richard ^a   Feldt, Robert ^a   Gorschek, Tony ^a  

^a BLEKINGE INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84856686810     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-61520-809-8.ch006     Document Type: Chapter

References (117)

1. Abdel-Ghaly, A. A., Chan, P. Y., & Littlewood, B. (1986). Evaluation of competing software reliability predictions. IEEE Transactions on Software Engineering, 12(9), 950-967.
2. Adnan, W. A., Yaakob, M., Anas, R., & Tamjis, M. R. (2000). Artificial neural network for software reliability assessment. Paper presented at the Proceedings of TENCON 2000.
3. Afzal, W., Torkar, R., & Feldt, R. (2008). Prediction of fault count data using genetic programming. Paper presented at the proceedings of INMIC 2008 IEEE International Multitopic Conference.
4. Aljahdali, S. H., Sheta, A., & Rine, D. (2001). Prediction of software reliability: A comparison between regression and neural network nonparametric models. Paper presented at the proceedings of ACS/IEEE International Conference on Computer Systems and Applications.
5. Arthur, K. (2006). Evolutionary computation at Dow Chemical. SIGEVOlution, 1(3), 4-9.doi:10.1145/1181964.1181965
6. Arthur Karl, K., Guido, F. S., & Mark, E. K. (2007). Industrial evolutionary computing. Paper presented at the Proceedings of the 2007 GECCO conference companion on Genetic and evolutionary computation.
7. Bäck, T., Fogel, D. B., & Michalewicz, Z. (2000). [-Basic algorithms and operators: San Francisco: Taylor & Francis Group.]. Evolutionary Computation, 1.
8. Barry, B., & Victor, R. B. (2001). Software Defect Reduction Top 10 List. Computer, 34(1), 135-137.
9. Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1978). Statistics for experimenters: An introduction to design, data analysis, and model building. Mahwah, NJ: Wiley-Interscience.
10. Brooks, W., & Motley, R. (1980). Analysis of discrete software reliability models. IBM Federal Systems.
11. Bugzilla homepage. (Last checked: October 2008). from http://www.bugzilla.org
12. Burgess, C. J., & Lefley, M. (2001). Can genetic programming improve software effort estimation? A comparative evaluation. Information and Software Technology, 43(14), 863-873. doi:10.1016/ S0950-5849(01)00192-6
13. Burke, E. K., & Kendall, G. (2005). Search meth-odologies-Introductory tutorials in optimization and decision support techniques. Berlin: Springer Science and Business Media.
14. Cai, K.-Y. (1996). Fuzzy methods in software reliability modeling. In Introduction to fuzzy reliability. Amsterdam: Kluwer International Series in Engineering and Computer Science, Kluwer Academic Publishers.
15. Cai, K.-Y., Wen, C., & Zhang, M. (1991). A critical review on software reliability modeling. Reliability Engineering & System Safety, 32(3), 357-371.doi:10.1016/0951-8320(91)90009-V
16. Cai, K.-Y., Wen, C., & Zhang, M. (1993). A novel approach to software reliability modeling. Micro-electronics and Reliability, 33(15), 2265-2267.doi:10.1016/0026-2714(93)90066-8
17. Carolyn, M., Gada, K., Martin, L., Keith, P., Chris, S., & Martin, S. (2000). An investigation of machine learning based prediction systems. Journal of Systems and Software, 53(1), 23-29.doi:10.1016/S0164-1212(00)00005-4
18. Claes, W., Per, R., Martin, H., Magnus, C. O., Björn, R., & Wesslén, A. (2000). Experimentation in software engineering: An introduction. Amsterdam: Kluwer Academic Publishers.
19. Costa, E. O., de Souza, G. A., Pozo, A. T. R., & Vergilio, S. R. (2007). Exploring Genetic Programming and Boosting Techniques to Model Software Reliability. Reliability. IEEE Transactions on, 56(3), 422-434.
20. Dolado, J. J., Fernandez, L., Otero, M. C., & Urkola, L. (1999). Software effort estimation: The elusive goal in project management. Paper presented at the Proceedings of the International Conference on Enterprise Information Systems.
21. Donald, E. N. (2002). An Enhanced Neural Network Technique for Software Risk Analysis. IEEE Transactions on Software Engineering, 28(9), 904-912.doi:10.1109/TSE.2002.1033229
22. Eduardo, O., Aurora, P., & Silvia Regina, V. (2006). Using Boosting Techniques to Improve Software Reliability Models Based on Genetic Programming. Paper presented at the Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence.
23. Eduardo Oliveira, C., Silvia, R. V., Aurora, P., & Gustavo, S. (2005). Modeling Software Reliability Growth with Genetic Programming. Paper presented at the Proceedings of the 16th IEEE International Symposium on Software Reliability Engineering.
24. Elaine, J. W., & Thomas, J. Ostrand & Robert, M. B. (2005). Predicting the Location and Number of Faults in Large Software Systems. IEEE Transactions on Software Engineering, 31(4), 340-355.doi:10.1109/TSE.2005.49
25. Farr, W. (Last checked March 2009). SMERFS3 homepage. Retrieved from http://www.slingcode.com/smerfs/downloads/
26. Giovanni, D., & Mauro, P. (2002). An empirical evaluation of fault-proneness models. Paper presented at the Proceedings of the 24th International Conference on Software Engineering.
27. Goel, A. L. (1985). Software Reliability Models: Assumptions, Limitations, and Applicability. Software Engineering. IEEE Transactions on, SE-11(12), 1411-1423.
28. Goel, A. L., & Okumoto, K. (1979). Time dependent error detection rate model for software reliability and other performance measures. IEEE Transactions on Reliability, R-28(3), 206-211.doi:10.1109/TR.1979.5220566
29. Gray, A. R., & MacDonell, S. G. (1997). A comparison of techniques for developing predictive models of software metrics. Information and Software Technology, 39(6), 425-437. doi:10.1016/ S0950-5849(96)00006-7
30. Gunn, S. R. (1998). Support vector machines for classification and regression. School of electronics and computer science. UK: University of Southampton.
31. Guo, P., & Lyu, M. R. (2004). A pseudoinverse learning algorithm for feedforward neural networks with stacked generalization applications to software reliability growth data. Neurocomputing, 56, 101-121.doi:10.1016/S0925-2312(03)00385-0
32. Ho, S. L., Xie, M., & Goh, T. N. (2003). A study of the connectionist models for software reliability prediction. Computers & Mathematics with Applications (Oxford, England), 46(7), 1037-1045.doi:10.1016/S0898-1221(03)90117-9
33. Hollander, M., & Wolfe, D.A. (1999). Nonparametric statistical methods. New York: John Wiley and Sons, Inc.
34. Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2(8), 696-701.doi:10.1371/journal.pmed.0020124
35. Jeff, T. (1996). An integrated approach to test tracking and analysis. Journal of Systems and Software, 35(2), 127-140.doi:10.1016/0164-1212(95)00092-5
36. Jeremy, G., & Art, F. (2007). Data mining static code attributes to learn defect predictors. IEEE Transactions on Software Engineering, 33(1), 2-13.doi:10.1109/TSE.2007.256941
37. Jos, & Javier, D. (2000). A validation of the component-based method for software size estimation. IEEE Trans. Softw. Eng., 26(10), 1006-1021.
38. Juristo, N., & Moreno, A. M. (2001). Basics of software engineering experimentation. Amsterdam: Kluwer Academic Publishers.
39. Kachigan, S. K. (1982). Statistical analysis - An interdisciplinary introduction to univariate and multivariate methods. New York: Radius Press.
40. Kai-Yuan, C., Lin, C., Wei-Dong, W., Zhou-Yi, Y., & David, Z. (2001). On the neural network approach in software reliability modeling. Journal of Systems and Software, 58(1), 47-62. doi:10.1016/ S0164-1212(01)00027-9
41. Karunanithi, N. (1993). A neural network approach for software reliability growth modeling in the presence of code churn. Paper presented at the Proceedings of Fourth International Symposium on Software Reliability Engineering.
42. Karunanithi, N., & Malaiya, Y. K. (1996). Neural networks for software reliability engineering. In Handbook of software reliability and system reliability. Hightstown, NJ: McGraw-Hill Inc.
43. Karunanithi, N., Malaiya, Y. K., & Whitley, D. (1991). Prediction of software reliability using neural networks. Paper presented at the proceedings of the 1991 International Symposium on Software Reliability Engineering.
44. Kehan, G., & Khoshgoftaar, T. M. (2007). A Comprehensive Empirical Study of Count Models for Software Fault Prediction. IEEE Transactions on Reliability, 56(2), 223-236. doi:10.1109/ TR.2007.896761
45. Khoshgoftaar, T., Allen, E., Hudepohl, J., & Aud, S. (1997). Application of neural networks to software quality modeling of a very large tele-communications system. IEEE Transactions on Neural Networks, 8(4).doi:10.1109/72.595888
46. Khoshgoftaar, T. M., & Allen, E. B. (1999). Logistic regression modeling of software quality. International Journal of Reliability Quality and Safety Engineering, 6(4), 303-317. doi:10.1142/ S0218539399000292
47. Khoshgoftaar, T. M., Pandya, A. S., & More, H. B. (1992). A neural network approach for predicting software development faults. Paper presented at the Proceedings of the Third International Symposium on Software Reliability Engineering.
48. Khoshgoftaar, T. M., & Seliya, N. (2003). Fault Prediction Modeling for Software Quality Estimation: Comparing Commonly Used Techniques. Empirical Software Engineering, 8(3), 255-283. doi:10.1023/A:1024424811345
49. Khoshgoftaar, T. M., & Szabo, R. M. (1996). Using neural networks to predict software faults during testing. IEEE Transactions on Reliability, 45(3), 456-462.doi:10.1109/24.537016
50. Khoshgoftaar, T. M., & Yi, L. (2007). A MultiObjective Software Quality Classification Model Using Genetic Programming. IEEE Transactions on Reliability, 56(2), 237-245. doi:10.1109/ TR.2007.896763
51. Kitchenham, B. A., Pickard, L. M., MacDonell, S. G., & Shepperd, M. J. (2001). What accuracy statistics really measure? Software. IEE Proceedings, 148(3), 81-85. doi:10.1049/ip-sen:20010506
52. Kordon, A., Smits, G., Jordaan, E., & Rightor, E. (2002). Robust soft sensors based on integration of genetic programming, analytical neural networks, and support vector machines. Paper presented at the Proceedings of the CEC '02 Proceedings of the 2002 Congress on Evolutionary Computation, 2002.
53. Kotanchek, M., Smits, G., & Kordon, A. (2003). Industrial strength genetic programming. In Genetic programming theory and practice (pp. 239-256). Amsterdam: Kluwer.
54. Koza, J. (1992). Genetic programming: on the programming of computers by means of natural selection. Cambridge, MA: MIT Press.
55. Langdon, W. B. (2008). A Field Guide to Genetic Programing. Published via http://lulu.com and freely available at http://www.gp-field-guide.org.uk
56. Laura Ignizio, B. (1991). Introduction to artificial neural systems for pattern recognition. Computers & Operations Research, 18(2), 211-220.doi:10.1016/0305-0548(91)90091-5
57. Lesley, P., Barbara, K., & Susan, L. (1999). An Investigation of Analysis Techniques for Software Datasets. Paper presented at the Proceedings of the 6th International Symposium on Software Metrics.
58. Leung, H., & Varadan, V. (2002). System modeling and design using genetic programming. Paper presented at the Proceedings of First IEEE International Conference on Cognitive Informatics.
59. Li, P. L., Shaw, M., & Herbsleb, J. (2003). Selecting a defect prediction model for maintenance resource planning and software insurance. Paper presented at the proceedings of the Fifth Workshop on Economics-Driven Software Research.
60. Lionel, C. B., Victor, R. B., & Christopher, J. H. (1993). Developing Interpretable Models with Optimized set Reduction for Identifying HighRisk Software Components. IEEE Transactions on Software Engineering, 19(11), 1028-1044.doi:10.1109/32.256851
61. Lionel, C. B., Victor, R. B., & William, M. T. (1992). A Pattern Recognition Approach for Software Engineering Data Analysis. IEEE Transactions on Software Engineering, 18(11), 931-942.doi:10.1109/32.177363
62. Lionel, C. B., Walcelio, L. M., & Wust, J. (2002). Assessing the applicability of fault-proneness models across object-oriented software projects. IEEE Transactions on Software Engineering, 28(7), 706-720.doi:10.1109/TSE.2002.1019484
63. Magnus, C. O., & Per, R. (2002). Experience from Replicating Empirical Studies on Prediction Models. Paper presented at the Proceedings of the 8th International Symposium on Software Metrics.
64. Malaiya, Y. K., Karunanithi, N., & Verma, P. (1990). Predictability measures for software reliability models. Paper presented at the Proceedings of COMPSAC 90 Fourteenth Annual International Computer Software and Applications Conference.
65. Martin, S., & Gada, K. (2001). Comparing Soft-ware Prediction Techniques Using Simulation. IEEE Transactions on Software Engineering, 27(11), 1014-1022.doi:10.1109/32.965341
66. Matsumoto, K., Inoue, K., Kikuno, T., & Torii, K. (1988). Experimental evaluation of software reliability growth models. Paper presented at FTCS-18, Digest of Papers, the proceedings of Eighteenth International Symposium on Fault-Tolerant Computing.
67. Michael, R. L., & Allen, N. (1992). Applying Reliability Models More Effectively. IEEE Software, 9(4), 43-52.doi:10.1109/52.143104
68. Munson, J. C., & Khoshgoftaar, T. M. (1992). The detection of fault-prone programs. IEEE Transactions on Software Engineering, 18(5), 423-433.doi:10.1109/32.135775
69. Nachimuthu, K., Darrell, W., & Yashwant, K. M. (1992). Using Neural Networks in Reliability Prediction. IEEE Software, 9(4), 53-59.doi:10.1109/52.143107
70. Nachimuthu, K., Darrell, W., & Yashwant, K. M. (1992). Prediction of Software Reliability Using Connectionist Models. IEEE Transactions on Software Engineering, 18(7), 563-574.doi:10.1109/32.148475
71. Niclas, O., Ann Christin, E., & Mary, H. (1997). Early Risk-Management by Identification of Faultprone Modules. Empirical Software Engineering, 2(2), 166-173. doi:10.1023/A:1009757419320
72. Niclas, O., & Hans, A. (1996). Predicting FaultProne Software Modules in Telephone Switches. IEEE Transactions on Software Engineering, 22(12), 886-894.doi:10.1109/32.553637
73. Niclas, O., Ming, Z., & Mary, H. (1998). Application of multivariate analysis for software fault prediction. Software Quality Control, 7(1), 51-66. doi:10.1023/A:1008844909795
74. Nidhi, G., & Manu Pratap, S. (2005). Estimation of software reliability with execution time model using the pattern mapping technique of artificial neural network. Computers & Operations Research, 32(1), 187-199.doi:10.1016/S0305-0548(03)00212-0
75. Nikora, A. P. (2009). CASRE homepage. Retrieved from http://www.openchannelfoundation.org/projects/CASRE_3.0
76. Nikora, A. P., & Lyu, M. R. (1995). An experiment in determining software reliability model applicability. Paper presented at the Proceedings of the Sixth International Symposium on Software Reliability Engineering.
77. Palu, S. (Last checked November 2008). Instance-based learning: A Java implementation. Retrieved from http://www.developer.com/java/other/article.php/10936_1491651_1
78. Paul Luo, L., Mary, S., Jim, H., Bonnie, R., & Santhanam, P. (2004). Empirical evaluation of defect projection models for widely-deployed production software systems. Paper presented at the Proceedings of the 12th ACM SIGSOFT twelfth international symposium on Foundations of software engineering.
79. Raj Kiran, N., & Ravi, V. (2008). Software reliability prediction by soft computing techniques. Journal of Systems and Software, 81(4), 576-583.doi:10.1016/j.jss.2007.05.005
80. Raymond, E. S. (1999). Cathedral and the bazaar. Sebastopol, CA: O'Reily & Associates.
81. Reformat, M., Pedrycz, W., & Pizzi, N. J. (2003). Software quality analysis with the use of computational intelligence. Information and Software Technology, 45(7), 405-417.doi:10.1016/S0950-5849(03)00012-0
82. Russell, S., & Norvig, P. (2003). Artificial intelligence-A modern approach. New York: Prentice Hall Series in Artificial Intelligence.
83. Sarah, B., & Bev, L. (1996). Techniques for prediction analysis and recalibration. In Handbook of software reliability engineering (pp. 119-166). New York: McGraw-Hill, Inc.
84. Sean, L., & Liviu, P. (2006). A comparison of bloat control methods for genetic programming. Evolutionary Computation, 14(3), 309-344.doi:10.1162/evco.2006.14.3.309
85. Shepperd, M., Cartwright, M., & Kadoda, G. (2000). On Building Prediction Systems for Software Engineers. Empirical Software Engineering, 5(3), 175-182. doi:10.1023/A:1026582314146
86. Silva, S. (2007). GPLAB - A Genetic Programming Toolbox for MATLAB. Retrieved from http://gplab.sourceforge.net (Last checked 27 February 2009)
87. Sitte, R. (1999). Comparison of software-reliabil-ity-growth predictions: neural networks vs para-metric-recalibration. IEEE Transactions on Reliability, 48(3), 285-291.doi:10.1109/24.799900
88. Smola, A. J., & Schölkopf, B. (2004). A tutorial on support vector regression. Statistics and Computing, 14(3), 199-222. doi:10.1023/ B:STCO.0000035301.49549.88
89. So, S. S., Cha, S. D., & Kwon, Y. R. (2002). Empirical evaluation of a fuzzy logic-based software quality prediction model. Fuzzy Sets and Systems, 127(2), 199-208.doi:10.1016/S0165-0114(01)00128-2
90. Stefan, L., Bart, B., Christophe, M., & Swantje, P. (2008). Benchmarking Classification Models for Software Defect Prediction: A Proposed Framework and Novel Findings. IEEE Transactions on Software Engineering, 34(4), 485-496.doi:10.1109/TSE.2008.35
91. Stringfellow, C., & Andrews, A. A. (2002). An Empirical Method for Selecting Software Reliability Growth Models. Empirical Software Engineering, 7(4), 319-343. doi:10.1023/A:1020515105175
92. Susan Elliott, S., Steve, E., & Richard, C. H. (2003). Using benchmarking to advance research: a challenge to software engineering. Paper presented at the Proceedings of the 25th International Conference on Software Engineering.
93. Tadashi, D., Yasuhiko, N., & Shunji, O. (1999). Optimal software release scheduling based on artificial neural networks. Annals of Software Engineering, 8(1-4), 167-185.
94. Taghi, M. K., Edward, B. A., Wendell, D. J., & John, P. H. (1999). Classification Tree Models of Software Quality Over Multiple Releases. Paper presented at the Proceedings of the 10th International Symposium on Software Reliability Engineering.
95. Taghi, M. K., John, C. M., Bibhuti, B. B., & Gary, D. R. (1992). Predictive Modeling Techniques of Software Quality from Software Measures. IEEE Transactions on Software Engineering, 18(11), 979-987.doi:10.1109/32.177367
96. Taghi, M. K., & Naeem, S. (2002). Tree-Based Software Quality Estimation Models For Fault Prediction. Paper presented at the Proceedings of the 8th International Symposium on Software Metrics.
97. Taghi, M. K., Naeem, S., & Nandini, S. (2006). An empirical study of predicting software faults with case-based reasoning. Software Quality Control, 14(2), 85-111.
98. Taghi, M. K., Yi, L., & Naeem, S. (2004). Module-Order Modeling using an Evolutionary Multi-Objective Optimization Approach. Paper presented at the Proceedings of the 10th International Symposium on Software Metrics.
99. Thomas, J. O., & Elaine, J. W. (2002). The distribution of faults in a large industrial software system. Paper presented at the Proceedings of the 2002 ACM SIGSOFT international symposium on software testing and analysis.
100. Tian, L., & Noore, A. (2004). Software reliability prediction using recurrent neural network with Bayesian regularization. International Journal of Neural Systems, 14(3), 165-174. doi:10.1142/S0129065704001966
101. Tian, L., & Noore, A. (2005). Dynamic software reliability prediction: An approach based on Support Vector Machines. International Journal of Reliability Quality and Safety Engineering, 12(4), 309-321.doi:10.1142/S0218539305001847
102. Tian, L., & Noore, A. (2005). Evolutionary neural network modeling for software cumulative failure time prediction. International Journal of Reliability Quality and Safety Engineering, 87(1), 45-51.
103. Tian, L., & Noore, A. (2005). On-line prediction of software reliability using an evolutionary connectionist model. Journal of Systems and Software, 77(22), 173-180.
104. Tian, L., & Noore, A. (2007). Computational intelligence methods in software reliability prediction. Computational Intelligence in Reliability Engineering, 39, 375-398. doi:10.1007/978-3-540-37368-1_12
105. Tibor, G., Rudolf, F., & Istvan, S. (2005). Empirical Validation of Object-Oriented Metrics on Open Source Software for Fault Prediction. IEEE Transactions on Software Engineering, 31(10), 897-910.doi:10.1109/TSE.2005.112
106. Utkin, L., Gurov, S., & Shubinsky, M. (2002). A fuzzy software reliability model with multiple-error introduction and removal. International Journal of Reliability Quality and Safety Engineering, 9(3).doi:10.1142/S0218539302000780
107. Venkata, U. B. C., Farokh, B. B., Yen, I. L., & Raymond, A. P. (2005). Empirical Assessment of Machine Learning based Software Defect Prediction Techniques. Paper presented at the Proceedings of the 10th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems.
108. Victor, R. B., & Lionel, C. B., Walc, & lio, L. M. (1996). A Validation of Object-Oriented Design Metrics as Quality Indicators. IEEE Transactions on Software Engineering, 22(10), 751-761.doi:10.1109/32.544352
109. Wasif, A., & Richard, T. (2008). A Comparative Evaluation of Using Genetic Programming for Predicting Fault Count Data. Paper presented at the Proceedings of The Third International Conference on Software Engineering Advances.
110. Wasif, A., & Richard, T. (2008). Suitability of Genetic Programming for Software Reliability Growth Modeling. Paper presented at the Proceedings of the International Symposium on Computer Science and its Applications.
111. Witten, I. H., & Frank, E. (2005). Data mining-Practical machine learning tools and techniques. San Francisco: Morgan Kaufmann Publishers.
112. Wood, A. (1996). Predicting software reliability. Computers, 29(11), 69-77.doi:10.1109/2.544240
113. Yamada, S., Ohba, M., & Osaki, S. (1983). S-shaped reliability growth modeling for software error detection. IEEE Transactions on Reliability, R-32(5), 475-478.doi:10.1109/TR.1983.5221735
114. Yongqiang, Z., & Huashan, C. (2006). Predicting for MTBF Failure Data Series of Software Reliability by Genetic Programming Algorithm. Paper presented at the Proceedings of the Sixth International Conference on Intelligent Systems Design and Applications - Volume 01.
115. Yu, T. J., Shen, V. Y., & Dunsmore, H. E. (1988). An Analysis of Several Software Defect Models. IEEE Transactions on Software Engineering, 14(9), 1261-1270.doi:10.1109/32.6170
116. Yu-Shen, S., & Chin-Yu, H. (2007). Neural-network-based approaches for software reliability estimation using dynamic weighted combinational models. Journal of Systems and Software, 80(4), 606-615.doi:10.1016/j.jss.2006.06.017
117. Zhang, D., & Tsai, J. (2003). Machine Learning and Software Engineering. Software Quality Journal, 11(2), 87-119. doi:10.1023/A:1023760326768