Performance evaluation metrics for software fault prediction studies

Acta Polytechnica Hungarica

Volumn 9, Issue 4, 2012, Pages 193-206

  Catal, Cagatay ^a  

^a ISTANBUL KULTUR UNIVERSITY   (Turkey)

Author keywords

Machine learning; Performance evaluation; Software fault prediction

Indexed keywords

EID: 84866117799     PISSN: 17858860     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (45)

1. E. Arisholm, L. C. Briand, and E. B. Johannessen, A Systematic and Comprehensive Investigation of Methods to Build and Evaluate Fault Prediction Models, Journal of Systems and Software 83 (1) (2010) 2-17
2. Y. Bingbing, Y. Qian, X. Shengyong, and G. Ping, Software Quality Prediction Using Affinity Propagation Algorithm, Proc. IJCNN 2008, 2008, pp. 1891-1896
3. D. Binkley, H. Feild, D. Lawrie, M. Pighin, Software Fault Prediction Using Language Processing, Proc. Testing: Academic and industrial Conference Practice and Research Techniques -MUTATION, TAICPART-MUTATION 2007, Washington, DC, 2007, pp. 99-110
4. L. C. Briand, V. Basili, C. Hetmanski, Developing Interpretable Models with Optimized Set Reduction for Identifying High Risk Software Components, IEEE Transactions on Software Engineering 19 (11) (1993) 1028-1044
5. C. Catal, B. Diri, A Systematic Review of Software Fault Prediction Studies, Expert Systems with Applications 36 (4) (2009a) 7346-7354
6. C. Catal, B. Diri, Investigating the Effect of Dataset Size, Metrics Sets, and Feature Selection Techniques on Software Fault Prediction Problem, Inf. Sci. 179 (8) (2009b) 1040-1058
7. N. V. Chawla, G. J. Karakoulas, Learning from Labeled and Unlabeled Data. An Empirical Study across Techniques and Domains, Journal of Artificial Intelligence Research, 23 (2005) 331-366
8. nd Int'l Conf. on Soft. Eng., Limerick, Ireland, 2000, pp. 704-706
9. G. Denaro, M. Pezzè, S. Morasca, Towards Industrially Relevant Fault-Proneness Models, International Journal of Software Engineering and Knowledge Engineering 13 (4) (2003) 395-417
10. C. Drummond, R. C. Holte, Cost Curves: An Improved Method for Visualizing Classifier Performance, Machine Learning 65 (1) (2006) 95130
11. K. El-Emam, S. Benlarbi, N. Goel, Comparing Case-based Reasoning Classifiers for Predicting High Risk Software Components, Technical Report, National Research Council of Canada, NRC/ERB-1058, Canada, 1999
12. K. El-Emam, W. Melo, J. C. Machado, The Prediction of Faulty Classes Using Object-oriented Design Metrics, Journal of Systems and Software 56 (1) (2001) 63-75
13. D. Fisher, L. Xu, N. Zard, Ordering Effects in Clustering, Proc. Ninth Int'l Conf. Machine Learning, 1992
14. K. Gao, T. M. Khoshgoftaar, A Comprehensive Empirical Study of Count Models for Software Fault Prediction, IEEE Transactions for Reliability 56 (2) (2007) 223-236
15. st Asia-Pacific Conference on Quality Software, Hong Kong, 2000, pp. 69-80
16. T. Gyimothy, R. Ferenc, I. Siket, Empirical Validation of Object-oriented Metrics on Open Source Software for Fault Prediction, IEEE Transactions on Software Engineering 31 (10) (2005) 897-910
17. M. Hall, G. Holmes, Benchmarking Attribute Selection Techniques for Discrete Class Data Mining, IEEE Trans. Knowledge and Data Eng. 15 (6) (2003) 1437-1447
18. D. J. Hand, Good Practice in Retail Credit Scorecard Assessment, Journal of the Operational Research Society 56 (2005) 1109-1117
19. th International Symposium on Software Reliability Engineering, IEEE Computer Society, Washington, DC, 2008, pp. 197-206
20. th IEEE Symposium on Software Metrics. Ottawa, Canada, 2002, pp. 203-215
21. th Int'l Symp. on Software Metrics, Ottawa, Canada, 2002, pp. 161-172
22. T. M. Khoshgoftaar, N. Seliya, N. Sundaresh, An Empirical Study of Predicting Software Faults with Case-based Reasoning, Software Quality Journal 14 (2) (2006) 85-111
23. A. G. Koru, H. Liu, An Investigation of the Effect of Module Size on Defect Prediction Using Static Measures, Proc. Workshop on Predictor Models in Software Engineering, St. Louis, Missouri, 2005, pp. 1-5
24. X. Li, L. Wang, E. Sung, AdaBoost with SVM-based Component Classifiers, Eng. Appl. Artif. Intelligence 21 (5) (2008) 785-795
25. C. X. Ling, J. Huang, H. Zhang, AUC: A Better Measure than Accuracy in Comparing Learning Algorithms, Canadian Conference on Artificial Intelligence, Halifax, Canada, 2003, pp. 329-341
26. Y. Ma, L. Guo, B. Cukic, A Statistical Framework for the Prediction of Fault-Proneness, Advances in Machine Learning Application in Software Engineering, Idea Group Inc., 2006, pp. 237-265
27. A. Mahaweerawat, P. Sophasathit, C. Lursinsap. Software Fault Prediction Using Fuzzy Clustering and Radial Basis Function Network, Proc. International Conference on Intelligent Technologies, Vietnam, 2002, pp. 304-313
28. th international Conference on Predictor Models in Software Engineering, Vancouver, Canada, 2009, pp. 1-10
29. T. Menzies, J. Greenwald, A. Frank, Data Mining Static Code Attributes to Learn Defect Predictors, IEEE Transactions on Software Engineering 32 (1) (2007) 2-13
30. S. Misra, Evaluation Criteria for Object-oriented Metrics, Acta Polytechnica Hungarica 8(5) (2011) 109-136
31. A. P. Nikora, J. C. Munson, Building High-Quality Software Fault Predictors, Software Practice and Experience 36 (9) (2006) 949-969
32. O. T. Pusatli, S. Misra, Software Measurement Activities in Small and Medium Enterprises: An Empirical Assessment, Acta Polytechnica Hungarica 8(5) (2011) 21-42
33. F. Sebastiani, Machine Learning in Automated Text Categorization, ACM Comput. Surv. 34 (1) (2002) 1-47
34. N. Seliya, Software Quality Analysis with Limited Prior Knowledge of Faults. Graduate Seminar, Wayne State University, Department of Computer Science, 2006
35. N. Seliya, T. M. Khoshgoftaar, Software Quality Estimation with Limited Fault Data: A Semi-supervised Learning Perspective, Software Quality Journal 15 (3) (2007) 327-344
36. th International Conference on Software Maintenance, Amsterdam, The Netherlands, 2003, pp. 113-122
37. th Conference on Software Engineering Research and Practice in Sweden, Västerås, Sweden, 2005, pp. 57-63
38. B. Turhan, A. Bener, Analysis of Naive Bayes' Assumptions on Software Fault Data: An Empirical Study, Data Knowl. Eng. 68 (2) (2009) 278-290
39. th International Conference on Machine Learning, Corvalis, Oregon, 2007, pp. 935-942
40. H. Wang, Y. Chen, and Y. Dai, A Soft Real-Time Web News Classification System with Double Control Loops, Proc. WAIM 2005, 2005, pp. 81-90
41. W. Youden, Index for Rating Diagnostic Tests, Cancer 3 (1) (1950) 32-35
42. rd IEEE Symposium on Application-Specific Systems and Software Engineering Technology, Richardson, Texas, 2000, p. 85
43. S. Zhong, T. M. Khoshgoftaar, N. Seliya. Unsupervised Learning for Expert-based Software Quality Estimation, Eighth IEEE International Symposium on High Assurance Systems Engineering, 2004, pp. 149-155
44. Y. Zhou, H. Leung, Empirical Analysis of Object-oriented Design Metrics for Predicting High and Low Severity Faults, IEEE Transactions on Software Engineering 32 (10) (2006) 771-789
45. M. J. Zolghadri, E. G. Mansoori, Weighting Fuzzy Classification Rules Using Receiver Operating Characteristics (ROC) Analysis, Inf. Sci. 177 (11) (2007) 2296-2307