Choosing software metrics for defect prediction: An investigation on feature selection techniques

Software - Practice and Experience

Volumn 41, Issue 5, 2011, Pages 579-606

  Gao, Kehan ^a   Khoshgoftaar, Taghi M ^b   Wang, Huanjing ^c   Seliya, Naeem ^d  

^a EASTERN CONNECTICUT STATE UNIVERSITY   (United States)

^b FLORIDA ATLANTIC UNIVERSITY   (United States)

^c WESTERN KENTUCKY UNIVERSITY   (United States)

^d UNIVERSITY OF MICHIGAN DEARBORN   (United States)

Author keywords

attribute selection; defect prediction; feature ranking; feature subset selection; search based software engineering; software metric; software quality

Indexed keywords

ATTRIBUTE SELECTION; DEFECT PREDICTION; FEATURE RANKING; FEATURE SUBSET SELECTION; SEARCH-BASED SOFTWARE ENGINEERING; SOFTWARE METRIC; SOFTWARE QUALITY;

ALGORITHMS; DEFECTS; FEATURE EXTRACTION; FORECASTING; MATHEMATICAL MODELS; MODELS; PROJECT MANAGEMENT; SET THEORY; SOFTWARE ENGINEERING;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 79952838952     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.1043     Document Type: Article

References (46)

1. Khoshgoftaar TM, Bullard LA, Gao K,. Attribute selection using rough sets in software quality classification. International Journal of Reliability, Quality and Safety Engineering 2009; 16 (1): 73-89.
2. Lessmann S, Baesens B, Mues C, Pietsch S,. Benchmarking classification models for software defect prediction: A proposed framework and novel findings. IEEE Transactions on Software Engineering 2008; 34 (4): 485-496.
3. Meulen MJ, Revilla MA,. Correlations between internal software metrics and software dependability in a large population of small C/C++ programs. Proceedings of the 18th IEEE International Symposium on Software Reliability Engineering, ISSRE 2007, Trollhattan, Sweden, 2007; 203-208.
4. Rodriguez D, Ruiz R, Cuadrado-Gallego J, Aguilar-Ruiz J,. Detecting fault modules applying feature selection to classifiers. Proceedings of Eighth IEEE International Conference on Information Reuse and Integration, Las Vegas, Nevada, 2007; 667-672.
5. Sunghun K, Zimmermann T, Whitehead EJ, Zeller A,. Predicting faults from cached history. Proceedings of the 29th International Conference on Software Engineering, ICSE 2007, Minneapolis, MN, 2007; 489-498. (Pubitemid 47430683)
6. Pfleeger SL,. Software metrics: Progress after 25 years ? IEEE Software 2008; 25 (6): 32-34.
7. Hall MA, Holmes G,. Benchmarking attribute selection techniques for discrete class data mining. IEEE Transactions on Knowledge and Data Engineering 2003; 15 (6): 1437-1447.
8. Guyon I, Elisseeff A,. An introduction to variable and feature selection. Journal of Machine Learning Research 2003; 3: 1157-1182.
9. Khoshgoftaar TM, Nguyen L, Gao K, Rajeevalochanam J,. Application of an attribute selection method to cbr-based software quality classification. Proceedings of 15th IEEE International Conference on Tools with Artificial Intelligence. IEEE: Sacramento, CA, 2003; 47-52.
10. Lin P, Wang H, Khoshgoftaar TM,. A novel hybrid search algorithm for feature selection. Proceedings of 21st International Conference on Software Engineering and Knowledge Engineering, Boston, MA, 2009; 81-86.
11. Witten IH, Frank E,. Data Mining: Practical Machine Learning Tools and Techniques (2nd edn). Morgan Kaufmann: Los Altos, CA, 2005.
12. Harman M, Mansouri SA, Zhang Y,. Search based software engineering: A comprehensive review. Available at: [12 March 2009 ].
13. Harman M,. The current state and future of search based software engineering. Proceedings of FOSE'07: 2007 Future of Software Engineering. IEEE Computer Society: Washington, DC, 2007; 342-357. (Pubitemid 47484936)
14. Rodríguez D, Ruiz R, Cuadrado-Gallego J, Aguilar-Ruiz J, Garre M,. Attribute selection in software engineering datasets for detecting fault modules. Proceedings of 33rd EUROMICRO Conference on Software Engineering and Advanced Applications, Lübeck, Germany, 2007; 418-423.
15. Chen Z, Menzies T, Port D, Boehm B,. Finding the right data for software cost modeling. IEEE Software 2005; 22 (6): 38-46. (Pubitemid 41709723)
16. Liu H, Yu L,. Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering 2005; 17 (4): 491-502. (Pubitemid 40495592)
17. Furlanello C, Serafini M, Merler S, Jurman G,. Entropy-based gene ranking without selection bias for the predictive classification of microarray data. BMC Bioinformatics 2003; 4: 54.
18. Forman G,. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research 2003; 3: 1289-1305.
19. Doraisamy S, Golzari S, Norowi NM, Sulaiman N, Udzir NI,. A study on feature selection and classification techniques for automatic genre classification of traditional malay music. Ninth International Conference on Music Information Retrieval, Philadelphia, PA, U.S.A., 2008; 331-336.
20. Jong K, Marchiori E, Sebag M, van der Vaart A,. Feature selection in proteomic pattern data with support vector machines. Proceedings of the 2004 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, San Diego, CA, 2004.
21. Ilczuk G, Mlynarski R, Kargul W, Wakulicz-Deja A,. New feature selection methods for qualification of the patients for cardiac pacemaker implantation. Computers in Cardiology, 2007, Durham, NC, U.S.A., 2007; 423-426.
22. Hudepohl JP, Aud SJ, Khoshgoftaar TM, Allen EB, Mayrand J,. EMERALD: Software metrics and models on the desktop. IEEE Software 1996; 13 (5): 56-60.
23. Cameron AC, Trivedi PK,. Regression Analysis of Count Data. Cambridge University Press: Cambridge, 1998.
24. Kira K, Rendell LA,. A practical approach to feature selection. Proceedings of the Ninth International Workshop on Machine Learning, Aberdeen, Scotland, U.K., 1992; 249-256.
25. Marko Robnik-Eikonja IK,. An adaptation of relief for attribute estimation in regression. Proceedings of the 14th International Conference on Machine Learning, Nashville, Tennessee, 1997; 296-304.
26. Dash M, Liu H,. Consistency-based search in feature selection. Artificial Intelligence 2003; 151 (1-2): 151-176.
27. Coppin B,. Artificial Intelligence Illuminated. Jones and Bartlett: Sudbury, MA, 2004.
28. Oliveira A, Vincentelli A,. Constructive induction using a non-greedy strategy for feature selection. Proceedings of the Ninth International Conference on Machine Learning, Aberdeen, Scotland, 1992; 355-360.
29. Aha DW, Kibler D, Albert MK,. Instance-based learning algorithms. Machine Learning 1991; 6 (1): 37-66. (Pubitemid 21727227)
30. Haykin S,. Neural Networks: A Comprehensive Foundation (2nd edn). Prentice-Hall: Englewood Cliffs, NJ, 1998.
31. Shawe-Taylor J, Cristianini N,. Support Vector Machines (2nd edn). Cambridge University Press: Cambridge, 2000.
32. John GH, Langley P,. Estimating continuous distributions in Bayesian classifiers. Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence, San Mateo, vol. 2, 1995; 338-345.
33. Le Cessie S, Van Houwelingen JC,. Ridge estimators in logistic regression. Applied Statistics 1992; 41 (1): 191-201.
34. Domingos P, Pazzani M,. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning 1997; 29 (2-3): 103-130. (Pubitemid 127510035)
35. Sokolova M, Japkowicz N, Szpakowicz S,. Beyond accuracy, f-score and ROC: A family of discriminant measures for performance evaluation. Proceedings of the Australian Conference on Artificial Intelligence, Hobart, Australia, 2006; 1015-1021.
36. Platt JC,. Advances in kernel methods-Support vector learning. Fast Training of Support Vector Machines using Sequential Minimal Optimization. MIT Press: Cambridge, MA, 1999; 185-208.
37. Aha DW,. Lazy learning. Kluwer Academic Publishers: Norwell, MA, U.S.A., 1997.
38. Fawcett T,. An introduction to ROC analysis. Pattern Recognition Letters 2006; 27 (8): 861-874.
39. Fogarty J, Baker RS, Hudson SE,. Case studies in the use of roc curve analysis for sensor-based estimates in human computer interaction. Proceedings of Graphics Interface 2005. The Canadian Human-Computer Communications Society: Victoria, BC, Canada, 2005; 129-136. (Pubitemid 43211958)
40. Tan PN, Steinbach M, Kumar V,. Introduction to Data Mining. Addison-Wesley: Reading, MA, 2006.
41. Jiang Y, Lin J, Cukic B, Menzies T,. Variance analysis in software fault prediction models. Proceedings of the 20th IEEE International Symposium on Software Reliability Engineering, Bangalore, Mysore, India, 2009; 99-108.
42. Menzies T, Greenwald J, Frank A,. Data mining static code attributes to learn defect predictors. IEEE Transactions on Software Engineering 2007; 33 (1): 2-13. (Pubitemid 46002165)
43. Khoshgoftaar TM, Golawala M, Van Hulse J,. An empirical study of learning from imbalanced data using random forest. Proceedings of the 19th IEEE International Conference on Tools with Artificial Intelligence, vol. 2. IEEE Computer Society: Washington, DC, U.S.A., 2007; 310-317.
44. Berenson ML, Goldstein M, Levine D,. Intermediate Statistical Methods and Applications: A Computer Package Approach (2nd edn). Prentice-Hall: Englewood Cliffs, NJ, 1983.
45. Wohlin C, Runeson P, Host M, Ohlsson MC, Regnell B, Wesslen A,. Experimentation in Software Engineering: An Introduction, Kluwer International Series in Software Engineering. Kluwer Academic Publishers: Boston, MA, 2000.
46. Votta LG, Porter AA,. Experimental software engineering: A report on the state of the art. Proceedings of the 17th International Conference on Software Engineering. IEEE Computer Society: Seattle, WA, U.S.A., 1995; 277-279.