Attribute selection and imbalanced data: Problems in software defect prediction

Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI

Volumn 1, Issue , 2010, Pages 137-144

  Khoshgoftaar, Taghi M ^a   Gao, Kehan ^b   Seliya, Naeem ^c  

^a FLORIDA ATLANTIC UNIVERSITY   (United States)

^b EASTERN CONNECTICUT STATE UNIVERSITY   (United States)

^c UNIVERSITY OF MICHIGAN DEARBORN   (United States)

Author keywords

Data sampling; Defect prediction; Feature selection; Software measurements

Indexed keywords

APPLICATION DOMAINS; ATTRIBUTE SELECTION; CLASS IMBALANCE; CLASSIFICATION MODELS; DATA SAMPLING; DEFECT PREDICTION; DEFECT PREDICTION MODELS; EMPIRICAL RESULTS; FEATURE SELECTION; IMBALANCED DATA; KEY PROBLEMS; MACHINE LEARNING COMMUNITIES; MACHINE-LEARNING; RESEARCH OBJECTIVES; SAMPLED DATA; SOFTWARE DEFECT PREDICTION; SOFTWARE MEASUREMENT; SOFTWARE MEASUREMENT DATA; SOFTWARE PROJECT; SOFTWARE QUALITY PREDICTION; TRAINING DATA;

ARTIFICIAL INTELLIGENCE; COMPUTER SOFTWARE SELECTION AND EVALUATION; DEFECTS; FORECASTING; LEARNING SYSTEMS; MATHEMATICAL MODELS; MODELS; SOFTWARE ENGINEERING;

FEATURE EXTRACTION;

EID: 78751556705     PISSN: 10823409     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICTAI.2010.27     Document Type: Conference Paper

References (25)

1. M. L. Berenson, M. Goldstein, and D. Levine. Intermediate Statistical Methods and Applications: A Computer Package Approach. Prentice-Hall, Englewood Cliffs, NJ, 2 edition, 1983.
2. G. Boetticher, T. Menzies, and T. Ostrand. Promise repository of empirical software engineering data, 2007.
3. N. V. Chawla, K. W. Bowyer, L. O. Hall, and P. W. Kegelmeyer. SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16:321-357, 2002.
4. Z. Chen, T. Menzies, D. Port, and B. Boehm. Finding the right data for software cost modeling. IEEE Software, (22):38-46, 2005.
5. D. A. Cieslak, N. V. Chawla, and A. Striegel. Combating imbalance in network intrusion datasets. In Proceedings of 2006 IEEE International Conference on Granular Computing, pages 732- 737, Athens, Georgia, May 2006.
6. C. Elkan. The foundations of cost-sensitive learning. In Proceedings of the Seventeenth International Conference on Machine Learning, page 239?246, 2001.
7. V. Engen, J. Vincent, and K. Phalp. Enhancing network based intrusion detection for imbalanced data. International Journal of Knowledge-Based and Intelligent Engineering Systems, 12(5-6):357-367, 2008.
8. A. Estabrooks, T. Jo, and N. Japkowicz. A multiple resampling method for learning from imbalanced data sets. International Journal of Computational Intelligence, 20(1):18-36, 2004.
9. K. Gao, T. M. Khoshgoftaar, H. Wang, and N. Seliya. Choosing software metrics for defect prediction: An investigation on feature selection techniques. Technical Report FAU-CSETR-2009-11-2, Florida Atlantic University, Boca Raton, FL, November 2009.
10. M. A. Hall and G. Holmes. Benchmarking attribute selection techniques for discrete class datamining. IEEE Transactions on Knowledge and Data Engineering, 15(6):1437-1447, Nov/Dec 2003.
11. Y. Jiang, J. Lin, B. Cukic, and T. Menzies. Variance analysis in software fault prediction models. In Proceedings of the 20th IEEE International Symposium on Software Reliability Engineering, pages 99-108, Bangalore-Mysore, India, Nov. 16-19 2009.
12. A. H. Kamal, X. Zhu, A. S. Pandya, S. Hsu, and M. Shoaib. The impact of gene selection on imbalanced microarray expression data. In Proceedings of the 1st International Conference on Bioinformatics and Computational Biology; Lecture Notes in Bioinformatics; Vol. 5462, pages 259-269, New Orleans, LA, 2009.
13. T. M. Khoshgoftaar, M. Golawala, and J. V. Hulse. An empirical study of learning from imbalanced data using random forest. In Proceedings of the 19th IEEE International Conference on Tools with Artificial Intelligence, volume 2, pages 310-317, Washington, DC, USA, 2007. IEEE Computer Society.
14. T. M. Khoshgoftaar, P. Rebours, and N. Seliya. Software quality analysis by combining multiple projects and learners. Software Quality Journal, 17(1):25-49, March 2009.
15. K. Kira and L. A. Rendell. A practical approach to feature selection. In Proceedings of 9th International Workshop on Machine Learning, pages 249-256, 1992.
16. S. Lessmann, B. Baesens, C. Mues, and S. Pietsch. Benchmarking classification models for software defect prediction: A proposed framework and novel findings. IEEE Transactions on Software Engineering, 34(4):485-496, July-August 2008.
17. H. Liu, H. Motoda, and L. Yu. A selective sampling approach to active feature selection. Artificial Intelligence, 159(1-2):49-74, November 2004.
18. H. Liu and L. Yu. Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering, 17(4):491-502, 2005.
19. R. L. Plackett. Karl pearson and the chi-squared test. International Statistical Review, 51(1):59?72, 1983.
20. Y. Saeys, T. Abeel, and Y. Peer. Robust feature selection using ensemble feature selection techniques. In Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases - Part II (2008), pages 313-325, 2008.
21. C. Seiffert, T. Khoshgoftaar, and J. Van Hulse. Improving software-quality predictions with data sampling and boosting. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 39(6):1283-1294, Nov. 2009.
22. H. Wang, T. M. Khoshgoftaar, K. Gao, and N. Seliya. Mining data from multiple software development projects. In Proceedings of the 3rd IEEE International Workshop Mining Multiple Information Sources, pages 551-557, Miami, FL, Dec. 6 2009.
23. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2 edition, 2005.
24. X.-M. Zhao, X. Li, L. Chen, and K. Aihara. Protein classification with imbalanced data. Proteins: Structure, Function, and Bioinformatics, 70(4):1125-1132, 2007.
25. T. Zimmermann, R. Premraj, and A. Zeller. Predicting defects for eclipse. In Proceedings of the 29th International Conference on Software Engineering Workshops, page 76, Washington, DC, USA, 2007. IEEE Computer Society.