A comprehensive empirical evaluation of missing value imputation in noisy software measurement data

Journal of Systems and Software

Volumn 81, Issue 5, 2008, Pages 691-708

  Van Hulse, Jason ^a   Khoshgoftaar, Taghi M ^a  

^a Florida Atlantic Univ   (United States)

Author keywords

Bayesian multiple imputation; Data quality; Imputation; Missing data; Software quality

Indexed keywords

COMPUTER SIMULATION; DATABASE SYSTEMS; INFORMATION RETRIEVAL; SOFTWARE ENGINEERING;

BAYESIAN MULTIPLE IMPUTATION; DATA QUALITY; IMPUTATION; MISSING DATA; SOFTWARE QUALITY;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 40749151020     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2007.07.043     Document Type: Article

References (29)

1. Allison, P.D., 2001. Missing Data. 07-136 Sage University Papers Series on Quantitative Applications in the Social Sciences. Thousand Oaks, Sage, CA.
2. Berenson M.L., Levine D.M., and Goldstein M. Intermediate Statistical Methods and Applications: A Computer Package Approach (1983), Prentice-Hall, Inc.
3. Bremaud P. Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues (1999), Springer
4. Cartwright, M.H., Shepperd, M.J., Song, Q. 2003. Dealing with missing software project data. In: Nineth IEEE International Software Metrics Symposium, pp. 154-165.
5. Fenton N.E., and Pfleeger S.L. Software Metrics: A Rigorous and Practical Approach. second ed. (1997), PWS Publishing Company: ITP, Boston, MA
6. Jonsson, P., Wohlin, C. 2004. An evaluation of k-nearest neighbour imputation using likert data. In: Tenth IEEE International Symposium on Software Metrics (METRICS'04), pp. 108-118.
7. Khoshgoftaar T.M., and Allen E.B. Classification of fault-prone software modules: prior probabilities, costs and model evaluation. Empirical Software Engineering 3 (1998) 275-298
8. Khoshgoftaar T.M., and Seliya N. Analogy-based practical classification rules for software quality estimation. Empirical Software Engineering Journal 8 4 (2003) 325-350
9. Khoshgoftaar T.M., and Seliya N. Fault-prediction modeling for software quality estimation: comparing commonly used techniques. Empirical Software Engineering Journal 8 3 (2003) 255-283
10. Khoshgoftaar T.M., and Seliya N. The necessity of assuring quality in software measurement data. Proceedings of Tenth International Software Metrics Symposium, September, Chicago, IL (2004), IEEE Computer Society 119-130
11. Khoshgoftaar T.M., and Van Hulse J. Determining noisy instances relative to attributes of interest. Intelligent Data Analysis: An International Journal 10 3 (2006) 251-268
12. Khoshgoftaar, T.M., Van Hulse, J. 2006b. Multiple imputation of software measurement data: a case study. In: International Conference on Software Engineering and Knowledge Engineering (SEKE'2006), July, pp. 220-226.
13. Khoshgoftaar T.M., Zhong S., and Joshi V. Enhancing software quality estimation using ensemble-classifier based noise filtering. Intelligent Data Analysis: An International Journal 6 1 (2005) 3-27
14. Khoshgoftaar, T.M. Van Hulse, J., Seiffert, C. 2006. A hybrid approach to cleansing software measurement data. In: Proceedings of the Eighteenth IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2006), November 13-15, Washington, DC, pp. 713-722.
15. Little R.J.A., and Rubin D.B. Statistical Analysis with Missing Data. second ed. (2002), John Wiley and Sons, Hoboken, NJ
16. Moses J., and Farrow M. Assessing variation in development effort consistency using a data source with missing data. Software Quality Journal 13 (2005) 71-89
17. Myrtveit I., Stensrud E., and Olsson U. Analyzing data sets with missing data: an empirical evaluation of imputation methods and likelihood-based methods. IEEE Transactions on Software Engineering 27 11 (2001) 999-1013 (November)
18. Rubin D.B. Multiple Imputation for Nonresponse in Surveys (1987), John Wiley and Sons
19. SAS Institute, 2004. SAS/STAT User's Guide. SAS Institute Inc.
20. Schafer J.L. Analysis of Incomplete Multivariate Data (2000), Chapman and Hall/CRC
21. Schafer J.L., and Olsen M.K. Multiple imputation for multivariate missing-data problems: a data analyst's perspective. Multivariate Behavioral Research 33 4 (1998) 545-571
22. Song Q., Shepperd M.J., and Cartwright M.H. A short note on safest default missingness mechanism assumptions. Empirical Software Engineering 10 2 (2005) 235-243
23. Strike K., Emam K.E., and Madhavji N. Software cost estimation with incomplete data. IEEE Transactions on Software Engineering 27 10 (2001) 890-908 October
24. Tanner M.A., and Wong W.H. The calculation of posterior distributions by data augmentation. Journal of the American Statistical Society 82 (1987) 528-550
25. Twala, B., Cartwright, M.H. 2005. Ensemble imputation methods for missing software engineering data. In: Proceedings of Eleventh IEEE International Software Metrics Symposium, pp. 30-40.
26. Van Hulse J., Khoshgoftaar T.M., and Huang H. The pairwise attribute noise detection algorithm. Knowledge and Information Systems Journal, Special Issue on Mining Low Quality Data 11 2 (2007) 171-190
27. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques with JAVA Implementations. second ed. (2005), Morgan Kaufmann, San Francisco, CA
28. Wohlin C., Runeson P., Host M., Ohlsson M.C., Regnell B., and Wesslen A. Experimentation in Software Engineering: An Introduction. Kluwer International Series in Software Engineering (2000), Kluwer Academic Publishers, Boston, MA
29. Yuan, Y.C., 2000. Multiple imputation for missing data: concepts and new development. In: Proceedings of the Twenty-fifth Annual SAS Users Group International Conference. SAS Institute, Paper No. 267.