On the influence of imputation in classification: Practical issues

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 21, Issue 1, 2009, Pages 43-58

  Hruschka, Eduardo R ^a   Garcia, Antonio J T ^b   Hruschka, Estevam R ^c   Ebecken, Nelson F F ^d  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b IBM Brazil   (Brazil)

^c FEDERAL UNIVERSITY OF SÃO CARLOS   (Brazil)

^d FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

Bayesian methods; Classification; Imputation; Missing values

Indexed keywords

DECISION TREES; INFERENCE ENGINES;

ALTERNATIVE APPROACHES; BAYESIAN METHODS; CLASSIFICATION; DATA PREPARATIONS; DATA-SETS; IMPUTATION; IMPUTATION METHODS; MISSING VALUES; MODELLING TOOLS; NAIVE BAYES; NEAREST NEIGHBOURS; PRACTICAL ISSUES; PRACTICAL PROCEDURES; PREDICTION CAPABILITIES;

BAYESIAN NETWORKS;

EID: 61449247372     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/09528130802246602     Document Type: Article

References (49)

1. Acuña, E., and Rodriguez, C. (2004), 'The Treatment of Missing Values and its Effect in the Classifier Accuracy,' in Classification, Clustering and Data Mining Applications, eds. D. Banks, L. House, F.R. McMorris, P. Arabic and W. Gaul, Heidelberg, Berlin: Springer-Verlag, pp. 639-648.
2. Aggarwal, C.C., and Parthasarathy, S. (2001), 'Mining Massively Incomplete Data Sets by Conceptual Reconstruction,' Proceedings of the ACM Knowledge Discovery from Databases (KDD 2001), San Francisco, CA: ACM, pp. 227-232.
3. Anderson, R.L. (1946), 'Missing Plot Techniques,' Biometrics, 2, 41-47.
4. Batista, G.E.A.P., and Monard, M.C. (2003), 'An Analysis of Four Missing Data Treatment Methods for Supervised Learning,' Applied Artificial Intelligence, 17(5-6), 519-534.
5. Bilmes, J. (1997), "A Gentle Tutorial on the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models", Technical Report, University of Berkeley, ICSI-TR-97-021,
6. Breiman, L., Friedman, J.H., Olshen, R.A., and Stone, C.J. (1983), CART: Classification and Regression Trees, Wadsworth, CA: Chapman & Hall.
7. Cooper, G., and Herskovitz, E. (1992), 'A Bayesian Method for the Induction of Probabilistic Networks from Data,' Machine Learning, 9, 309-347.
8. Dempster, A.P., Laird, MM., and Rubin, D.B. (1977), 'Maximum Likelihood from Incomplete Data via the EM algorithm,' Journal of the Royal Statistical Society B, 39, 1-39.
9. Di Zio, M., Scanu, M., Coppola, L., Luzi, O., and Ponti, A. (2004), 'Bayesian Networks for Imputation,' Journal of the Royal Statistical Society A, 167(2), 309-322.
10. Domingos, P., and Pazzani, M. (1997), 'On the Optimality of the Simple Bayesian Classifier under Zero-One Loss,' Machine Learning, 29, 103-130.
11. Friedman, H.F., Kohavi, R., and Yun, Y. (1996), 'Lazy Decision Trees,' Proceedings of the 13th National Conference on Artificial Intelligence, Cambridge, MA: AAAI Press/MIT Press, pp. 717-724.
12. Garcia, A.J.T., and Hruschka, E.R. (2005), 'Naïve Bayes as an Imputation Tool for Classification Problems,' Proceedings of the Fifth International conference on Hybrid Intelligent Systems (HIS05), Piscataway, NJ: IEEE Computer Society, pp. 497-499.
13. Ghahramami, Z., and Jordan, M. (1995), "Learning from incomplete data", Technical Report AI Lab Memo No. 1509, CBCL Paper No. 108, MIT AI Lab.
14. Hruschka Jr, E.R., and Ebecken, N.F.F. (2002), 'Missing Values Prediction with K2,' Intelligent Data Analysis, Netherlands, 6(6), 557-566.
15. Hruschka, E.R., Hruschka Jr. E.R., and Ebeeken, N.F.F. (2004), 'Towards Efficient Imputation by Nearest-Neighbors: A Clustering Based Approach,' Lecture Notes in Artificial Intelligence 3339, USA: Springer, pp. 513-525.
16. Hruschka Jr, E.R., Hruschka, E.R., and Ebecken, N.F.F. (2007), 'Bayesian Networks for Imputation in Classification Problems,' Journal of Intelligent Information Systems, 29, 231-252,
17. lohn, G.H., and Langley, P. (1995), 'Estimating Continuous Distributions in Bayesian Classifiers,' Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA: Morgan Kaufmann, pp. 338-345.
18. Jordan, M., and Xu, L. (1996), 'Convergence Results for the EM Approach to Mixtures of Experts Architectures,' Neural Networks, 8, 1409-1431.
19. Karmaker, A., and Kwek, S. (2005), 'An EM-Approach for Handling Missing Values in Classification Problems,' Proceedings of the Hybrid Intelligent Systems (HIS'05), Piscataway, NJ: IEEE Press, pp. 309-314.
20. Kim, K., Kim, B., and Yi, G. (2004), 'Reuse of Imputed Data in Microarray Analysis Increases Imputation Efficiency,' BMC Bioinformatics, 5, 160.
21. Kim, H., Golub, G.H., and Park, H. (2005), 'Missing Value Estimation for DNA Microarray Gene Expression Data: Local Least Squares Imputation,' Bioinformatics, 21(2), 187-198.
22. King, G., Honaker, J., Joseph, A., and Scheve, K. (2001), 'Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation,' American Political Science Review, 95(1), 49-69.
23. Kononenko, I., Bratko, I., Roskar, E. (1984), 'Experiments in Automatic Learning of Medical Diagnostic Rules', Technical Report, Jozef Stefan Institute, Ljubjana, Slovenia.
24. Little, R., and Rubin, D.B. (1987), Statistical Analysis with Missing Data, New York: John Wiley & Sons.
25. Lobo, O.O., and Noneao, M. (2000), 'Ordered Estimation of Missing Values for Propositional Learning,' Journal of the Japanese Society for Artificial Intelligence, 15(1), 162-168.
26. Melville, P., Saar-Tsechansky, M., Provost, F., and Mooney, R.J. (2005), 'Economical Active Feature-value Acquisition through Expected Utility Estimation,' Proceedings of the KDD-05 Workshop on Utility-Based Data Mining, Chicago, IL: ACM, pp. 1-7.
27. Merz, C.J., Murphy, P.M. (1997), UCI Repository of Machine Learning Databases, [http://www.ics.uci.edu]. Irvine, CA: University of California, Department of Information and Computer Science.
28. Pearl, J. (1988), Probabilistic Reasoning in Intelligent Systems, San Francisco, CA: Morgan Kaufmann.
29. Preece, A.D. (1971), 'Iterative Procedures for missing values in Experiments,' Technometrics, 13, 743-753.
30. Pyle, D. (1999), Data Preparation for Data Mining, San Diego, CA: Academic Press.
31. Quinlan, J.R. (1986), 'Induction of Decision Trees,' Machine Learning, 1, 81-106.
32. -. (1989), 'Unknown Attribute Values in Induction,' Proceedings of 6th International Workshop on Machine Learning, Ithaca, NY: Morgan Kaufmann, pp. 164-168.
33. -. (1993), C4.5: Programs for Machine Learning, San Francisco, CA: Morgan Kaufmann.
34. Redner, R., and Walker, H. (1984), 'Mixture Densities, Maximum Likelihood and the EM Algorithm,' SIAM Review, 26(2), 195-239.
35. Rubin, D.B. (1977), 'Formalizing Subjective Notion about the Effects of Nonrespondents in Samples Surveys,' Journal of the American Statistical Association, 72, 538-543.
36. -. (1976), 'Inference and Missing Data,' Biometrika, 63, 581-592.
37. -. (1987), Multiple Imputation for Non-Responses in Surveys, New York: John Wiley & Sons.
38. Schafer, J.L. (2000), Analysis of Incomplete Multivariate Data, Boca Raton, FL: Chapman & Hall/CRC.
39. Schafer, J.L., and Graham, J.W. (2002), 'Missing Data: Our View of the State of the Art,' Psychological Methods, 7(2), 147-177.
40. Scheel, I., Aldrin, M., Glad, I.K., Sørum, R., Lyng, H., and Frigessi, A. (2005), 'The Influence of Missing Value Imputation on Detection of Differentially Expressed Genes from Microarray Data,' Bioinformatics, 21, 4272-4279.
41. Song, Q., Shepperd, M., Cartwright, M., and Twala, B. (2007), 'A New Imputation Method for Small Software Project Data Sets,' Journal of Systems and Software, 80(1), 51-62.
42. Tanner, M.A., and Wong, W.H. (1987), 'The Calculation of Posterior Distributions by Data Augmentation (with Discussion),' Journal of the American Statistical Association, 82, 528-550.
43. Troyanskaya, O.G., Cantor, M., Sherlock, G., Brown, P., Hastie, T., Tibshirani, R., Botstein, D., and Altman, R.B. (2001), 'Missing Value Estimation Methods for DNA Microarrays,' Bioinformatics, 17(6), 520-525.
44. Wasito, I., and Mirkin, B. (2005), 'Nearest Neighbour Approach in the Least Squares Data Imputation Algorithms,' Information Sciences, 169, 1-25.
45. White, A.P. (1987), 'Probabilistic Induction by Dynamic Path Generation in Virtual Trees,' in Research and Development in Expert Systems III, ed. M.A. Bramer, Cambridge University Press, pp. 35-46.
46. Witten, I.H., and Frank, E. (2000), Data Mining-Practical Machine Learning Tools and Techniques with Java Implementations, USA: Morgan Kaufmann Publishers.
47. Wu, C.F.J. (1983), 'On the Convergence Properties of the EM Algorithm,' The Annals of Statistics, 11(1), 95-103.
48. Wu, X., and Barbará, D. (2002), 'Learning Missing Values from Summary Constraints,' SIGKDD Explorations, 4(1), 21-30.
49. Yang, Y., and Webb, G.I. (2003), 'On Why Discretization Works for Naïve-Bayes Classifiers,' Lecture Notes on Artificial Intelligence (LNAI 2903), 2903, 440-452.