A novel framework for imputation of missing values in databases

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 37, Issue 5, 2007, Pages 692-709

  Farhangfar, Alireza ^a   Kurgan, Lukasz A ^a   Pedrycz, Witold ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Accuracy; Databases; Missing values; Multiple imputation (MI); Single imputation

Indexed keywords

ALGORITHMS; ASYMPTOTIC ANALYSIS; COMPUTATIONAL COMPLEXITY;

MULTIPLE IMPUTATION (MI); SINGLE IMPUTATION;

DATABASE SYSTEMS;

EID: 34548234315     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2007.902631     Document Type: Article

References (59)

1. E. Acuna and C. Rodriguez, "The treatment of missing values and its effect in the classifier accuracy," in Classification, Clustering and Data Mining Applications, D. Banks, L. House, F. R. McMorris, P. Arabie, and W. Gaul, Eds. Berlin, Germany: Springer-Verlag, 2004, pp. 639-648.
2. C. Alzola and F. Harrell, An Introduction of S-Plus and the Hmisc and Design Libraries, 1999. [Online]. Available: http:// www.med.virginia.edu/medicine/clinical/hes
3. J. Barnard and X. L. Meng, "Applications of multiple imputation in medical studies: From AIDS to NHANES," Stat. Methods Med. Res., vol. 8, no. 1, pp. 17-36, Jan. 1999.
4. G. Batista and M. Monard, "An analysis of four missing data treatment methods for supervised learning," Appl. Artif. Intell., vol. 17, no. 5/6, pp. 519-533, 2003.
5. C. L. Blake and C. J. Merz, UCI Repository of Machine Learning Databases. Irvine, CA: Univ. California at Irvine, Dept. Inf. and Comput. Sci.,1998. [Online]. Available: http://www.ics.uci.edu/~mlearn/ MLRepository.html
6. J. P. L. Brand, "Development, implementation and evaluation of multiple imputation strategies for the statistical analysis of incomplete datasets," Ph.D. dissertation, Erasmus Univ., Rotterdam, The Netherlands, 1999.
7. P. Brazdil, J. Gama, and R. Henery, "Characterizing the applicability of classification algorithms using meta level learning," in Proc. ECML, 1994, pp. 83-102.
8. S. F. Buck, "A method of estimation of missing values in multivariate data suitable for use with an electronic computer," J. R. Stat. Soc. vol. B22, no. 2, pp. 302-306, 1960.
9. S. Buuren and C. G. M. Oudshoorn, Flexible Multivariate Imputation by MICE. Leiden, The Netherlands: TNO Preventie en Gezondheid, 1999. TNO/VGZ/PG 99.054.
10. S. Buuren and C. G. M. Oudshoorn, Flexible Multivariate Imputation by MICE. Leiden, The Netherlands: TNO Preventie en Gezondheid, 1999. TNO/VGZ/PG 99.045.
11. S. V. Buuren, E. M. Mulligen, and J. P. L. Brand, "Routine multiple imputation in statistical databases," in Proc. 7th Int. Work. Conf. Sci. and Statistical Database Manage., J. C. French and H. Hinterberger, Eds., Los Alamitos, CA, 1994, pp. 74-78.
12. G. Casella and E. L. George, "Explaining the Gibbs sampler," Amer. Stat., vol. 46, no. 3, pp. 167-174, Aug. 1992.
13. K. Chan, T. W. Lee, and T. J. Sejnowski, "Variational Bayesian learning of ICA with missing data," Neural Comput., vol. 15, no. 8, pp. 1991-2011, Aug. 2003.
14. P. Cheeseman, J. Kelly, M. Self, J. Stutz, W. Taylor, and D. Freeman, "Autoclass: A Bayesian classification system," in Proc. 5th Int. Workshop Mach. Learn., Ann Arbor, MI, 1988, pp. 54-64.
15. K. J. Cios and L. A. Kurgan, "Hybrid inductive machine learning: An overview of CLIP algorithms," in New Learning Paradigms in Soft Computing, L. C. Jain and J. Kacprzyk, Eds. New York: Springer-Verlag, 2001, pp. 276-322.
16. K. J. Cios and L. A. Kurgan, "CLIP4: Hybrid inductive machine learning algorithm that generates inequality rules," Inf. Sci., vol. 163, no. 1-3, pp. 37-83, 2004.
17. K. J. Cios and G. Moore, "Uniqueness of medical data mining," Artif. Intell. Med., vol. 26, no. 1/2, pp. 1-24, Sep./Oct. 2002.
18. K. J. Cios, W. Pedrycz, and R. Swiniarski, Data Mining Methods for Knowledge Discovery. Norwell, MA: Kluwer, 1998.
19. C. Conversano and C. Capelli, "Missing data incremental imputation through tree-based methods," in Proc. COMPSTAT, W. Hardle and B. Ronz, Eds., 2002, pp. 455-460.
20. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm (with discussion)," J. R. Stat. Soc., vol. 82, pp. 528-550, 1978.
21. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis Hoboken, NJ: Wiley, 1977.
22. A. Farhangfar, L. A. Kurgan, and W. Pedrycz, "Experimental analysis of methods for imputation of missing values in databases," in Proc. Intell. Comput.: Theory and Appl. II Conf., Conjunction with SPIE Defense and Security Symp. (formerly AeroSense), Orlando, FL, 2004, pp. 172-182.
23. A. J. Feelders, "Handling missing data in trees: Surrogate splits or statistical imputation," in Proc. 3rd Eur. Conf. PKDD, 1999, pp. 329-334.
24. B. M. Ford, An Overview of Hot-Deck Procedures. Incomplete Data in Sample Surveys, vol. 2. New York: Academic, 1983.
25. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. 13th Int. Conf. Mach. Learn., 1996, pp. 146-148.
26. Z. Ghahramani and M. I. Jordan, "Mixture models for learning from incomplete data," in Computational Learning Theory and Natural Learning Systems, vol. 4, Making Learning Systems Practical, R. Greiner, T. Petsche, and S. J. Hanson, Eds. Cambridge, MA: MIT Press, 1997, pp. 67-85.
27. S. Hettich and S. D. Bay, The UCI KDD Archive. Irvine, CA: Univ. California, Dept. Inf. and Comput. Sci., 1999. [Online]. Available: http://kdd.ics.uci.edu
28. N. J. Horton and S. R. Lipsitz, "Multiple imputation in practice: Comparison of software packages for regression models with missing variables," Amer. Stat., vol. 55, no. 3, pp. 244-254, 2001.
29. H. Junninen, H. Niska, K. Tuppurainen, J. Ruuskanen, and M. Kolehmainen, "Methods for imputation of missing values in air quality data sets," Atmos. Environ., vol. 38, no. 18, pp. 2895-2907, Jun. 2004.
30. L. A. Kurgan, K. J. Cios, M. Sontag, and F. J. Accurso, "Mining the cystic fibrosis data," in Next Generation of Data-Mining Applications, J. Zurada and M. Kantardzic, Eds. Piscataway, NJ: IEEE Press, 2005, pp. 415-444.
31. K. Lakshminarayan, S. A. Harp, and T. Samad, "Imputation of missing data in industrial databases," Appl. Intell., vol. 11, no. 3, pp. 259-275, Nov./Dec. 1999.
32. K.-H. Li, "Imputation using Markov chains," J. Comput. Simul., vol. 30, no. 1, pp. 57-79, 1988.
33. R. J. Little and D. B. Rubin, Statistical Analysis With Missing Data Hoboken, NJ: Wiley, 1987.
34. B. F. J. Manly, Multivariate Statistical Methods: A Primer, 2nd ed. London, U. K.: Chapman & Hall, 1994.
35. D. Michie, D. J. Spiegelhalterand, and C. Taylor, Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood, 1994.
36. T. M. Mitchell, Machine Learning. New York: McGraw-Hill, 1997.
37. A. Naeim, E. B. Keeler, and C. M. Mangione, "Options for handling missing data in the health utilities index mark 3," Med. Decision Making, vol. 25, no. 2, pp. 186-198, 2005.
38. H. L. Oh and F. L. Scheuren, "Weighting adjustments for unit nonresponse, incomplete data in sample survey," in Theory and Bibliographies, vol. 2, W. G. Madow, I. Olkin, and D. B. Rubin, Eds. New York: Academic, 1983, pp. 143-183.
39. J. R. Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1992.
40. J. R. Quinlan, "Induction of decision trees," Mach. Learn., vol. 1, no. 1, pp. 81-106, 1986.
41. A. Ragel, "A preprocessing method to treat missing values in knowledge discovery in databases," Comput. Inf. Syst., vol. 2, pp. 66-72, 2000.
42. D. B. Rubin and J. L. Schafer, "Efficiently creating multiple imputation for incomplete multivariate normal data," in Proc. Stat. Comput. Section, 1990, pp. 83-88.
43. D. B. Rubin, "Formalizing subjective notions about the effect of nonrespondents in sample surveys," J. Amer. Stat. Assoc., vol. 72, no. 359, pp. 538-543, Sep. 1977.
44. D. B. Rubin, "Multiple imputation after 18+ years," J. Amer. Stat. Assoc., vol. 91, no. 434, pp. 473-489, Jun. 1996.
45. D. B. Rubin, Multiple Imputations for Nonresponse in Surveys. New York: Wiley, 1987.
46. D. B. Rubin, "Multiple imputations in sample surveys," in Proc. Survey Res. Methods Section Amer. Stat. Assoc., 1978, pp. 20-34.
47. M. M. Rueda, S. González, and A. Arcos, "Indirect methods of imputation of missing data based on available units," Appl. Math. Comput., vol. 164, no. 1, pp. 249-261, May 2005.
48. G. Sande, Hot-Deck Imputation Procedures, Incomplete Data in Sample Surveys, vol. 3. New York: Academic, 1983.
49. W. S. Sarle, "Prediction with missing inputs," in Proc. 4th JCIS 1998, vol. 2, pp. 399-402.
50. R. E. Schapire, "A brief introduction to boosting," in Proc. 16th Int. Joint Conf. Artif. Intell., 1999, pp. 1401-1406.
51. J. L. Shafer, Analysis of Incomplete Multivariate Data. London, U.K.: Chapman & Hall, 1997.
52. J. L. Shafer, "Multiple imputations: A primer," Stat. Methods Med. Res., vol. 8, pp. 3-15, 1999.
53. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, 1948.
54. G. W. Snedecor and W. G. Cochran, Statistical Methods, 8th ed. Ames, IA: Iowa State Univ. Press, 1989.
55. V. Tresp, R. Neuneier, and S. Ahmad, "Efficient methods for dealing with missing data in supervised learning," in Advances in Neural Information Processing Systems 7, G. Tesauro, D. S. Touretzky, and T. K. Leen, Eds. Cambridge, MA: MIT Press, 1995, pp. 689-696.
56. W. Vach, "Missing values: Statistical theory and computational practice," in Computational Statistics, P. Dirschedl and R. Ostermann, Eds. Heidelberg, Germany: Physica-Verlag, 1994, pp. 345-354.
57. R. Winter and K. Auerbach, Contents Under Pressure, May 2004, Intelligent Enterprise. [Online]. Available: http:// www.intelligententerprise.com/showArticle.jhtml?articleID=18902161
58. W. Zhang, "Association based multiple imputation in multivariate datasets: A summary," in Proc. 16th ICDE, 2000, pp. 310-311.
59. P. Zhang, "Multiple imputation: Theory and method (with discussion," Int. Stat. Rev., vol. 71, no. 3, pp. 581-592, 2003.