Missing data in medical databases: Impute, delete or classify?

Artificial Intelligence in Medicine

Volumn 58, Issue 1, 2013, Pages 63-72

  Cismondi, Federico ^a,b,c   Fialho, André S ^a,b,c   Vieira, Susana M ^b   Reti, Shane R ^c   Sousa, João M C ^b   Finkelstein, Stan N ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^c HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Fuzzy systems; Intensive care unit; Missing data classification; Statistical classifier; Test bed

Indexed keywords

ACCURACY OF CLASSIFICATIONS; INFORMATION SOURCES; MEDICAL GUIDELINES; MISSING DATA; MODELING PERFORMANCE; SIMULATION TEST BEDS; STATISTICAL CLASSIFIER; STATISTICAL POWER;

DATABASE SYSTEMS; EQUIPMENT TESTING; FUZZY SYSTEMS; INFORMATION MANAGEMENT; INTENSIVE CARE UNITS; MEDICAL COMPUTING;

CLASSIFICATION (OF INFORMATION);

ARTICLE; DATA BASE; FUZZY LOGIC; HUMAN; INFORMATION PROCESSING; MEDICAL INFORMATION SYSTEM; PRIORITY JOURNAL; SAMPLING; SENSITIVITY AND SPECIFICITY; SURVIVAL PREDICTION;

DATABASES, FACTUAL; FUZZY LOGIC; HUMANS; INTENSIVE CARE UNITS; MODELS, STATISTICAL; ROC CURVE;

EID: 84876973042     PISSN: 09333657     EISSN: 18732860     Source Type: Journal    
DOI: 10.1016/j.artmed.2013.01.003     Document Type: Article

References (40)

1. Sackett D.L., Rosenberg W.M., Gray J.A., Haynes R.B., Richardson W.S. Evidence based medicine: what it is and what it isnt. British Medical Journal 1996, 312:71-72.
2. Brilli R.J., Spevetz A., Branson R.D., Campbell G.M., Cohen H., Dasta J.F., et al. Critical care delivery in the intensive care unit: defining clinical roles and the best practice model. Critical Care Medicine 2001, 29(10):2007-2019.
3. Aigner W., Miksch S., Müller W., Schumann H., Tominski C. Visual methods for analyzing time-oriented data. IEEE Transactions on Visualization and Computer Graphics 2008, 14(1):47-60.
4. Heitjan D.F. Annotation: what can be done about missing data?. American Journal of Public Health 1997, 87(4):548-550.
5. Erdogan E., Ma S., Beygelzimer A., Rish I. Statistical models for unequally spaced time series. SIAM 2004.
6. Allison PD. Missing data. Sage University papers series on quantitative applications in the social sciences. Thousand Oaks, CA: SAGE Publications; 2001.
7. Mehari S.M., Havill J.H. Written guidelines for laboratory testing in intensive care-still effective after 3 years***. Critical Care Resucitation 2001, 3:158-162.
8. Sterne J.A.C., White I.R., Carlin J.B., Spratt M., Royston P., Kenward M.G., et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. British Journal of Medicine 2009, 2393b.
9. Gorelick M.H. Bias arising from missing data in predictive model. Journal of Clinical Epidemiology 2006, 59(10):1115-1123.
10. Little R.J.A., Rubin D.B. Statistical analysis with missing data. Wiley series in probability and mathematical statistics. Probability and mathematical statistics 2002, Wiley, Hoboken, New Jersey.
11. Cios K.J., Kurgan L.A. Trends in data mining and knowledge discovery. Knowledge discovery in advanced information systems 2005, 200-202. Springer, Heidelberg. N.R. Pal, L.C. Jain, N. Teoderesku (Eds.).
12. Pyle D. Data preparation for data mining 1999, Morgan Kaufmann, San Francisco, CA.
13. Paetz J. Knowledge-based approach to septic shock patient data using a neural network with trapezoidal activation functions. Artificial Intelligence in Medicine 2003, 28(6):207-230.
14. Kalyadin N.I., Lemenkov V.A., Losev I.R., Kantor S.I. Problems of medical monitoring of patients and the requirements for development of computer monitoring systems. Biomedical Engineering 1996, 30(2):81-85.
15. Hamilton J.D. Time series analysis 1994, Princenton University Press, NJ, USA.
16. Xia H. Bayesian hierarchical model for combining two-resolution metrology data. Ph.D. dissertation, Texas A&M University; 2008.
17. Honaker J., King G. What to do about missing values in time-series cross-section data. American Journal of Political Science 2010, 54(2):561-581.
18. Cismondi F., Fialho A.S., Vieira S.M., Sousa J.M.C., Reti S.R., Howell M.D., et al. Computational intelligence methods for processing misaligned, unevenly sampled time series containing missing data. CIDM 2011, 224-231.
19. Shih W.J. Problems in dealing with missing data and informative censoring in clinical trials. Current Controlled Trials in Cardiovascular Medicine 2002, 3(1):4.
20. Wayman J.C. Multiple imputation for missing data: what is it and how can I use it?. Annual meeting of the American Education Research Association 2003, 1-16. AERA, Chicago.
21. Jerez J.M., Molina I., García-Laencina P.J., Alba E., Ribelles N., Martín M., et al. Missing data imputation using statistical and machine learning methods in a real breast cancer problem. Artificial Intelligence in Medicine 2010, 50(2):105-115.
22. Liew A.W., Law N.F., Yan H. Missing value imputation for gene expression data: computational techniques to recover missing data from available information. Briefings in Bioinformatics 2010, 12(5):498-513.
23. Barnard J., Meng X.L. Applications of multiple imputation in medical studies: from AIDS to NHANES. Statistical Methods in Medical Research 1999, 8(1):17-36.
24. Ramoni M., Sebastiani P., Dybowski R. Robust outcome prediction for intensive-care patients. Methods of Information in Medicine 2001, 40(1):39-45.
25. Barnard J., Meng X.L. Working with missing data. Family Science Review 1997, 1(10):76-102.
26. Huisman M. Missing data in behavioural science research: investigation of a collection of data sets. Kuantitieve Methoden 1998, 87(4):548-550.
27. Orme R.G., Reis J. Multiple regression with missing data. Journal of Social Service Research 1991, 15:61-91.
28. Clifford G.D., Scott D.J., Villarroel M. User guide and documentation for the mimic ii database, version 2.1 2009.
29. Hanisch E., Brause R., Arlt B., Paetz J., Holzer K. The MEDAN database. Computer Methods and Programs in Biomedicine 2003, 75(1):23-30.
30. Schafer J.L., Graham J.W. Missing data: our view of the state of the art. Psychological Methods 2002, 7:147-177.
31. Guobing L., Copas J.B. Missing at random, likelihood ignorability and model completeness. Annals of Statistics 2004, 32:754-765.
32. Vach W., Blettner M. Missing values in epidemiological studies 1997.
33. Sousa J.M.C., Kaymak U. Fuzzy decision making in modeling and control 2002, World Scientific Pub. Co., Singapore.
34. Liu H., Hiroshi M. Feature selection for knowledge discovery and data mining 1998, Kluwer Academic Publishers, Norwell, MA, USA.
35. Mendonça L.F., Vieira S.M., Sousa J.M.C. Decision tree search methods in fuzzy modeling and classification. International Journal of Approximate Reasoning 2007, 44:106-123.
36. Milligan G.W., Cooper M.C. A study of standardization of variables in cluster analysis. Journal of Classification 1988, 5:181-204.
37. Takagi T., Sugeno M. Fuzzy identification of systems and its applications to modelling and control. IEEE Transactions on Systems, Man and Cybernetics 1985, 15:116-132.
38. Paetz J., Arlt B., Erz K., Holzer K., Brause R., Hanisch E. Data quality aspects of a database for abdominal septic shock patients. Computer Methods and Programs in Biomedicine 2004, 75:23-30.
39. Lemeshow S., Gall J.R.L. Modelling the severity of illness of ICU patients: a systems update. Journal of American Medical Association 1994, 272:1049-1055.
40. Gelman A, Hill J. Data analysis using regression and multilevel/hierarchical models. Analytical methods for social research. Cambridge:Cambridge University Press; 2007.