Predictive data mining in clinical medicine: Current issues and guidelines

International Journal of Medical Informatics

Volumn 77, Issue 2, 2008, Pages 81-97

  Bellazzi, Riccardo ^a   Zupan, Blaz ^b,c  

^a UNIVERSITY OF PAVIA   (Italy)

^b UNIVERSITY OF LJUBLJANA   (Slovenia)

^c BAYLOR COLLEGE OF MEDICINE   (United States)

Author keywords

Clinical medicine; Data analysis; Data mining; Data mining process; Predictive models

Indexed keywords

COMPUTATIONAL METHODS; DATA REDUCTION; MEDICINE; PROBLEM SOLVING;

CLINICAL MEDICINE; DATA MINING PROCESS; PREDICTIVE MODELS;

DATA MINING;

CLINICAL MEDICINE; DATA ANALYSIS; GENOMICS; MEDICAL INFORMATICS; MODEL; PRACTICE GUIDELINE; PRIORITY JOURNAL; REVIEW; STANDARDIZATION; VALIDATION PROCESS;

CLINICAL MEDICINE; GUIDELINES AS TOPIC; MODELS, STATISTICAL; STATISTICS AS TOPIC; UNITED STATES;

EID: 37249089420     PISSN: 13865056     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijmedinf.2006.11.006     Document Type: Review

References (108)

1. Giudici P. Applied Data Mining Statistical Methods for Business and Industry (2003), Wiley & Sons
2. Fayyad U., Piatetsky-Shapiro G., and Smyth P. Data mining and knowledge discovery in databases. Commun. ACM 39 (1996) 24-26
3. Zupan B., Demsar J., Smrke D., Bozikov K., Stankovski V., Bratko I., and Beck J.R. Predicting patient's long-term clinical status after hip arthroplasty using hierarchical decision modelling and data mining. Meth. Inf. Med. 40 (2001) 25-31
4. Demsar J., Zupan B., Leban G., and Curk T. Orange: from experimental machine learning to interactive data mining. European Conference of Machine Learning (2004), Springer Verlag, Pisa, Italy 537-539
5. Kononenko I. Inductive and Bayesian learning in medical diagnosis. Appl. Artif. Intelligen. 7 (1993) 317-337
6. Lubsen J., Pool J., and van der Does E. A practical device for the application of a diagnostic or prognostic function. Meth. Inf. Med. 17 (1978) 127-129
7. Mozina M., Demsar J., Kattan M.W., and Zupan B. Nomograms for visualization of naive bayesian classifier. Proceedings of the Principles Practice of Knowledge Discovery in Databases (PKDD-04). Pisa, Italy (2004) 337-348
8. Harrell F.E. Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis (2001), Springer, New York
9. Kattan M.W., Eastham J.A., Stapleton A.M., Wheeler T.M., and Scardino P.T. A preoperative nomogram for disease recurrence following radical prostatectomy for prostate cancer. J. Natl. Cancer Inst. 90 (1998) 766-771
10. Graefen M., Karakiewicz P.I., Cagiannos I., Quinn D.I., Henshall S.M., Grygiel J.J., Sutherland R.L., Stricker P.D., et al. International validation of a preoperative nomogram for prostate cancer recurrence after radical prostatectomy. J. Clin. Oncol. 20 (2002) 3206-3212
11. Quinlan J.R. C4.5: Programs for Machine Learning (1993), Morgan Kaufmann Publishers, San Mateo, Calif
12. Breiman L. Classification and Regression Trees (1993), Chapman & Hall, New York, London
13. Clark P., and Niblett T. The CN2 Induction Algorithm. Mach. Learn. 3 (1989) 261-283
14. Michalski R.S., and Kaufman K. Learning patterns in noisy data: the AQ approach. In: Paliouras G., Karkaletsis V., and Spyropoulos C. (Eds). Machine Learning and its Applications (2001), Springer-Verlag, Berlin 22-38
15. Lavrac N., Kononenko I., Keravnou E., Kukar M., and Zupan B. Intelligent data analysis for medical diagnosis: using machine learning and temporal abstraction. AI Commun. 11 (1998) 191-218
16. Hosmer D.W., and Lemeshow S. Applied Logistic Regression. 2nd ed. (2000), Wiley, New York
17. Hastie T., Tibshirani R., and Friedman J.H. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2001), Springer, New York
18. Schwarzer G., Vach W., and Schumacher M. On the misuses of artificial neural networks for prognostic and diagnostic classification in oncology. Stat. Med. 19 (2000) 541-561
19. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods (2000), Cambridge University Press, Cambridge, UK, New York
20. Vapnik V.N. Statistical Learning Theory (1998), Wiley, New York
21. Cortes C., and Vapnik V. Support-vectors networks. Mach. Learn. 20 (1995) 273-297
22. Kononenko I. Machine learning for medical diagnosis: history, state of the art and perspective. Artif. Intell. Med. 23 (2001) 89-109
23. Andreassen S., Jensen F.V., and Olesen K.G. Medical expert systems based on causal probabilistic networks. Int. J. Biomed. Comput. 28 (1991) 1-30
24. Hamilton P.W., Montironi R., Abmayr W., Bibbo M., Anderson N., Thompson D., and Bartels P.H. Clinical applications of Bayesian belief networks in pathology. Pathologica 87 (1995) 237-245
25. Galan S.F., Aguado F., Diez F.J., and Mira J. NasoNet, modeling the spread of nasopharyngeal cancer with networks of probabilistic events in discrete time. Artif. Intell. Med. 25 (2002) 247-264
26. Luciani D., Marchesi M., and Bertolini G. The role of Bayesian Networks in the diagnosis of pulmonary embolism. J. Thromb. Haemost. 1 (2003) 698-707
27. Spiegelhalter D.J., and Lauritzen S.L. Sequential updating of conditional probabilities on directed graphical structures. Networks 20 (1990) 579-605
28. Buntine W.L. A guide to the literature on learning probabilistic networks from data. IEEE Trans. Know. Data Eng. 8 (1996) 195-210
29. Cooper G.F., and Herskovits E. A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 9 (1992) 309-347
30. Ramoni M., and Sebastiani P. Robust learning with missing data. Mach. Learn. 45 (2001) 147-170
31. Herskovits E.H., and Gerring J.P. Application of a data-mining method based on Bayesian networks to lesion-deficit analysis. Neuroimage 19 (2003) 1664-1673
32. Sebastiani P., Ramoni M.F., Nolan V., Baldwin C.T., and Steinberg M.H. Genetic dissection and prognostic modeling of overt stroke in sickle cell anemia. Nat. Genet. 37 (2005) 435-440
33. Geiger D., and Hackerman D. Learning Gaussian networks. In: de Mantaras R.L., and Poole D. (Eds). Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence (1994), Morgan Kaufmann, San Francisco, CA/Seattle, WA 235-243
34. Larrañaga P., Sierra B., Gallego M.Y., and Michelena M.J. P J M. Learning Bayesian networks by genetic algorithms: a case study in the prediction of survival in malignant skin melanoma. In: Keravnou E., Garbay C., Baud R., and Wyatt C.J. (Eds). Artificial Intelligence in Medicine Europe (1997), Grenoble, France 261-272
35. Le Phillip P., Bahl A., and Ungar L.H. Using prior knowledge to improve genetic network reconstruction from microarray data. In. Silico. Biol. 4 (2004) 335-353
36. Chapman P., Clinton J., Kerber R., Khabaza T., Reinartz T., Shearer C., and Wirth R. CRISP-DM 1. 0: Step-by-Step Data Mining Guide: The CRISP-DM Consortium (2000)
37. Moore G.W., and Berman J.J. Anatomic pathology data mining. In: Cios K.J. (Ed). Medical Data Mining and Knowledge Discovery (2001), Springer-Verlag, Berlin/Heidelberg 61-108
38. Hristovski D., Stare J., Peterlin B., and Dzeroski S. Supporting discovery in medicine by association rule mining in Medline and UMLS. Medinfo 10 (2001) 1344-1348
39. Aronson A.R. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Proc. AMIA Symp. (2001) 17-21
40. Hand D.J. Data mining: statistics and more?. Am. Statist. 52 (1998) 112-118
41. Hand D.J., Mannila H., and Smyth P. Principles of Data Mining (2001), MIT Press, Cambridge, Mass
42. Bloedorn E., and Michalski R.S. Data-driven constructive induction. IEEE Intell. Syst. 13 (1998) 30-37
43. Jakulin A., Bratko I., Smrke D., Demsar J., and Zupan B. Attribute interactions in medical data analysis. In: Dojad M., Keravnou E., and Barahona P. (Eds). Proceedings of the Ninth Conference on Artificial Intelligence in Medicine in Europe (AIME 2003). Protaras, Cyprus: Springer (2003) 229-238
44. Eisen M.B., Spellman P.T., Brown P.O., and Botstein D. Cluster analysis and display of genome-wide expression patterns. Proc. Natl. Acad. Sci. U. S. A. 95 (1998) 14863-14868
45. Yu J.S., Ongarello S., Fiedler R., Chen X.W., Toffolo G., Cobelli C., and Trajanoski Z. Ovarian cancer identification based on dimensionality reduction for high-throughput mass spectrometry data. Bioinformatics 21 (2005) 2200-2209
46. Louie B., Mork P., Martin-Sanchez F., Halevy A., and Tarczy-Hornoch P. Data integration and genomic medicine. J. Biomed. Inform. 40 (2007) 5-16
47. Mischel P.S., and Cloughesy T. Using molecular information to guide brain tumor therapy. Nat. Clin. Pract. Neurol. 2 (2006) 232-233
48. Golub T.R., Slonim D.K., Tamayo P., Huard C., Gaasenbeek M., Mesirov J.P., Coller H., Loh M.L., et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286 (1999) 531-537
49. van't Veer L.J., Dai H., van de Vijver M.J., He Y.D., Hart A.A., Mao M., Peterse H.L., van der Kooy K., et al. Gene expression profiling predicts clinical outcome of breast cancer. Nature 415 (2002) 530-536
50. Pomeroy S.L., Tamayo P., Gaasenbeek M., Sturla L.M., Angelo M., McLaughlin M.E., Kim J.Y., Goumnerova L.C., et al. Prediction of central nervous system embryonal tumour outcome based on gene expression. Nature 415 (2002) 436-442
51. Shipp M.A., Ross K.N., Tamayo P., Weng A.P., Kutok J.L., Aguiar R.C., Gaasenbeek M., Angelo M., et al. Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat. Med. 8 (2002) 68-74
52. Nevins J.R., Huang E.S., Dressman H., Pittman J., Huang A.T., and West M. Towards integrated clinico-genomic models for personalized medicine: combining gene expression signatures and clinical factors in breast cancer outcomes prediction. Hum. Mol. Genet. (2003) R153-R157 12 Spec No 2:
53. Futschik M.E., Sullivan M., Reeve A., and Kasabov N. Prediction of clinical behaviour and treatment for cancers. Appl. Bioinform. 2 (2003) S53-S58
54. Fernandez-Teijeiro A., Betensky R.A., Sturla L.M., Kim J.Y., Tamayo P., and Pomeroy S.L. Combining gene expression profiles and clinical parameters for risk stratification in medulloblastomas. J. Clin. Oncol. 22 (2004) 994-998
55. Brenton J.D., Carey L.A., Ahmed A.A., and Caldas C. Molecular classification and molecular forecasting of breast cancer: ready for clinical application?. J. Clin. Oncol. 23 (2005) 7350-7360
56. Berrar D., Bradbury I., and Dubitzky W. Avoiding model selection bias in small-sample genomic datasets. Bioinformatics 22 (2006) 1245-1250
57. Simon R., Radmacher M.D., Dobbin K., and McShane L.M. Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification. J. Natl. Cancer Inst. 95 (2003) 14-18
58. Ein-Dor L., Zuk O., and Domany E. Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer. Proc. Natl. Acad. Sci. U. S. A. 103 (2006) 5923-5928
59. Hu Z., Fan C., Oh D.S., Marron J.S., He X., Qaqish B.F., Livasy C., Carey L.A., et al. The molecular portraits of breast tumors are conserved across microarray platforms. BMC Genom. 7 (2006) 96
60. Adam B.L., Qu Y., Davis J.W., Ward M.D., Clements M.A., Cazares L.H., Semmes O.J., Schellhammer P.F., et al. Serum protein fingerprinting coupled with a pattern-matching algorithm distinguishes prostate cancer from benign prostate hyperplasia and healthy men. Cancer Res. 62 (2002) 3609-3614
61. Petricoin E.F., Ardekani A.M., Hitt B.A., Levine P.J., Fusaro V.A., Steinberg S.M., Mills G.B., Simone C., et al. Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359 (2002) 572-577
62. Barbarini N., Magni P., and Bellazzi R. A new approach for the analysis of mass spectrometry data for biomarker discovery. AMIA Annu Symp. Proc. (2006) 26-30
63. Somorjai R.L., Dolenko B., and Baumgartner R. Class prediction and discovery using gene microarray and proteomics mass spectroscopy data: curses, caveats, cautions. Bioinformatics 19 (2003) 1484-1491
64. Liu X., Minin V., Huang Y., Seligson D.B., and Horvath S. Statistical methods for analyzing tissue microarray data. J. Biopharm. Stat. 14 (2004) 671-685
65. Bismar T.A., Demichelis F., Riva A., Kim R., Varambally S., He L., Kutok J., Aster J.C., et al. Defining aggressive prostate cancer using a 12-gene model. Neoplasia 8 (2006) 59-68
66. McKinney B.A., Reif D.M., Ritchie M.D., and Moore J.H. Machine learning for detecting gene-gene interactions: a review. Appl. Bioinform. 5 (2006) 77-88
67. Moore J.H., Gilbert J.C., Tsai C.T., Chiang F.T., Holden T., Barney N., and White B.C. A flexible computational framework for detecting, characterizing, and interpreting statistical patterns of epistasis in genetic studies of human disease susceptibility. J. Theor. Biol. 241 (2006) 252-261
68. Wyatt C.J., and Altman D.G. Prognostic models: clinically useful or quickly forgotten?. BMJ (1995) 311
69. Kattan M.W., Zelefsky M.J., Kupelian P.A., Scardino P.T., Fuks Z., and Leibel S.A. Pretreatment nomogram for predicting the outcome of three-dimensional conformal radiotherapy in prostate cancer. J. Clin. Oncol. 18 (2000) 3352-3359
70. Shortliffe E.H., Davis R., Axline S.G., Buchanan B.G., Green C.C., and Cohen S.N. Computer-based consultations in clinical therapeutics: explanation and rule acquisition capabilities of the MYCIN system. Comput. Biomed. Res. 8 (1975) 303-320
71. Miller R.A., Pople Jr. H.E., and Myers J.D. Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N. Engl. J. Med. 307 (1982) 468-476
72. Andrews P.J., Sleeman D.H., Statham P.F., McQuatt A., Corruble V., Jones P.A., Howells T.P., and Macmillan C.S. Predicting recovery in patients suffering from traumatic brain injury by using admission variables and physiological data: a comparison between decision tree analysis and logistic regression. J. Neurosurg. 97 (2002) 326-336
73. Stel V.S., Pluijm S.M., Deeg D.J., Smit J.H., Bouter L.M., and Lips P. A classification tree for predicting recurrent falling in community-dwelling older persons. J. Am. Geriatr. Soc. 51 (2003) 1356-1364
74. Eastwood E.A., Magaziner J., Wang J., Silberzweig S.B., Hannan E.L., Strauss E., and Siu A.L. Patients with hip fracture: subgroups and their outcomes. J. Am. Geriatr. Soc. 50 (2002) 1240-1249
75. Sierra B., and Larranaga P. Predicting survival in malignant skin melanoma using Bayesian networks automatically induced by genetic algorithms An empirical comparison between different approaches. Artif. Intell. Med. 14 (1998) 215-230
76. Fellbaum C., Fellbaums C., and Fellbaum C. WordNet An Electronic Lexical Database (1998), MIT Press
77. Zupan B., Holmes J.H., and Bellazzi R. Knowledge-based data analysis and interpretation. Artif. Intell. Med. 37 (2006) 163-165
78. Lavrac N., Dzeroski S., Pirnat V., and Krizman V. The utility of background knowledge in learning medical diagnostic rules. Appl. Artif. Intelligen. 7 (1993) 273-293
79. Quaglini S., Bellazzi R., Locatelli F., Stefanelli M., and Salvaneschi C. An influence diagram for assessing GVHD prophylaxis after bone marrow transplantation in children. Med. Decis. Mak. 14 (1994) 223-235
80. Silipo R., Vergassola R., Zong W., and Berthold M.R. Knowledge-based and data-driven models in arrhythmia fuzzy classification. Meth. Inf. Med. 40 (2001) 397-402
81. Mani S., Shankle W.R., Dick M.B., and Pazzani M.J. Two-stage machine learning model for guideline development. Artif. Intell. Med. 16 (1999) 51-71
82. Lucas P. Expert knowledge and its role in learning Bayesian Networks in medicine: an appraisal. In: Quaglini S., Barahona P., and Andreassen S. (Eds). Artificial Intelligence in Medicine (2001), Springer, Berlin 156-166
83. Druzdzel M.J., and van der Gaag L.C. Building probabilistic networks: "Where do the numbers come from?". IEEE Transn. Knowl. Data Eng. 12 (2000) 481-486
84. Coupe V.M.H., Van der Gaag L.C., and Habbema J.D.F. Sensitivity analysis: an aid for belief-network quantification. Knowl. Eng. Rev. 15 (2000) 215-232
85. Pazzani M., and Kibler D. The utility of background knowledge in inductive learning. Mach. Learn. 9 (1992) 57-94
86. Pazzani M.J., Mani S., and Shankle W.R. Acceptance of rules generated by machine learning among medical experts. Meth. Inf. Med. 40 (2001) 380-385
87. Kononenko I. Estimating attributes: analysis and extensions of RELIEF. European Conference on Machine Learning (ECML) (1994) 171-182
88. Kohavi R., and John G.H. Wrappers for feature subset selection. Artif. Intell. 97 (1997) 273-324
89. Zupan B., Demsar J., Kattan M.W., Beck J.R., and Bratko I. Machine learning for survival analysis: a case study on recurrence of prostate cancer. Artif. Intell. Med. 20 (2000) 59-75
90. Bellazzi R., and Zupan B. Intelligent data analysis in medicine and pharmacology: a position statement. Workshop on Intelligent Data Analysis in Medicine and Pharmacology (IDAMAP). Brighton, UK (1998) 2-5
91. Pyle D. Data preparation for data mining (1999), Morgan Kaufmann Publishers, San Francisco, CA
92. Lavrac N., Flach P., and Zupan B. Rule evaluation measures: a unifying view. Workshop on Inductive Logic Programming (1999) 174-185
93. Beck J.R., and Shultz E.K. The use of relative operating characteristic (ROC) curves in test performance evaluation. Arch. Pathol. Lab. Med. 110 (1986) 13-20
94. Brier G.W. Verification of forecasts expressed in terms of probability. Month. Weather Rev. 78 (1950) 1-3
95. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques With Java Implementations (1999), Morgan Kaufmann, San Francisco, CA
96. Hand D.J. Construction and assessment of classification rules (1997), Wiley, Chichester; New York
97. Bohanec M., and Zupan B. Integrating Decision Support and Data Mining by Hierarchical Multi-Attribute Decision Models. Intl. Workshop on Integration and Collaboration Aspects of Data Mining, Decision Support and Meta-Learning. Helsinki, Finland (2001) 25-36
98. de Rooij S.E., Abu-Hanna A., Levi M., and de Jonge E. Factors that predict outcome of intensive care treatment in very elderly patients: a review. Crit. Care 9 (2005) R307-R314
99. Bemmel J.H.v., Musen M.A., and Helder J.C. Handbook of Medical Informatics (1997), Springer Verlag, Heidelberg, Germany
100. Zupan B., Porenta A., Vidmar G., Aoki N., Bratko I., and Beck J.R. Decisions at hand: a decision support system on handhelds. Medinfo 10 (2001) 566-570
101. Zupan B., Demsar J., Kattan M.W., Ohori M., Graefen M., Bohanec M., and Beck J.R. Orange and Decisions-at-Hand: bridging predictive data mining and decision support. Intlerationa Workshop on Integration and Collaboration Aspects of Data Mining, Decision Support and Meta-Learning. Helsinki, Finland (2001) 151-162
102. Abidi S.S. Knowledge management in healthcare: towards 'knowledge-driven' decision-support services. Int. J. Med. Inf. 63 (2001) 5-18
103. Pazzani M. Knowledge discovery from data?. IEEE Intell. Syst. (March-April 2000) 10-13
104. Cios K.J., and Moore G.W. Uniqueness of medical data mining. Artif. Intell. Med. 26 (2002) 1-24
105. Fox J., and Das S.K. Safe and Sound: Artificial Intelligence In Hazardous Applications (2000), MIT Press, Cambridge, Mass
106. Bellazzi R., and Zupan B. Intelligent data analysis. Meth. Inf. Med. 40 (2001) 362-364
107. Haux R., Ammenwerth E., Herzog W., and Knaup P. Health care in the information society A prognosis for the year 2013. Int. J. Med. Inf. 66 (2002) 3-21
108. Towards 2020 Science, Available at http://research.microsoft.com/towards2020science.