Stable feature selection for clinical prediction: Exploiting ICD tree structure using Tree-Lasso

Journal of Biomedical Informatics

Volumn 53, Issue , 2015, Pages 277-290

  Kamkar, Iman ^a   Gupta, Sunil Kumar ^a   Phung, Dinh ^a   Venkatesh, Svetha ^a  

^a DEAKIN UNIVERSITY   (Australia)

Author keywords

Classification; Feature selection; Feature stability; Lasso; Tree Lasso

Indexed keywords

CLASSIFICATION (OF INFORMATION); CODES (SYMBOLS); DECISION MAKING; DECISION TREES; DIAGNOSIS; FORECASTING; FORESTRY; LOGISTIC REGRESSION; MEDICAL COMPUTING; MEDICAL PROBLEMS; PATIENT TREATMENT; PREDICTIVE ANALYTICS; SUPPORT VECTOR MACHINES; SUPPORT VECTOR REGRESSION;

ACUTE MYOCARDIAL INFARCTION; CLASSIFICATION PERFORMANCE; CLINICAL DECISION MAKING; ELECTRONIC MEDICAL RECORD; FEATURE SELECTION METHODS; HEALTHCARE PROBLEMS; LASSO; TREE-LASSO;

FEATURE EXTRACTION;

ACUTE HEART INFARCTION; ARTICLE; BAYESIAN LEARNING; CLASSIFIER; CLINICAL DECISION MAKING; CLINICAL EVALUATION; CONTROLLED STUDY; DECISION TREE; ELECTRONIC MEDICAL RECORD; FEATURE SELECTION; HUMAN; ICD-10; INTERNATIONAL CLASSIFICATION OF DISEASES; LEARNING ALGORITHM; LOGISTIC REGRESSION ANALYSIS; MACHINE LEARNING; MAJOR CLINICAL STUDY; MALIGNANT NEOPLASTIC DISEASE; PATTERN RECOGNITION; PREDICTION; PRIORITY JOURNAL; RANDOM FOREST; SUPPORT VECTOR MACHINE; TREE LASSO; ALGORITHM; BAYES THEOREM; DECISION MAKING; MEDICAL INFORMATICS; PROBABILITY; PROGNOSIS; REGRESSION ANALYSIS; REPRODUCIBILITY; RISK FACTOR; STATISTICAL MODEL;

ALGORITHMS; BAYES THEOREM; DECISION MAKING; DECISION TREES; ELECTRONIC HEALTH RECORDS; HUMANS; INTERNATIONAL CLASSIFICATION OF DISEASES; LOGISTIC MODELS; MEDICAL INFORMATICS; PROBABILITY; PROGNOSIS; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS; RISK FACTORS; SUPPORT VECTOR MACHINE;

EID: 84924499646     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2014.11.013     Document Type: Article

References (60)

1. Altman D.G. Practical Statistics for Medical Research 1990, CRC Press.
2. Bach F.R. Bolasso: model consistent lasso estimation through the bootstrap. Proceedings of the 25th International Conference on Machine Learning 2008, 33-40. ACM.
3. Breiman L. Random forests. Mach Learn 2001, 45:5-32.
4. Breiman L., Friedman J., Stone C.J., Olshen R.A. Classification and Regression Trees 1984, CRC press.
5. Brown J.R., Conley S.M., Niles N.W. Predicting readmission or death after acute st-elevation myocardial infarction. Clin Cardiol 2013, 36:570-575.
6. Burges C.J. A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 1998, 2:121-167.
7. Cover TM. Ja thomas elements of information theory; 1991.
8. Davis J., Goadrich M. The relationship between precision-recall and roc curves. Proceedings of the 23rd international conference on machine learning 2006, 233-240. ACM.
9. Desai M.M., Stauffer B.D., Feringa H.H., Schreiner G.C. Statistical models and patient predictors of readmission for acute myocardial infarction a systematic review. Circ Cardiovasc Qual Out 2009, 2:500-507.
10. Duda R.O., Hart P.E., Stork D.G. Pattern Classification 2001, John Wiley, New York, Section 10, l.
11. Dunlay S.M., Weston S.A., Killian J.M., Bell M.R., Jaffe A.S., Roger V.L. Thirty-day rehospitalizations after acute myocardial infraction: a cohort study. Ann Internal Med 2012, 157:11-18.
12. Egan JP. Signal detection theory and ROC analysis; 1975.
13. Friedman J., Hastie T., Höfling H., Tibshirani R. Pathwise coordinate optimization. Ann Appl Stat 2007, 1:302-332.
14. Grady JN, Bhat KR, Desai MM, Grosso L, Lin Z, Parzynski C, Strait K, Wang Y. 2012 measures maintenance technical report: acute myocardial infarction, heart failure, and pneumonia 30-day risk-standardized readmission measure; 2012.
15. Gupta S, Phung D, Venkatesh S. Factorial multi-task learning: a bayesian nonparametric approach. In: Proceedings of the 30th international conference on machine learning (ICML-13); 2013. p. 657-65.
16. Gupta S., Tran T., Luo W., Phung D., Kennedy R.L., Broad A., et al. Machine-learning prediction of cancer survival: a retrospective study using electronic administrative records and a cancer registry. BMJ Open 2014, 4:e004007.
17. Gupta S.K., Phung D.Q., Venkatesh S. A bayesian nonparametric joint factor model for learning shared and individual subspaces from multiple data sources. SDM 2012, 200-211. SIAM.
18. Harrell F.E., Lee K.L., Califf R.M., Pryor D.B., Rosati R.A. Regression modelling strategies for improved prognostic prediction. Stat Med 1984, 3:143-152.
19. Hastie T., Tibshirani R., Friedman J., Franklin J. The elements of statistical learning: data mining, inference and prediction. Math Intell 2005, 27:83-85.
20. Jacob L., Obozinski G., Vert J.P. Group lasso with overlap and graph lasso. Proc of the 26th international conference on machine learning 2009, 433-440. ACM.
21. Jensen P.B., Jensen L.J., Brunak S. Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet 2012, 13:395-405.
22. Kalousis A., Prados J., Hilario M. Stability of feature selection algorithms: a study on high-dimensional spaces. Knowl Inform Syst 2007, 12:95-116.
23. Khoshgoftaar T.M., Fazelpour A., Wang H., Wald R. A survey of stability analysis of feature subset selection techniques. 2013 IEEE 14th international conference on information reuse and integration (IRI) 2013, 424-431. IEEE.
24. Kira K., Rendell L.A. A practical approach to feature selection. Proceedings of the ninth international workshop on machine learning 1992, 249-256. Morgan Kaufmann Publishers Inc.
25. Kittler J., et al. Feature set search algorithms. Pattern Recognit Signal Process 1978, 41-60.
26. Kononenko I., Šimec E., Robnik-Šikonja M. Overcoming the myopia of inductive learning algorithms with relieff. Appl Intell 1997, 7:39-55.
27. Křížek P., Kittler J., Hlaváč V. Improving stability of feature selection methods. Computer analysis of images and patterns 2007, 929-936. Springer.
28. Krumholz H.M., Chen J., Chen Y.T., Wang Y., Radford M.J. Predicting one-year mortality among elderly survivors of hospitalization for an acute myocardial infarction: results from the cooperative cardiovascular project. J Am College Cardiol 2001, 38:453-459.
29. Kuncheva LI. A stability index for feature selection. In: Artificial intelligence and applications; 2007. p. 421-7.
30. Laird B.J., Kaasa S., McMillan D.C., Fallon M.T., Hjermstad M.J., Fayers P., et al. Prognostic factors in patients with advanced cancer: a comparison of clinicopathological factors and the development of an inflammation-based prognostic system. Clin Cancer Res 2013, 19:5456-5464.
31. Liu H., Setiono R. Chi2: feature selection and discretization of numeric attributes. 1995 proceedings of seventh international conference on tools with artificial intelligence 1995, 388-391. IEEE.
32. Liu J, Ye J. Moreau-yosida regularization for grouped tree structure learning. In: Advances in neural information processing systems; 2010. p. 1459-67.
33. Loscalzo S., Yu L., Ding C. Consensus group stable feature selection. Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining 2009, 567-576. ACM.
34. Maltoni M., Scarpi E., Pittureri C., Martini F., Montanari L., Amaducci E., et al. Prospective comparison of prognostic scores in palliative care cancer populations. Oncologist 2012, 17:446-454.
35. Meinshausen N., Bühlmann P. Stability selection. J Roy Stat Soc Ser B (Stat Methodol) 2010, 72:417-473.
36. Pfeiffer R.M., Park Y., Kreimer A.R., Lacey Jr J.V., Pee D., Greenlee R.T., et al. Risk prediction for breast, endometrial, and ovarian cancer in white women aged 50 y or older: derivation and validation from population-based cohort studies. PLoS Med 2013, 10:e1001492.
37. Prokosch H.U., Ganslandt T. Perspectives for medical informatics. Methods Inf Med 2009, 48:38-44.
38. Quinlan J.R. Induction of decision trees. Mach Learn 1986, 1:81-106.
39. Quinlan J.R. C4.5: programs for machine learning 1993, vol. 1. Morgan kaufmann.
40. Ramchandran K.J., Shega J.W., Von Roenn J., Schumacher M., Szmuilowicz E., Rademaker A., et al. A predictive model to identify hospitalized cancer patients at risk for 30-day mortality based on admission criteria via the electronic medical record. Cancer 2013, 119:2074-2080.
41. Rana S., Tran T., Luo W., Phung D., Kennedy R., Venkatesh S. Predicting unplanned readmission after myocardial infarction from routinely collected administrative hospital data. Aust Health Rev 2014.
42. Rish I. An empirical study of the naive bayes classifier. In: IJCAI 2001 workshop on empirical methods in artificial intelligence; 2001. p. 41-6.
43. Ryali S., Supekar K., Abrams D.A., Menon V. Sparse logistic regression for whole-brain classification of FMRI data. NeuroImage 2010, 51:752-764.
44. Saeys Y., Inza I., Larrañaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007, 23:2507-2517.
45. Shi W., Wahba G., Irizarry R., Bravo H., Wright S. The partitioned lasso-patternsearch algorithm with application to gene expression data. BMC Bioinformatics 2012, 13:98.
46. Siedlecki W., Sklansky J. On automatic feature selection. Int J Pattern Recognit Artif Intell 1988, 2:197-220.
47. Spiegelhalter D.J. Probabilistic prediction in patient management and clinical trials. Stat Med 1986, 5:421-433.
48. Stuart Russell P.N. Artificial intelligence: a modern approach. 2nd ed 2003, Prentice Hall, [1995].
49. Tibshirani R. Regression shrinkage and selection via the lasso. J Roy Stat Soc Ser B (Methodol) 1996, 267-288.
50. Vapnik V. The nature of statistical learning theory 2000, Springer.
51. Vapnik V.N., Vapnik V. Statistical learning theory 1998, vol. 2. Wiley, New York.
52. Witten I.H., Frank E. Data mining: practical machine learning tools and techniques 2005, Morgan Kaufmann.
53. Wu J., Roy J., Stewart W.F. Prediction modeling using EHR data: challenges, strategies, and a comparison of machine learning approaches. Med Care 2010, 48:S106-S113.
54. Wu T.T., Chen Y.F., Hastie T., Sobel E., Lange K. Genome-wide association analysis by lasso penalized logistic regression. Bioinformatics 2009, 25:714-721.
55. You Z.H., Yin Z., Han K., Huang D.S., Zhou X. A semi-supervised learning approach to predict synthetic genetic interactions by combining functional and topological properties of functional gene network. BMC Bioinformatics 2010, 11:343.
56. Yuan M., Lin Y. Model selection and estimation in regression with grouped variables. J Roy Stat Soc Ser B (Stat Methodol) 2006, 68:49-67.
57. Yuhara H., Steinmaus C., Cohen S.E., Corley D.A., Tei Y., Buffler P.A. Is diabetes mellitus an independent risk factor for colon cancer and rectal cancer&quest. Am J Gastroenterol 2011, 106:1911-1921.
58. Zhao D., Weng C. Combining pubmed knowledge and EHR data to develop a weighted bayesian network for pancreatic cancer prediction. J Biomed Inform 2011, 44:859-868.
59. Zhao P., Yu B. On model selection consistency of lasso. J Mach Learn Res 2006, 7:2541-2563.
60. Zou H., Hastie T. Regularization and variable selection via the elastic net. J Roy Stat Soc Ser B (Stat Methodol) 2005, 67:301-320.