Multi-layer representation learning for medical concepts

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn 13-17-August-2016, Issue , 2016, Pages 1495-1504

  Choi, Edward ^a   Bahadori, Mohammad Taha ^a   Searles, Elizabeth ^b   Coffey, Catherine ^b   Thompson, Michael ^b   Bost, James ^b   Tejedor Sojo, Javier ^b   Sun, Jimeng ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b CHILDREN'S HEALTHCARE OF ATLANTA   (United States)

Author keywords

Healthcare analytics; Medical concepts; Neural networks; Representation learning

Indexed keywords

CODES (SYMBOLS); DATA MINING; HEALTH CARE; NEURAL NETWORKS;

BROAD APPLICATION; CLINICAL APPLICATION; ELECTRONIC HEALTH RECORD; HIERARCHICAL STRUCTURES; MEDICAL CONCEPTS; PREDICTION ACCURACY; REPRESENTATION LEARNING; SEQUENTIAL ORDERING;

DIAGNOSIS;

EID: 84985025946     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2939672.2939823     Document Type: Conference Paper

References (39)

1. Y. Bengio. Learning deep architectures for ai. Founda-tions and Trends R in Machine Learning, 2009.
2. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. PAMI, 2013.
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Janvin. A neural probabilistic language model. JMLR, 2003.
4. Y. Bengio, P. Lamblin, D. Popovici, H. Larochelle, et al. Greedy layer-wise training of deep networks. NIPS, 2007.
5. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio. Theano: a cpu and gpu math expression compiler. In Proceedings of SciPy, 2010.
6. Z. Che, S. Purushotham, R. Khemani, and Y. Liu. Distilling knowledge from deep networks with applications to healthcare domain. arXiv preprint arXiv: 1512. 03542, 2015.
7. R. Chen, H. Su, Y. Zhen, M. Khalilia, D. Hirsch, M. Thompson, T. Davis, Y. Peng, S. Lin, J. Tejedor-Sojo, E. Searles, and J. Sun. Cloud-based predictive modeling system and its application to asthma readmission prediction. In AMIA. AMIA, 2015.
8. E. Choi, M. T. Bahadori, and J. Sun. Doctor ai: Predicting clinical events via recurrent neural networks. arXiv preprint arXiv: 1511. 05942, 2015.
9. E. Choi, A. Schuetz, W. F. Stewart, and J. Sun. Medical concept representation learning from electronic health records and its application on heart failure prediction. arXiv preprint arXiv: 1602. 03686, 2016.
10. Y. Choi, C. Y.-I. Chiu, and D. Sontag. Learning lowdimensional representations of medical concepts. 2016. To be submitted to AMIA CRI.
11. L. Cocito, E. Favale, and L. Reni. Epileptic seizures in cerebral arterial occlusive disease. Stroke, 1982.
12. R. Collobert and J. Weston. A unified architecture for natural language processing: Deep neural networks with multitask learning. In ICML, 2008.
13. L. De Vine, G. Zuccon, B. Koopman, L. Sitbon, and P. Bruza. Medical semantic similarity with a neural language model. In KDD, 2014.
14. D. Erhan, Y. Bengio, A. Courville, and P. Vincent. Visualizing higher-layer features of a deep network. Uni-versity of Montreal, 2009.
15. J. Forner. Lung volumes and mechanics of breathing in tetraplegics. Spinal Cord, 18 (4): 258-266, 1980.
16. M. Ghassemi, T. Naumann, F. Doshi-Velez, N. Brimmer, R. Joshi, A. Rumshisky, and P. Szolovits. Unfolding physiological state: Mortality modelling in intensive care units. In KDD, 2014.
17. G. E. Hinton, S. Osindero, and Y.-W. Teh. A fast learning algorithm for deep belief nets. Neural computation, 2006.
18. R. Kiros, R. Zemel, and R. R. Salakhutdinov. A multiplicative model for learning distributed text-based attribute representations. In NIPS, 2014.
19. R. Kiros, Y. Zhu, R. Salakhutdinov, R. S. Zemel, A. Torralba, R. Urtasun, and S. Fidler. Skip-thought vectors. In NIPS, 2015.
20. Q. Le and T. Mikolov. Distributed representations of sentences and documents. In ICML, 2014.
21. Q. V. Le. Building high-level features using large scale unsupervised learning. In ICASSP, 2013.
22. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 1998.
23. Z. C. Lipton, D. C. Kale, C. Elkan, and R. Wetzell. Learning to diagnose with lstm recurrent neural networks. In ICLR, 2016.
24. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Effi-cient estimation of word representations in vector space. arXiv preprint arXiv: 1301. 3781, 2013.
25. T. Mikolov, M. Karaat, L. Burget, J. Cernocky, and S. Khudanpur. Recurrent neural network based language model. In INTERSPEECH, 2010.
26. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS, 2013.
27. J. A. Minarro-Gimenez, O. Marn-Alonso, and M. Samwald. Exploring the application of deep learning techniques on medical text corpora. Studies in health technology and informatics, 2013.
28. A. Mnih and G. E. Hinton. A scalable hierarchical distributed language model. In NIPS, 2009.
29. K. P. Murphy. Machine learning: a probabilistic per-spective. MIT press, 2012.
30. J. Pennington, R. Socher, and C. D. Manning. Glove: Global vectors for word representation. EMNLP, 2014.
31. J. Schluter and S. Bock. Improved musical onset detection with convolutional neural networks. In ICASSP, 2014.
32. R. Socher, A. Perelygin, J. Y. Wu, J. Chuang, C. D. Manning, A. Y. Ng, and C. Potts. Recursive deep models for semantic compositionality over a sentiment treebank. In EMNLP, 2013.
33. J. Sun, C. D. McNaughton, P. Zhang, A. Perer, A. Gkoulalas-Divanis, J. C. Denny, J. Kirby, T. Lasko, A. Saip, and B. A. Malin. Predicting changes in hypertension control using electronic health records from a chronic disease management program. JAMIA, 21, 2014.
34. J. Sun, F. Wang, J. Hu, and S. Edabollahi. Supervised patient similarity measure of heterogeneous patient records. KDD Explorations, 2012.
35. J. Turian, L. Ratinov, and Y. Bengio. Word representations: a simple and general method for semi-supervised learning. In ACL, 2010.
36. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, 2008.
37. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. JMLR, 2010.
38. Y. Wang, K. Ng, R. J. Byrd, J. Hu, S. Ebadollahi, Z. Daar, C. deFilippi, S. R. Steinhubl, and W. F. Stewart. Early detection of heart failure with varying prediction windows by structured and unstructured data in electronic health records. In EMBC, 2015.
39. M. D. Zeiler. Adadelta: An adaptive learning rate method. arXiv preprint arXiv: 1212. 5701, 2012.