RETAIN: An interpretable predictive model for healthcare using reverse time attention mechanism

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 3512-3520

  Choi, Edward ^a   Bahadori, Mohammad Taha ^a   Kulas, Joshua A ^a   Schuetz, Andy ^b   Stewart, Walter F ^b   Sun, Jimeng ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b SUTTER HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIAGNOSIS;

ATTENTION MECHANISMS; COMPUTATIONAL SCALABILITY; ELECTRONIC HEALTH RECORD; LOGISTIC REGRESSIONS; PREDICTIVE ACCURACY; PREDICTIVE MODELING; RECURRENT NEURAL NETWORK (RNN); STATE-OF-THE-ART METHODS;

RECURRENT NEURAL NETWORKS;

EID: 85018679038     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. J. Ba, V. Mnih, and K. Kavukcuoglu. Multiple object recognition with visual attention. In ICLR, 2015.
2. D. Bahdanau, K. Cho, and Y. Bengio. Neural machine translation by jointly learning to align and translate. In ICLR, 2015.
3. Y. Bengio, P. Simard, and P. Frasconi. Learning long-term dependencies with gradient descent is difficult. Neural Networks, IEEE Transactions on, 5(2): 157-166, 1994.
4. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y Bengio. Theano: a CPU and GPU math expression compiler. In Proceedings of SciPy, 2010.
5. A. D. Black, J. Car, C. Pagliari, C. Anandan, K. Cresswell, T. Bokun, B. McKinstry, R. Procter, A. Majeed, and A. Sheikh. The impact of ehealth on the quality and safety of health care: a systematic overview. PLoS Med, 8(1): e1000387, 2011.
6. R. Caruana, Y. Lou, J. Gehrke, P. Koch, M. Sturm, and N. Elhadad. Intelligible models for healthcare: Predicting pneumonia risk and hospital 30-day readmission. In KDD, 2015.
7. B. Chaudhry, J. Wang, S. Wu, M. Maglione, W. Mojica, E. Roth, S. C. Morton, and P. G. Shekelle. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Annals of internal medicine, 144(10): 742-752, 2006.
8. Z. Che, S. Purushotham, R. Khemani, and Y Liu. Distilling knowledge from deep networks with applications to healthcare domain. arXiv preprint arXiv: 1512.03542, 2015.
9. K. Cho, B. Van Merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In EMNLP, 2014.
10. E. Choi, M. T. Bahadori, E. Searles, C. Coffey, and J. Sun. Multi-layer representation learning for medical concepts. In KDD, 2016.
11. E. Choi, M. T. Bahadori, and J. Sun. Doctor ai: Predicting clinical events via recurrent neural networks. arXiv preprint arXiv: 1511.05942, 2015.
12. J. K. Chorowski, D. Bahdanau, D. Serdyuk, K. Cho, and Y. Bengio. Attention-based models for speech recognition. In NIPS, pages 577-585, 2015.
13. D. Erhan, Y. Bengio, A. Courville, and P. Vincent. Visualizing higher-layer features of a deep network. University of Montreal, 2009.
14. C. Esteban, O. Staeck, Y. Yang, and V. Tresp. Predicting clinical events by combining static and dynamic information using recurrent neural networks. arXiv preprint arXiv: 1602.02685, 2016.
15. A. S. Fleisher, B. B. Sowell, C. Taylor, A. C. Gamst, R. C. Petersen, L. J. Thal, and f. t. A. D. C. Study. Clinical predictors of progression to Alzheimer disease in amnestic mild cognitive impairment. Neurology, 68(19): 1588-1595, May 2007.
16. A. for Healthcare Research and Quality. Clinical classifications software (ccs) for icd-9-cm. https://www.hcup-us.ahrq.gov/toolssoftware/ccs/ccs.jsp. Accessed: 2016-04-01.
17. A. for Healthcare Research and Quality. Clinical classifications software for services and procedures. https://www.hcup-us.ahrq.gov/toolssoftware/ccs-svcsproc/ccssvcproc.jsp. Accessed: 2016-04-01.
18. B. Gallego, S. R. Walter, R. O. Day, A. G. Dunn, V. Sivaraman, N. Shah, C. A. Longhurst, and E. Coiera. Bringing cohort studies to the bedside: framework for a 'green button' to support clinical decision-making. Journal of Comparative Effectiveness Research, pages 1-7, May 2015.
19. J. Ghosh and V. Karamcheti. Sequence learning with recurrent networks: analysis of internal representations. In Aerospace Sensing, pages 449-460. International Society for Optics and Photonics, 1992.
20. C. L. Goldzweig, A. Towfigh, M. Maglione, and P. G. Shekelle. Costs and benefits of health information technology: new trends from the literature. Health affairs, 28(2): w282-w293, 2009.
21. K. Gregor, I. Danihelka, A. Graves, and D. Wierstra. Draw: A recurrent neural network for image generation. arXiv preprint arXiv: 1502.04623, 2015.
22. K. M. Hermann, T. Kocisky, E. Grefenstette, L. Espeholt, W. Kay, M. Suleyman, and P. Blunsom. Teaching machines to read and comprehend. In NIPS, pages 1684-1692, 2015.
23. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9(8): 1735-1780, 1997.
24. W. K. C. D. Information. Medi-span electronic drug file (med-file) v2. http://www.wolterskluwercdi.com/drug-data/medi-span-electronic-drug-file/. Accessed: 2016-04-01.
25. A. K. Jha, C. M. DesRoches, E. G. Campbell, K. Donelan, S. R. Rao, T. G. Ferris, A. Shields, S. Rosenbaum, and D. Blumenthal. Use of electronic health records in us hospitals. N Engl J Med, 2009.
26. A. Karpathy, J. Johnson, and F.-F. Li. Visualizing and understanding recurrent networks. arXiv preprint arXiv: 1506.02078, 2015.
27. A. N. Kho, M. G. Hayes, L. Rasmussen-Torvik, J. A. Pacheco, W. K. Thompson, L. L. Armstrong, J. C. Denny, P. L. Peissig, A. W. Miller, W.-Q. Wei, S. J. Bielinski, C. G. Chute, C. L. Leibson, G. P. Jarvik, D. R. Crosslin, C. S. Carlson, K. M. Newton, W. A. Wolf, R. L. Chisholm, and W. L. Lowe. Use of diverse electronic medical record systems to identify genetic risk for type 2 diabetes within a genome-wide association study. JAMIA, 19(2): 212-218, Apr. 2012.
28. Q. V. Le. Building high-level features using large scale unsupervised learning. In ICASSP, 2013.
29. Q. V. Le, N. Jaitly, and G. E. Hinton. A simple way to initialize recurrent networks of rectified linear units. arXiv preprint arXiv: 1504.00941, 2015.
30. Z. C. Lipton, D. C. Kale, C. Elkan, and R. Wetzell. Learning to Diagnose with LSTM Recurrent Neural Networks. In ICLR, 2016.
31. A. F. Martins and R. F. Astudillo. From softmax to sparsemax: A sparse model of attention and multi-label classification. In ICML, 2016.
32. V. Mnih, N. Heess, A. Graves, et al. Recurrent models of visual attention. In NIPS, 2014.
33. A. M. Rush, S. Chopra, and J. Weston. A neural attention model for abstractive sentence summarization. In EMNLP, 2015.
34. S. Saria, D. Koller, and A. Penn. Learning individual and population level traits from clinical temporal data. In NIPS, Predictive Models in Personalized Medicine workshop, 2010.
35. P. Schulam and S. Saria. A probabilistic graphical model for individualizing prognosis in chronic, complex diseases. In AMIA, Volume 2015, page 143, 2015.
36. J. Sun, F. Wang, J. Hu, and S. Edabollahi. Supervised patient similarity measure of heterogeneous patient records. ACM SIGKDD Explorations Newsletter, 14(1): 16-24, 2012.
37. K. Xu, J. Ba, R. Kiros, A. Courville, R. Salakhutdinov, R. Zemel, and Y. Bengio. Show, attend and tell: Neural image caption generation with visual attention. In ICML, 2015.
38. M. D. Zeiler. Adadelta: an adaptive learning rate method. arXiv preprint arXiv: 1212.5701, 2012.