Towards automated clinical coding

International Journal of Medical Informatics

Volumn 120, Issue , 2018, Pages 50-61

  Catling, Finneas ^a   Spithourakis, Georgios P ^a   Riedel, Sebastian ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Clinical coding; Hierarchical representation learning; Knowledge representation; Machine learning; Natural language processing; Recurrent neural networks

Indexed keywords

AUTOMATION; CLASSIFICATION (OF INFORMATION); CLINICAL RESEARCH; CODES (SYMBOLS); DISEASES; FORECASTING; INVERSE PROBLEMS; KNOWLEDGE REPRESENTATION; LEARNING ALGORITHMS; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; ONTOLOGY; TEXT PROCESSING;

CLINICAL CODING; HIERARCHICAL REPRESENTATION; INTERNATIONAL CLASSIFICATION OF DISEASE; MEDICAL INFORMATION; PERFORMANCE IMPROVEMENTS; TERM FREQUENCY-INVERSE DOCUMENT FREQUENCIES; TEXT REPRESENTATION; UNBALANCED DISTRIBUTION;

RECURRENT NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATION; CODING; LEARNING; MEDICAL INFORMATION; ONTOLOGY; PREDICTION; PRIORITY JOURNAL; STATISTICAL ANALYSIS; STATISTICAL MODEL; AUTOMATED PATTERN RECOGNITION; ELECTRONIC HEALTH RECORD; HUMAN; INTERNATIONAL CLASSIFICATION OF DISEASES; PROCEDURES; STANDARDS;

CLINICAL CODING; ELECTRONIC HEALTH RECORDS; HUMANS; INTERNATIONAL CLASSIFICATION OF DISEASES; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 85054423133     PISSN: 13865056     EISSN: 18728243     Source Type: Journal    
DOI: 10.1016/j.ijmedinf.2018.09.021     Document Type: Article

References (55)

1. Rosenbloom, S.T., Denny, J.C., Xu, H., Lorenzi, N., Stead, W.W., Johnson, K.B., Data from clinical notes: a perspective on the tension between structure and flexible documentation. J. Am. Med. Inform. Assoc. 18:2 (2011), 181–186.
2. Capita Health and Wellbeing Limited, The quality of clinical coding in the NHS, Tech. rep. September 2014.
3. Cipparone, C.W., Withiam-Leitch, M., Kimminau, K.S., Fox, C.H., Singh, R., Kahn, L., Inaccuracy of ICD-9 codes for chronic kidney disease: a study from two practice-based research networks (PBRNs). J. Am. Board Fam. Med. 28:5 (2015), 678–682.
4. O'Malley, K.J., Cook, K.F., Price, M.D., Wildes, K.R., Hurdle, J.F., Ashton, C.M., Measuring diagnoses: ICD code accuracy. Health Serv. Res. 40:5 Pt 2 (2005), 1620–1639.
5. Benesch, C., Witter, D.M. Jr., Wilder, A.L., Duncan, P.W., Samsa, G.P., Matchar, D.B., Inaccuracy of the International Classification of Diseases (ICD-9-CM) in identifying the diagnosis of ischemic cerebrovascular disease. Neurology 49:3 (1997), 660–664.
6. Wei, W.-Q., Teixeira, P.L., Mo, H., Cronin, R.M., Warner, J.L., Denny, J.C., Combining billing codes, clinical notes, and medications from electronic health records provides superior phenotyping performance. J. Am. Med. Inform. Assoc. 23:e1 (2016), e20–e27.
7. Robertson, R., Wenzel, L., Thompson, J., Charles, A., Understanding NHS financial pressures: how are they affecting patient care? Tech. rep., The King's Fund. March 2017.
8. Ghassemi, M., Naumann, T., Doshi-Velez, F., Brimmer, N., Joshi, R., Rumshisky, A., Szolovits, P., Unfolding physiological state: mortality modelling in intensive care units. KDD 2014 (2014), 75–84.
9. Caballero Barajas, K.L., Akella, R., Dynamically modeling patient's health state from electronic medical records: a time series approach. Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '15, ACM, New York, NY, USA, 2015, 69–78.
10. Chapman, W.W., Bridewell, W., Hanbury, P., Cooper, G.F., Buchanan, B.G., Evaluation of negation phrases in narrative clinical reports. Proc. AMIA Symp., 2001, 105–109.
11. Agniel, D., Benik, N., Borner, K., Brown, N., Halsey, D., Kohane, I., O'Donnell, D., Weber, G., Healthcare system dynamics. June 2016.
12. Parkin, E., A paperless NHS: electronic health records, Tech. rep. April 2016, House of Commons Library.
13. Pereira, S., Névéol, A., Massari, P., Joubert, M., Darmoni, S., Construction of a semi-automated ICD-10 coding help system to optimize medical and economic coding. Stud. Health Technol. Inform. 124 (2006), 845–850.
14. Crammer, K., Dredze, M., Ganchev, K., Talukdar, P.P., Carroll, S., Automatic code assignment to medical text. Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing, BioNLP '07, Association for Computational Linguistics, Stroudsburg, PA, USA, 2007, 129–136.
15. Marcus, M., New trends in natural language processing: statistical natural language processing. Proc. Natl. Acad. Sci. 92:22 (1995), 10052–10059.
16. Medori, J., Fairon, C., Machine learning and features selection for semi-automatic ICD-9-CM encoding. Proceedings of the NAACL HLT 2010 Second Louhi Workshop on Text and Data Mining of Health Documents, Louhi '10, Association for Computational Linguistics, Stroudsburg, PA, USA, 2010, 84–89.
17. Goldstein, I., Arzrumtsyan, A., Uzuner, O., Three approaches to automatic assignment of ICD-9-CM codes to radiology reports. AMIA Annu. Symp. Proc., 2007, 279–283.
18. W.B.C. Leah Larkey, Automatic assignment of ICD9 codes to discharge summaries, citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.49.816.
19. Lita, L.V., Yu, S., Niculescu, R.S., Bi, J., Large scale diagnostic code classification for medical patient records. IJCNLP, 2008, 877–882.
20. Patrick, J., Zhang, Y., Wang, Y., Developing feature types for classifying clinical notes. Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing, BioNLP '07, Association for Computational Linguistics, Stroudsburg, PA, USA, 2007, 191–192.
21. P. Nigam, Applying deep learning to ICD-9 multi-label classification from 700 medical records. Accessed: 12 July 2017.
22. L. Lefebure, ICD-9 coding of discharge summaries. Accessed: 12 July 2017.
23. Arifoğlu, D., Deniz, O., Aleçakır, K., Yöndem, M., CodeMagic: semi-automatic assignment of ICD-10-AM codes to patient records. Information Sciences and Systems 2014, 2014, Springer, Cham, 259–268.
24. J. Brauer, Clinical entity recognition for ICD-9 code prediction in clinical discharge summaries. Accessed: 12 July 2017.
25. Weegar, R., Casillas, A., de Ilarraza, A.D., Oronoz, M., Pérez, A., Gojenola, K., The impact of simple feature engineering in multilingual medical NER. Proceedings of the Clinical Natural Language Processing Workshop, 2016, 2016, 1.
26. Hochreiter, S., Schmidhuber, J., Long short-term memory. Neural Comput. 9:8 (1997), 1735–1780.
27. K. Cho, B. van Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, Y. Bengio, Learning phrase representations using RNN Encoder-Decoder for statistical machine translation, arXiv [cs.CL]arXiv:1406.1078.
28. Jozefowicz, R., Zaremba, W., Sutskever, I., An empirical exploration of recurrent network architectures. Proceedings of the 32nd International Conference on Machine Learning – volume 37, ICML'15, JMLR.org, Lille, France, 2015, 2342–2350.
29. Z.C. Lipton, D.C. Kale, C. Elkan, R. Wetzell, Learning to diagnose with LSTM recurrent neural networks, arXiv [cs.LG]arXiv:1511.03677.
30. R. Chalapathy, E.Z. Borzeshi, M. Piccardi, Bidirectional LSTM-CRF for clinical concept extraction, arXiv [stat.ML]arXiv:1611.08373.
31. E. Choi, M.T. Bahadori, A. Schuetz, W.F. Stewart, J. Sun, Doctor AI: Predicting clinical events via recurrent neural networks, arXiv [cs.LG].
32. E. Choi, M.T. Bahadori, L. Song, W.F. Stewart, J. Sun, GRAM: Graph-based attention model for healthcare representation learning, arXiv [cs.LG]arXiv:1611.07012.
33. Choi, E., Schuetz, A., Stewart, W.F., Sun, J., Using recurrent neural network models for early detection of heart failure onset. J. Am. Med. Inform. Assoc. 24:2 (2017), 361–370.
34. Zhang, Y., A hierarchical approach to encoding medical concepts for clinical notes. Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Student Research Workshop, HLT-SRWS '08, Association for Computational Linguistics, Stroudsburg, PA, USA, 2008, 67–72.
35. Perotte, A., Pivovarov, R., Natarajan, K., Weiskopf, N., Wood, F., Elhadad, N., Diagnosis code assignment: models and evaluation metrics. J. Am. Med. Inform. Assoc. 21:2 (2014), 231–237.
36. M. Subotin, A.R. Davis, A system for predicting ICD-10-PCS codes from electronic health records, Proc BioNLP, 2014, 59–67.
37. S. Boytcheva, Automatic matching of ICD-10 codes to diagnoses in discharge letters, Proceedings of the Workshop on Biomedical.
38. Ning, W., Yu, M., Zhang, R., A hierarchical method to automatically encode Chinese diagnoses through semantic similarity estimation. BMC Med. Inform. Decis. Mak., 16, 2016, 30.
39. Che, Z., Kale, D., Li, W., Bahadori, M.T., Liu, Y., Deep computational phenotyping. Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '15, ACM, New York, NY, USA, 2015, 507–516.
40. scikit-learn developers, 3.3. model evaluation: quantifying the quality of predictions [Online: accessed 6 August 2017] (2017). http://scikit-learn.org/stable/modules/model_evaluation.html.
41. Z.C. Lipton, C. Elkan, B. Narayanaswamy, Thresholding classifiers to maximize F1 score, arXiv [stat.ML]arXiv:1402.1892.
42. Johnson, A.E.W., Pollard, T.J., Shen, L., Lehman, L.-W.H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Celi, L.A., Mark, R.G., MIMIC-III, a freely accessible critical care database. Sci. Data, 3, 2016, 160035.
43. N. C. for Health Statistics, ICD-9-CM official guidelines for coding and reporting. Accessed: 31 July 2017.
44. S. Ayyar, O. Bear Don't Walk IV, Tagging patient notes with ICD-9 codes. Accessed: 12 July 2017.
45. Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., McClosky, D., The Stanford CoreNLP natural language processing toolkit. Association for Computational Linguistics (ACL) System Demonstrations, 2014, 55–60 http://www.aclweb.org/anthology/P/P14/P14-5010.
46. M. Schmidt, N. Le Roux, F. Bach, Minimizing finite sums with the stochastic average gradient, arXiv [math.OC]arXiv:1309.2388.
47. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E., Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12 (2011), 2825–2830.
48. S. Pyysalo, F. Ginter, H. Moen, T. Salakoski, S. Ananiadou, Distributional semantics resources for biomedical text processing, Proceedings of LBM.
49. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J., Distributed representations of words and phrases and their compositionality. Burges, C.J.C., Bottou, L., Welling, M., Ghahramani, Z., Weinberger, K.Q., (eds.) Advances in Neural Information Processing Systems 26, 2013, Curran Associates, Inc., 3111–3119.
50. Choi, Y., Chiu, C.Y.-I., Sontag, D., Learning low-dimensional representations of medical concepts. AMIA Jt. Summits Transl. Sci. Proc. 2016 (2016), 41–50.
51. Glorot, X., Bengio, Y., Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, 2010, 249–256.
52. D.P. Kingma, J. Ba, Adam: A method for stochastic optimization, arXiv [cs.LG]arXiv:1412.6980.
53. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G.S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viégas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, X. Zheng, TensorFlow: Large-scale machine learning on heterogeneous systems, software available from tensorflow.org (2015). http://tensorflow.org/.
54. Y. Gal, Z. Ghahramani, A theoretically grounded application of dropout in recurrent neural networks, arXiv [stat.ML]arXiv:1512.05287.
55. Chial, H., Rare genetic disorders: learning about genetic disease through gene mapping, SNPs, and microarray data. Nat. Educ., 1(1), 2008, 192.