Natural language processing in radiology: A systematic review

Radiology

Volumn 279, Issue 2, 2016, Pages 329-343

  Pons, Ewoud ^a   Braun, Loes M M ^a   Hunink, M G Myriam ^a   Kors, Jan A ^a  

^a ERASMUS MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; CLINICAL DECISION SUPPORT SYSTEM; CLINICAL PRACTICE; COHORT ANALYSIS; DATA ANALYSIS; DATA EXTRACTION; ELECTRONIC HEALTH RECORD; HUMAN; MEDICAL RESEARCH; MEDICAL SERVICE; NATURAL LANGUAGE PROCESSING; OUTCOME ASSESSMENT; PRIORITY JOURNAL; QUALITY CONTROL; RADIOLOGY; REVIEW; SYSTEMATIC REVIEW; INFORMATION RETRIEVAL; RADIOLOGY INFORMATION SYSTEM;

ELECTRONIC HEALTH RECORDS; HUMANS; INFORMATION STORAGE AND RETRIEVAL; NATURAL LANGUAGE PROCESSING; RADIOLOGY; RADIOLOGY INFORMATION SYSTEMS;

EID: 84965134347     PISSN: 00338419     EISSN: 15271315     Source Type: Journal    
DOI: 10.1148/radiol.16142770     Document Type: Review

References (88)

1. Jensen PB, Jensen LJ, Brunak S. Mining electronic health records: Towards better research applications and clinical care. Nat Rev Genet 2012;13(6):395-405.
2. ACR Appropriateness Criteria. American College of Radiology. http://www. Acr. org/ ac. Accessed November 26, 2014.
3. European Society of Radiology (ESR). ESR communication guidelines for radiologists. Insights Imaging 2013;4(2):143-146.
4. Hearst MA. Untangling text data mining. In: Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics. College Park, Md: Association for Computational Linguistics, 1999.
5. Meystre SM, Savova GK, Kipper-Schuler KC, Hurdle JF. Extracting information from textual documents in the electronic health record: A review of recent research. Yearb Med Inform 2008:128-144.
6. Demner-Fushman D, Chapman WW, Mc-Donald CJ. What can natural language processing do for clinical decision support? J Biomed Inform 2009;42(5):760-772.
7. Stanfill MH, Williams M, Fenton SH, Jenders RA, Hersh WR. A systematic literature review of automated clinical coding and classification systems. J Am Med Inform Assoc 2010;17(6):646-651.
8. Kao A, Poteet S. Overview. In: Kao A, Poteet S, eds. Natural language processing and text mining. New York, NY: Springer, 2007; 1-7.
9. Unified Medical Language System (UMLS). U. S. National Library of Medicine. http:// www. nlm. nih. gov/research/umls/. Accessed November 26, 2014.
10. RadLex. Radiological Society of North America. http://www. rsna. org/RadLex. Aspx. Accessed November 26, 2014.
11. PubMed. gov. US National Library of Medicine. http://www. ncbi. nlm. nih. gov/ pubmed/. Accessed March 24, 2015.
12. EMBASE. Elsevier B. V. http://www. embase. com/. Accessed March 24, 2015.
13. Journal Citation Reports. Thomson Reuters. http://thomsonreuters. com/journal-citationreports/. Accessed November 26, 2014.
14. Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Ann Intern Med 2009;151(4):264-269, W64.
15. Van Rijsbergen CJ. Information retrieval. 2nd ed. London, England: Butterworths, 1979.
16. Obuchowski NA. Receiver operating characteristic curves and their use in radiology. Radiology 2003;229(1):3-8.
17. Rink B, Roberts K, Harabagiu S, et al. Extracting actionable findings of appendicitis from radiology reports using natural language processing. AMIA Jt Summits Transl Sci Proc 2013;2013:221.
18. Lakhani P, Kim W, Langlotz CP. Automated detection of critical results in radiology reports. J Digit Imaging 2012;25(1):30-36.
19. Solti I, Cooke CR, Xia F, Wurfel MM. Automated classification of radiology reports for acute lung injury: comparison of keyword and machine learning based natural language processing approaches. Proceedings (IEEE Int Conf Bioinformatics Biomed) 2009;2009:314-319.
20. Zingmond D, Lenert LA. Monitoring freetext data using medical language processing. Comput Biomed Res 1993;26(5):467-481.
21. Garla V, Taylor C, Brandt C. Semi-supervised clinical text classification with Laplacian SVMs: An application to cancer case management. J Biomed Inform 2013;46(5):869-875.
22. Cheng LT, Zheng J, Savova GK, Erickson BJ. Discerning tumor status from unstructured MRI reports: completeness of information in existing reports and utility of automated natural language processing. J Digit Imaging 2010;23(2):119-132.
23. Yetisgen-Yildiz M, Gunn ML, Xia F, Payne TH. A text processing pipeline to extract recommendations from radiology reports. J Biomed Inform 2013;46(2):354-362.
24. Dutta S, Long WJ, Brown DF, Reisner AT. Automated detection using natural language processing of radiologists recommendations for additional imaging of incidental findings. Ann Emerg Med 2013;62(2): 162-169.
25. Yetisgen-Yildiz M, Gunn ML, Xia F, Payne TH. Automatic identification of critical follow-up recommendation sentences in radiology reports. AMIA Annu Symp Proc 2011;2011:1593-1602.
26. Xu Y, Tsujii J, Chang EI. Named entity recognition of follow-up and time information in 20, 000 radiology reports. J Am Med Inform Assoc 2012;19(5):792-799.
27. Mendonça EA, Haas J, Shagina L, Larson E, Friedman C. Extracting information on pneumonia in infants using natural language processing of radiology reports. J Biomed Inform 2005;38(4):314-321.
28. Haas JP, Mendonça EA, Ross B, Friedman C, Larson E. Use of computerized surveillance to detect nosocomial pneumonia in neonatal intensive care unit patients. Am J Infect Control 2005;33(8):439-443.
29. Gundlapalli AV, Olson J, Smith SP, et al. Hospital electronic medical record-based public health surveillance system deployed during the 2002 Winter Olympic Games. Am J Infect Control 2007;35(3):163-171.
30. Chapman WW, Fizman M, Chapman BE, Haug PJ. A comparison of classification algorithms to automatically identify chest x-ray reports that support pneumonia. J Biomed Inform 2001;34(1):4-14.
31. Liu V, Clark MP, Mendoza M, et al. Automated identification of pneumonia in chest radiograph reports in critically ill patients. BMC Med Inform Decis Mak 2013;13:90.
32. Elkin PL, Froehling D, Wahner-Roedler D, et al. NLP-based identification of pneumonia cases from free-text radiological reports. AMIA Annu Symp Proc 2008:172-176.
33. Pham AD, Névéol A, Lavergne T, et al. Natural language processing of radiology reports for the detection of thromboembolic diseases and clinically relevant incidental findings. BMC Bioinformatics 2014;15:266.
34. O'Connor SD, Silverman SG, Ip IK, Maehara CK, Khorasani R. Simple cyst-appearing renal masses at unenhanced CT: can they be presumed to be benign? Radiology 2013;269(3):793-800.
35. Dublin S, Baldwin E, Walker RL, et al. Natural Language Processing to identify pneumonia from radiology reports. Pharmacoepidemiol Drug Saf 2013;22(8):834-841.
36. Hripcsak G, Austin JH, Alderson PO, Friedman C. Use of natural language processing to translate clinical information from a database of 889, 921 chest radiographic reports. Radiology 2002;224(1):157-163.
37. Danforth KN, Early MI, Ngan S, Kosco AE, Zheng C, Gould MK. Automated identification of patients with pulmonary nodules in an integrated health system using administrative health plan data, radiology reports, and natural language processing. J Thorac Oncol 2012;7(8):1257-1262.
38. Percha B, Nassif H, Lipson J, Burnside E, Rubin D. Automatic classification of mammography reports by BI-RADS breast tissue composition class. J Am Med Inform Assoc 2012;19(5):913-916.
39. Esuli A, Marcheggiani D, Sebastiani F. An enhanced CRFs-based system for information extraction from radiology reports. J Biomed Inform 2013;46(3):425-435.
40. Yu S, Kumamaru KK, George E, et al. Classification of CT pulmonary angiography reports by presence, chronicity, and location of pulmonary embolism with natural language processing. J Biomed Inform 2014; 52:386-393.
41. Petkov VI, Penberthy LT, Dahman BA, Poklepovic A, Gillam CW, McDermott JH. Automated determination of metastases in unstructured radiology reports for eligibility screening in oncology clinical trials. Exp Biol Med (Maywood) 2013;238(12):1370-1378.
42. Zopf JJ, Langer JM, Boonn WW, Kim W, Zafar HM. Development of automated detection of radiology reports citing adrenal findings. J Digit Imaging 2012;25(1): 43-49.
43. Sohn S, Ye Z, Liu H, Chute CG, Kullo IJ. Identifying abdominal aortic aneurysm cases and controls using natural language processing of radiology reports. AMIA Jt Summits Transl Sci Proc 2013;2013:249-253.
44. Savova GK, Fan J, Ye Z, et al. Discovering peripheral arterial disease cases from radiology notes using natural language processing. AMIA Annu Symp Proc 2010;2010:722-726.
45. Schuemie MJ, Sen E, 't Jong GW, van Soest EM, Sturkenboom MC, Kors JA. Automating classification of free-text electronic health records for epidemiological studies. Pharmacoepidemiol Drug Saf 2012;21(6):651-658.
46. Garla V, Lo Re V 3rd, Dorey-Stein Z, et al. The Yale cTAKES extensions for document classification: Architecture and application. J Am Med Inform Assoc 2011;18(5):614-620.
47. Rubin D, Wang D, Chambers DA, Chambers JG, South BR, Goldstein MK. Natural language processing for lines and devices in portable chest x-rays. AMIA Annu Symp Proc 2010;2010:692-696.
48. Trick WE, Chapman WW, Wisniewski MF, Peterson BJ, Solomon SL, Weinstein RA. Electronic interpretation of chest radiograph reports to detect central venous catheters. Infect Control Hosp Epidemiol 2003;24(12):950-954.
49. Flynn RW, Macdonald TM, Schembri N, Murray GD, Doney AS. Automated data capture from free-text radiology reports to enhance accuracy of hospital inpatient stroke codes. Pharmacoepidemiol Drug Saf 2010;19(8):843-847.
50. Friedlin J, McDonald CJ. A natural language processing system to extract and code concepts relating to congestive heart failure from chest radiology reports. AMIA Annu Symp Proc 2006:269-273.
51. Zhou Y, Amundson PK, Yu F, Kessler MM, Benzinger TL, Wippold FJ. Automated classification of radiology reports to facilitate retrospective study in radiology. J Digit Imaging 2014;27(6):730-736.
52. Gerstmair A, Daumke P, Simon K, Langer M, Kotter E. Intelligent image retrieval based on radiology reports. Eur Radiol 2012;22(12):2750-2758.
53. Mamlin BW, Heinze DT, McDonald CJ. Automated extraction and normalization of findings from cancer-related free-text radiology reports. AMIA Annu Symp Proc 2003:420-424.
54. Lacson R, Andriole KP, Prevedello LM, Khorasani R. Information from Searching Content with an Ontology-Utilizing Toolkit (iSCOUT). J Digit Imaging 2012;25(4):512-519.
55. Do BH, Wu A, Biswal S, Kamaya A, Rubin DL. Informatics in radiology: RADTF-a semantic search-enabled, natural language processor-generated radiology teaching file. RadioGraphics 2010;30(7):2039-2048.
56. Dang PA, Kalra MK, Schultz TJ, Graham SA, Dreyer KJ. Informatics in radiology: Render-an online searchable radiology study repository. RadioGraphics 2009;29(5):1233-1246.
57. Hersh W, Mailhot M, Arnott-Smith C, Lowe H. Selective automated indexing of findings and diagnoses in radiology reports. J Biomed Inform 2001;34(4):262-273.
58. Warden GI, Lacson R, Khorasani R. Leveraging terminologies for retrieval of radiology reports with critical imaging findings. AMIA Annu Symp Proc 2011;2011:1481-1488.
59. Dreyer KJ, Kalra MK, Maher MM, et al. Application of recently developed computer algorithm for automatic classification of unstructured radiology reports: validation study. Radiology 2005;234(2):323-329.
60. Dang PA, Kalra MK, Blake MA, et al. Natural language processing using online analytic processing for assessing recommendations in radiology reports. J Am Coll Radiol 2008;5(3):197-204.
61. Dang PA, Kalra MK, Blake MA, Schultz TJ, Halpern EF, Dreyer KJ. Extraction of recommendation features in radiology with natural language processing: exploratory study. AJR Am J Roentgenol 2008;191(2): 313-320.
62. Sistrom CL, Dreyer KJ, Dang PP, et al. Recommendations for additional imaging in radiology reports: multifactorial analysis of 5. 9 million examinations. Radiology 2009; 253(2):453-461.
63. Ip IK, Mortele KJ, Prevedello LM, Khorasani R. Focal cystic pancreatic lesions: Assessing variation in radiologists' management recommendations. Radiology 2011;259(1):136-141.
64. Lakhani P, Menschik ED, Goldszal AF, Murray JP, Weiner MG, Langlotz CP. Development and validation of queries using structured query language (SQL) to determine the utilization of comparison imaging in radiology reports stored on PACS. J Digit Imaging 2006;19(1):52-68.
65. Gershanik EF, Lacson R, Khorasani R. Critical finding capture in the impression section of radiology reports. AMIA Annu Symp Proc 2011;2011:465-469.
66. Duszak R Jr, Nossal M, Schofield L, Picus D. Physician documentation deficiencies in abdominal ultrasound reports: frequency, characteristics, and financial impact. J Am Coll Radiol 2012;9(6):403-408.
67. Lakhani P, Langlotz CP. Automated detection of radiology reports that document non-routine communication of critical or significant results. J Digit Imaging 2010; 23(6):647-657.
68. Lakhani P, Kim W, Langlotz CP. Automated extraction of critical test values and communications from unstructured radiology reports: An analysis of 9. 3 million reports from 1990 to 2011. Radiology 2012;265(3):809-818.
69. Ip IK, Mortele KJ, Prevedello LM, Khorasani R. Repeat abdominal imaging exam-inations in a tertiary care hospital. Am J Med 2012;125(2):155-161.
70. Lacson R, Prevedello LM, Andriole KP, et al. Factors associated with radiologists' adherence to Fleischner Society guidelines for management of pulmonary nodules. J Am Coll Radiol 2012;9(7):468-473.
71. Raja AS, Ip IK, Prevedello LM, et al. Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department. Radiology 2012;262(2):468-474.
72. Sippo DA, Warden GI, Andriole KP, et al. Automated extraction of BI-RADS final assessment categories from radiology reports with natural language processing. J Digit Imaging 2013;26(5):989-994.
73. Fiszman M, Haug PJ, Frederick PR. Automatic extraction of PIOPED interpretations from ventilation/perfusion lung scan reports. Proc AMIA Symp 1998:860-864.
74. Do BH, Wu AS, Maley J, Biswal S. Automatic retrieval of bone fracture knowledge using natural language processing. J Digit Imaging 2013;26(4):709-713.
75. Sevenster M, Bozeman J, Cowhy A, Trost W. Automatically pairing measured findings across narrative abdomen CT reports. AMIA Annu Symp Proc 2013;2013:1262-1271.
76. Sevenster M, van Ommering R, Qian Y. Automatically correlating clinical findings and body locations in radiology reports using MedLEE. J Digit Imaging 2012;25(2):240-249.
77. Fiszman M, Chapman WW, Aronsky D, Evans RS, Haug PJ. Automatic detection of acute bacterial pneumonia from chest x-ray reports. J Am Med Inform Assoc 2000;7(6):593-604.
78. Fiszman M, Chapman WW, Evans SR, Haug PJ. Automatic identification of pneumonia related concepts on chest x-ray reports. Proc AMIA Symp 1999:67-71.
79. Voll K, Atkins S, Forster B. Improving the utility of speech recognition through error detection. J Digit Imaging 2008;21(4):371-377.
80. Sinha U, Dai B, Johnson DB, et al. Interactive software for generation and visualization of structured findings in radiology reports. AJR Am J Roentgenol 2000;175(3):609-612.
81. Farkas R, Szarvas G. Automatic construction of rule-based ICD-9-CM coding systems. BMC Bioinformatics 2008;9(Suppl 3):S10.
82. Roberts K, Rink B, Harabagiu SM, et al. A machine learning approach for identifying anatomical locations of actionable findings in radiology reports. AMIA Annu Symp Proc 2012;2012:779-788.
83. Bozkurt S, Rubin D. Automated detection of ambiguity in BI-RADS assessment categories in mammography reports. Stud Health Technol Inform 2014;197:35-39.
84. Pestian JP, Brew C, Matykiewicz P, et al. A shared task involving multi-label classification of clinical free text. Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing. Prague, Czech Republic: Association for Computational Linguistics, 2007; 97-104.
85. Integrating the Healthcare Enterprise. IHE Radiology. http://www. ihe. net/Radiology/. Accessed November 26, 2014.
86. Radiology Reporting Initiative. Radiological Society of North America. http://www. rsna. org/Reporting-Initiative. Aspx. Accessed November 26, 2014.
87. Radreport. org. Radiological Society of North America. http://www. radreport. org/. Accessed March 11, 2015.
88. Cramer JA, Eisenmenger LB, Pierson NS, Dhatt HS, Heilbrun ME. Structured and templated reporting: An overview. Appl Radiol 2014.