A reliability study for evaluating information extraction from radiology reports

Journal of the American Medical Informatics Association

Volumn 6, Issue 2, 1999, Pages 143-150

  Hripcsak, George ^a,d   Kuperman, Gilad J ^b   Friedman, Carol ^a,c   Heitjan, Daniel F ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b PARTNERS HEALTHCARE   (United States)

^c CITY UNIVERSITY OF NEW YORK   (United States)

^d NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPUTER AIDED DESIGN; EXTRACTION; INFORMATION PROCESSING; LANGUAGE ABILITY; PHYSICIAN ATTITUDE; PLEURA EFFUSION; PNEUMONIA; PNEUMOTHORAX; RELIABILITY; STANDARD;

EID: 0033036039     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1136/jamia.1999.0060143     Document Type: Article

References (23)

1. Friedman CP, Wyatt JC. Evaluation Methods in Medical Informatics. New York: Springer, 1997.
2. Dunn G. Design and Analysis of Reliability Studies. New York: Oxford University Press, 1989.
3. Cork RD, Detmer WM, Friedman CP. Development and initial validation of an instrument to measure physicians' use of, knowledge about, and attitudes toward computers. J Am Med Inform Assoc. 1998;5:164-76.
4. Bates DW, Cullen DJ, Laird N, et al. Incidence of adverse drug events and potential adverse drug events: implications for prevention. JAMA. 1996;274:29-34.
5. Berner ES, Webster GD, Shugerman AA, et al. Performance of four computer-based diagnostic systems. N Engl J Med. 1994;330:1792-6.
6. Cooper GF, Miller RA. An experiment comparing lexical and statistical methods for extracting MeSH terms from clinical free text. J Am Med Inform Assoc. 1998;5:62-75.
7. Yu VL, Fagan LM, Wraith S, et al. An evaluation of MYCIN's advice. In: Buchanan BG, Shortliffe EH (eds). Rule-based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. Reading, Mass.: Addison-Wesley, 1984.
8. van der Lei J, Musen MA, van der Does E, Man in't Veld AJ, van Bemmel JH. Comparison of computer-aided and human review of general practitioners' management of hypertension. Lancet. 1991;338:1504-8.
9. Hripcsak G, Friedman C, Alderson PO, DuMouchel W, Johnson SB, Clayton PD. Unlocking clinical data from narrative reports: a study of natural language processing. Ann Intern Med. 1995;122:681-8.
10. Hripcsak G, Kuperman GJ, Friedman C. Extracting findings from narrative reports: software transferability and sources of physician disagreement. Method Inform Med. 1998;37: 1-7.
11. Verdaguer A, Patak A, Sancho JJ, Sierra C, Sanz F. Validation of the medical expert system PNEUMON-IA. Comput Biomed Res. 1992;25:511-26.
12. Will C. Comparing human and machine performance for natural language information extraction: results for English microelectronics from the MUC-5 evaluation. In: Proceedings of the Fifth Message Understanding Conference (MUC-5); Aug 25-27, 1993; Baltimore, Md.
13. Friedman C, Hripcsak G, DuMouchel W, Johnson SB, P.D. Clayton. Natural language processing in an operational clinical information system. Natural Language Engineering. 1995;1:83-108.
14. Cronbach LJ, Gleser GC, Nanda H, Rajaratnam N. The dependability of behavioral measurements: theory of generalizability of scores and profiles. New York: John Wiley, 1972.
15. Shavelson RJ, Webb NM, Rowley GL. Generalizability theory. Am Psychologist. 1989;44:922-32.
16. SAS Institute, Inc. SAS/STAT Software: Changes and Enhancements through Release 6.11. Cary, N.C.: SAS Institute, 1996:533-656.
17. StataCorp. Stata Statistical Software, release 4.0, volume 2. College Station, Tex.: StataCorp, 1995:163.
18. Carol Friedman, George Hripcsak, Irina Shablinsky. An evaluation of natural language processing methodologies. Proc AMIA Annu Fall Symp. 1998:855-9.
19. Adam Wilcox, George Hripcsak. Knowledge discovery and data mining to assist natural language understanding. Proc AMIA Annu Fall Symp. 1998:835-9.
20. Jain NL, Knirsch C, Friedman C, Hripcsak G. Identification of suspected tuberculosis patients based on natural language processing of chest radiograph reports. Proc AMIA Annu Fall Symp. 1996:542-6.
21. Knirsch CA, Jain NL, Pablos-Mendez A, Friedman C, Hripcsak G. Respiratory isolation of tuberculosis patients using clinical guidelines and an automated clinical decision support system. Infect Control Hosp Epidemiol. 1998;19:94-100.
22. Fleiss JL. The Design and Analysis of Clinical Experiments. New York: John Wiley, 1986:291-305.
23. Mood AM, Graybill FA, Boes DC. Introduction to the Theory of Statistics, 3rd ed. New York: McGraw-Hill, 1974:181.