Automatically extracting information needs from complex clinical questions

Journal of Biomedical Informatics

Volumn 43, Issue 6, 2010, Pages 962-971

  Cao, Yong Gang ^a   Cimino, James J ^b   Ely, John ^c   Yu, Hong ^a  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b NATIONAL INSTITUTES OF HEALTH   (United States)

^c UNIVERSITY OF IOWA   (United States)

Author keywords

Keyword extraction; Natural language processing; Question analysis; Question answering

Indexed keywords

EXTRACTING INFORMATION; INFORMATION NEED; KEYWORD EXTRACTION; MACHINE-LEARNING; MULTIMEDIA INFORMATION; NATURAL LANGUAGE PROCESSING; PATIENT CARE; QUESTION ANALYSIS; QUESTION ANSWERING; QUESTION ANSWERING SYSTEMS; TOPIC CLASSIFICATION; TRAINING DATA;

COMPUTATIONAL LINGUISTICS; ERROR ANALYSIS; INFORMATION SCIENCE; MACHINE DESIGN;

NATURAL LANGUAGE PROCESSING SYSTEMS;

ARTICLE; CLASSIFICATION; MACHINE LEARNING; MULTIMEDIA; NATURAL LANGUAGE PROCESSING; PATIENT CARE; PRIORITY JOURNAL; SYSTEM ANALYSIS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATABASES, FACTUAL; INFORMATION STORAGE AND RETRIEVAL; NATURAL LANGUAGE PROCESSING;

EID: 78649332322     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2010.07.007     Document Type: Article

References (88)

1. Ely J.W., Osheroff J.A., Ebell M.H., Bergus G.R., Levy B.T., Chambliss M.L., et al. Analysis of questions asked by family doctors regarding patient care. BMJ 1999, 319:358-361.
2. Timpka T., Arborelius E. The GP's dilemmas: a study of knowledge need and use during health care consultations. Methods Inf Med 1990, 29:23-29.
3. Bergus G.R., Randall C.S., Sinift S.D., Rosenthal D.M. Does the structure of clinical questions affect the outcome of curbside consultations with specialty colleagues?. Arch Fam Med 2000, 9:541-547.
4. Ely J.W., Burch R.J., Vinson D.C. The information needs of family physicians: case-specific clinical questions. J Fam Pract 1992, 35:265-269.
5. Osheroff J.A., Forsythe D.E., Buchanan B.G., Bankowitz R.A., Blumenfeld B.H., Miller R.A. Physicians' information needs: analysis of questions posed during clinical teaching. Ann Intern Med 1991, 114:576-581.
6. Covell D.G., Uman G.C., Manning P.R. Information needs in office practice: are they being met?. Ann Intern Med 1985, 103:596-599.
7. Smith R. What clinical information do doctors need?. BMJ 1996, 313:1062-1068.
8. Hersh W.R., Hickam D.H. How well do physicians use electronic information retrieval systems? A framework for investigation and systematic review. JAMA 1998, 280:1347-1352.
9. Hersh W. Evidence-based medicine and the Internet. ACP J Club 1996, 125:A14-A16.
10. Westbrook J.I., Gosling A.S., Coiera E. Do clinicians use online evidence to support patient care? A study of 55,000 clinicians. J Am Med Inform Assoc 2004, 11:113-120.
11. Westbrook J.I., Coiera E.W., Gosling A.S. Do online information retrieval systems help experienced clinicians answer clinical questions?. J Am Med Inform Assoc 2005, 12:315-321.
12. Gosling A.S., Westbrook J.I. Allied health professionals' use of online evidence: a survey of 790 staff working in the Australian public hospital system. Int J Med Inform 2004, 73:391-401.
13. Ely J.W., Osheroff J.A., Ebell M.H., Chambliss M.L., Vinson D.C., Stevermer J.J., et al. Obstacles to answering doctors' questions about patient care with evidence: qualitative study. BMJ 2002, 324:710-713.
14. Ely J.W., Osheroff J.A., Chambliss M.L., Ebell M.H., Rosenbaum M.E. Answering physicians' clinical questions: obstacles and potential solutions. J Am Med Inform Assoc 2005, 12:217-224.
15. Hoogendam A., Stalenhoef A.F., Robbe P.F., Overbeke A.J. Answers to questions posed during daily patient care are more likely to be answered by UpToDate than PubMed. J Med Internet Res 2008, 10:e29.
16. Cullen R.J. In search of evidence: family practitioners' use of the Internet for clinical information. J Med Libr Assoc 2002, 90:370-379.
17. Stephens M.B., Von Thun A.M. Military medical informatics: accessing information in the deployed environment. Mil Med 2009, 174:259-264.
18. Tang H., Ng J.H. Googling for a diagnosis - use of Google as a diagnostic aid: Internet based study. BMJ 2006, 333:1143-1145.
19. Kitchin D.R., Applegate K.E. Learning radiology a survey investigating radiology resident use of textbooks, journals, and the Internet. Acad Radiol 2007, 14:1113-1120.
20. Purcell G.P., Wilson P., Delamothe T. The quality of health information on the Internet. BMJ 2002, 324:557-558.
21. Jadad A.R., Gagliardi A. Rating health information on the Internet: navigating to knowledge or to Babel?. JAMA 1998, 279:611-614.
22. Silberg W.M., Lundberg G.D., Musacchio R.A. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor - let the reader and viewer beware. JAMA 1997, 277:1244-1245.
23. Glennie E., Kirby A. The career of radiography: information on the web. J Diagn Radiogr Imaging 2006, 6:25-33.
24. Childs S. Judging the quality of Internet-based health information. Perform Meas Metrics 2005, 6:80-96.
25. Griffiths K.M., Christensen H. Quality of web based information on treatment of depression: cross sectional survey. BMJ 2000, 321:1511-1515.
26. Cline R.J., Haynes K.M. Consumer health information seeking on the Internet: the state of the art. Health Educ Res 2001, 16:671-692.
27. Benigeri M., Pluye P. Shortcomings of health information on the Internet. Health Promot Int 2003, 18:381-386.
28. Wyatt J.C. Commentary: measuring quality and impact of the World Wide Web. BMJ 1997, 314:1879-1881.
29. McClung H.J., Murray R.D., Heitlinger L.A. The Internet as a source for current patient information. Pediatrics 1998, 101:E2.
30. De Leo G., LeRouge C., Ceriani C., Niederman F. Websites most frequently used by physician for gathering medical information. AMIA Annu Symp Proc 2006, 902.
31. Freeman M.K., Lauderdale S.A., Kendrach M.G., Woolley T.W. Google Scholar versus PubMed in locating primary literature to answer drug-related questions. Ann Pharmacother 2009, 43:478-484.
32. Fletcher R.H., Fletcher S.W. Evidence-based approach to the medical literature. J Gen Intern Med 1997, 12(Suppl. 2):S5-S14.
33. Hersh W.R., Crabtree M.K., Hickam D.H., Sacherek L., Friedman C.P., Tidmarsh P., et al. Factors associated with success in searching MEDLINE and applying evidence to answer clinical questions. J Am Med Inform Assoc 2002, 9:283-293.
34. Yu H, Sable C. Being Erlang Shen: identifying answerable questions. In: Proceedings of the nineteenth international joint conference on artificial intelligence on knowledge and reasoning for answering questions; 2005.
35. Yu H, Sable C, Zhu HR. Classifying medical questions based on an evidence taxonomy. In: Proceedings of the AAAI 2005 workshop on question answering in restricted domains; 2005.
36. Yu H, Wei Y. The semantics of a definiendum constrains both the lexical semantics and the lexicosyntactic patterns in the definiens. In: Proceedings of the BioNLP workshop on linking natural language processing and biology at HLT-NAACL, New York, USA; 2006. p. 1-8.
37. Yu H. Towards answering biological questions with experimental evidence: automatically identifying text that summarize image content in full-text articles. AMIA Annu Symp Proc 2006, 834-838.
38. Lee M., Cimino J., Zhu H.R., Sable C., Shanker V., Ely J., et al. Beyond information retrieval-medical question answering. AMIA Annu Symp Proc 2006, 469-473.
39. Yu H., Lee M., Kaufman D., Ely J., Osheroff J., Hripcsak G., et al. Development, implementation, and a cognitive evaluation of a definitional question answering system for physicians. J Biomed Inform 2007, 40:236-251.
40. Yu H., Cao Y.G. Automatically extracting information needs from ad hoc clinical questions. AMIA Annu Symp Proc 2008, 96-100.
41. Yu H, Cao YG. Using the weighted keyword models to improve clinical question answering. In: IEEE international conference on bioinformatics & biomedicine workshop NLP approaches for unmet information needs in health care; 2009.
42. Kim D., Yu H. Hierarchical image classification in the bioscience literature. AMIA Annu Symp Proc. 2009, 2009:327-331.
43. Cao YG, Ely J, Antieau L, Yu H. Evaluation of the clinical question answering presentation. In: Proceedings of the Workshop on BioNLP, Boulder, Colorado, 171-8.
44. Cao YG, Ely J, Yu H. Using weighted keywords to improve clinical question answering. In: Proceeding of IEEE BIBM workshop in NLP approaches in unmet information needs in health care; 2009.
45. Agarwal S., Yu H. FigSum: automatically generating structured text summaries for figures in biomedical literature. AMIA Annu Symp Proc 2009, 2009:6-10.
46. Yu H., Kaufman K. A cognitive evaluation of four online search engines for answering definitional questions posed by physicians. Pac Symp Biocomput 2007, 328-339.
47. Niu Y, Hirst G, McArthur G, Rodriguez-Gianolli P. Answering clinical questions with role identification. In: ACL workshop on natural language processing in biomedicine; 2003.
48. Cimino J.J., Borotsov D.V. Leading a horse to water: using automated reminders to increase use of online decision support. AMIA Annu Symp Proc 2008, 116-120.
49. Huang X., Lin J., Demner-Fushman D. Evaluation of PICO as a knowledge representation for clinical questions. AMIA Annu Symp Proc 2006, 359-363.
50. Demner-Fushman D., Lin J. Answering clinical questions with knowledge-based and statistical techniques. Comput Linguist 2007, 33:63-103.
51. Zweigenbaum P. Question-answering for biomedicine: methods and state of the art. In: MIE 2005 workshop; 2005.
52. Zweigenbaum P. Question answering in biomedicine. In: EACL workshop on natural language processing for question answering, Budapest; 2003. p. 1-4.
53. Rinaldi F, Dowdall J, Schneider G, Persidis A. Answering questions in the genomics domain. In: ACL 2004 workshop on question answering in restricted domain; 2004.
54. Cimino J. Infobuttons: anticipatory passive decision support. AMIA Annu Symp Proc 2008, 1203-1204.
55. Cimino J.J., Li J., Allen M., Currie L.M., Graham M., Janetzki V., et al. Practical considerations for exploiting the world wide web to create infobuttons. Medinfo 2004, 11:277-281.
56. Cimino J.J., Li J. Sharing infobuttons to resolve clinicians' information needs. AMIA Annu Symp Proc 2003, 815.
57. Cimino J.J., Li J., Graham M., Currie L.M., Allen M., Bakken S., et al. Use of online resources while using a clinical information system. AMIA Annu Symp Proc 2003, 175-179.
58. Cimino J.J., Li J., Bakken S., Patel V.L. Theoretical, empirical and practical approaches to resolving the unmet information needs of clinical information system users. Proc AMIA Symp 2002, 170-174.
59. Cimino J.J., Elhanan G., Zeng Q. Supporting infobuttons with terminological knowledge. Proc AMIA Annu Fall Symp 1997, 528-532.
60. Wilczynski N.L., McKibbon K.A., Haynes R.B. Enhancing retrieval of best evidence for health care from bibliographic databases: calibration of the hand search of the literature. Medinfo 2001, 393.
61. Sneiderman C.A., Demner-Fushman D., Fiszman M., Ide N.C., Rindflesch T.C. Knowledge-based methods to help clinicians find answers in MEDLINE. J Am Med Inform Assoc 2007, 14:772-780.
62. Srinivasan P., Rindflesch T. Exploring text mining from MEDLINE. Proc AMIA Symp 2002, 722-726.
63. Ide N.C., Loane R.F., Demner-Fushman D. Essie: a concept-based search engine for structured biomedical text. J Am Med Inform Assoc 2007, 14:253-263.
64. Cimino J.J., Aguirre A., Johnson S.B., Peng P. Generic queries for meeting clinical information needs. Bull Med Libr Assoc 1993, 81:195-206.
65. Seol Y.H., Kaufman D.R., Mendonca E.A., Cimino J.J., Johnson S.B. Scenario-based assessment of physicians' information needs. Medinfo 2004, 11:306-310.
66. Niu Y, Hirst G. Analysis of semantic classes in medical text for question answering. In: ACL 2004 workshop on question answering in restricted domains; 2004.
67. Ely J.W., Osheroff J.A., Gorman P.N., Ebell M.H., Chambliss M.L., Pifer E.A., et al. A taxonomy of generic clinical questions: classification study. BMJ 2000, 321:429-432.
68. Ely J.W., Osheroff J.A., Ferguson K.J., Chambliss M.L., Vinson D.C., Moore J.L. Lifelong self-directed learning using a computer database of clinical questions. J Fam Pract 1997, 45:382-388.
69. D'Alessandro D.M., Kreiter C.D., Peterson M.W. An evaluation of information-seeking behaviors of general pediatricians. Pediatrics 2004, 113:64-69.
70. Lin J., Wilbur W.J. Syntactic sentence compression in the biomedical domain: facilitating access to related articles. Inform Retrieval 2007, 10:393-414.
71. MMTx; 2005. Available from: http://mmtx.nlm.nih.gov/docs.shtml.
72. Friedman C., Hripcsak G., Shagina L., Liu H. Representing information in patient reports using natural language processing and the extensible markup language. J Am Med Inform Assoc 1999, 6:76.
73. Schwartz A.S., Hearst M.A. A simple algorithm for identifying abbreviation definitions in biomedical text. Pac Symp Biocomput 2003, 451-462.
74. Patrick J, Li M, A cascade approach to extracting medication events. In: Proceedings of the Australasian Language Technology Association Workshop 2009;99-103.
75. Li Z, Cao Y, Antieau L, Agarwal S, Zhang Q, Yu H. A hybrid approach to extract medication information from medical discharge summaries. J Am Med Inform Assoc, in press.
76. Yu H., Hripcsak G., Friedman C. Mapping abbreviations to full forms in biomedical articles. J Am Med Inform Assoc 2002, 9:262-272.
77. Jones S.K. A statistical interpretation of term specificity and its application in retrieval. J Doc 1972, 28:11-21.
78. Pradhan SS, Illouz G, Blair-Goldensohn SJ, Schlaikjer AH, Krugler V, Filatova E et al. Building a foundation system for producing short answers to factual questions. In: Eleventh text retrieval conference (TREC-11), Washington, DC; 2002.
79. Kleinbaum D.G., Klein M. Logistic regression 2005, Springer. 2nd ed.
80. Lafferty J, McCallum A, Pereira F. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the ICML-01; 2001. p. 282-9.
81. Bagley S.C., White H., Golomb B.A. Logistic regression in the medical literature: standards for use and reporting, with particular attention to one medical domain. J Clin Epidemiol 2001, 54:979-985.
82. Settles B. Biomedical named entity recognition using conditional random fields and rich feature sets. In: Proceedings of the international joint workshop on natural language processing in biomedicine and its applications (NLPBA), Geneva, Switzerland; 2004. p. 104-7.
83. Ristad E.S., Yianilos P.N., Inc M.T., Princeton N.J. Learning string-edit distance. IEEE Trans Pattern Anal Mach Intell 1998, 20:522-532.
84. Johnson S.B., Aguirre A., Peng P., Cimino J. Interpreting natural language queries using the UMLS. Proc Annu Symp Comput Appl Med Care 1993, 294.
85. Yu H, Cao YG. Using the weighted keyword models to improve biomedical information retrieval. In: AMIA summit on translational bioinformatics, San Francisco, USA; 2009.
86. Hersh W, Cohen AM, Roberts P, Rekapalli HK. TREC 2006 genomics track overview. In: TREC genomics track conference; 2006.
87. Hersh W, Cohen A, Ruslen L, Roberts P. TREC 2007 genomics track overview. In: The TREC genomics track conference; 2007.
88. Bendersky M, Croft WB. Discovering key concepts in verbose queries. In: Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval; 2008. p. 491-8.