Conceptual knowledge acquisition in biomedicine: A methodological review

Journal of Biomedical Informatics

Volumn 40, Issue 5, 2007, Pages 582-602

  Payne, Philip R O ^a   Mendonça, Eneida A ^b   Johnson, Stephen B ^b   Starren, Justin B ^c  

^a OHIO STATE UNIVERSITY   (United States)

^b Howard Hughes Medical Institute   (United States)

^c MARSHFIELD CLINIC   (United States)

Author keywords

Conceptual knowledge; Knowledge acquisition; Knowledge engineering

Indexed keywords

DATABASE SYSTEMS; ONTOLOGY; SEMANTICS; TERMINOLOGY;

BIOMEDICINE; COGNITIVE SCIENCE; CONCEPTUAL KNOWLEDGE;

KNOWLEDGE ACQUISITION;

ACADEMIC ACHIEVEMENT; ARTIFICIAL INTELLIGENCE; BIOMEDICINE; COMPUTER; CONCEPTUAL FRAMEWORK; EDUCATION; ETHNOGRAPHIC RESEARCH; HEALTH CARE MANAGEMENT; HEALTH SERVICE; INFORMATION PROCESSING; KNOWLEDGE BASE; LANGUAGE ABILITY; LEARNING; PERSONAL CONSTRUCT THEORY; PRIORITY JOURNAL; PSYCHOLOGY; REVIEW; STRUCTURED INTERVIEW; TAXONOMY;

ARTIFICIAL INTELLIGENCE; BIOMEDICAL RESEARCH; DATABASES, BIBLIOGRAPHIC; DECISION TREES; DOCUMENTATION; EXPERT SYSTEMS; FORECASTING; LANGUAGE; LINGUISTICS; MODELS, THEORETICAL; QUALITY CONTROL; SEMANTICS; SOFTWARE VALIDATION; SYMBOLISM;

EID: 34548240138     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2007.03.005     Document Type: Review

References (108)

1. McCormick R. Conceptual and procedural knowledge. Int J Technol Design Edu 7 (1997) 141-159
2. Achour S.L., et al. A UMLS-based knowledge acquisition tool for rule-based clinical decision support system development. J Am Med Inform Assoc 8 4 (2001) 351-360
3. Ashburner M., et al. Gene ontology: tool for the unification of biology. The gene ontology consortium. Nat Genet 25 1 (2000) 25-29
4. Bakken S., et al. Evaluation of the clinical LOINC (Logical Observation Identifiers, Names, and Codes) semantic structure as a terminology model for standardized assessment measures. J Am Med Inform Assoc 7 6 (2000) 529-538
5. Bell D.S., Pattison-Gordon E., and Greenes R.A. Experiments in concept modeling for radiographic image reports. J Am Med Inform Assoc 1 3 (1994) 249-262
6. Campbell K.E., et al. Representing thoughts, words, and things in the UMLS. J Am Med Inform Assoc 5 5 (1998) 421-431
7. Cimino J.J., et al. Knowledge-based approaches to the maintenance of a large controlled medical terminology. J Am Med Inform Assoc 1 1 (1994) 35-50
8. Coenen A., et al. Collaborative efforts for representing nursing concepts in computer-based systems: international perspectives. J Am Med Inform Assoc 8 3 (2001) 202-211
9. Dolin R.H., et al. Kaiser Permanente's convergent medical terminology. Medinfo 11 Pt 1 (2004) 346-350
10. Humphreys B.L., et al. Planned NLM/AHCPR large-scale vocabulary test: using UMLS technology to determine the extent to which controlled vocabularies cover terminology needed for health care and public health. J Am Med Inform Assoc 3 4 (1996) 281-287
11. Peleg M., et al. The InterMed approach to sharable computer-interpretable guidelines: a review. J Am Med Inform Assoc 11 1 (2004) 1-10
12. Liou YI, Knowledge acquisition: issues, techniques, and methodology. In: Proceedings of the 1990 ACM SIGBDP conference on trends and directions in expert systems. 1990, Orlando, Florida, United States: ACM Press, p.212-36.
13. Preece A. Evaluating verification and validation methods in knowledge engineering. Micro-Level Knowl Manage (2001) 123-145
14. Brachman R.J., and McGuinness D.L. Knowledge representation, connectionism and conceptual retrieval. Proceedings of the 11th annual international ACM SIGIR conference on research and development in information retrieval (1988), ACM Press, Grenoble, France
15. Compton P., and Jansen R. A philosophical basis for knowledge acquisition. Knowl Acquisition 2 3 (1990) 241-257
16. Gaines BR, Social and cognitive processes in knowledge acquisition. Knowledge acquisition 1989 [cited 2005 8/23/2005]; Available from: http://www.repgrid.com/reports/PSYCH/SocioCog/.
17. Gaines BR, Shaw MLG. Knowledge acquisition tools based on personal construct psychology. 1993 [cited 2005 8/23/2005]; Available from: http://www.repgrid.com/reports/KBS/KER/.
18. Liou Y.I. Knowledge acquisition: issues, techniques, and methodology (1990), ACM Press, New York, United States
19. Alan L.R., et al. Untangling taxonomies and relationships: personal and practical problems in loosely coupled development of large ontologies. Proceedings of the international conference on knowledge capture (2001), ACM Press, Victoria, British Columbia, Canada
20. Canas AJ, Leake DB, Wilson DC. Managing, mapping, and manipulating conceptual knowledge. In: Proceedings of the AAAI-99 workshop on exploring synergies of knowledge management and case-based reasoning. 1999. Menlo Park: AAAI Press.
21. Ian N., and Adam P. Towards a standard upper ontology. Proceedings of the international conference on formal ontology in information systems (2001), ACM Press, Ogunquit, Maine, USA
22. Joachim H., et al. Conceptual knowledge discovery and data analysis. Proceedings of the linguistic on conceptual structures: logical linguistic, and computational issues (2000), Springer-Verlag 421-437
23. Tayar N. A model for developing large shared knowledge bases. CIKM '93: Proceedings of the second international conference on information and knowledge management (1993), ACM Press, Washington, D.C., United States
24. Payne P.R., and Starren J.B. Quantifying visual similarity in clinical iconic graphics. J Am Med Inform Assoc 12 3 (2005) 338-345
25. Barsalow L.W., et al. Grounding conceptual knowledge in modality-specific systems. Trends Cogn Sci 7 2 (2003) 84-91
26. Glaser R. Education and thinking: the role of knowledge. Am Psychologist 39 2 (1984) 93-104
27. Hiebert J. Procedural and conceptual knowledge: the case of mathematics (1986), Lawrence Erlbaum Associates, London
28. Scribner S. Knowledge at work. Anthropol Edu Quarter 16 3 (1985) 199-206
29. Borlawsky T., et al. Partitioning knowledge bases between advanced notification and clinical decision support systems. AMIA Annu Symp Proc (2005) 901
30. Cook L. Knowledge acquisition tools for expert systems. In: Boose J.H., and Gaines B.R. (Eds). Knowledge acquisition for knowledge based systems (1990), ACM Press, New York
31. Hoffman R.R. A survey of methods for eliciting the knowledge of experts. ACM SIGART Bullet 108 (1989) 19-27
32. Lavrac N., and Mozetic I. Methods for knowledge acquisition and refinement in second generation expert systems. ACM SIGART Bullet 108 (1989) 63-69
33. Rook FW, Croghan JW. Knowledge acquisition for AI system requirements analysis: a systems engineering methodology. In: Proceedings of the 1st international conference on industrial and engineering applications of artificial intelligence and expert systems-Volume 2. 1988, ACM Press: Tullahoma, Tennessee, United States.
34. Menzies T., and Harmelen Fv. Evaluating knowledge engineering techniques. Int J Hum-Comput Stud 51 4 (1999) 715-727
35. Hereth J., et al. Conceptual knowledge discovery and data analysis. Proceedings of the linguistic on conceptual structures: logical linguistic and computational issues (2000), Springer-Verlag 421-437
36. Evans D.A., et al. Toward a medical-concept representation language. The Canon Group. J Am Med Inform Assoc 1 3 (1994) 207-217
37. Campbell K.E., Oliver D.E., and Shortliffe E.H. The unified medical language system: toward a collaborative approach for solving terminologic problems. J Am Med Inform Assoc 5 1 (1998) 12-16
38. Cimino J.J. From data to knowledge through concept-oriented terminologies: experience with the medical entities dictionary. J Am Med Inform Assoc 7 3 (2000) 288-297
39. Friedman C., et al. The Canon group's effort: working toward a merged model. J Am Med Inform Assoc 2 1 (1995) 4-18
40. Yeh I., et al. Knowledge acquisition, consistency checking and concurrency control for gene ontology (GO). Bioinformatics 19 2 (2003) 241-248
41. PubMed. 2005 [cited; Available from: www.pubmed.org.
42. ACM Portal. 2005 [cited; Available from: http://portal.acm.org/portal.cfm.
43. PsycArticles. 2005 [cited; Available from: http://www.apa.org/psycarticles/.
44. ERIC. 2005 [cited; Available from: http://www.eric.ed.gov/.
45. Newell A., and Simon H.A. Computer science as empirical inquiry: symbols and search. In: Haugeland J. (Ed). Mind design (1981), MIT Press/Bradfor Books, Cambridge 35-66
46. Newell A, Simon HA. Computer science as empirical inquiry: symbols and search. In: ACM annual conference. 1975. Minneapolis.
47. Kelly GA. The psychology of personal constructs. 1st ed. 1955, New York: Norton. 2 v. p. 1218.
48. Hawkins D. An analysis of expert thinking. Int J Man-Mach Stud 18 1 (1983) 1-47
49. Zhang J. Representations of health concepts: a cognitive perspective. J Biomed Inform 35 1 (2002) 17-24
50. Horsky J., et al. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform 36 1-2 (2003) 4-22
51. Horsky J., Kaufman D.R., and Patel V.L. The cognitive complexity of a provider order entry interface. AMIA Annu Symp Proc (2003) 294-298
52. Horsky J., Kaufman D.R., and Patel V.L. Computer-based drug ordering: evaluation of interaction with a decision-support system. Medinfo 11 Pt 2 (2004) 1063-1067
53. Horsky J., Kuperman G.J., and Patel V.L. Comprehensive analysis of a medication dosing error related to CPOE. J Am Med Inform Assoc 12 4 (2005) 377-382
54. Horsky J., Zhang J., and Patel V.L. To err is not entirely human: complex technology and user cognition. J Biomed Inform 38 4 (2005) 264-266
55. Patel V.L., et al. Methods of cognitive analysis to support the design and evaluation of biomedical systems: the case of clinical practice guidelines. J Biomed Inform 34 1 (2001) 52-66
56. Patel V.L., Arocha J.F., and Kaufman D.R. A primer on aspects of cognition for medical informatics. J Am Med Inform Assoc 8 4 (2001) 324-343
57. Chandler D. Semiotics: The basics. 1st ed. (2003), Routledge, New York
58. Harris Z. On a theory of language. J Philosophy 73 10 (1976) 253-276
59. Friedman C., Kra P., and Rzhetsky A. Two biomedical sub-languages: a description based on the theories of Zellig Harris. J Biomed Inform 35 4 (2002) 222-235
60. Grishman R., and Kittredge R. Analyzing language in restricted domains: sublangauge description and processing (1986), Lawrence Erlbaum, Hillsdale, Nj
61. Starren J. From multimodal sublanguages to medical data presentations. Deptartment of medical informatics (1997), Columbia University, New York
62. Boy G.A. The group elicitation method for participatory design and usability testing. Interactions 4 2 (1997) 27-33
63. Morgan MS, Benjamin Martz, Wm. Jr. Group consensus: do we know it when we see it? In: Proceedings of the 37th annual Hawaii International conference on system sciences (HICSS'04) Track 1 - Volume 1. 2004, IEEE Computer Society.
64. Agostini A. et al. Stimulating knowledge discovery and sharing. In: GROUP '03: Proceedings of the 2003 international ACM SIGGROUP conference on supporting group work. 2003. Sanibel Island, Florida, USA: ACM Press.
65. Wood WC, Roth RM. A workshop approach to acquiring knowledge from single and multiple experts. In: SIGBDP '90: Proceedings of the 1990 ACM SIGBDP conference on Trends and directions in expert systems. 1990. Orlando, Florida, United States: ACM Press.
66. Adria HL, William AS, Stephen DK. GMS: preserving multiple expert voices in scientific knowledge management. In: Proceedings of the 2003 conference on designing for user experiences. 2003, San Francisco, California: ACM Press. p. 1-4.
67. John H., et al. The role of ethnography in interactive systems design. Interactions 2 2 (1995) 56-65
68. Wickstrom G., and Bendix T. The "Hawthorne effect-what did the original Hawthorne studies actually show?. Scand J Work Environ Health 26 4 (2000) 363-367
69. Rahat I, Richard G, Anne J. A general approach to ethnographic analysis for systems design. In: Proceedings of the 23rd annual international conference on design of communication: documenting & designing for pervasive information. 2005, Coventry, United Kingdom: ACM Press. p. 34-40.
70. Rugg G., and McGeorge P. The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts. Expert Syst 14 2 (1997) 80-93
71. Stockburger DW. Introductory statistics: concepts, models, and applications. [Web site] 1998 2/19/1998 [cited 2003; 1:[Available from: http://www.psychstat.smsu.edu/sbk00.htm.
72. Everitt B., Landau S., and Leese M. Cluster analysis. 4th ed. viii (2001), Oxford University Press, New York 237
73. Cimiano P., et al. Conceptual knowledge processing with formal concept analysis and ontologies. Lect Notes Comput Sci (2004) 189
74. Cole R., and Becker P. Agreement contexts in formal concept analysis. Lect Notes Comput Sci (2004) 172
75. Priss U. Formal concept analysis in information science. In: Blaise C. (Ed). Annual review of information science and technology (2006), Information Today, Inc., Medford, NJ
76. Sowa JF. A conceptual schema for Knowledge-based systems. In: Proceedings of the 1980 workshop on Data abstraction, databases and conceptual modeling. 1980, Pingree Park, Colorado, United States: ACM Press. p.193-5.
77. Salomons O.W., van Houten F.J.A.M., and Kals H.J.J. Conceptual graphs in constraint based re-design. Proceedings of the third ACM symposium on solid modeling and applications (1995), ACM Press, Salt Lake City, Utah, United States
78. Yang G., and Oh J. Knowledge acquisition and retrieval based on conceptual graphs. Proceedings of the 1993 ACM/SIGAPP symposium on applied computing: states of the art and practice (1993), ACM Press, Indianapolis, Indiana, United States
79. Campbell J.R., et al. Phase II evaluation of clinical coding schemes: completeness, taxonomy, mapping, definitions, and clarity. CPRI work group on codes and structures. J Am Med Inform Assoc 4 3 (1997) 238-251
80. TOCKIT, Tupleware. 2006, Technische Universitaet Darmstadt and University of Queensland.
81. Polson P.G. A quantitative theory of human-computer interaction. Interfacing thought: cognitive aspects of human-computer interaction (1987), MIT Press 184-235
82. Polson P.G., et al. Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. Int J Man-Mach Stud 36 5 (1992) 741-773
83. Alvarez R. Discourse analysis of requirements and knowledge elicitation interviews. In: Proceedings of the 35th annual Hawaii International conference on system sciences (HICSS'02) vol. 8. IEEE Computer Society; 2002. p. 255.
84. Davidson J.E. Topics in discourse analysis (1977), University of British Columbia
85. Friedman C., et al. A general natural-language text processor for clinical radiology. J Am Med Inform Assoc 1 2 (1994) 161-174
86. Friedman C., and Hripcsak G. Evaluating natural language processors in the clinical domain. Methods Inf Med 37 4-5 (1998) 334-344
87. Friedman C., and Hripcsak G. Natural language processing and its future in medicine. Acad Med 74 8 (1999) 890-895
88. Friedman C., Hripcsak G., and Shablinsky I. An evaluation of natural language processing methodologies. Proc AMIA Symp (1998) 855-859
89. Hripcsak G., et al. Unlocking clinical data from narrative reports: a study of natural language processing. Ann Intern Med 122 9 (1995) 681-688
90. Corbridge C., et al. Laddering: technique and tool use in knowledge acquisition. Knowl Acquisition 6 (1994) 315-341
91. Roth RM, Wood WC. A Delphi approach to acquiring knowledge from single and multiple experts. In: SIGBDP '90: Proceedings of the 1990 ACM SIGBDP conference on trends and directions in expert systems. Orlando, Florida, United States: ACM Press; 1990.
92. Hripcsak G., and Heitjan D.F. Measuring agreement in medical informatics reliability studies. J Biomed Inform 35 2 (2002) 99-110
93. Hripcsak G., and Wilcox A. Reference standards, judges, and comparison subjects: roles for experts in evaluating system performance. J Am Med Inform Assoc 9 1 (2002) 1-15
94. Gruber T.R. Toward principles for the design of ontologies used for knowledge sharing. In: Guarino N., and Poli R. (Eds). Formal ontology in conceptual analysis and knowledge representation (1993), Kluwer Academic Publishers
95. Demming W.E. Out of the crisis (1966), MIT-CAES., Cambridge, MA
96. Walton M. The Demming management method (1986), The Putnam Publishing Group, New York
97. Robinson RE. Tackling the ISO 9000 documentation monster. In: Annual conference - Society for Technical Communication. 1995, Society for Technical Communication: Washington, D.C.
98. Pivka M., and Mulej M. Requisitely Holistic ISO 9000 Audt leads to continuous innovation/improvement. Cybernet Syst 35 4 (2004) 363-378
99. Delano K. Identifying factors that contribute to program success. Acquisition review quarterly. Winter; 1998. p. 35-50.
100. Gottfredson D.M. Prediction and classification in criminal justice decision making. Crime and Justice 9 1 (1987) 1-20
101. Cimino J.J. Desiderata for controlled medical vocabularies in the twenty-first century. Methods Inf Med 37 4-5 (1998) 394-403
102. Humphreys B.L., McCray A.T., and Cheh M.L. Evaluating the coverage of controlled health data terminologies: report on the results of the NLM/AHCPR large scale vocabulary test. J Am Med Inform Assoc 4 6 (1997) 484-500
103. Hripcsak G., and Rothschild A.S. Agreement, the f-measure, and reliability in information retrieval. J Am Med Inform Assoc 12 3 (2005) 296-298
104. Kudikyala UK, Allen EB, Vaughn RB. Measuring consensus during verification and validation of requirements. In: Proceedings of the tenth IEEE international software metrics symposium (METRICS 2004). Chicago, Illinois; 2004.
105. Burgun A, Bodenreider O. Aspects of the taxonomic relation in the biomedical domain. In: Proceedings of the international conference on formal ontology in information systems. Ogunquit, Maine, USA: ACM Press; 2001. p. 222-33.
106. Griffith R.L. Three principles of representation for semantic networks. ACM Trans Database Syst 7 3 (1982) 417-442
107. Zhou Y., Lu J., and Xu H.B. A comparative study of graph theory-based class cohesion measures. SIGSOFT Softw Eng Notes 29 2 (2004) 13
108. Noy N.F., et al. Protege-2000: an open-source ontology-development and knowledge-acquisition environment. AMIA Annu Symp Proc (2003) 953