Varieties of knowledge elicitation techniques

International Journal of Human - Computer Studies

Volumn 41, Issue 6, 1994, Pages 801-849

  Cooke, Nancy J ^a  

^a NEW MEXICO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; ARTIFICIAL INTELLIGENCE; BIBLIOGRAPHIC RETRIEVAL SYSTEMS; COGNITIVE SYSTEMS; EXPERT SYSTEMS; KNOWLEDGE ENGINEERING; USER INTERFACES;

KNOWLEDGE ELICITATION; METHODOLOGICAL SIMILARITY;

KNOWLEDGE ACQUISITION;

EID: 0028736412     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1006/ijhc.1994.1083     Document Type: Article

References (231)

1. Agarwal, R. & Tanniru, M. R. (1991). Knowledge extraction using content analysis. Knowledge Acquisition, 3, 421-441.
2. Altmann, J. (1974). Observational study of behavior: sampling methods. Behavior, 49, 227-265.
3. Anderson, J. R. (1982). Acquisition of cognitive skill. Psychological Review, 89, 369-406.
4. Anderson, J. R. (1983). The Architecture of Cognition. Cambridge, MA: Harvard University Press.
5. Arabie, P. & Carroll, J. D. (1980). MAPCLUS: a mathematical programming approach to fitting the ADCLUS model. Psychometrika, 45, 211-235.
6. Bainbridge, L. (1979). Verbal reports as evidence of the process operator's knowledge. International Journal of Man-Machine Studies, 11, 411-436.
7. Bainbridge, L. (1985). Inferring from verbal reports to cognitive processes. In M. Brenner, J. Brown & D. Canter, Eds. The Research Interview. Uses and Approaches, pp. 200-215. London: Academic Press.
8. Bainbridge, L. (1990). Verbal protocol analysis. In J. R. Wilson & E. N. Corlett, Eds. Evaluation of Human Work: A Practical Ergonomics Methodology, pp. 161-179. London: Taylor & Francis.
9. Barnard, P. J., Ellis, J. & MacLean, A. (1986a). Relating ideal and non-ideal verbalised knowledge to performance. In A. Sutcliffe & L. Macaulay, Eds. People and Computers V, pp. 463-473. Cambridge: Cambridge University Press.
10. y86 Human Factors in Computing Systems, pp. 285-240. New York: ACM.
11. Barsalou, L. W. (1987). The instability of graded structure: implications for the nature of concepts. In U. Neisser, Ed. Concepts and Conceptual Development: Ecological and Intellectual Factors in Categorization, pp. 101-140. New York: Cambridge University Press.
12. Bartlett, F. C. (1932). Remembering: A Study in Experimental and Social Psychology. Oxford: Cambridge University Press.
13. Belkin, N. J., Brooks, H. M. & Daniels, P. J. (1987). Knowledge elicitation using discourse analysis. International Journal of Man-Machine Studies, 27, 127-144.
14. Bell, J. & Hardiman, R. J. (1989). The third role—the naturalistic knowledge engineer. In D. Diaper, Ed. Knowledge Elicitation: Principles, Techniques, and Applications, pp. 49-85. New York: John Wiley.
15. Berry, D. C. (1987). The problem of implicit knowledge. Expert Systems, 4, 144-151.
16. Berry, D. C. & Broadbent, D. E. (1984). On the relationship between task performance and associated verbalized knowledge. Quarterly Journal of Experimental Psychology, 36A, 209-212.
17. Bhaskar, R. & Simon, H. A. (1977). Problem solving in semantical rich domains: an example from engineering thermodynamics. Cognitive Science, 1, 193-215.
18. Bolger, F. & Wright, G. (1992). Reliability and validity in expert judgment. In G. Wright & F. Bolger, Eds. Expertise and Decision Support, pp. 47-76. New York: Plenum Press.
19. Boose, J. H. (1986). Expertise Transfer for Expert System Design. Amsterdam: Elsevier.
20. Boose, J. H. (1988). A grid tool for eliciting expert knowledge. In J. C. Mancuso & M. L. G. Shaw, Eds. Cognition and Personal Structure: Computer Access and Analysis, pp. 107-136. New York: Praeger.
21. Boose, J. H. (1989). A survey of knowledge acquisition techniques and tools. Knowledge Acquisition, 1, 3-37.
22. Boose, J. H. (1990). Uses of repertory grid-centered knowledge acquisition tools for knowledge-based systems. In J. H. Boose & B. R. Gaines, Eds. The Foundations of Knowledge Acquisition, pp. 61-84. San Diego, CA: Academic Press.
23. Boose, J. H. & Bradshaw, J. M. (1987). Expertise transfer and complex problems: using Aquinas as a knowledge-acquisition workbench for knowledge-based systems. International Journal of Man-Machine Studies, 26, 3-28.
24. Bovair, S., Kieras, D. E. & Polson, P. G. (1990). The acquisition and performance of text-editing skill: a cognitive complexity analysis. Human-Computer interaction, 5, 1-48.
25. Bradley, J. & Harbison-Briggs, K. (1989). The symptom-component approach to knowledge acquisition. SIGART Newsletter, 108, 70-76.
26. Bradshaw, J. M. & Boose, J. H. (1990). Decision analysis techniques for knowledge acquisition; combining information and pREFERENCES using Aquinas and Axotl. International Journal of Man-Machine Studies, 32, 121-186.
27. Bradshaw, J. M., Ford, K. M., Adams-Webber, J. R. & Boose, J. H. (1993). Beyond the repertory grid: new approaches to constructivist knowledge acquisition tool development. International Journal of Intelligent Systems, 8, 287-333.
28. Brenner, M., Brown, J. & Canter, D., Eds. (1985). The Research Interview: Uses and Approaches. London: Academic Press.
29. Breuker, J. & Wielinga, B. (1987). Use of models in the interpretation of verbal data. In A. Kidd, Ed. Knowledge Acquisition for Expert Systems, pp. 17-43. New York: Plenum Press.
30. Brisaboa, N. R., Cooke, N. & Blanco-Ferro, A. (1994). Enhancing the repertory grid technique using multidimensional scaling. Memoranda in Computer and Cognitive Science, MCCS-94-274, Computing Research Laboratory, New Mexico State University, Las Cruces, NM.
31. Butler, K. A. & Corter, J. (1986). Use of psychometric tools for knowledge acquisition: A case study. In W. A. Gale, Ed. Artificial Intelligence and Statistics. Reading, MA: Addison-Wesley.
32. Canter, D., Brown, J. & Groat, L. (1985). A multiple sorting procedure for studying conceptual systems. In M. Brenner, J. Brown, & D. Cantor, Eds. The Research Interview: Uses and Approaches, pp. 79-114, London: Academic Press.
33. Card, S. K., Moran, T. P. & Newell, A. (1983). The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum.
34. Carmody, D. P., Kundel, H. L. & Toto, L. C. (1984). Comparison scans while reading chest images: taught, but not practiced. Investigative Radiology, 19, 462-466.
35. Carroll, J. D. & Arabie, P. (1980). Multidimensional Scaling. Annual Review of Psychology, 31, 607-649.
36. Champagne, A. B., Gunstone, R. F. & Klopfer, L. E. (1985). Effecting changes in cognitive structures among physics students. In L. H. T. West & A. L. Pines, Eds. Cognitive Structure and Conceptual Change, pp. 163-187. Orlando, FL: Academic Press.
37. Chignell, M. H. & Peterson, J. G. (1988). Strategic issues in knowledge engineering. Human Factors, 30, 381-394.
38. Clarke, B. (1987). Knowledge acquisition for real-time knowledge-based systems. Proceedings of the First European Workshop on Knowledge Acquisition for Knowledge Based Systems, Reading University, UK, 2-3 September.
39. Cleaves, D. A. (1987). Cognitive biases and corrective techniques: proposals for improving elicitation procedures for knowledge-based systems. International Journal of Man-Machine Studies, 27, 155-156.
40. Compton, P. & Jansen, R. (1990). A philosophical basis for knowledge acquisition. Knowledge Acquisition, 2, 241-257.
41. Cooke, N. M. (1983). Memory structures of expert and novice computer programmers: recall order vs. similarity ratings. Unpublished M.A. Thesis, New Mexico State University, Las Cruces, NM, USA.
42. Cooke, N. M. (1987). The elicitation of units of knowledge and relations: enhancing empirically-derived semantic networks. Unpublished Ph.D. dissertation, New Mexico State University, Las Cruces, NM, USA.
43. Cooke, N. J. (1989). The elicitation of domain-related ideas; stage one of the knowledge acquisition process. In C. Ellis, Ed. Expert Knowledge and Explanation, pp. 58-75. Chichester, UK: Ellis Horwood.
44. Cooke, N. J. (1992a). Predicting judgment time from measures of psychological proximity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 640-653.
45. Cooke, N. J. (1992b). Eliciting semantic relations for empirically derived networks. International Journal of Man-Machine Studies, 37, 721-750.
46. Cooke, N. M., Durso, F. T. & Schvaneveldt, R. W. (1986). Recall and measures of memory organization. Journal of Experimental Psychology: Learning, Memory and Cognition, 12, 538-549.
47. Cooke, N. M. & McDonald, J. E. (1986). A formal methodology for acquiring and representing expert knowledge. IEEE Special Issue on Knowledge Representation, 74, 1422-1430.
48. Cooke, N. M. & McDonald, J. E. (1987). The application of psychological scaling techniques to knowledge elicitation for knowledge-based systems. International Journal of Man-Machine Studies, 26, 533-550.
49. Cooke, N. J., Neville, K. J., & Rowe, A. L. (in press). Procedural network representations of sequential data. Human-Computer Interaction.
50. Cooke, N. M. & Schvaneveldt, R. W. (1988). Effects of computer programming experience on network representations of abstract programming concepts. International Journal of Man-Machine Studies, 29, 407-427.
51. Cordingley, E. S. (1989). Knowledge elicitation techniques for knowledge-based systems. In D. Diaper, Ed. Knowledge Elicitation: Principles, Techniques, and Applications, pp. 89-175. New York: John Wiley & Sons.
52. Corter, J. E. & Tversky, A. (1986). Extended similarity trees. Psychometrika, 51, 429-451.
53. Cullen, J. E. & Bryman, A. (1988). The knowledge acquisition bottleneck: a time for reassessment? Expert Systems, 5, 216-225.
54. Dawes, R. M. (1979). The robust beauty of improper linear models. American Psychologist, 34, 571-582.
55. Dearholt, D. W. & Schvaneveldt, R. W. (1990). Properties of Pathfinder networks. In R. Schvanedelt, Ed. Pathfinder Associative Networks: Studies in Knowledge Organization, pp. 267-277. Norwood, NJ: Ablex.
56. DeSanctis, G. & Gallupe, R. B. (1985). Group decision support systems: a new frontier. DataBase, (Winter) 3-10.
57. Diaper, D. (1990). An organizational context for expert system design. In D. Berry & A. Hart, Eds. Expert Systems: Human Issues, pp. 214-236. Cambridge, MA: MIT Press.
58. Diederich, J., Ruhmann, I. & May, M. (1987). KRITON: a knowledge acquisition tool for expert systems. International Journal of Man-Machine Studies, 26, 29-40.
59. Drury, C. G. (1990). Methods for direct observation of performance: In J. R. Wilson & E. N. Corlett, Eds. Evaluation of Human Work: A Practical Ergonomics Methodology, pp. 35-57. London: Taylor & Francis.
60. Dunn-Rankin, P. (1983). Scaling Methods. San Diego, CA: Academic Press.
61. Eden, C., Jones, S. & Sims, D. (1983). Messing About in Problems. Oxford: Pergamon Press.
62. Elstein, A. S., Shulman, L. S. & Sprafka, S. A. (1978). Medical Problem Solving: An Analysis of Clinical Reasoning. Cambridge, MA: Harvard University Press.
63. Ericsson, K. A. & Simon, H. A. (1984). Protocol Analysis: Verbal Reports as Data. Cambridge, MA: MIT Press.
64. Everitt, B. (1980). Cluster Analysis. New York: Halsted Press.
65. Feigenbaum, E. A. & McCorduck, P. (1984). The Fifth Generation: Artificial Intelligence and Japan's Computer Challenge to the World. New York: New American Library.
66. Feigenbaum, E. A. (1989). What hath Simon wrought? In D. Klahr & K. Kotovsky, Eds. Complex Information Processing: The Impact of Herbert A Simon, pp. 165-182. Hillsdale, NJ: Lawrence Erlbaum.
67. Fischhoff, B. (1989) Eliciting knowledge for analytical representation. IEEE Transactions on Systems, Man, & Cybernetics, 19, 448-461.
68. Fishe, C. (1987). Advancing the study of programming with computer-aided protocol analysis. In G. Olson, E. Soloway & S. Shepherd, Eds. Empirical Studies of Programmers, pp. 198-216. Norwood, NJ: Ablex.
69. Fisher, D. & Langley, P. (1986). Conceptual clustering and its relation to numerical taxonomy. In W. G. Gale, Ed. Artificial Intelligence and Statistics. Reading, MA, Addison-Wesley.
70. Fisher, K. M., Faletti, J., Patterson, H., Thornton, R., Lipson, J. & Spring, C. (1990). Knowledge networks: theoretical considerations. Journal of College Science Teaching, 19, 347-352.
71. Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51, 327-358.
72. Ford, K. M. & Adams-Webber, J. R. (1992). Knowledge acquisition and constructivist epistemology. In R. R. Hoffman, Ed. The Psychology of Expertise: Cognitive Research and Empirical Al, pp. 121-136. New York: Springer-Verlag.
73. Ford, J. M. & Wood, L. E. (1992). Structuring and documenting interactions with subject-matter experts. Performance Improvement Quarterly, 5, 2-24.
74. Forsyth, D. E. & Buchanan, B. G. (1989). Knowledge acquisition for expert systems: some pitfalls and suggestions. IEEE Transactions on Systems, Man, & Cybernetics, 19, 435-442.
75. Fox, J., Myers, C. D., Greaves, M. F. & Pegram, S. (1985). Knowledge acquisition for expert systems: experience in leukaemia diagnosis. Methods of Information in Medicine, 24, 65-72.
76. Fransella, F. & Bannister, D. (1977). A Manual for Repertory Grid Technique. London: Academic Press.
77. Friendly, M. L. (1977). In search of the m-gram: the structure of organisation in free recall. Cognitive Psychology, 9, 188-249.
78. Gaines, B. R. (1987). Rapid prototyping for expert systems. In M. Oliff, Ed. Intelligent Manufacturing: Proceedings from the First International Conference on Expert Systems and the Leading Edge in Production, Planning, and Control, pp. 45-73. Menlo Park, CA: Benjamin Cummins.
79. Gaines, B. R. & Shaw, M. L. G. (1987). Knowledge support systems. ACM MCC— University Research Symposium, pp. 47-66. Austin, TX: MCC.
80. Gaines, B. R. & Shaw, M. L. G. (1992). Knowledge acquisition tools based on personal construct psychology. Knowledge Engineering Review: Special Issue on Automated Knowledge Acquisition Tools.
81. Gammack, J. G. (1987a). Modelling expert knowledge using cognitively compatible structures. Proceedings of the Third International Expert Systems Conference, pp. 191-200. London: Oxford University Press. 2-4 June.
82. Gammack, J. G. (1987b). Different techniques and different aspects on declarative knowledge. In A. L. Kidd, Ed. Knowledge Acquisition for Expert Systems: A Practical Handbook, pp. 137-163. New York: Plenum Press.
83. Gammack, J. G. (1990). Expert conceptual structure: the stability of Pathfinder representations. In R. Schvaneveldt, Ed. Pathfinder Associate Networks: Studies in Knowledge Organization, pp. 213-226. Norwood, NJ: Ablex.
84. Gammack, J. G. & Young, R. M. (1985). Psychological techniques for eliciting expert knowledge. In M. A. Bramer, Ed. Research and Development in Expert Systems, pp. 105-116. Cambridge: Cambridge University Press.
85. Gammack, J. (1992). Knowledge engineering issues for decision support. In G. Wright & F. Bolger, Eds. Expertise and Decision Support, pp. 203-226. New York: Plenum Press.
86. Garg-Janardan, C. & Salvendy, G. (1990). A structured knowledge elicitation methodology for building expert systems. In J. H. Boose & B. R. Gaines, Eds. The Foundations of Knowledge Acquisition, pp. 85-114. San Diego, CA: Academic Press.
87. Gati, I. & Tversky, A. (1982). Representation of qualitative and quantitative dimensions. Journal of Experimental Psychology: Human Perception and Performance, 8, 325-340.
88. Geiwitz, J., Klatsky, R. L. & McCloskey, B. P. (1988). Knowledge Acquisition for Expert Systems: Conceptual and Empirical Comparisons. Santa Barbara, CA: Anacapa Sciences.
89. Geiwitz, J., Kornell, J. & McCloskey, B. (1990). An Expert System for the Selection of Knowledge Acquisition Techniques. Technical Report 785-2. Santa Barbara, CA: Anacapa Sciences.
90. Glaser, R. & Chi, M. T. H. (1988). Overview. In M. T. H. Chi, R. Glaser & M. J. Far, Eds. The Nature of Expertise, pp. xv-xxviii. Hillsdale, NI: Lawrence Erlbaum.
91. Goldsmith, T. E. & Davenport, D. M. (1990). Assessing structural similarity of graphs. In R. Schvaneveldt, Ed. Pathfinder Associative Networks: Studies in Knowledge Organization, pp. 75-87. Norwood, NJ: Ablex.
92. Gordon, S. E. & Gill, R. T. (1989a). Question probes: a structured method for eliciting declarative knowledge. Al Applications in Resource Management, 3, 13-20.
93. Gordon, S. E. & Gill, R. T. (1989b). The formation and use of knowledge structures in problem solving domains. AFOSR technical report no. AFOSR-88-0063.
94. Gordon, S. E., Kinghorn, R. A. & Schmierer, K. A. (1991). Representing expert knowledge for instructional system design: a case study. Proceedings of the Human Factors Society 35th Annual Meeting, pp. 1412-1416, San Francisco, CA, 2-6 September.
95. Grabowski, M., Massey, A. P. & Wallace, W. A. (1992). Focus groups as a group knowledge acquisition technique. Knowledge Acquisition, 4, 407-425.
96. Graesser, A. C. & Clark, L. F. (1985). Structures and Procedures of Implicit Knowledge. Norwood, NJ: Ablex.
97. Graesser, A. C. & Murray, K. (1990). A question-answering methodology for exploring a user's acquisition and knowledge of a computer environment. In S. P. Robertson, W. Zachary, & J. B. Black, Eds. Cognition, Computing, and Cooperation, pp. 237-267. Norwood, NJ: Ablex.
98. Grover, M. D. (1983). A pragmatic knowledge acquisition methodology. Proceedings of the 8th International Joint Conference on Artificial Intelligence, pp. 436-438, Karlsruhe, West Germany, August.
99. Gruber, T. R. (1989). The Acquisition of Strategic Knowledge. San Diego, CA: Academic Press.
100. Hall, E. M., Gott, S. P. & Pokorny, R. A. (1994). A Procedural Guide to Cognitive Task Analysis: The PARI Methodology. Unpublished manuscript. Brooks AFB, TX.
101. Hammond, K. R. (1955). Probabilistic functioning and the clinical method. Psychological Review, 62, 255-262.
102. Hart, A. (1986). Knowledge Acquisition for Expert Systems. London: Kogan Page.
103. Hassebrock, F. & Prietula, M. J. (1992). A protocol-based coding scheme for the analysis of medical reasoning. International Journal of Man-Machine Studies, 37, 613-652.
104. Hayes, N. A. & Broadbent, D. E. (1988). Two modes of learning for interactive tasks. Cognition, 28, 1-18.
105. Hayes-Roth, F. & Jacobstein, N. (1994). The state of knowledge-based systems. Communications of the ACM, 37, 27-59.
106. Hink, R. F. & Woods, D. L. (1987). How humans process uncertain knowledge: an Introduction for knowledge engineers. Al Magazine, Fall, 41-53.
107. Hoffmann, R. R. (1984). Procedures for efficiently extracting the knowledge of experts. Final Report, Contract No. F49620-85-C-00013, Air Force Office of Scientific Research, Boiling AFB, Washington, DC.
108. Hoffman, R. R. (1987). The problem of extracting the knowledge of experts from the perspective of experimental psychology. Al Magazine, 8, 53-67.
109. Hoffmann, R. R. (1989). A survey of methods for eliciting the knowledge of experts. SIGART Newsletter, 108.
110. Hoffmann, R. R. (1992). Doing psychology in an Al context: a personal perspective and introduction to this volume. In R. R. Hoffman, Ed. The Psychology of Expertise-. Cognitive Research and Empirical Al, pp. 3-11. New York: Springer-Verlag.
111. Hubert, L. J. (1979). Generalized concordance. Psychometrika, 44, 135-142.
112. Hutchinson, J. W. (1989). NETSCAL: a network scaling algorithm for nonsymmetric proximity data. Psychometrika, 54, 25-52.
113. Hwang, G. J. & Tseng, S. S. (1990). EMCUD: a knowledge acquisition method which captures embedded meanings under uncertainty. International Journal of Man-Machine Studies, 33, 431-451.
114. Johnson, L. & Johnson, N. (1987). Knowledge elicitation involving teachback interviewing. In A. Kidd, Ed. Knowledge Elicitation for Expert Systems: A Practical Handbook, pp. 91-108. New York: Plenum Press.
115. Johnson, S. C. (1967). Hierarchical clustering schemes. Psychometrika, 32, 241-254.
116. Johnson, P. E., Zualkerman, I. & Garber, S. (1987). Specification of expertise. International Journal of Man-Machine Studies, 26, 161-181.
117. Johnson-Laird, P. N. & Wason, P. C. (1977). Thinking: Readings in Cognitive Science. Cambridge: Cambridge University Press.
118. Kahn, G., Nowlan, S. & McDermott, J. (1985). Strategies for knowledge acquisition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 7, 511-522.
119. Kahneman, D., Slovic, P. & Tversky, A. (1982). Judgment Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press.
120. Kelly, G. A. (1955). The Psychology of Personal Constructs. New York: Norton.
121. Keren, G. (1992). Improving decisions and judgments: the desirable versus the feasible. In G. Wright & F. Bolger, Eds. Expertise and Decision Support, pp. 25-46. New York: Plenum Press.
122. Kidd, A. L. & Cooper, M. B. (1985). Man-machine interface issues in the construction and use of an expert system. International Journal of Man-Machine Studies, 22, 91102.
123. Kitto, C. M. & Boose, J. H. (1987). Choosing knowledge acquisition strategies for knowledge acquisition tasks. Proceedings of WESTEX-87-Western Conference on Expert Systems, pp. 96-103.
124. Kitto, C. M. & Boose, J. H. (1989). Selecting knowledge acquisition tools and strategies based on application characteristics. International Journal of Man-Machine Studies, 31, 149-160.
125. Klauer, K. C. & Carroll, J. D. (1989). A mathematical programming approach to fitting general graphs. Journal of Classification, 6, 247-270.
126. Klauer, K. C. & Carroll, J. D. (1991). A comparison of two approaches to fitting directed graphs to nonsymmetric proximity measures. Journal of Classification, 8, 251-268.
127. Klein, G. A., Calderwood, R. & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, & Cybernetics, 19, 462-472.
128. Kowalski, B. & VanLehn, K. (1988). Cirrus: inducing subject models from protocol data. Proceedings of the 10th Annual Conference of the Cognitive Science Society, pp. 623-629, Quebec, Canada, 17-19 August.
129. Krippendorff, K. (1980). Content Analysis: An Introduction to its Methodology. Beverly Hills, CA: Sage.
130. Krumhansl, C. L. (1978). Concerning the applicability of geometric models to similarity data: the interrelationship between similarity and spatial density. Psychological Review, 85, 115-129.
131. Kruskal, J. B. (1977). Multidimensional scaling and other methods for discovering structure. In K. Enslein, A. Ralston, & H. S. Wilf, Eds. Statistical Methods for Digital Computers. New York: Wiley.
132. Kruskal, J. B. & Wish, M. (1978). Multidimensional Scaling. Sage University. Paper Series on Quantitative Applications in the Social Sciences, #07-011. London: Sage Publications.
133. Kuipers, B. & Kassirer, J. P. (1983). How to discover a knowledge representation for casual reasoning by studying an expert physician. IJCAI-83, Proceedings of the 8th International Conference on Artificial Intelligence, pp. 49-56.
134. Kuipers, B. & Kassirer, J. P. (1987). Knowledge acquisition by analysis of verbatim protocols. In A. Kidd, Ed. Knowledge Acquisition for Expert Systems: A Practical Handbook, pp. 45-71. New York: Plenum Press.
135. LaFrance, M. (1987). The knowledge acquisition grid: a method for training knowledge engineers. International Journal of Man-Machine Studies, 26, 245-255.
136. Leddo, J. & Cohen, M. S. (1988). Objective Structure Analysis: A Method of Eliciting Expert Knowledge. Alexandria, VA: Army Research Institute.
137. Leddo, J. M., Mulin, T. M., Cohen, M. S., Bresnick, T. A., Marvin, F. F. & O'Connor, M. F. (1988). Knowledge Elicitation: Phase I Final Report. Volume 1, Technical Report 87-15. Alexandria, VA: Army Research Institute.
138. Leplat, J. & Hoc, J. (1981). Subsequent verbalization in the study of cognitive processes. Ergonomics, 24, 743-755.
139. Lewis, S. (1991). Cluster analysis as a technique to guide interface design. International Journal of Man-Machine Studies, 35, 251-265.
140. Likert, R. A. (1932). A technique for measurement of attitudes. Archives of Psychology, 140, 5-53.
141. Lovie, A. D. & Lovie, P. (1989). Linear scoring models: lessons for experts and cognitive scientists. In C. Ellis, Ed. Expert Knowledge and Explanation, pp. 58-75. Chichester: Ellis Horwood.
142. Lueke, E., Pagerey, P. D. & Brown, C. R. (1987). User requirements gathering through verbal protocol analysis. In G. Salvendy, Ed. Cognitive Engineering in the Design of Human-Computer Interaction and Expert Systems. Amsterdam: Elsevier.
143. MacCallum, R. C. (1978). Recovery of structure in incomplete data by ALSCAL. Psychometrika, 44, 69-74.
144. Mack, R. & Robinson, J. B. (1992). When novices elicit knowledge: question asking in designing, evaluating, and learning to use software. In R. R. Hoffman, Ed. The Psychology of Expertise: Cognitive Research and Empirical Al, pp. 245-268. New York: Springer-Verlag.
145. Madni, A. M. (1988). The role of human factors in expert systems design and acceptance. Human Factors, 30, 395-414.
146. Mancuso, J. C. & Shaw, M. L. G. (1988). Cognition and Personal Structure: Computer Access and Analysis. New York: Praeger.
147. Marcus, S., McDermott, J. & Wang, T. (1985). Knowledge acquisition for constructive systems. Proceedings of the Ninth International Joint Conference on Artificial Intelligence, Los Angeles, CA.
148. Martin, J., Slemon, A. G., Hiebert, B., Hallberg, E. T. & Cummings, A. L. (1989). Conceptualizations of novice and experienced counselors. Journal of Counseling Psychology, 36, 395-400.
149. McDonald, J. E. & Schvaneveldt, R. W. (1988). The application of user knowledge to interface design. In R. Guindon, Ed. Cognitive Science and its Applications for Human-Computer Interaction, pp. 289-338. Hillsdale, NJ: Lawrence Erlbaum.
150. McGraw, K. L. & Harbison-Briggs, K. (1989). Knowledge Acquisition: Principles and Guidelines. Englewood Cliffs, NJ: Prentice Hall.
151. Meister, D. (1989). Conceptual Aspects of Human Factors. Baltimore, MD: The Johns Hopkins University Press.
152. Meyer, M. A. (1992). How to apply the anthropological technique of participant observation to knowledge acquisition for expert systems. IEEE Transactions on Systems, Man, and Cybernetics, 22, 983-990.
153. Meyer, M. A. & Booker, J. M. (1990). Eliciting and analyzing expert judgment: a practical guide. Technical report no. NUREG/CR-5424; LA-11667-MS. Los Alamos National Laboratory, Los Alamos, NM.
154. Meyer, M. A. & Paton, R. C. (1992). Towards an analysis and classification of approaches to knowledge acquisition from examination of textual metaphor. Knowledge Acquisition, 4, 347-369.
155. Mjcciche, P. F. & Lancaster, J. S. (1989). Application of neurolinguistic programming to knowledge acquisition. SIGART Newsletter, 108, 28-33.
156. Michalski, R. S. & Stepp, R. E., III. (1983). Learning from observation: conceptual clustering. In R. S. Michalski, J. G. Carbonell & T. M. Mitchell, Eds. Machine Learning: An Artificial Intelligence Approach, pp. 331-363. Palo Alto, CA: Tioga.
157. Miller, G. A. (1969). A psychological method to investigate verbal concepts. Journal of Mathematical Psychology, 6, 169-191.
158. Miyamoto, S., Oi, K., Abe, O., Katsuya, A. & Nakayama, K. (1986). Directed graph representations of association structures: a systematic approach. IEEE Transactions on Systems, Man, and Cybernetics, 16, 53-61.
159. Morik, K. (1991). Underlying assumptions of knowledge acquisition and machine learning. Knowledge Acquisition, 3, 137-156.
160. Mostyn, B. (1985). The content analysis of qualitative research data: a draamic approach. In M. Brenner, J. Brown & D. Canter, Eds. The Research Interview: Uses and Approaches, pp. 115-145. London: Academic Press.
161. Nisbett, R. E. & Wilson, T. D. (1977). Telling more than we can know: verbal reports on mental processes. Psychological Review, 84, 231-259.
162. Olson, J. R. & Biolsi, K. J. (1991). Techniques for representing expert knowledge. In K. A. Ericsson & J. Smith, Eds. Toward a General Theory of Expertise, pp. 240-285. Cambridge: Cambridge University Press.
163. Olson, J. R. & Rueter, H. H. (1987). Extracting expertise from esperts: methods for knowledge acquisition. Expert Systems, 4, 152-168.
164. Pidgeon, N. F., Turner, B. A. & Blockley, D. I. (1991). The use of Grounded Theory for conceptual analysis in knowledge elicitation. International Journal of Man-Machine Studies, 35, 151-173.
165. Pollard, P. & Crozier, R. (1989). The validity of verbal reports: unconscious processes and biases in judgment. In C. Ellis, Ed. Expert Knowledge and Explanation: The Knowledge-language Interface, pp. 13-57. Chichester, UK: Ellis Horwood.
166. Polson, P. G. & Lewis, C. H. (1990). Theory-based design for easily learned interfaces. Human-Computer Interaction, 5, 191-220.
167. Praetorius, N. & Duncan, K. D. (1988). Verbal reports: a problem in research design. In L. P. Goldstein, H. B., Anderson & S. E. Olsen, Eds. Tasks, Errors, and Mental Models, pp. 293-314. London: Taylor & Francis.
168. Redding, R. E., Cannon, J. R., Lierman, B. C., Ryder, J. M., Purcell, J. A. & Seamster, T. L. (1991). The analysis of expert performance in the redesign of the en route air traffic control curriculum. Proceedings of the Human Factors Society 35th Annual Meeting, pp. 1403-1407, San Francisco, CA, 2-6 September.
169. Regoczei, S. B. & Hirst, G. (1992). Knowledge and knowledge acquisition in the computational context. In R. R. Hoffman, Ed. The Psychology of Expertise: Cognitive Research and Empirical Al, pp. 12-25. New York: Springer-Verlag.
170. Reitman, J. S. & Rueter, H. H. (1980). Organization revealed by recall orders and confirmed by pauses. Cognitive Psychology, 12, 554-581.
171. Roske-Hofstrand, R. J. & Paap, K. R. (1990). Discriminating between degrees of low or high similarity: implications for scaling techniques using semantic judgments. In R. W. Schvaneveldt, Ed. Pathfinder Associative Networks: Studies in Knowledge Organization, pp. 61-73. Norwood, NJ: Ablex.
172. Roth, E. M. & Woods, D. (1989). Cognitive task analysis: an approach to knowledge acquisition for intelligent system design. In G. Guida & C. Tasso, Eds. Topics in Expert System Design: Methodologies and Tools, pp. 233-264. Amsterdam: North Holland.
173. Rowe, A. L. (1994). Mental models of physical systems: Examining the relationship between knowing and doing. Unpublished Ph.D. dissertation, Rice University, Houston, TX.
174. Rusk, R. A. & Krone, R. M. (1984). The Crawford Slip Method (CSM) as a tool for extraction of expert knowledge. In G. Salvendy, Ed. Human-Comp uter Interaction, pp. 279-282. New York: Elsevier.
175. Russo, J. E., Johnson, E. J. & Stephens, D. L. (1989). The validity of verbal protocols. Memory and Cognition, 17 (6), 759-69.
176. Russo, J. E. & Rosen, L. D. (1975). An eye fixation analysis of multialternative choice. Memory and Cognition, 3, 267-276.
177. Sackett, G. P. (1977). Observing Behavior, Vol. 1. Baltimore, MD: University Park Press.
178. Sackett, G. P. (1978). Observing Behavior, Vol. 2. Baltimore: MD: University Park Press.
179. Sanders, M. S. & McCormick, E. J. (1987). Human Factors in Engineering and Design. New York: McGraw-Hill.
180. Sanderson, P. M., James, J. M. & Seidler, K. (1989a). SHAPA: an interactive software environment for protocol analysis. EPRL Technical Report no. EPRL-89-08. University of Illinois at Urbana-Champaign, Urbana, IL.
181. Sanderson, P. M., Verhage, A. G. & Fuld, R. B. (1989b). Cognitive engineering and continuous process control: empirical methods for a complex world. EPRL Technical Report no. EPRL-89-01, University of Illinois at Urbana-Champaign, Urbana, IL.
182. Sattath, S. & Tversky, A. (1977). Additive similarity trees. Psychometrika, 42, 319-345.
183. Schachter, R. D. & Heckerman, D. E. (1987). Thinking backward for knowledge acquisition. The Al Magazine, Fall, 55-61.
184. Scherer, K. R. & Ekman, P. (1982). Handbook of Methods in Nonverbal Behavior Research. Cambridge: Cambridge University Press.
185. Schvaneveldt, R. W. (1990). Pathfinder Associative Networks: Studies in Knowledge Organization. Norwood, NJ: Ablex.
186. Schvaneveldt, R. W., Durso, F. T. & Dearholt, D. W. (1985a). Pathfinder: scaling with network structures. Memorandum in Computer and Cognitive Science, MCCS-85-9, Computing Research Laboratory, New Mexico State University, NM.
187. Schvaneveldt, R. W., Durso, F. T. & Dearholt, D. W. (1989). Network structures in proximity data. In G. H. Bower, Ed. The Psychology of Learning and Motivation: Advances in Research and Theory, Vol. 24, pp. 249-284. New York: Academic Press.
188. Schvaneveldt, R. W., Durso, F. T., Goldsmith, T. E., Breen, T. J., Cooke, N. M., Tucker, R. G. & DeMajo, J. C. (1985b). Measuring the structure of expertise. International Journal of Man-Machine Studies, 23, 699-728.
189. Schweikert, R., Burton, A. M., Taylor, N. K., Cortlett, E. N., Shadbolt, N. R. & Hedgecock, A. P. (1987). Comparing knowledge elicitation techniques: a case study. Artificial Intelligence Review, 1, 245-253.
190. Scott, A. A., Clayton, J. E. & Gibson, E. L. (1991). A Practical Guide to Knowledge Acquisition. Reading, MA: Addison-Wesley.
191. Shadbolt, N. & Burton, M. (1990). Knowledge elicitation. In J. R. Wilson & E. N. Corlett, Eds. Evaluation of Human Work: A Practical Ergonomics Methodology, pp. 321-345. London: Taylor & Francis.
192. Shanteau, J. (1992). The psychology of experts: an alternative view. In G. Wright & F. Bolger, Eds. Expertise and Decision Support, pp. 11-23. New York: Plenum Press.
193. Shaw, M. L. G. (1980). On Becoming a Personal Scientist. London: Academic Press.
194. Shaw, M. L. G. (1982). PLANET: some experience in creating an integrated system for repertory grid applications on a microcomputer. International Journal of Man-Machine Studies, 17, 345-360.
195. Shaw, M. L. G. & Gaines, B. R. (1987). An interactive knowledge elicitation technique using personal construct technology. In A. Kidd, Ed. Knowledge Acquisition for Expert Systems: A Practical Handbook. New York: Plenum Press.
196. Shaw, M. L. G. & Gaines, B. R. (1988a). KITTEN: knowledge initiation and transfer tools for experts and novices. In J. H. Boose & B. R. Gaines, Eds. Knowledge Acquisition Tools for Expert Systems, Vol. 2, pp. 309-338. San Diego, CA: Academic Press.
197. Shaw, M. L. G. & Gaines, B. R. (1988b). PLANET: a computer-based system for personal learning, analysis, negotiation, and elicitation techniques. In J. C. Mancuso & M. L. G. Shaw, Eds. Cognition and Personal Structure: Computer Access and Analysis, pp. 27-65. New York: Praeger.
198. Shaw, M. L. G. & Gaines, B. R. (1989). Comparing conceptual structures: consensus, conflict, correspondence, and contrast. Knowledge Acquisition, 1, 341-363.
199. Shaw, M. L. G. & Mancuso, J. C. (1988). Modeling cognitive processes. In J. C. Mancuso & M. L. G. Shaw, Eds. Cognition and Personal Structure; Computer Access and Analysis, pp. 13-26. New York: Praeger.
200. Shaw, M. L. G. & Woodward, J. B. (1989). Mental models in the knowledge acquisition process. Proceedings of the 4th AAAI-sponsored Knowledge Acquisition for Knowledge-Based Systems Workshop, 29/1-29/24. Banff, Alberta, Canada, October.
201. Shaw, M. L. G. & Woodward, J. B. (1990). Modeling expert knowledge. Knowledge Acquisition, 2, 179-206.
202. Shepard, R. N. (1962a). Analysis of proximities: multidimensional scaling with an unknown distance function. II. Psychometrika, 27, 125-140.
203. Shepard, R. N. (1962b). Analysis of proximities: multidimensional scaling with an unknown distance function. II. Psychometrika, 27, 219-246.
204. Shepard, R. N. & Arabie, P. (1979). Additive clustering: representation of similarities as combinations of discrete overlapping properties. Psychological Review, 86, 87-123.
205. Sholz, R. W. (1983). Decision Making Under Uncertainty. Amsterdam: North Holland.
206. Sinclair, M. A. (1990). Subjective assessment. In J. R. Wilson & E. N. Corlett, Eds. Evaluation of Human Work: A Practical Ergonomics Methodology, pp. 58-88. London: Taylor & Francis.
207. Slovic, P., Fleissner, D. & Bauman, W. S. (1972). Quantitative analysis of investment decisions. Journal of Business of the University of Chicago, 45, 283-301.
208. Slovic, P. & Lichtenstein, S. (1971). Comparison of Bayesian and regression approaches to the study of human information processing in judgement. Organizational Behavior and Human Performance, 6, 649-744.
209. Smith, P. J., Normore, L. F. & Denning, R. (1991). Knowledge acquisition techniques: A case study in the design of a reference materials access tools. Proceedings of the Human Factors Society 35th Annual Meeting, pp. 273-277, San Francisco, CA.
210. Smith, J. B., Smith, D. K. & Kupstas, E. (1993). Automated protocol analysis. Human-Computer Interaction, 8, 101-145.
211. Sowa, J. F. (1983). Conceptual Structures: Information Processing in Mind and Machine. Reading, MA: Addison-Wesley.
212. Sowa, J. F. (1992). Conceptual analysis as a basis for knowledge acquisition. In R. R. Hoffman, Ed. The Psychology of Expertise: Cognitive Research and Empirical Al, pp. 80-96. New York: Springer-Verlag.
213. Spence, I. & Ogilvie, J. C. (1973). A table of expected stress values for random rankings in nonmetric multidimensional scaling. Multivariate Behavioral Research, October, 511-517.
214. Stammers, R. B., Carey, M. S. & Astley, J. A. (1990). Task analysis. In J. R. Wilson & E. N. Corlett, Eds. Evaluation of Human Work: A Practical Ergonomics Methodology, pp. 134-160. London: Taylor & Francis.
215. Svenson, O. (1979). Process descriptions of decision making. Organizational Behavior and Human Performance., 23, 86-112.
216. Thordsen, M. L. (1991). A comparison of two tools for cognitive task analysis: Concept mapping and the critical decision method. Proceedings of the Human Factors Society 35th Annual Meeting, pp. 283-285. San Francisco, CA.
217. Triggs, T. J. (1988). The ergonomics of decision-making in large scale systems: information displays and expert knowledge elicitation. Ergonomics, 31, 711-719.
218. Tversky, A. (1977). Features of similarity. Psychological Review, 84, 324-352.
219. Tversky, A. & Gati, I. (1982). Similarity, separability, and triangle inequality. Psychological Review, 89, 123-154.
220. VanHooff, J. A. R. A. M. (1982). Categories and sequences of behavior: methods of description and analysis. In K. R. Scherer & P. Ekman, Eds. Handbook of Methods in Nonverbal Behavior Research. Cambridge: Cambridge University Press.
221. Waern, Y. (1972). Structure in similarity matrices. A graphic approach. Scandanavian Journal of Psychology, 13, 5-16.
222. Wallsten, T. & Budescu, D. (1983). Encoding subject probabilities: a psychological and psychometric review. Management Science, 29, 151-173.
223. Waterman, D. A. & Newell, A. (1971). Protocol analysis as a task for artificial intelligence. Artificial Intelligence, 2, 285-318.
224. Weiss, S. & Kulikowski, C. (1984). A Practical Guide to Designing Expert Systems. Toiowa, NJ: Rowan and Allenheld.
225. Welbank, M. (1990). An overview of knowledge acquisition methods. Interacting with Computers, 2, 83-91.
226. Wielinga, B. J., Schreiber, A. Th. & Breuker, J. A. (1992). KADS: a modelling approach to knowledge engineering. Knowledge Acquisition, 4, 5-53.
227. Wilson, M. (1989). Task models for knowledge elicitation. In D. Diaper, Ed. Knowledge Elicitation: Principles, Techniques, and Applications, pp. 197-219. Chichester, UK: Ellis Horwood.
228. Wood, L. E. & Ford, J. M. (1993). Structuring interviews with experts during knowledge elicitation. International Journal of Intelligent Systems: Special Issue on Knowledge Acquisition, 8, 71-90.
229. Woodward, B. (1990). Knowledge acquisition at the front end: defining the domain. Knowledge Acquisition, 2, 73-94.
230. Wright, G., & Bolger, F., Eds. (1992). Expertise and Decision Support. New York: Plenum Press.
231. Zachary, W. W., Ryder, J. M. & Purcell, J. A. (1990). A computer-based tool to support mental modeling for human-computer interface design. CHI svstems technical report no. 900831-8908, 3 August.