Measuring team knowledge

Human Factors

Volumn 42, Issue 1, 2000, Pages 151-173

  Cooke, Nancy J ^a   Salas, Eduardo ^b   Cannon Bowers, Janis A ^c   Stout, Renée J ^d  

^a NEW MEXICO STATE UNIVERSITY   (United States)

^b UNIVERSITY OF CENTRAL FLORIDA   (United States)

^c Naval Air Warfare Center Training Systems Division   (United States)

^d AlignMark   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COGNITION; EMPIRICISM; SCIENCE; TASK PERFORMANCE; TEAMWORK; TRAINING;

EID: 0033921084     PISSN: 00187208     EISSN: None     Source Type: Journal    
DOI: 10.1518/001872000779656561     Document Type: Article

References (74)

1. Blickensderfer, E., Cannon-Bowers, J. A., & Salas, E. (1997a, April). Training teams to self-correct: An empirical evaluation. Paper presented at the Meeting of the Society for Industrial and Organizational Psychology, St. Louis, Missouri.
2. Blickensderfer, E., Cannon-Bowers, J. A., & Salas, E. (1997b, September). Does overlap of team member knowledge predict team performance? Paper presented at the 1997 Human Factors and Ergonomics Society 41st Annual Meeting, Albuquerque, New Mexico.
3. Boose, J. H., & Bradshaw, J. M. (1987). Expertise transfer and complex problems: Using Aquinas as a knowledge-acquisition workbench for knowledge-based systems. International Journal of Man-Machine Studies, 26, 3-28.
4. Cannon-Bowers, J. A., & Salas, E. (1997). Teamwork competencies: The interaction of team member knowledge, skills and attitudes. In O. F. O'Neil (Ed.). Workforce readiness: Competencies and assessment (pp. 151-174). Mahwah, NJ: Erlbaum.
5. Cannon-Bowers, J. A., Salas, E., & Blickensderfer, E. (1999). Toward an understanding of shared cognition. Unpublished manuscript, Naval Air Warfare Center Training Systems Division, Orlando, Florida.
6. Cannon-Bowers, J. A., Salas, E., Blickensderfer, E., & Bowers, C. A. (1998). The impact of cross-training and workload on team functioning: A replication and extension of initial findings. Human Factors, 40, 92-101.
7. Cannon-Bowers, J. A., Salas, E., & Converse, S. (1993). Shared mental models in expert team decision making. In J. Castellan, Jr. (Ed.), Current issues in individual and group decision making (pp. 221-246). Mahwah, NJ: Erlbaum.
8. Cannon-Bowers, J. A., Tannenbaum, S. I., Salas, E., & Volpe, C. E. (1995). Defining team competencies and establishing team training requirements. In R. Guzzo & E. Salas (Eds.), Teams: Their training and performance (pp. 101-124). Norwood, NJ: Ablex.
9. Chase, W. G., & Simon, H. A. (1973). The minds eye in chess. In W. G. Chase (Ed.), Cognitive skills and their acquisition (pp. 141-189). Mahwah, NJ: Erlbaum.
10. Clark, H. H. (1994). Discourse in production. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 985-1021). San Diego, CA: Academic.
11. Converse, S., Cannon-Bowers, J. A., & Salas, E. (1991). Team member shared mental models. In Proceedings of the Human Factors Society 35th Annual Meeting (pp. 1417-1421). Santa Monica, CA: Human Factors and Ergonomics Society.
12. Cooke, N. J. (1994). Varieties of knowledge elicitation techniques. International Journal of Human-Computer Studies, 41, 801-849.
13. Cooke, N. J. (1999). Knowledge elicitation. In F. T. Durso (Ed.), Handbook of applied cognition (pp. 479-509). Chichester, England: Wiley.
14. Cooke, N. J., Neville, K. J., & Rowe, A. L. (1996). Procedural network representations of sequential data. Human-Computer Interaction, 11, 29-68.
15. Cooke, N. J., Stout, R., Rivera, K., & Salas, E. (1998). Exploring measures of team knowledge. In Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (pp. 215-219). Santa Monica, CA: Human Factors and Ergonomics Society.
16. Cooke, N. J., Stout, R., & Salas, E. (1997). Expanding the measurement of situation awareness through cognitive engineering methods. In Proceedings of the Human Factors and Ergonomics Society 41st Annual Meeting (pp. 215-219). Santa Monica, CA: Human Factors and Ergonomics Society.
17. Dawes, R. M. (1979). The robust beauty of improper linear models. American Psychologist, 34, 571-82.
18. Durso, F. T., Hackworth, C., Truitt, T. R., Crutchfield, J., Nikolic, D., & Manning, C. A. (1998). Situation awareness as a predictor of performance in en route air traffic controllers. Air Traffic Control Quarterly, 5, 1-20.
19. Endsley, M. R. (1990). A methodology for the objective measure of situation awareness. In Situational awareness in aerospace operations (Report No. AGARD-CP-478; pp. 1/1-1/9). Neuilly-Sur-Seine, France: NATO - Advisory Group for Aerospace Research and Development.
20. Ericsson, K. A., & Simon, H. A. (1996). Protocol analysis: Verbal reports as data (rev. ed.). Cambridge: Massachusetts Institute of Technology.
21. Geiwitz, J., Klatsky, R. L., & McCloskey, B. P. (1988). Knowledge acquisition for expert systems: Conceptual and empirical comparisons. Santa Barbara, CA: Anacapa Sciences, Inc.
22. Geiwitz, J., Kornell, J., & McCloskey, B. (1990). An expert system for the selection of knowledge acquisition techniques. (Technical Report No. 785-2). Santa Barbara, CA: Anacapa Sciences, Inc.
23. Glaser, R. & Chi, M. T. H. (1988). Overview. In M. T. H. Chi, R. Glaser, & M. J. Farr (Eds.), The nature of expertise (xv-xxviii). Mahwah, NJ: Erlbaum.
24. Goldsmith, T. E., & Davenport, D. M. (1990). Assessing structural similarity of graphs. In R. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 75-87). Norwood, NJ: Ablex.
25. Gualtieri, J., Burns, J., Phipps, D., Reeves, D., & Pierce, L. (1998). Assessing team knowledge structures: Findings from the field. In Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (pp. 1417-1421). Santa Monica, CA: Human Factors and Ergonomics Society.
26. Gualtieri, J., Fowlkes, J., & Ricci, K. E. (1996). Measuring individual and team knowledge structures for use in training. Training Research Journal, 2, 117-141.
27. Harrison, B. L., & Baecker, R. M. (1991). Designing video automation and analysis systems. In Proceedings of Graphics Interface '92, 209-219.
28. Heffner, T. S., Mathieu, J. E., & Cannon-Bowers, J. A. (1998, April). The impact of mental models on team performance: Sharedness, quality, or both? Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Dallas, TX.
29. Hinsz, V. B. (1995). Mental models of groups as social systems: Considerations of specification and assessment. Small Group Research, 26, 200-233.
30. Hinsz, V. B., & Tindale, R. S. (1997). The emerging conceptualization of groups as information processors. Psychological Bulletin, 121, 43-66.
31. Hoffman, R. R., Shadbolt, N. R., Burton, A. M., & Klein, G. (1995). Eliciting knowledge from experts: A methodological analysis. Organizational Behavior and Human Decision Processes, 62, 129-158.
32. Howell, W. C., & Cooke, N. J. (1989). Training the human information processor: A look at cognitive models. In I. Goldstein (Ed.), Training and development in work organizations: Frontier series of industrial and organizational psychology (Vol. 3, pp. 121-182). New York: Jossey-Bass.
33. Hutchins, E. (1991). The social organization of distributed cognition. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Socially shared cognition (pp. 283-301). Washington. DC: American Psychological Association.
34. Hutchins, E. (1995). Cognition in the wild. Cambridge: MIT Press.
35. James, L. R., Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98.
36. Janis, I. L. (1972). Victims of groupthink. Boston, MA: Houghton Mifflin.
37. Jenkins, N. M., & Rentsch, J. R. (1995, May). The effects of teamwork schema similarity on team effectiveness and fairness perceptions. In J. Mathieu (Chair), Mental models and team effectiveness: Three empirical tests. Symposium presented to the 10th Annual Conference of the Society for Industrial/Organizational Psychology, Orlando, Florida.
38. Johnson, S. C. (1967). Hierarchical clustering schemes. Psychometrika, 32, 241-254.
39. Jonassen, D. H., Beissner, K., & Yacci, M. (1993). Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge. Mahwah, NJ: Erlbaum.
40. Kirwan, B., & Ainsworth, L. K. (1992). A guide to task analysis. London: Taylor & Francis.
41. Kitto, C. M., & Boose, J. H. (1987). Choosing knowledge acquisition strategies for knowledge acquisition tasks. In Proceedings of WESTEX-87 - Western Conference on Expert Systems (pp. 96-103).
42. Kitto, C. M., & Boose, J. H. (1989). Selecting knowledge acquisition tools and strategies based on application characteristics. International Journal of Man-Machine Studies, 31, 149-160.
43. Kleinman, D. L., & Serfaty, D. (1989). Team performance assessment in distributed decision making. In R. Gilson, J. P. Kincaid, & B. Godiez (Eds.), Proceedings: Interactive Networked Simulation for Training Conference (pp. 22-27). Orlando, FL: Institute for Simulation and Training, University of Central Florida.
44. Klimoski, R., & Mohammed, S. (1994). Team mental model: Construct or metaphor? Journal of Management, 20, 403-437.
45. Kraiger, K., Krause, J. R., & Hart, P. F. (1996, August). Construct validation of multiple measures of shared mental models. Paper presented at the annual convention of the American Psychological Association, Toronto, Ontario, Canada.
46. Kraiger, K., & Wenzel, L. H. (1997). Conceptual development and empirical evaluation of measures of shared mental models as indicators of team effectiveness. In M. T. Brannick, E. Salas, & C. Prince (Eds.), Performance assessment and measurement: Theory, methods, & applications (pp. 63-84). Mahwah, NJ: Erlbaum.
47. Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Salas, E., & Cannon-Bowers, J. A. (in press). The influence of shared mental models on team process and performance. Journal of Applied Psychology.
48. Meyer, M. A., & Booker, J. M. (1990). Eliciting and analyzing expert judgment: A practical guide (Report No. NUREG/CR-5424: LA-11667-MS). Los Alamos, NM: Los Alamos National Laboratory.
49. Minionis, D. P., Zaccaro, S. J., & Perez, R. (1995, May). Shared mental models, team coordination, and team performance. In J. Mathieu (Chair), Mental models and team effectiveness: Three empirical tests. Symposium presented to the 10th annual conference of the Society for Industrial/Organizational Psychology, Orlando, Florida.
50. Neerincx, M. A., & deGreef, H. P. (1998). Cognitive support: Extending human knowledge and processing capacities. Human-Computer Interaction, 13, 73-106.
51. Norman, D. A. (1986). Cognitive engineering. In D. A. Norman & S. W. Draper (Eds.), User centered system design (pp. 31-61). Mahwah, NJ: Erlbaum.
52. Orasanu, J. (1990). Shared mental models and crew decision making (Report No. 46). Princeton, NJ: Princeton University, Cognitive Science Laboratory.
53. Rentsch, J. R., & Hall, R. J. (1994). Members of great teams think alike: A model of team effectiveness and schema similarity among team members. In M. M. Beyerlein & D. A. Johnson (Eds.), Advances in interdisciplinary studies of work teams: Theories of self-managing work teams (Vol. 1, pp. 223-262). Greenwich, CT: JAI Press.
54. Robertson, M. M., & Endsley, M. R. (1997). Development of a situation awareness training program for aviation maintenance. In Proceedings of the Human factors and Ergonomics Society 41st Annual Meeting (pp. 1163-1167). Santa Monica, CA: Human Factors and Ergonomics Society.
55. Rouse, W. B., Cannon-Bowers, J. A., & Salas, E. (1992). The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man & Cybernetics, 22, 1296-1308.
56. Salas, E., Cannon-Bowers, J. A., Church-Payne, S., & Smith-Jentsch, K. A. (1998). Teams and teamwork in the military. In C. Cronin (Ed.), Military psychology: An introduction (pp. 71-87). Needham Heights, MA: Simon & Schuster.
57. Salas, E., Dickinson, T. L., Converse, S. A., & Tannenbaum, S. I. (1992). Toward an understanding of team performance and training. In R. W. Swezey & E. Salas (Eds.), Teams: Their training and performance (pp. 3-29). Norwood, NJ: Ablex.
58. Sanderson, P. M., & Fisher, C. (1994). Exploratory sequential data analysis: Foundations. Human-Computer Interaction, 9, 251-317.
59. Sarter, N. B., & Woods, D. D. (1991). Situation awareness: A critical but ill-defined phenomenon. International Journal of Aviation Psychology, 1, 45-57.
60. Schvaneveldt, R. W. (1990). Pathfinder associative networks: Studies in knowledge organization. Norwood, NJ: Ablex.
61. Schvaneveldt, R. W., Durso, F. T., & Dearholt, D. W. (1989). Network structures in proximity data. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 24, pp. 249-284). New York: Academic.
62. Shaw, M. L. G., & Gaines, B. R. (1989). Comparing conceptual structures: Consensus, conflict, correspondence, and contrast. Knowledge Acquisition, 1, 341-363.
63. Shepard, R. N. (1962a). Analysis of proximities: Multidimensional scaling with an unknown distance function: I. Psychometrika, 27, 125-140.
64. Shepard, R. N. (1962b). Analysis of proximities: Multidimensional scaling with an unknown distance function: II. Psychometrika, 27, 219-246.
65. Stout, R. J. (1995). Planning effects on communication strategies: A shared mental models perspective. In Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting (pp. 1278-1282). Santa Monica, CA: Human Factors and Ergonomics Society.
66. Stout, R., Cannon-Bowers, J. A., & Salas, E. (1996). The role of shared mental models in developing team situation awareness: Implications for training. Training Research Journal, 2, 85-116.
67. Stout, R. J., Salas, E., Cannon-Bowers, J. A. (in press). Team situational awareness: Cue recognition training. In M. McNeese, E. Salas, & M. Endsley (Eds.), Multi-crew performance in complex systems.
68. Sundstrom, E., DeMeuse, K. P., & Futrell, D. (1990). Work teams: Applications and effectiveness. American Psychologist, 45, 120-133.
69. vanSomeren, M. W., Barnard, Y. F., & Sandberg, J. A. C. (1994). The think aloud method: A practical guide to modeling cognitive processes. London: Academic.
70. Volpe, C. E., Cannon-Bowers, J. A., Salas, E., & Spector, P. (1996). The impact of cross-training on team functioning: An empirical investigation. Human Factors, 38, 87-100.
71. Walsh, J. P., Henderson, C. M., & Deighton, J. (1988). Negotiated belief structure and decision performance: An empirical investigation. Organizational Behavior and Human Decision Processes, 42, 194-216.
72. Wellens, A. R. (1993). Group situation awareness and distributed decision making: From military to civilian applications. In N. J. Castellan, Jr. (Ed.), Individual and group decision making (pp. 267-291). Mahwah, NJ: Erlbaum.
73. Wielinga, B. J., Schreiber, A. T., & Breuker, J. A. (1992). KADS: A modelling approach to knowledge engineering. Knowledge Acquisition, 4, 5-53.
74. Woods, D. D., & Roth, E. M. (1988). Cognitive systems engineering. In M. Helander (Ed.), Handbook of human-computer interaction (pp. 3-43). Amsterdam: Elsevier.