Observational assessment of situation awareness, team differences and training implications

Ergonomics

Volumn 49, Issue 4, 2006, Pages 393-417

  Patrick, J ^a   James, N ^b   Ahmed, A ^a   Halliday, P ^a  

^a CARDIFF UNIVERSITY   (United Kingdom)

^b SWANSEA UNIVERSITY   (United Kingdom)

Author keywords

Observational method; Rating reliability; Team situation awareness; Training

Indexed keywords

CORRELATION METHODS; ERGONOMICS; PERSONNEL TRAINING; PLANNING; PROBLEM SOLVING; SOCIAL SCIENCES;

OBSERVATIONAL ASSESSMENT; RATING RELIABILITY; TEAM DIFFERENCES; TEAM SITUATION AWARENESS;

HUMAN ENGINEERING;

ADULT; ALERTNESS; ARTICLE; ATTENTION; CORRELATION COEFFICIENT; CRITICAL INCIDENTS METHOD; HUMAN; HUMAN RELATION; KNOWLEDGE; METHODOLOGY; OBSERVATIONAL METHOD; PROBLEM SOLVING; RELIABILITY; RETROSPECTIVE STUDY; TEAM BUILDING; TEAMWORK; TRAINING;

ADULT; AWARENESS; GREAT BRITAIN; GROUP PROCESSES; HUMANS; INSERVICE TRAINING; MIDDLE AGED; OBSERVATION; RETROSPECTIVE STUDIES;

EID: 33646715641     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140130600576272     Document Type: Article

References (61)

1. Adams, M. and Tenney, Y. and Pew, R. (1995) Situation awareness and the cognitive management of complex systems Human Factors, 37, pp. 85-104.
2. Anderson, J.(1993) Rules of the Mind. Hillsdale NJ: Lawrence Erlbaum Associates.
3. Artman, H. (2000) Team situation assessment and information distribution Ergonomics, 43, pp. 1111- 128.
4. Artman, H. and Granlund, R.(1998) Team situation awareness using graphical or textual databases in dynamic decision making. In Proceedings of 9th Conference of Cognitive Ergonomics. (pp. 149-155). Limerick: European Association of Cognitive Ergonomics (EACE).
5. Busquets, A. and Parrish, R. and Williams, S. and Nold, D.(1994) Comparison of pilots' acceptance and spatial awareness when using EFIS vs. pictorial display formats for complex, curved landing approaches. In Situational Awareness in Complex Systems. (pp. 139-170). Daytona Beach FL: Embry-Riddle Aeronautical University Press.
6. Ebel, R. (1951) Estimation of the reliability of ratings Psychometrika, 16, pp. 407-424.
7. Endsley, M.(1987) SAGAT: A Methodology for the Measurement of Situation Awareness (NORDOC 87-83). Hawthorne CA: Northrop Corporation.
8. Endsley, M.(1988) Design and evaluation for situation awareness enhancement. In Proceedings of the Human Factors Society 34th Annual Meeting. (pp. 41-45). Santa Monica CA: Human Factors and Ergonomics Society.
9. Endsley, M.(1990) Predictive utility of an objective measure of situational awareness. In Proceedings of the Human Factors Society 34th Annual Meeting. (pp. 41-45). Santa Monica CA: Human Factors and Ergonomics Society.
10. Endsley, M. (1993) A survey of situation awareness requirements in air-to-air combat fighters International Journal of Aviation Psychology, 3, pp. 157-168.
11. Endsley, M. (1995) Towards a theory of situation awareness in dynamic systems Human Factors, 37, pp. 32-64.
12. Endsley, M.(2000) Theoretical underpinning of situation awareness: A critical review. In Situation Awareness Analysis and Measurement. (pp. 3-32). Mahwah NJ: Lawrence Erlbaum Associates.
13. Endsley, M. and Garland, D.(2000) Situation Awareness Analysis and Measurement. Mahwah NJ: Lawrence Erlbaum Associates.
14. Endsley, M. and Robertson, M.(2000) Training for situation awareness in individuals and teams. In Situation Awareness Analysis and Measurement. (pp. 349-365). Mahwah NJ: Lawrence Erlbaum Associates.
15. Flach, J. (1995) Situation awareness: Proceed with caution Human Factors, 37, pp. 149-157.
16. Flanagan, J. (1954) The Critical Incident Technique Psychological Bulletin, 51, pp. 327-358.
17. Forrester, L.(1978) Fly for Your Life 2nd ed. New York: Bantam Books Inc.
18. Fracker, M.(1988) A theory of situation assessment: Implications for measuring situation awareness. In Proceedings of the Human Factors Society 32nd Annual Meeting. (pp. 102-106). Santa Monica CA: Human Factors and Ergonomics Society.
19. Fracker, M.(1991) Measures of Situation Awareness: Review and Future Directions (AL-TR-1991-C128). Dayton OH: Air Force Systems Command, Armstrong Laboratory, Wright-Patterson Air Force Base.
20. Gaba, D. and Howard, S. and Small, S. (1995) Situation awareness in anesthesiology Human Factors, 37, pp. 20-31.
21. Garbis, C. and WÆrn, Y. (1999) Team coordination and communication in a rescue command staff - The role of public representations Le Travail Humain, 62, pp. 273-291.
22. Gugerty, L. (1997) Situation awareness during driving: Explicit and implicit knowledge in dynamic spatial memory Journal of Experimental Psychology: Applied, 3, pp. 42-66.
23. Haggard, E.(1958) Intraclass Correlation and the Analysis of Variance. New York: Dryden Press.
24. Hartman, B. and Secrist, G. (1991) SA is more than exceptional vision Aviation, Space, and Environmental Medicine, 62, pp. 1084-1089.
25. Harwood, K. and Barnett, B. and Wickens, C.(1988) Situation awareness: A conceptual and methodological framework. In In Proceedings of the Symposium Psychology in the Department of Defense. (pp. 316-320). Colorado Springs CO: U.S. Air Force Academy.
26. Heath, C. and Luff, P. (1992) Collaboration and control: Crisis management and multimedia technology in London Underground line control rooms Computer Supported Cooperative Work, 1, pp. 69-94.
27. Hogg, D. and Folleso, K. and Strand-Volden, F. and Torralba, B. (1995) Development of a situation awareness measure to evaluate advanced alarm systems in nuclear power plant control rooms Ergonomics, 38, pp. 2394-2431.
28. Hogg, D. and Folleso, K. and Torralba, B. and Strand-Volden, F.(1994) Measurement of the Operator's Situation Awareness for Use within Process Control Research: Four Methodological Studies. Halden: Institutt for Energiteknikk, OECD Halden Reactor Project. HWR-377
29. Jones, D.(2000) Subjective measures of situation awareness. In In Situation Awareness Analysis and Measurement. (pp. 113-128). Mahwah NJ: Lawrence Erlbaum Associates.
30. Jones, D. and Endsley, M. (1996) Sources of situation awareness errors in aviation Aviation, Space, and Environmental Medicine, 67, pp. 507-512.
31. Kahneman, D. and Slovic, P. and Tversky, A.(1982) Judgment under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press.
32. Kelly, M. and Wooldridge, L. and Hennessey, R. and Vreuls, D. and Barnebey, S. and Cotton, J. and Reed, J.(1979) Air Combat Maneuvering Performance Measurement. San Antonio TX: Air Force Human Resources Laboratory, Brooks Air Force Base. AFHRL-TR-79-3, September 1979
33. Lahey, M. and Downey, R. and Saal, F. (1983) Intraclass correlations: there's more than meets the eye Psychological Bulletin, 9, pp. 586-595.
34. Lave, J.(1988) Cognition in Practice: Mind, Mathematics, and Culture in Everyday Life. Cambridge: Cambridge University Press.
35. McGraw, K. and Wong, S. (1996) Forming inferences about some intraclass correlation coefficients Psychological Methods, 1, pp. 30-46.
36. Mumaw, R. and Roth, E. and Vicente, K. and Burns, C. (2000) There is more to monitoring than meets the eye Human Factors, 42, pp. 36-55.
37. Patrick, J. and Gregov, A. and Halliday, P. and Handley, J. and O'Reilly, S. (1999) Training to break the barriers in reasoning about unusual faults Journal of Experimental Psychology: Applied, 5, pp. 314-335.
38. Patrick, J. and James, N.(2004) A task-oriented perspective of situation awareness. In In A Cognitive Approach to Situation Awareness: Theory, Measures and Application. (pp. 61-81). London: Ashgate Publishers.
39. Patrick, J. and James, N. and Ahmed, A. (2006a) Situation awareness in nuclear control room teams (in press) Le Travail Humain.
40. Patrick, J. and James, N. and Ahmed, A. (2006b) Human processes of control: Tracing the goals and strategies of control room teams (in press) Ergonomics.
41. Pew, R. (1994) Situation awareness: The buzzword of the '90s. CSERIAC Gateway, 5, pp. 1-4.
42. Pew, R.(2000) The state of situation awareness measurement: Heading toward the next century. In In Situation Awareness Analysis and Measurement. (pp. 33-47). Mahwah NJ: Lawrence Erlbaum Associates.
43. Pew, R. and Miller, D. and FeehRer, C.(1981) Evaluation of Proposed Control Room Improvements Through Analysis of Critical Operator Decisions. Palo Alto CA: Electric Power research Institute. EPRI NP-1982
44. Prince, C. and Chidester, T. and Bowers, C. and Cannon-Bowers, J.(1992) Aircrew coordination - achieving teamwork in the cockpit. In In Teams: Their Training and Performance. (pp. 329-353). Norwood NJ: Ablex.
45. Prince, C. and Salas, E.(2000) Team situation awareness, errors, and crew resource management: Research integration for training guidance. In In Situation Awareness Analysis and Measurement. (pp. 325-347). Mahwah NJ: Lawrence Erlbaum Associates.
46. Pritchett, A. and Hansman, R.(2000) Use of testable responses for a performance-based measurement of situation awareness. In In Situation Awareness Analysis and Measurement. (pp. 189-209). Mahwah NJ: Lawrence Erlbaum Associates.
47. Reason, J.(1990) Human Error. Cambridge: Cambridge University Press.
48. Salas, E. and Prince, C. and Baker, D. and Shrestha, L. (1995) Situation awareness in team performance: Implications for measurement and training Human Factors, 37, pp. 123- 36.
49. Sarter, N. and Woods, D. (1994) Pilot interaction with cockpit automation II: An experimental study of pilots' model and awareness of the Flight Management System (FMS) International Journal of Aviation Psychology, 4, pp. 1-28.
50. Sarter, N. and Woods, D. (1995) How in the world did we ever get into that mode? Mode error and awareness in supervisory control Human Factors, 37, pp. 5-19.
51. Shepherd, A.(2001) Hierarchical Task Analysis. London: Taylor & Francis.
52. Shrestha, L. and Prince, C. and Baker, D. and Salas, E.(1995) Understanding situation awareness: Concepts, methods, and training. In In Human Technology Interaction in Complex Systems. (pp. 45-83). Greenwich CT: JAI Press Inc.
53. Shrout, P. and Fleiss, J. (1979) Intraclass correlations: Uses in assessing rater reliability Psychological Bulletin, 86, pp. 420-428.
54. Smith, K. and Hancock, P. (1995) Situation awareness is adaptive, externally directed consciousness Human Factors, 37, pp. 137-148.
55. Suchman, L.(1987) Plans and Situated Actions. Cambridge: Cambridge University Press.
56. Taylor, R.(1989) Situation Awareness: Aircrew Constructs for Situation Awareness. Farnborough Hants: RAF Institute of Aviation Medicine. IAM Report No. 670
57. Taylor, R.(1990) Situational Awareness Rating Technique (SART): The development of a tool for aircrew systems design. In Proceedings of the AGARD AMP Symposium on Situational Awareness in Aerospace Operations, CP47. Seuilly-sur Seine: NATO AGARD.
58. Underwood, B.(1957) Psychological Research. Englewood Cliffs NJ: Prentice Hall.
59. Venturino, M. and Hamilton, W. and Dvorchak, S.(1990) Performance-based measures of merit for tactical situation awareness. In In Situation Awareness in Aerospace Operations (AGARD-CP-478). Copenhagen: NATO - Advisory Group for Aerospace Research and Development.
60. Whitaker, L. and Klein, G.(1988) Situation awareness in the virtual world. In In Proceedings of the Eleventh Symposium on Psychology in the Department of Defense (USAFA-TR-88 - 1). (pp. 321 - 325). Colorado Springs CO: USAF Academy.
61. Wickens, C.(2000) The trade-off of design for routine and unexpected performance: Implications of situation awareness. In In Situation Awareness Analysis and Measurement. (pp. 211-225). Mahwah NJ: Lawrence Erlbaum Associates.