Never blame the umpire – a review of Situation Awareness models and methods for examining the performance of officials in sport

Ergonomics

Volumn 59, Issue 7, 2016, Pages 962-975

  Neville, Timothy J ^a,b   Salmon, Paul M ^a  

^a UNIVERSITY OF THE SUNSHINE COAST   (Australia)

^b DEFENCE SCIENCE AND TECHNOLOGY ORGANISATION   (Australia)

Author keywords

cognitive ergonomics; naturalistic research; officials in sport; referee; Situation Awareness; sociotechnical systems; sport; umpire

Indexed keywords

COGNITIVE SYSTEMS; SPORTS;

COGNITIVE ERGONOMICS; REFEREE; SITUATION AWARENESS; SOCIOTECHNICAL SYSTEMS; UMPIRE;

ERGONOMICS;

AWARENESS; ERGONOMICS; HUMAN; HUMAN EXPERIMENT; MODEL; PHYSICIAN; SPORTS SCIENCE; LEGISLATION AND JURISPRUDENCE; PSYCHOLOGICAL MODEL; PSYCHOLOGY; SPORT; TASK PERFORMANCE;

AWARENESS; HUMANS; MODELS, PSYCHOLOGICAL; SPORTS; TASK PERFORMANCE AND ANALYSIS;

EID: 84949206245     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140139.2015.1100758     Document Type: Article

References (81)

1. G.Atkinson, and T.Reilly. 2009. “Sport, Leisure and Ergonomics VI.” Ergonomics 52 (4):411–412.10.1080/00140130802707667
2. M.R.Baumann, and J.F.Krems. 2009. “A Comprehension Based Cognitive Model of Situation Awareness.” In Digital Human Modeling HCII 2009, LNCS 5620, edited by V.G.Duffy, 192–201. Berlin:Springer.
3. N.Baumgartner, S.Mitsch, A.Müller, W.Retschitzegger, A.Salfinger, and W.Schwinger. 2014. “A Tour of BeAware – A Situation Awareness Framework for Control Centers.” Information Fusion 20:155–173.10.1016/j.inffus.2014.01.008
4. G.Z.Bedny, W.Karwowski, and O.-J.Jeng. 2004. “The Situational Reflection of Reality in Activity Theory and the Concept of Situation Awareness in Cognitive Psychology.” Theoretical Issues in Ergonomics Science 5 (4):275–296.10.1080/1463922031000075070
5. G.Bedny, and D.Meister. 1999. “Theory of Activity and Situation Awareness.” International Journal of Cognitive Ergonomics 3 (1):63–72.10.1207/s15327566ijce0301_5
6. J.Bourbousson, G.Poizat, J.Saury, and C.Seve. 2010. “Team Coordination in Basketball:Description of the Cognitive Connections among Teammates.” Journal of Applied Sport Psychology 22 (2):150–166.10.1080/10413201003664657
7. J.Bourbousson, G.Poizat, J.Saury, and C.Seve. 2011. “Description of Dynamic Shared Knowledge:An Exploratory Study during a Competitive Team Sports Interaction.” Ergonomics 54 (2):120–138.10.1080/00140139.2010.544763
8. J.Bourbousson, G.Poizat, J.Saury, and C.Sève. 2012. “Temporal Aspects of Team Cognition:A Case Study on Concerns Sharing within Basketball.” Journal of Applied Sport Psychology 24 (2):224–241.10.1080/10413200.2011.630059
9. J.Bourbousson, M.R’Kiouak, and D.W.Eccles. 2015. “The Dynamics of Team Coordination:A Social Network Analysis as a Window to Shared Awareness.” European Journal of Work and Organizational Psychology 24 (5):742–760.
10. Y.Cardin, C.Bossard, and C.Buche. 2013. “Investigate Naturalistic Decision-Making of a Workgroup in Dynamic Situation. From the Modelling to the Design of a Training Virtual Environment.” In NDM11, the 11th International Conference on Naturalistic Decision Making, 271–278. Marseille, France.
11. P.Catteeuw, B.Gilis, J.Wagemans, and W.Helsen. 2010. “Perceptual-Cognitive Skills in Offside Decision Making:Expertise and Training Effects.” Journal of Sport and Exercise Psychology 32 (6):828–844.
12. D.Chiappe, R.C.Rorie, C.A.Morgan, and K.P.L.Vu. 2014. “A Situated Approach to the Acquisition of Shared SA in Team Contexts.” Theoretical Issues in Ergonomics Science 15 (1):69–87.10.1080/1463922X.2012.696739
13. D.L.Chiappe, T.Z.Strybel, and K.P.L.Vu. 2012. “Mechanisms for the Acquisition of Situation Awareness in Situated Agents.” Theoretical Issues in Ergonomics Science 13 (6):625–647.10.1080/1463922X.2011.611267
14. H.Collins, 2010. “The Philosophy of Umpiring and the Introduction of Decision-Aid Technology.” Journal of the Philosophy of Sport 37 (2):135–146.10.1080/00948705.2010.9714772
15. H.Collins, and R.Evans. 2012. “Sport-Decision Aids and the ‘CSI-Effect’:Why Cricket Uses Hawk-Eye Well and Tennis Uses it Badly.” Public Understanding of Science 21 (8):904–921.10.1177/0963662511407991
16. C.De Keukelaere, G.Kermarrec, C.Bossard, D.Pasco, and P.De Loor. 2013. “Formes, contenus et évolution du partage au d’une équipe de sport de haut niveau.” [Sharedness Forms, Contents and Dynamics among Expert Sportteam.] Le travail humain 76 (3):227–255.10.3917/th.763.0227
17. F.T.Durso, A.R.Dattel, S.Banbury, and S.Tremblay. 2004. “SPAM:The Real-Time Assessment of SA.” In A Cognitive Approach to Situation Awareness:Theory and Application, edited by S.Banbury and S.Tremblay, 137–154. Aldershot:Ashgate.
18. M.R.Endsley, 1988. “Design and Evaluation for Situation Awareness Enhancement.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 97–101. Santa Monica:Sage.
19. M.R.Endsley, 1995a. “Measurement of Situation Awareness in Dynamic Systems.” Human Factors:The Journal of the Human Factors and Ergonomics Society 37 (1):65–84.10.1518/001872095779049499
20. M.R.Endsley, 1995b. “Toward a Theory of Situation Awareness in Dynamic Systems.” Human Factors:The Journal of the Human Factors and Ergonomics Society 37 (1):32–64.10.1518/001872095779049543
21. S.M.Fiore, and E.Salas. 2006. “Team Cognition and Expert Teams:Developing Insights from Cross-disciplinary Analysis of Exceptional Teams.” International Journal of Sport and Exercise Psychology 4 (4):369–375.10.1080/1612197X.2006.9671803
22. R.D.Gilson, 1995. “Special Issue Preface.” Human Factors:The Journal of the Human Factors and Ergonomics Society 37 (1):3–4.10.1518/001872095779049426
23. F.Guillén, and D.L.Feltz. 2011. “A Conceptual Model of Referee Efficacy.” Frontiers in Psychology 2 (25):1–5.
24. E.Hutchins, 1995. “How a Cockpit Remembers its Speeds.” Cognitive Science 19 (3):265–288.10.1207/s15516709cog1903_1
25. N.James, and J.Patrick. 2004. “The Role of Situation Awareness in Sport.” In A Cognitive Approach to Situation Awareness:Theory and Application, 297–316. Aldershot:Ashgate Publishing.
26. D.P.Jenkins, P.M.Salmon, N.A.Stanton, and G.H.Walker. 2010. “A Systemic Approach to Accident Analysis:A Case Study of the Stockwell Shooting.” Ergonomics 53 (1):1–17.10.1080/00140130903311625
27. G.Kermarrec, and C.Bossard. 2014. “Defensive Soccer Players’ Decision Making:A Naturalistic Study.” Journal of Cognitive Engineering and Decision Making 8 (2):187–199.10.1177/1555343414527968
28. G.Klein, 1998. Sources of Power:How People Make Decisions. Cambridge, MA:MIT Press.
29. R.M.Laing, S.T.Sims, C.A.Wilson, B.E.Niven, and N.M.Cruthers. 2008. “Differences in Wearer Response to Garments for Outdoor Activity.” Ergonomics 51 (4):492–510.10.1080/00140130701636520
30. P.Larkin, J.Berry, B.Dawson, and B.Lay. 2011. “Perceptual and Decision-Making Skills of Australian Football Umpires.” International Journal of Performance Analysis in Sport 11 (3):427–437.
31. S.Loft, V.Bowden, J.Braithwaite, D.B.Morrell, S.Huf, and F.T.Durso. 2014. “Situation Awareness Measures for Simulated Submarine Track Management.” Human Factors:The Journal of the Human Factors and Ergonomics Society 57 (2):298–310.
32. C.MacMahon, and H.Plessner. 2008. “The Sport Official in Research and Practice.” In Developing Sport Expertise, edited by D.Farrow, J.Baker and C.MacMahon, 172–192. London:Routledge.
33. A.C.Macquet, 2009. “Recognition within the Decision-Making Process:A Case Study of Expert Volleyball Players.” Journal of Applied Sport Psychology 21 (1):64–79.10.1080/10413200802575759
34. A.C.Macquet, 2013. “Getting Them on the Same Page:A Method to Study the Consistency of Coaches’ and Athletes’ Situation Understanding during Training Sessions and Competitions.” Sport Psychologist 27 (3):292–295.
35. A.C.Macquet, and P.Fleurance. 2007. “Naturalistic Decision-Making in Expert Badminton Players.” Ergonomics 50 (9):1433–1450.10.1080/00140130701393452
36. A.C.Macquet, and N.A.Stanton. 2014. “Do the Coach and Athlete have the Same ‘Picture’ of the Situation? Distributed Situation Awareness in an Elite Sport Context.” Applied Ergonomics 45 (3):724–733.10.1016/j.apergo.2013.09.014
37. J.Mallo, P.G.Frutos, D.Juárez, and E.Navarro. 2012. “Effect of Positioning on the Accuracy of Decision Making of Association Football Top-Class Referees and Assistant Referees during Competitive Matches.” Journal of Sports Sciences 30 (13):1437–1445.10.1080/02640414.2012.711485
38. J.Martin, N.C.Smith, K.Tolfrey, and A.M.Jones. 2001. “Activity Analysis of English Premiership Rugby Football Union Refereeing.” Ergonomics 44 (12):1069–1075.10.1080/00140130110098237
39. D.R.Mascarenhas, C.Button, D.Hara, and M.Dicks. 2009. “Physical Performance and Decision Making in Association Football Referees:A Naturalistic Study.” Open Sports Sciences, 2(9):1–9.
40. D.Mascarenhas, D.Collins, P.Mortimer, and R.Morris. 2005. “A Naturalistic Approach to Training Accurate and Coherent Decision Making in Rugby Union Referees.” The Sport Psychologist 19 (2):131–147.
41. D.Mascarenhas, D.O’Hare, and H.Plessner. 2006. “The Psychological and Performance Demands of Association Football Refereeing.” International Journal of Sport Psychology 37 (2–3):99–120.
42. A.J.Masys, 2005. “A Systemic Perspective of Situation Awareness:An Analysis of the 2002 Mid-Air Collision over Überlingen, Germany.” Disaster Prevention and Management 14 (4):548–557.10.1108/09653560510618375
43. M.D.Matthews, and S.A.Beal. 2002. Assessing Situation Awareness in Field Training Exercises. U.S. Army Research Institute for the Behavioural and Social Sciences, Research Report 1795, Alexandria, VA, USA. 10.1037/e435292005-001
44. J.McLennan, and M.M.Omodei. 1996. “The Role of Prepriming in Recognition-primed Decision Making.” Perceptual and Motor Skills 82 (3c):1059–1069.10.2466/pms.1996.82.3c.1059
45. U.Neisser, 1976. Cognition and Reality:Principles and Implications of Cognitive Psychology. New York:WH Freeman/Times Books/Henry Holt & Co.
46. B.Nicholson, and D.O’Hare. 2014. “The Effects of Individual Differences, Prior Experience and Cognitive Load on the Transfer of Dynamic Decision-Making Performance.” Ergonomics 57 (9):1353–1365.10.1080/00140139.2014.933884
47. K.Nonose, T.Kanno, and K.Furuta. 2010. “An Evaluation Method of Team Situation Awareness Based on Mutual Belief.” Cognition, Technology and Work 12 (1):31–40.
48. J.Orasanu, and T.Connolly. 1993. “The Reinvention of Decision Making.” In Decision Making in Action:Models and Methods, edited by G.A.Klein, J.Orasanu, R.Calderwood, and C.E.Zsambok, 3–20. Westport, CT:Ablex.
49. G.Orwell, 1945. “The Sporting Spirit.” The Collected Essays, Journalism and Letters of George Orwell 4:1945–1950.
50. G.Poizat, J.Bourbousson, J.Saury, and C.Sève. 2009. “Analysis of Contextual Information Sharing during Table Tennis Matches:An Empirical Study of Coordination in Sports.” International Journal of Sport and Exercise Psychology 7 (4):465–487.10.1080/1612197X.2009.9671920
51. N.van Quaquebeke, and S.R.Giessner. 2010. “How Embodied Cognitions Affect Judgments:Height-Related Attribution Bias in Football Foul Calls.” Journal of Sport and Exercise Psychology 32 (1):3–22.
52. J.T.Reason, and J.T.Reason. 1997. Managing the Risks of Organizational Accidents. Vol. 6. Aldershot:Ashgate.
53. G.Rix-Lièvre, S.Boyer, F.Coutarel, and P.Lièvre. 2014. “La performance arbitrale:de son étude à son développement [Refereeing performance:From study to development].” @ ctivités 11 (1):86–104.
54. G.Rix-Lièvre, S.Boyer, and M.Récopé. 2011. “Referee Cognition as it Occurs:Different Kind of Judgment Acts.” In International Conference on Naturalistic Decision Making, 136–139. Florida.
55. G.Rix-Lievre, M.Recope, S.Boyer, and M.Grimonprez. 2013. “Naturalistic Decision Making and Emotion in Refereeing:Affect at the Heart of Judgment.” NDM11, the 11th International Conference on Naturalistic Decision Making, 83–86. Marseille, France.
56. R.Rousseau, S.Tremblay, and R.Breton. 2004. “Defining and Modeling Situation Awareness:A Critical Review.” In A cognitive approach to situation awareness:Theory and application, edited by S.Banbury and S.Tremblay, 3–21. Aldershot:Ashgate.
57. B.Sætrevik, and J.Eid. 2013. “The ‘Similarity Index’ as an Indicator of Shared Mental Models and Situation Awareness in Field Studies.” Journal of Cognitive Engineering and Decision Making 8 (2):119–136.
58. E.Salas, C.Prince, D.P.Baker, and L.Shrestha. 1995. “Situation Awareness in Team Performance:Implications for Measurement and Training.” Human Factors:The Journal of the Human Factors and Ergonomics Society 37 (1):123–136.10.1518/001872095779049525
59. P.Salmon, A.Gibbon, N.A.Stanton, D.P.Jenkins, and G.H.Walker. 2010. Human Factors Methods and Sports Science:A Practical Guide. Boca Raton, FL/London:CRC/Taylor & Francis.
60. P.M.Salmon, M.G.Lenne, G.H.Walker, N.A.Stanton, and A.Filtness. 2014a. “Exploring Schema-Driven Differences in Situation Awareness between Road Users:An On-Road Study of Driver, Cyclist and Motorcyclist Situation Awareness.” Ergonomics 57 (2):191–209.10.1080/00140139.2013.867077
61. P.M.Salmon, M.G.Lenne, G.H.Walker, N.A.Stanton, and A.Filtness. 2014b. “Using the Event Analysis of Systemic Teamwork (EAST) to Explore Conflicts between Different Road User Groups When Making Right Hand Turns at Urban Intersections.” Ergonomics. 57 (11):1628–1642.
62. P.M.Salmon, and N.A.Stanton. 2013. “Situation Awareness and Safety:Contribution or Confusion? Situation Awareness and Safety Editorial.” Safety Science 56 (July):1–5.10.1016/j.ssci.2012.10.011
63. P.M.Salmon, N.A.Stanton, G.H.Walker, C.Baber, D.P.Jenkins, R.McMaster, and M.S.Young. 2008. “What Really is Going on? Review of Situation Awareness Models for Individuals and Teams.” Theoretical Issues in Ergonomics Science 9 (4):297–323.10.1080/14639220701561775
64. P.Salmon, N.Stanton, G.Walker, and D.Green. 2006. “Situation Awareness Measurement:A Review of Applicability for C4i Environments.” Applied Ergonomics 37 (2):225–238.10.1016/j.apergo.2005.02.001
65. P.M.Salmon, N.A.Stanton, G.H.Walker, D.Jenkins, C.Baber, and R.McMaster. 2008. “Representing Situation Awareness in Collaborative Systems:A Case Study in the Energy Distribution Domain.” Ergonomics 51 (3):367–384.10.1080/00140130701636512
66. P.M.Salmon, N.A.Stanton, G.H.Walker, D.Jenkins, D.Ladva, L.Rafferty, and M.Young. 2009. “Measuring Situation Awareness in Complex Systems:Comparison of Measures Study.” International Journal of Industrial Ergonomics 39 (3):490–500.10.1016/j.ergon.2008.10.010
67. P.M.Salmon, N.A.Stanton, G.H.Walker, D.P.Jenkins, and L.Rafferty. 2010. “Is it Really Better to Share? Distributed Situation Awareness and its Implications for Collaborative System Design.” Theoretical Issues in Ergonomics Science 11 (1–2):58–83.10.1080/14639220903009953
68. Y.Shu, and K.Furuta. 2005. “An Inference Method of Team Situation Awareness Based on Mutual Awareness.” Cognition, Technology & Work 7 (4):272–287.
69. K.Smith, and P.A.Hancock. 1995. “Situation Awareness is Adaptive, Externally Directed Consciousness.” Human Factors:The Journal of the Human Factors and Ergonomics Society 37 (1):137–148.10.1518/001872095779049444
70. N.Souchon, G.Cabagno, A.Traclet, D.Trouilloud, and G.Maio. 2009. “Referees’ Use of Heuristics:The Moderating Impact of Standard of Competition.” Journal of Sports Sciences 27 (7):695–700.10.1080/02640410902874729
71. N.A.Stanton, 2014a. “Commentary on the Paper by Heimrich Kanis Entitled ‘Reliability and Validity of Findings in Ergonomics Research’:Where is the Methodology in Ergonomics Methods?” Theoretical Issues in Ergonomics Science 15 (1):55–61.10.1080/1463922X.2013.778355
72. N.A.Stanton, 2014b. “Representing Distributed Cognition in Complex Systems:How a Submarine Returns to Periscope Depth.” Ergonomics 57 (3):403–418.10.1080/00140139.2013.772244
73. N.A.Stanton, P.M.Salmon, L.Rafferty, G.H.Walker, C.Baber, and D.P.Jenkins. 2013. Human Factors Methods:A Practical Guide for Engineering and Design. Aldershot:Ashgate.
74. N.A.Stanton, P.M.Salmon, G.H.Walker, and D.Jenkins. 2009. “Genotype and Phenotype Schemata and Their Role in Distributed Situation Awareness in Collaborative Systems.” Theoretical Issues in Ergonomics Science 10 (1):43–68.10.1080/14639220802045199
75. N.A.Stanton, R.Stewart, D.Harris, R.J.Houghton, C.Baber, R.McMaster, P.Salmon, G.Hoyle, G.Walker, M.S.Young, M.Linsell, R.Dymott, and D.Green. 2006. “Distributed Situation Awareness in Dynamic Systems:Theoretical Development and Application of an Ergonomics Methodology.” Ergonomics 49 (12–13):1288–1311.10.1080/00140130600612762
76. R.Taylor, 1990. “Situational Awareness Rating Technique (SART):The Development of a Tool for Aircrew Systems Design.” Paper 3:Situational Awareness in Aerospace Operations, AGARD-CP-478, 3/1–3/17. Neuilly-sur-Seine:NATO-AGARD.
77. J.Theureau, 2003. “Course-of-action Analysis and Course-of-action Centered Design.” In Handbook of Cognitive Task Design, edited by E.Hollnagel, 55–81. Mahwah, NJ:Lawrence Erlbaum Associates10.1201/LEAHUMFACERG.
78. M.A.Vidulich, and E.R.Hughes. 1991. “Testing a Subjective Metric of Situation Awareness.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 1307–1311. San Francisco, CA:Sage.
79. G.H.Walker, H.Gibson, N.A.Stanton, C.Baber, P.Salmon, and D.Green. 2006. “Event Analysis of Systemic Teamwork (EAST):A Novel Integration of Ergonomics Methods to Analyse C4i Activity.” Ergonomics 49 (12–13):1345–1369.10.1080/00140130600612846
80. G.H.Walker, N.A.Stanton, C.Baber, L.Wells, H.Gibson, P.Salmon, and D.Jenkins. 2010. “From Ethnography to the EAST Method:A Tractable Approach for Representing Distributed Cognition in Air Traffic Control.” Ergonomics 53 (2):184–197.10.1080/00140130903171672
81. J.L.Wildman, E.Salas, and C.P.R.Scott. 2014. “Measuring Cognition in Teams:A Cross-Domain Review.” Human Factors:The Journal of the Human Factors and Ergonomics Society 56 (5):911–941.10.1177/0018720813515907