Experience of automation failures in training: effects on trust, automation bias, complacency and performance

Ergonomics

Volumn 59, Issue 6, 2016, Pages 767-780

  Sauer, Juergen ^a   Chavaillaz, Alain ^a   Wastell, David ^b  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

^b UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

adaptable automation; automation bias; Automation failure; complacency; trust

Indexed keywords

PERSONNEL TRAINING;

AUTOMATION BIAS; AUTOMATION FAILURES; COMPLACENCY; CONTROL ENVIRONMENT; DIAGNOSTIC SYSTEMS; REPAIR FACILITIES; TRAINING EXPERIENCES; TRUST;

AUTOMATION;

ADOLESCENT; ADULT; AUTOMATION; DEVICE FAILURE; FEMALE; HUMAN; MALE; MAN MACHINE INTERACTION; STATISTICAL BIAS; TRUST; YOUNG ADULT;

ADOLESCENT; ADULT; AUTOMATION; BIAS (EPIDEMIOLOGY); EQUIPMENT FAILURE; FEMALE; HUMANS; MALE; MAN-MACHINE SYSTEMS; TRUST; YOUNG ADULT;

EID: 84945205673     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140139.2015.1094577     Document Type: Article

References (34)

1. J.E.Bahner,, A.-D.Hüper, and D.Manzey. 2008. “Misuse of Automated Decision Aids: Complacency, Automation Bias and the Impact of Training Experience.” International Journal of Human-computer Studies 66 (9): 688–699. doi:10.1016/j.ijhcs.2008.06.001.
2. N.R.Bailey,, and M.W.Scerbo. 2007. “Automation-induced Complacency for Monitoring Highly Reliable Systems: The Role of Task Complexity, System Experience, and Operator Trust.” Theoretical Issues in Ergonomics Science 8 (4): 321–348. doi:10.1080/14639220500535301.
3. E.A.Bustamante,, J.P.Bliss, and B.L.Anderson. 2007. “Effects of Varying the Threshold of Alarm Systems and Workload on Human Performance.” Ergonomics 50 (7): 1127–1147. doi:10.1080/00140130701237345.
4. A.Chavaillaz,, D.Wastell, and J.Sauer, 2015, Forthcoming. “System Reliability, Performance and Trust in Adaptable Automation”. Applied Ergonomics.
5. J.Y.C.Chen,, and M.J.Barnes. 2012. “Supervisory Control of Multiple Robots: Effects of Imperfect Automation and Individual Differences.” Human Factors: The Journal of the Human Factors and Ergonomics Society 54 (2): 157–174. doi:10.1177/0018720811435843.
6. S.R.Dixon,, C.D.Wickens, and J.S.McCarley. 2007. “On the Independence of Compliance and Reliance: Are Automation False Alarms Worse than Misses?” Human Factors: The Journal of the Human Factors and Ergonomics Society 49 (4): 564–572. doi:10.1518/001872007X215656.
7. M.T.Dzindolet,, S.A.Peterson, R.A.Pomranky, L.G.Pierce, and H.P.Beck. 2003. “The Role of Trust in Automation Reliance.” International Journal of Human-computer Studies 58 (6): 697–718. doi:10.1016/S1071-5819(03)00038-7.
8. M.R.Endsley,, and D.B.Kaber. 1999. “Level of Automation Effects on Performance, Situation Awareness and Workload in a Dynamic Control Task.” Ergonomics 42 (3): 462–492. doi:10.1080/001401399185595.
9. J.Goh,, D.A.Wiegmann, and P.Madhavan, 2005. “Effects of Automation Failure in a Luggage Screening Task: A Comparison between Direct and Indirect Cueing.” Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, Orlando, FL: SAGE Publications, September 26-30., 492–496.
10. S.Hart,, and L.Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.”In Human Mental Workload, edited by P.A.Hancock and N.Meshkati, 139–183. Amsterdam: North-Holland.
11. G.R.J.Hockey, 1997. “Compensatory Control in the Regulation of Human Performance under Stress and High Workload: A Cognitive-energetical Framework.” Biological Psychology 45 (1–3): 73–93. doi:10.1016/S0301-0511(96)05223-4.
12. G.R.J.Hockey,, D.G.Wastell, and J.Sauer. 1998. “Effects of Sleep Deprivation and User Interface on Complex Performance: A Multilevel Analysis of Compensatory Control.” Human Factors: The Journal of the Human Factors and Ergonomics Society 40 (2): 233–253. doi:10.1518/001872098779480479.
13. J.-Y.Jian,, A.M.Bisantz, and C.G.Drury. 2000. “Foundations for an Empirically Determined Scale of Trust in Automated Systems.” International Journal of Cognitive Ergonomics 4 (1): 53–71. doi:10.1207/S15327566IJCE0401_04.
14. K.H.E.Kroemer,, H.B.Kroemer, and K.E.Kroemer-Elbert. 2001. Ergonomics: How to Design for Ease and Efficiency. 2nd ed. Upper Saddle River, NJ: Prentice Hall.
15. J.A.Landeweerd, 1979. “Internal Representation of a Process, Fault Diagnosis and Fault Correction.” Ergonomics 22 (12): 1343–1351. doi:10.1080/00140137908924708.
16. J.D.Lee,, B.F.Gore, and J.L.Campbell. 1999. “Display Alternatives for in-vehicle Warning and Sign Information: Message Style, Location, and Modality.” Transportation Human Factors 1 (4): 347–375. doi:10.1207/sthf0104_6.
17. J.D.Lee,, and N.Moray, 1994. “Trust, Self-Confidence, and Operators’ Adaptation to Automation”. International Journal of Human-computer Studies, 40 (1), 153–184. http://www.sciencedirect.com/science/article/pii/S107158198471007X.10.1006/ijhc.1994.1007
18. J.D.Lee,, and K.A.See. 2004. “Trust in Automation: Designing for Appropriate Reliance.” Human Factors: The Journal of the Human Factors and Ergonomics Society 46 (1): 50–80. doi:10.1518/hfes.46.1.50_30392.
19. B.Lorenz,, F.Di Nocera, S.Rottger, and R.Parasuraman. 2002. “Automated Fault-management in a Simulated Spaceflight Micro-world.” Aviation, Space, and Environmental Medicine 73 (9): 886–897.
20. M.Madsen,, and S.Gregor, 2000. “Measuring Human-computer Trust.” In G.Gable and M.Viatle, eds. Proceedings of 11th Australasian Conference on Information Systems. December 6-8. Brisbane. QUT: Australasian Association for Information Systems, 6–8.
21. D.Manzey,, M.Bleil, J.E.Bahner-Heyne, A.Klostermann, L.Onnasch, J.Reichenbach, and S.Röttger, 2008. AutoCAMS 2.0TU Manual. Berichte Aus Dem Fachgebiet Arbeits- Ingenieur- Und Organisationspsychologie Der Berlin. Accessed June 29. http://www.aio.tu-berlin.de/?id=30492
22. D.Manzey,, J.Reichenbach, and L.Onnasch. 2012. “Human Performance Consequences of Automated Decision Aids: The Impact of Degree of Automation and System Experience.” Journal of Cognitive Engineering and Decision Making 6 (1): 57–87. doi:10.1177/1555343411433844.
23. N.Moray, 2003. “Monitoring, Complacency, Scepticism and Eutactic Behaviour.” International Journal of Industrial Ergonomics 31 (3): 175–178. doi:10.1016/S0169-8141(02)00194-4.
24. K.L.Mosier,, L.J.Skitka, M.Dunbar, and L.McDonnell. 2001. “Aircrews and Automation Bias: The Advantages of Teamwork?” The International Journal of Aviation Psychology 11 (1): 1–14. doi:10.1207/S15327108IJAP1101_1.
25. R.Parasuraman,, and D.Manzey. 2010. “Complacency and Bias in Human Use of Automation: An Attentional Integration.” Human Factors: The Journal of the Human Factors and Ergonomics Society 52 (3): 381–410. doi:10.1177/0018720810376055.
26. R.Parasuraman,, T.Sheridan, and C.Wickens. 2000. “A Model for Types and Levels of Human Interaction with Automation.” IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans 30 (3): 286–297. doi:10.1109/3468.844354.
27. J.Sauer,, C.-S.Kao, and D.Wastell. 2012. “A Comparison of Adaptive and Adaptable Automation under Different Levels of Environmental Stress.” Ergonomics 55 (8): 840–853. doi:10.1080/00140139.2012.676673.
28. J.Sauer,, C.-S.Kao, D.Wastell, and P.Nickel. 2011. “Explicit Control of Adaptive Automation under Different Levels of Environmental Stress.” Ergonomics 54 (8): 755–766. doi:10.1080/00140139.2011.592606.
29. J.Sauer,, P.Nickel, and D.Wastell. 2013. “Designing Automation for Complex Work Environments under Different Levels of Stress.” Applied Ergonomics 44 (1): 119–127. doi:10.1016/j.apergo.2012.05.008.
30. T.B.Sheridan,, and W.L.Verplank, 1978. Human and Computer Control of Undersea Teleoperators. Technical Report. Cambridge, MA: MIT Man-machine Systems Laboratory.
31. L.J.Skitka,, K.L.Mosier, M.Burdick, and B.Rosenblatt. 2000. “Automation Bias and Errors: Are Crews Better than Individuals?” The International Journal of Aviation Psychology 10 (1): 85–97. doi:10.1207/S15327108IJAP1001_5.
32. L.J.Skitka,, K.L.Mosier, and M.D.Burdick. 2000. “Accountability and Automation Bias.” International Journal of Human-computer Studies 52 (4): 701–717. doi:10.1006/ijhc.1999.0349.
33. C.D.Wickens,, and S.R.Dixon. 2007. “The Benefits of Imperfect Diagnostic Automation: A Synthesis of the Literature.” Theoretical Issues in Ergonomics Science 8 (3): 201–212. doi:10.1080/14639220500370105.
34. D.A.Wiegmann,, A.Rich, and H.Zhang. 2001. “Automated Diagnostic Aids: The Effects of Aid Reliability on Users’ Trust and Reliance.” Theoretical Issues in Ergonomics Science 2 (4): 352–367. doi:10.1080/14639220110110306.