How much time do drivers need to obtain situation awareness? A laboratory-based study of automated driving

Applied Ergonomics

Volumn 60, Issue , 2017, Pages 293-304

  Lu, Zhenji ^a   Coster, Xander ^a   de Winter, Joost ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Eye tracking; Hazard perception; Scene perception; Spatial memory

Indexed keywords

ERGONOMICS; PHYSICAL THERAPY;

AUTOMATED DRIVING; EYE-TRACKING; GEOMETRIC DIFFERENCE; HAZARD PERCEPTIONS; NOCV1; SITUATION AWARENESS; SPATIAL MEMORY; SPATIAL PATTERNS; TRAFFIC SITUATIONS;

ERRORS;

AWARENESS; CLINICAL ARTICLE; CONTROLLED STUDY; DRIVER; EYE TRACKING; HUMAN; PARTICIPANT OBSERVATION; PERCEPTION; SPATIAL MEMORY; VELOCITY; VIDEORECORDING; ADULT; ATTENTION; AUTOMATION; CAR DRIVING; COMPUTER SIMULATION; EYE MOVEMENT; FEMALE; MALE; SPATIAL BEHAVIOR; TASK PERFORMANCE; TIME FACTOR; YOUNG ADULT;

ADULT; ATTENTION; AUTOMATION; AUTOMOBILE DRIVING; AWARENESS; COMPUTER SIMULATION; EYE MOVEMENTS; FEMALE; HUMANS; MALE; SPATIAL PROCESSING; TASK PERFORMANCE AND ANALYSIS; TIME FACTORS; YOUNG ADULT;

EID: 85007397865     PISSN: 00036870     EISSN: 18729126     Source Type: Journal    
DOI: 10.1016/j.apergo.2016.12.003     Document Type: Article

References (81)

1. Arkin, E.M., Chew, L.P., Huttenlocher, D.P., Kedem, K., Mitchell, J.S., An efficiently computable metric for comparing polygonal shapes. IEEE Trans. Pattern Anal. Mach. Intell. 13 (1991), 209–216.
2. Baumann, M., Franke, T., Krems, J.F., The Effect of Experience, Relevance, and Interruption Duration on Drivers' Mental Representation of a Traffic Situation. Human Factors for Assistance and Automation. 2008, Shaker Publishing, Maastricht, The Netherlands, 141–152.
3. Borji, A., Itti, L., State-of-the-art in visual attention modelling. IEEE Trans. Pattern Anal. Mach. Intell. 35 (2013), 185–207.
4. Borowsky, A., Oron-Gilad, T., The effects of automation failure and secondary task on drivers' ability to mitigate hazards in highly or semi-automated vehicles. Adv. Transp. Stud. 1 (2016), 59–70.
5. Brouwer, A.M., Brenner, E., Smeets, J.B., Perception of acceleration with short presentation times: can acceleration be used in interception?. Percept. Psychophys. 64 (2002), 1160–1168.
6. Casner, S.M., Hutchins, E.L., Norman, D., The challenges of partially automated driving. Commun. ACM 59 (2016), 70–77.
7. Clark, H., Feng, J., Semi-autonomous vehicles examining driver performance during the take-over. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 59 (2015), 781–785.
8. Conover, W.J., Iman, R.L., Rank transformations as a bridge between parametric and nonparametric statistics. Am. Statistician 35 (1981), 124–129.
9. Coster, X.A., A Method for Determining How Much Time People Need to Understand Traffic Situations. (MSc thesis), 2015, Delft University of Technology, The Netherlands.
10. Crundall, D., Chapman, P., Phelps, N., Underwood, G., Eye movements and hazard perception in police pursuit and emergency response driving. J. Exp. Psychol. Appl. 9 (2003), 163–174.
11. Desmond, P., Hancock, P., Monette, J., Fatigue and automation-induced impairments in simulated driving performance. Transp. Res. Rec. J. Transp. Res. Board 1628 (1998), 8–14.
12. De Winter, J.C.F., Happee, R., Martens, M., Stanton, N.A., Effects of adaptive cruise control and highly automated driving on workload and situation awareness: a review of the empirical evidence. Transp. Res. Part F Traffic Psychol. Behav. 27 (2014), 196–217.
13. Durso, F.T., Truitt, T.R., Hackworth, C.A., Crutchfield, J.M., Nikolic, D., Moertl, P.M., Manning, C.A., Expertise and chess: a pilot study comparing situation awareness methodologies. Garland, D., Endsley, M., (eds.) Proceedings of the International Conference on Experimental Analysis and Measurement of Situation Awareness, 1995, 295–303.
14. Durso, F.T., Bleckley, M.K., Dattel, A.R., Does situation awareness add to the validity of cognitive tests?. Hum. Factors 48 (2006), 721–733.
15. Endsley, M.R., Direct measurement of situation awareness: validity and use of SAGAT. Endsley, M.R., Garland, D.J., (eds.) Situation Awareness Analysis and Measurement, 2000, Lawrence Erlbaum Associates, Mahwah, NJ, 147–174.
16. Endsley, M.R., Situation awareness: operationally necessary and scientifically grounded. Cognition, Technol. Work 17 (2015), 163–167.
17. Faul, F., Erdfelder, E., Lang, A.G., Buchner, A., G* Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39 (2007), 175–191.
18. Feldhütter, A., Gold, C., Schneider, S., Bengler, K., How the duration of automated driving influences take-over performance and gaze behavior. In Gesellschaft für Arbeitswissenschaft e. V. (Hrsg.), 62. Kongress der Gesellschaft für Arbeitswissenschaft, 2016, GfA Press, Dortmund, Germany.
19. Funke, G., Greenlee, E., Carter, M., Dukes, A., Brown, R., Menke, L., Which eye tracker is right for your research? Performance evaluation of several cost variant eye trackers. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 60 (2016), 1240–1244.
20. Garay-Vega, L., & Fisher, D. L. (2005). Can novice drivers recognize foreshadowing risks as easily as experienced drivers. Proceedings of 3rd International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design. Rockport, ME.
21. Gardner, A.K., Kosemund, M., Martinez, J., Examining the feasibility and predictive validity of the SAGAT tool to assess situational awareness among surgical trainees. J. Am. Coll. Surg. 221 (2015), e9–e10.
22. Garland, D.J., Endsley, M.R., Experimental Analysis and Measurement of Situation Awareness. 1995, EmbryRiddle: Aeronautical University Press, Daytona Beach, FL.
23. Gasser, T., Westhoff, D., BASt-study: Definitions of Automation and Legal Issues in Germany. 2012, TRB Road Vehicle Automation Workshop, Irvine, CA, USA Retrieved from http://onlinepubs.trb.org/onlinepubs/conferences/2012/Automation/presentations/Gasser.pdf.
24. Gibson, M., Lee, J., Venkatraman, V., Price, M., Lewis, J., Montgomery, O., Foley, J., Situation awareness, scenarios, and secondary tasks: measuring driver performance and safety margins in highly automated vehicles. SAE Int. J. Passeng. Cars-Electronic Electr. Syst. 9 (2016), 237–242.
25. Gold, C., Damböck, D., Lorenz, L., Bengler, K., “Take over!” How long does it take to get the driver back into the loop?. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 57 (2013), 1938–1942.
26. Gold, C., Körber, M., Lechner, D., Bengler, K., Taking over control from highly automated vehicles in complex traffic situations: the role of traffic density. Hum. Factors J. Hum. Factors Ergonomics Soc. 58 (2016), 642–652.
27. Gottsdanker, R., Frick, J.W., Lockard, R.B., Identifying the acceleration of visual targets. Br. J. Psychol. 52 (1961), 31–42.
28. Gugerty, L.J., Situation awareness during driving: explicit and implicit knowledge in dynamic spatial memory. J. Exp. Psychol. Appl. 3 (1997), 42–66.
29. Gugerty, L., Evidence from a partial report task for forgetting in dynamic spatial memory. Hum. Factors J. Hum. Factors Ergonomics Soc. 40 (1998), 498–508.
30. Gugerty, L.J., Tirre, W.C., Individual difference in situation awareness. Endsley, M.R., Garland, D.J., (eds.) Situation Awareness Analysis and Measurement, 2000, Lawrence Erlbaum Associates, Mahwah, NJ, 249–276.
31. Gugerty, L., Situation awareness in driving. Lee, J., Rizzo, M., Fischer, D., Caird, J., (eds.) Handbook for Driving Simulation in Engineering, Medicine and Psychology, 2011, CRC Press, Boca Roca, FL (pp. 19–265–19-272).
32. Gutzwiller, R.S., Clegg, B.A., The role of working memory in levels of situation awareness. J. Cognitive Eng. Decis. Mak. 7 (2013), 141–154.
33. Henderson, J.M., Human gaze control during real-world scene perception. Trends Cognitive Sci. 7 (2003), 498–504.
34. Horswill, M.S., McKenna, F.P., Drivers' hazard perception ability: situation awareness on the road. Banbury, S., Tremblay, S., (eds.) A Cognitive Approach to Situation Awareness, 2004, Ashgate, Aldershot, United Kingdom, 155–175.
35. Hosking, S.G., Liu, C.C., Bayly, M., The visual search patterns and hazard responses of experienced and inexperienced motorcycle riders. Accid. Anal. Prev. 42 (2010), 196–202.
36. Huebner, G.M., Gegenfurtner, K.R., Effects of viewing time, fixations, and viewing strategies on visual memory for briefly presented natural objects. Q. J. Exp. Psychol. 63 (2010), 1398–1413.
37. Irwin, D.E., Zelinsky, G.J., Eye movements and scene perception: memory for things observed. Percept. Psychophys. 64 (2002), 882–895.
38. Itti, L., Koch, C., Computational modelling of visual attention. Nat. Rev. Neurosci. 2 (2001), 194–203.
39. Jackson, L., Chapman, P., Crundall, D., What happens next? Predicting other road users' behaviour as a function of driving experience and processing time. Ergonomics 52 (2009), 154–164.
40. Kerschbaum, P., Lorenz, L., & Bengler, K. (2015). A transforming steering wheel for highly automated cars. Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV) (pp. 1287–1292). Seoul.
41. Körber, M., Weißgerber, T., Kalb, L., Blaschke, C., Farid, M., Prediction of take-over time in highly automated driving by two psychometric tests. Dyna 82 (2015), 195–201.
42. Körber, M., Gold, C., Lechner, D., Bengler, K., The influence of age on the take-over of vehicle control in highly automated driving. Transp. Res. Part F Traffic Psychol. Behav. 39 (2016), 19–32.
43. Kyriakidis, M., Happee, R., De Winter, J.C.F., Public opinion on automated driving: results of an international questionnaire among 5000 respondents. Transp. Res. Part F Traffic Psychol. Behav. 32 (2015), 127–140.
44. Loft, S., Morrell, D.B., Huf, S., Using the situation present assessment method to measure situation awareness in simulated submarine track management. Int. J. Hum. Factors Ergonomics 2 (2013), 33–48.
45. Loft, S., Bowden, V., Braithwaite, J., Morrell, D.B., Huf, S., Durso, F.T., Situation awareness measures for simulated submarine track management. Hum. Factors J. Hum. Factors Ergonomics Soc. 57 (2015), 298–310.
46. Lu, Z., Happee, R., Cabrall, C.D.D., Kyriakidis, M., De Winter, J.C.F., Human factors of transitions in automated driving: A general framework and literature survey. Transp. Res. Part F Traffic Psychol. Behav. 43 (2016), 183–198.
47. Mackenzie, A.K., Harris, J.M., Eye movements and hazard perception in active and passive driving. Vis. Cogn. 23 (2015), 736–757.
48. Martelaro, N., Sirkin, D., & Ju, W. (2015). DAZE: a real-time situation awareness measurement tool for driving. Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 158–163.
49. Melcher, V., Rauh, S., Diederichs, F., Bauer, W., Take-over requests for automated driving. Procedia Manuf. 3 (2015), 2867–2873.
50. Merat, N., Jamson, A.H., Lai, F.C., Daly, M., Carsten, O.M., Transition to manual: driver behaviour when resuming control from a highly automated vehicle. Transp. Res. Part F Traffic Psychol. Behav. 27 (2014), 274–282.
51. Mok, B., Johns, M., Lee, K. J., Miller, D., Sirkin, D., Ive, P., & Ju, W. (2015). Emergency, automation off: Unstructured transition timing for distracted drivers of automated vehicles. Proceedings of the 2015 IEEE 18th International Conference on Intelligent Transportation Systems.
52. Moore, K., Gugerty, L., Development of a novel measure of situation awareness: the case for eye movement analysis. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 54 (2010), 1650–1654.
53. Neubauer, C., Matthews, G., Saxby, D., Fatigue in the automated vehicle do games and conversation distract or energize the driver?. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 58 (2014), 2053–2057.
54. Norman, D.A., The human side of automation. Road Vehicle Automation, vol. 2, 2015, Springer International Publishing, 73–79.
55. Oestmann, J.W., Greene, R., Kushner, D.C., Bourgouin, P.M., Linetsky, L., Llewellyn, H.J., Lung lesions: correlation between viewing time and detection. Radiology 166 (1988), 451–453.
56. Over, E.A.B., Hooge, I.T.C., Vlaskamp, B.N.S., Erkelens, C.J., Coarse-to-fine eye movement strategy in visual search. Vis. Res. 47 (2007), 2272–2280.
57. Pierce, R.S., The effect of SPAM administration during a dynamic simulation. Hum. Factors J. Hum. Factors Ergonomics Soc. 54 (2012), 838–848.
58. Poulin, C., Stanton, N.A., Cebon, D., Epple, W., Responses to: autonomous vehicles. Ingenia 62 (2015), 8–11.
59. Pylyshyn, Z.W., Storm, R.W., Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spat. Vis. 3 (1988), 179–197.
60. Rayner, K., Eye movements and attention in reading, scene perception, and visual search. Q. J. Exp. Psychol. 62 (2009), 1457–1506.
61. SAE International, Taxonomy and Definitions for Terms Related to On-road Motor Vehicle Automated Driving Systems (Standard No. J3016). 2014, SAE International Retrieved from http://standards.sae.org/j3016_201401/.
62. Salmon, P., Stanton, N., Walker, G., Green, D., Situation awareness measurement: a review of applicability for C4i environments. Appl. Ergon. 37 (2006), 225–238.
63. Salmon, P.M., Stanton, N.A., Walker, G.H., Jenkins, D., Ladva, D., Rafferty, L., Young, M., Measuring situation awareness in complex systems: comparison of measures study. Int. J. Industrial Ergonomics 39 (2009), 490–500.
64. Salthouse, T.A., When does age-related cognitive decline begin?. Neurobiol. Aging 30 (2009), 507–514.
65. Samuel, S., Borowsky, A., Zilberstein, S., Fisher, D.L., Minimum Time to Situation Awareness in Scenarios Involving Transfer of Control from Automated Driving Suite. Transportion Research Board 95th Annual Meeting, 16–3788, 2016.
66. Schmidt, J.S., Stolzmann, W., Karrer-Gauß, K., Experimental Evaluation of Different Request Intervals for a Driver Alertness Device for Conditionally Automated Driving with Induced Drowsiness. Automatisierungs-, Assistenzsysteme und eingebettete Systeme für Transportmittel, 2016.
67. Schömig, N., Hargutt, V., Neukum, A., Petermann-Stock, I., Othersen, I., The interaction between highly automated driving and the development of drowsiness. Procedia Manuf. 3 (2015), 6652–6659.
68. Stanton, N.A., Salmon, P.M., Walker, G.H., Let the reader decide: a paradigm shift for situation awareness in socio-technical systems. J. Cognitive Eng. Decis. Mak. 9 (2015), 44–50.
69. Tass International, PreScan: Simulation of ADAS & Active Safety. Retrieved from, 2015 https://www.tassinternational.com/prescan.
70. Thorpe, S., Fize, D., Marlot, C., Speed of processing in the human visual system. Nature 381 (1996), 520–522.
71. Underwood, G., Chapman, P., Bowden, K., Crundall, D., Visual search while driving: skill and awareness during inspection of the scene. Transp. Res. Part F Traffic Psychol. Behav. 5 (2002), 87–97.
72. Underwood, G., Crundall, D., Chapman, P., Driving simulator validation with hazard perception. Transp. Res. Part F Traffic Psychol. Behav. 14 (2011), 435–446.
73. Underwood, G., Ngai, A., Underwood, J., Driving experience and situation awareness in hazard detection. Saf. Sci. 56 (2013), 29–35.
74. Underwood, S.E., Automated Vehicles Forecast Vehicle Symposium Opinion Survey. Presentation at the 2014 Automated Vehicles Symposium, San Francisco, CA, 2014.
75. Unema, P.J., Pannasch, S., Joos, M., Velichkovsky, B.M., Time course of information processing during scene perception: the relationship between saccade amplitude and fixation duration. Vis. Cogn. 12 (2005), 473–494.
76. U.S. Senate Committee on Commerce, Science, & Transportation, Hands off: the Future of Self-driving Cars (Testimony of M. L. Cummings). 2016, March 15.
77. Van den Beukel, A.P., Van der Voort, M.C., The Influence of Time-criticality on Situation Awareness when Retrieving Human Control after Automated Driving. 16th International IEEE Annual Conference on Intelligent Transportation System, The Hague, the Netherlands, 2013, 2000–2005.
78. Velichkovsky, B.M., Rothert, A., Kopf, M., Dornhöfer, S.M., Joos, M., Towards an express-diagnostics for level of processing and hazard perception. Transp. Res. Part F Traffic Psychol. Behav. 5 (2002), 145–156.
79. Wai, J., Lubinski, D., Benbow, C.P., Spatial ability for STEM domains: aligning over 50 years of cumulative psychological knowledge solidifies its importance. J. Educ. Psychol. 101 (2009), 817–835.
80. Wright, T., Samuel, S., Borowsky, A., Zilberstein, S., Fisher, D.L., Experienced drivers are quicker to achieve situation awareness than inexperienced drivers in situations of transfer of control within a Level 3 autonomous environment. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 60 (2016), 270–273.
81. Zeeb, K., Buchner, A., Schrauf, M., Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. Accid. Anal. Prev. 92 (2016), 230–239.