Virtual reality tour for first-time users of highly automated cars: Comparing the effects of virtual environments with different levels of interaction fidelity

Applied Ergonomics

Volumn 90, Issue , 2021, Pages

  Ebnali, Mahdi ^a   Lamb, Richard ^a   Fathi, Razieh ^b   Hulme, Kevin ^a  

^a UNIVERSITY AT BUFFALO   (United States)

^b ROCHESTER INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Highly automated driving; Interaction fidelity; Takeover; Training; Trust; Virtual reality (VR)

Indexed keywords

AUTOMATION; AUTOMOBILE DRIVERS; COST EFFECTIVENESS; COST REDUCTION;

AUTOMATED DRIVING; AUTOMATED SYSTEMS; COST-EFFECTIVE SOLUTIONS; DRIVING PERFORMANCE; EFFECTIVE APPROACHES; IMMERSIVE TECHNOLOGIES; INTERACTIVE TRAINING; TRAINING SOLUTIONS;

VIRTUAL REALITY;

ARTICLE; AUTOMATION; HUMAN; TRUST; VIDEORECORDING; VIRTUAL REALITY; CAR; COST BENEFIT ANALYSIS;

AUTOMATION; AUTOMOBILES; COST-BENEFIT ANALYSIS; HUMANS; TRUST; VIRTUAL REALITY;

EID: 85089437261     PISSN: 00036870     EISSN: 18729126     Source Type: Journal    
DOI: 10.1016/j.apergo.2020.103226     Document Type: Article

References (71)

1. Abraham, H., McAnulty, H., Mehler, B., Reimer, B., Case study of today's automotive dealerships: introduction and delivery of advanced driver assistance systems. Transport. Res. Rec. 2660:1 (2017), 7–14.
2. Alshaer, A., Regenbrecht, H., O'Hare, D., Immersion factors affecting perception and behaviour in a virtual reality power wheelchair simulator. Appl. Ergon. 58 (2017), 1–12.
3. Anderson, J.R., Skill acquisition: compilation of weak-method problem situations. Psychol. Rev., 94(2), 1987, 192.
4. Aromaa, S., Väänänen, K., Suitability of virtual prototypes to support human factors/ergonomics evaluation during the design. Appl. Ergon. 56 (2016), 11–18.
5. Banks, V.A., Eriksson, A., O'Donoghue, J., Stanton, N.A., Is partially automated driving a bad idea? Observations from an on-road study. Appl. Ergon. 68 (2018), 138–145.
6. Banks, V.A., Stanton, N., Keep the driver in control: automating automobiles of the future. Appl. Ergon. 53 (2016), 389–395.
7. Beggiato, M., Krems, J.F., behaviour, The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transport. Res. Part F: Traffic Psychology 18 (2013), 47–57.
8. Beggiato, M., Pereira, M., Petzoldt, T., Krems, J., behaviour, Learning and development of trust, acceptance and the mental model of ACC. A longitudinal on-road study. Transport. Res. Part F: Traffic Psychology 35 (2015), 75–84.
9. Bertram, J., Moskaliuk, J., Cress, U., Virtual training: making reality work?. Comput. Hum. Behav. 43 (2015), 284–292.
10. Bhagat, K.K., Liou, W.-K., Chang, C.-Y., A cost-effective interactive 3D virtual reality system applied to military live firing training. Virtual Real. 20:2 (2016), 127–140.
11. Boelhouwer, A., van den Beukel, A.P., van der Voort, M.C., Martens, M., behaviour, Should I take over? Does system knowledge help drivers in making take-over decisions while driving a partially automated car?. Transport. Res. Part F: Traffic Psychology 60 (2019), 669–684.
12. Brandenburg, S., Chuang, L., Behaviour, Take-over requests during highly automated driving: how should they be presented and under what conditions?. Transport. Res. Part F: Traffic Psychology 66 (2019), 214–225.
13. Casner, S.M., Hutchins, E.L., What do we tell the drivers? Toward minimum driver training standards for partially automated cars. Journal of Cognitive Engineering Decision Making 13:2 (2019), 55–66.
14. Coulter, R., Saland, L., Caudell, T., Goldsmith, T.E., Alverson, D., The effect of degree of immersion upon learning performance in virtual reality simulations for medical education. InMedicine Meets Virtual Reality, 15, 2007, 155.
15. Dogan, E., Honnêt, V., Masfrand, S., Guillaume, A., Effects of non-driving-related tasks on takeover performance in different takeover situations in conditionally automated driving. Transport. Res. F Traffic Psychol. Behav. 62 (2019), 494–504.
16. Ebnali, M., R. Fathi, R. Lamb, S. Pourfalatoun and S. Motamedi "Using Augmented Holographic UIs to Communicate Automation Reliability in Partially Automated Driving.".
17. Ebnali, M., Hulme, K., Ebnali-Heidari, A., Mazloumi, A., How does training effect users' attitudes and skills needed for highly automated driving?. Transport. Res. F Traffic Psychol. Behav. 66 (2019), 184–195.
18. Ebnali, M., Kian, C., Ebnali-Heidari, M., Mazloumi, A., User experience in immersive VR-based serious game: an application in highly automated driving training. International Conference on Applied Human Factors and Ergonomics, 2019, Springer.
19. Eriksson, A., Stanton, N.A., Takeover time in highly automated vehicles: noncritical transitions to and from manual control. Hum. Factors 59:4 (2017), 689–705.
20. Fitts, P.M., Perceptual-motor Skill Learning Categories of Human Learning. 1964, Elsevier, 243–285.
21. Forster, Y., Hergeth, S., Naujoks, F., Beggiato, M., Krems, J.F., Keinath, A., Learning to use automation: behavioral changes in interaction with automated driving systems. Transport. Res. F Traffic Psychol. Behav. 62 (2019), 599–614.
22. Georgiou, Y., Kyza, E.A., Relations between student motivation, immersion and learning outcomes in location-based augmented reality settings. Comput. Hum. Behav. 89 (2018), 173–181.
23. Gold, C., Damböck, D., Lorenz, L., Bengler, K., “Take over!” How long does it take to get the driver back into the loop?. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2013, SAGE Publications Sage CA, Los Angeles, CA.
24. Gold, C., Naujoks, F., Radlmayr, J., Bellem, H., Jarosch, O., Testing scenarios for human factors research in level 3 automated vehicles. International Conference on Applied Human Factors and Ergonomics, 2017, Springer.
25. Gurari, N., Baud-Bovy, G., Customization, control, and characterization of a commercial haptic device for high-fidelity rendering of weak forces. J. Neurosci. Methods 235 (2014), 169–180.
26. Hergeth, S., Lorenz, L., Krems, J.F., Prior familiarization with takeover requests affects drivers' takeover performance and automation trust. Hum. Factors 59:3 (2017), 457–470.
27. Hergeth, S., Lorenz, L., Krems, J.F., Toenert, L., Effects of Take-Over Requests and Cultural Background on Automation Trust in Highly Automated Driving. 2015.
28. Holmes, J.G., Trust and the Appraisal Process in Close Relationships. 1991.
29. Jian, J.-Y., Bisantz, A.M., Drury, C.G., Foundations for an empirically determined scale of trust in automated systems. Int. J. Cognit. Ergon. 4:1 (2000), 53–71.
30. Jones, G.R., George, J.M., The experience and evolution of trust: implications for cooperation and teamwork. Acad. Manag. Rev. 23:3 (1998), 531–546.
31. Ke, F., Lee, S., Xu, X., Teaching training in a mixed-reality integrated learning environment. Comput. Hum. Behav. 62 (2016), 212–220.
32. Kennedy, R.S., Lane, N.E., Berbaum, K.S., Lilienthal, M.G., Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3:3 (1993), 203–220.
33. Khastgir, S., Birrell, S., Dhadyalla, G., Jennings, P., Calibrating trust through knowledge: introducing the concept of informed safety for automation in vehicles. Transport. Res. C Emerg. Technol. 96 (2018), 290–303.
34. Körber, M., Baseler, E., Bengler, K., Introduction matters: manipulating trust in automation and reliance in automated driving. Appl. Ergon. 66 (2018), 18–31.
35. Krampell, M., Solís-Marcos, I., Hjälmdahl, M., Driving automation state-of-mind: using training to instigate rapid mental model development. Appl. Ergon., 83, 2020, 102986.
36. Lamb, R., Antonenko, P., Etopio, E., Seccia, A., Comparison of virtual reality and hands on activities in science education via functional near infrared spectroscopy. Comput. Educ. 124 (2018), 14–26.
37. Lamb, R.L., Etopio, E., Virtual reality simulations and writing: a neuroimaging study in science education. J. Sci. Educ. Technol., 2019, 1–11.
38. Lawson, G., Herriotts, P., Malcolm, L., Gabrecht, K., Hermawati, S., The use of virtual reality and physical tools in the development and validation of ease of entry and exit in passenger vehicles. Appl. Ergon. 48 (2015), 240–251.
39. Lee, J.D., See, K.A., Trust in automation: designing for appropriate reliance. Hum. Factors 46:1 (2004), 50–80.
40. Lu, Z., Coster, X., de Winter, J., How much time do drivers need to obtain situation awareness? A laboratory-based study of automated driving. Appl. Ergon. 60 (2017), 293–304.
41. Makransky, G., Petersen, G.B., Investigating the process of learning with desktop virtual reality: a structural equation modeling approach. Comput. Educ. 134 (2019), 15–30.
42. Makransky, G., Terkildsen, T.S., Mayer, R.E., Adding Immersive Virtual Reality to a Science Lab Simulation Causes More Presence but Less Learning. 2017, Learning & Instruction.
43. McGloin, R., Farrar, K.M., Krcmar, M., The impact of controller naturalness on spatial presence, gamer enjoyment, and perceived realism in a tennis simulation video game. Presence Teleoperators Virtual Environ. 20:4 (2011), 309–324.
44. McMahan, R.P., Bowman, D.A., Zielinski, D.J., Brady, R.B., Evaluating display fidelity and interaction fidelity in a virtual reality game. IEEE Trans. Visual. Comput. Graph. 18:4 (2012), 626–633.
45. Melcher, V., Rauh, S., Diederichs, F., Widlroither, H., Bauer, W., Take-over requests for automated driving. Procedia Manufacturing 3 (2015), 2867–2873.
46. Nabiyouni, M., Saktheeswaran, A., Bowman, D.A., Karanth, A., Comparing the performance of natural, semi-natural, and non-natural locomotion techniques in virtual reality. 2015 IEEE Symposium on 3D User Interfaces (3DUI), IEEE, 2015.
47. Narasimha, S., Dixon, E., Bertrand, J.W., Madathil, K.C., An empirical study to investigate the efficacy of collaborative immersive virtual reality systems for designing information architecture of software systems. Appl. Ergon. 80 (2019), 175–186.
48. NHTSA, P.F.A.V., Accelerating the Next Revolution in Roadway Safety. 2016, NHTSA, US Dept, NHTSA.
49. Noble, A.M., Klauer, S.G., Doerzaph, Z.R., Manser, M.P., Driver training for automated vehicle technology–knowledge, behaviors, and perceived familiarity. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2019, SAGE Publications Sage CA, Los Angeles, CA.
50. Nowakowski, C., Shladover, S.E., Chan, C.-Y., Tan, H.-S., Development of California regulations to govern testing and operation of automated driving systems. Transport. Res. Rec. 2489:1 (2015), 137–144.
51. Olmos-Raya, E., Ferreira-Cavalcanti, J., Contero, M., Castellanos-Baena, M., Chicci-Giglioli, I., Alcañiz, M., Mobile virtual reality as an educational platform: a pilot study on the impact of immersion and positive emotion induction in the learning process. Eurasia J. Math. Sci. Technol. Educ. 14:6 (2018), 2045–2057.
52. Parong, J., Mayer, R.E., Learning science in immersive virtual reality. J. Educ. Psychol., 110(6), 2018, 785.
53. Payre, W., Cestac, J., Dang, N.-T., Vienne, F., Delhomme, P., Impact of training and in-vehicle task performance on manual control recovery in an automated car. Transportation Research Part F: Traffic Psychology Behaviour, vol. 46, 2017, 216–227.
54. Payre, W., Cestac, J., Delhomme, P., Fully automated driving: impact of trust and practice on manual control recovery. Hum. Factors 58:2 (2016), 229–241.
55. Rajendra, I.M., Sudana, I.M., The influence of interactive multimedia technology to enhance achievement students on practice skills in mechanical technology. J. Phys. Conf., 953(1), 2018 IOP Publishing.
56. Reychav, I., Wu, D., Mobile collaborative learning: the role of individual learning in groups through text and video content delivery in tablets. Comput. Hum. Behav. 50 (2015), 520–534.
57. Sauer, J., Chavaillaz, A., Wastell, D., Experience of automation failures in training: effects on trust, automation bias, complacency and performance. Ergonomics 59:6 (2016), 767–780.
58. Schindler, L.A., Burkholder, G.J., A mixed methods examination of the influence of dimensions of support on training transfer. J. Mix. Methods Res. 10:3 (2016), 292–310.
59. Schmidt, R.A., Young, D.E., Transfer of Movement Control in Motor Skill Learning. Transfer of Learning. 1987, Elsevier, 47–79.
60. Schubert, T., Friedmann, F., Regenbrecht, H., The experience of presence: factor analytic insights. Presence Teleoperators Virtual Environ. 10:3 (2001), 266–281.
61. Seibert, J., Shafer, D.M., Control mapping in virtual reality: effects on spatial presence and controller naturalness. Virtual Real. 22:1 (2018), 79–88.
62. Sportillo, D., Paljic, A., Boukhris, M., Fuchs, P., Ojeda, L., Roussarie, V., An immersive Virtual Reality system for semi-autonomous driving simulation: a comparison between realistic and 6-DoF controller-based interaction. Proceedings of the 9th International Conference on Computer and Automation Engineering, 2017, ACM.
63. Sportillo, D., Paljic, A., Ojeda, L., Get ready for automated driving using Virtual Reality. Accid. Anal. Prev. 118 (2018), 102–113.
64. Sportillo, D., Paljic, A., Ojeda, L., On-road evaluation of autonomous driving training. 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), IEEE, 2019.
65. Sullivan, J.M., Flannagan, M.J., Pradhan, A.K., Bao, S., Literature review of behavioral adaptations to advanced driver assistance systems. 2016.
66. Sun, H.-M., Li, S.-P., Zhu, Y.-Q., Hsiao, B., The effect of user's perceived presence and promotion focus on usability for interacting in virtual environments. Appl. Ergon. 50 (2015), 126–132.
67. Tenhundfeld, N.L., de Visser, E.J., Haring, K.S., Ries, A.J., Finomore, V.S., Tossell, C.C., Calibrating trust in automation through familiarity with the autoparking feature of a Tesla model X. Journal of Cognitive Engineering and Decision Making, 2019 1555343419869083.
68. Vagia, M., Transeth, A.A., Fjerdingen, S.A., A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed?. Appl. Ergon. 53 (2016), 190–202.
69. Viktorová, L., Šucha, M., Learning about advanced driver assistance systems–The case of ACC and FCW in a sample of Czech drivers. Transport. Res. F Traffic Psychol. Behav. 65 (2019), 576–583.
70. Wintersberger, P., Green, P., Riener, A., Am I Driving or Are You or Are We Both? A Taxonomy for Handover and Handback in Automated Driving. 2017.
71. Yu, M., Zhou, R., Wang, H., Zhao, W., An evaluation for VR glasses system user experience: the influence factors of interactive operation and motion sickness. Appl. Ergon. 74 (2019), 206–213.