A meta-analysis of in-vehicle and nomadic voice-recognition system interaction and driving performance

Accident Analysis and Prevention

Volumn 106, Issue , 2017, Pages 31-43

  Simmons, Sarah M ^a   Caird, Jeff K ^b   Steel, Piers ^b  

^a UNIVERSITY OF CALGARY   (Canada)

^b UNIVERSITY OF CALGARY   (Canada)

Author keywords

Driver distraction; Driving performance; Meta analysis; Speech to text; Voice recognition

Indexed keywords

AUTOMOBILE DRIVERS; CHARACTER RECOGNITION; SPEECH RECOGNITION; VEHICLES;

DEPENDENT VARIABLES; DRIVER DISTRACTIONS; DRIVING PERFORMANCE; IN-VEHICLE SYSTEMS; META ANALYSIS; MOBILE PHONE APPLICATIONS; MULTIPLE SOLUTIONS; VOICE-RECOGNITION SYSTEMS;

CELLULAR TELEPHONE SYSTEMS;

AUTOMATIC SPEECH RECOGNITION; DISTRACTED DRIVING; FEMALE; HUMAN; MALE; META ANALYSIS; PHYSIOLOGY; PREVENTION AND CONTROL; REACTION TIME; SMARTPHONE; STATISTICS AND NUMERICAL DATA; TRAFFIC ACCIDENT; UTILIZATION;

ACCIDENTS, TRAFFIC; DISTRACTED DRIVING; FEMALE; HUMANS; MALE; REACTION TIME; SMARTPHONE; SPEECH RECOGNITION SOFTWARE;

EID: 85019849253     PISSN: 00014575     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.aap.2017.05.013     Document Type: Article

References (88)

1. Angell, L., Auflick, J., Austria, P.A., Kochhar, D., Tijerina, L., Biever, W., … Kiger, S., Driver Workload Metrics Project: Task 2 Final Report (Report No. DOT HS 810 635)., 2006, National Highway Traffic Safety Administration, Washington, DC.
2. Atchley, P., Atwood, S., Boulton, A., The choice of text and drive in younger drivers: behavior may shape attitude. Accident Anal. Prevent. 43 (2011), 134–142.
3. Barón, A., Green, P., Safety and usability of speech interfaces for in-vehicle task while driving: A brief literature rewiew (Tech. Rep. No. UMTRI-2006-5). 2006, Univesity of Michigan Transportation Research Institute, Ann Arbor, MI.
4. Beckers, N., Schreiner, S., Bertrand, P., Reimer, B., Mehler, B., Munger, D., Dobres, J., Comparing the demands of destination entry using Google Glass and the Samsung Galaxy S4. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58 (2014), 2156–2160, 10.1177/1541931214581453.
5. Borenstein, M., Hedges, L.V., Higgins, J.P.T., Rothstein, H.R., Introduction to Meta-Analysis. 2009, Wiley, West Sussex, U.K.
6. Bruyas, M.-P., Brusque, C., Debailleux, S., Duraz, M., Aillerie, I., Does making a conversation asynchronous reduce the negative impact of phone call on driving?. Transport. Res. Part F: Traffic Psychol. Behav. 12:1 (2009), 12–20, 10.1016/j.trf.2008.06.002.
7. Caird, J.K., Horrey, W., A review of novice and teen driver distraction. Fisher, D.L., Caird, J.K., Horrey, W.J., Trick, L., (eds.) The Handbook of Teen and Novice Drivers: Research, Practice, Policy and Directions, 2017, CRC Press, Boca Raton, FL.
8. Caird, J.K., Johnston, K., Willness, C., Asbridge, M., Steel, P., A meta-analysis of the effects of texting on driving. Accident Anal. Prevent. 71 (2014), 311–318.
9. Caird, J.K., Willness, C.R., Steel, P., Scialfa, C., A meta-analysis of the effects of cell phones on driver performance. Accident Anal. Prevent. 40:4 (2008), 1282–1293, 10.1016/j.aap.2008.01.009.
10. Canadian Council on Motor Transport Administrators (CCMTA), Canadian fines and demerit points for: Hand-held cell phone or electronic communication device use - August 2013. 2013 Retrieved September 27, 2015, from http://ccmta.ca/images/publications/pdf//Canadian-fines-and-demerit-points-cell-phones-ensligh.pdf.
11. Carter, C., Graham, R., Experimental comparison of manual and voice controls for the operation of in-vehicle systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 58, 2000, 2156–2160, 10.1177/154193120004402016.
12. Cochrane Collaboration, 16.1.3.1 Imputing standard deviations. Higgins, J.P.T., Green, S., (eds.) Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011], 2011 Retrieved from www.cochrane-handbook.org.
13. Cochrane Collaboration, 7.7.3.2 Obtaining standard deviations from standard errors and confidence intervals for group means. Higgins, J.P.T., Green, S., (eds.) Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011], 2011 Retrieved from www.cochrane-handbook.org.
14. Cochrane Collaboration, 9.6.4 Meta-regression. Higgins, J.P.T., Green, S., (eds.) Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011], 2011 Retrieved from www.cochrane-handbook.org.
15. Cohen, J., A power primer. Psychol. Bull. 112:1 (1992), 155–159, 10.1037/0033-2909.112.1.155.
16. Cooper, H., Hedges, L.V., Valentine, J.C., (eds.) The Handbook of Research Synthesis and Meta-Analysis, 2nd ed., 2009, Russel Sage Foundation, New York, New York, USA.
17. Cooper, J.M., Ingebretsen, H., Strayer, D.L., Mental Workload of Common Voice-Based Vehicle Interactions across Six Different Vehicle Systems. 2014, AAA Foundation for Traffic Safety, Washington, DC.
18. Cuřín, J., Labský, M., Macek, T., Kleindienst, J., Young, H., Thyme-Gobbel, A., … König, L., Dictating and editing short texts while driving. Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘11, 2011, ACM Press, New York, New York, USA, 13, 10.1145/2381416.2381418.
19. Dingus, T.A., Guo, F., Lee, S., Antin, J.F., Perez, M., Buchman-King, M., Hankey, J., Driver crash risk factors and prevalence evaluation using naturalistic driving data. Proc. Natl. Acad. Sci. 113:10 (2016), 60–68.
20. Fitch, G.M., Soccolich, S.A., Guo, F., McClafferty, J., Fang, Y., Olson, R.L., Perez, M.A., Hanowski, R.J., Hankey, J.M., Dingus, T.A., The impact of hand-held and hands-free cell phone use on driving performance and safety-critical event risk (report no. DOT HS 811 757)., 2013, National Highway Traffic Safety Administration, Washington, DC.
21. Governors Highway Safety Association (GHSA), Cell phone and texting laws. 2015 Retrieved July 9, 2015, from http://www.ghsa.org/html/stateinfo/laws/cellphone_laws.html.
22. Graham, R., Carter, C., Voice dialling can reduce the interference between concurrent tasks of driving and phoning. Int. J. Vehicle Design, 26(1), 2001, 30, 10.1504/IJVD.2001.001925.
23. Green, P., Where do drivers look while driving (and for how long)?. Smiley, A., (eds.) Human Factors in Traffic Safety, 3rd ed., 2016, Lawyers and Judges Publishing, Tucson, AZ, 57–86.
24. Greenberg, J., Tijerina, L., Curry, R., Artz, B., Cathey, L., Kochhar, D., … Grant, P., Driver distraction: evaluation with event detection paradigm. Transport. Res. Rec. 1843 (2003), 1–9, 10.3141/1843-01.
25. Hamilton, B.C., Arnold, L.S., Tefft, B.C., Distracted driving and perceptions of hands-free technologies: Findings from the 2013 Traffic Safety Culture Index. 2013, AAA Foundation for Traffic Safety, Washington, DC.
26. Harbluk, J.L., Burns, P.C., Hernandez, S., Tam, J., Glazduri, V., Detection response tasks: Using remote, headmounted and tactile signals to assess cognitive demand while driving. Proceedings of the Seventh International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, 2013, 78–84.
27. Harbluk, J.L., Burns, P.C., Lochner, M., Trbovich, P.L., Using the Lane Change Test (LCT) to assess distraction: Tests of visual-manual and speech-based operation of navigation system interfaces. Proceedings of the 4th International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, 2007, 16–22.
28. He, J., Chaparro, A., Nguyen, B., Burge, R.J., Crandall, J., Chaparro, B., … Cao, S., Texting while driving: is speech-based text entry less risky than handheld text entry?. Accident Anal. Prevent. 72 (2014), 287–295, 10.1016/j.aap.2014.07.014.
29. TM: promising but not distraction-free. Accident Anal. Prevent. 81 (2015), 218–229, 10.1016/j.aap.2015.03.033.
30. Horrey, W.J., Wickens, C.D., The impact of cell phone conversation on driving using meta-analytic techniques. Human Factors 48:1 (2006), 196–205.
31. Itoh, K., Miki, Y., Yoshitsugu, N., Kubo, N., Mashimo, S., Evaluation of a Voice-Activated System Using a Driving Simulator (SAE Technical Paper 2004-01-0232). 2004, SAE Technical Paper 2004-01-0232, 10.4271/2004-01-0232.
32. Klein, M., 26 Actually Useful Things You Can Do with Siri. 2015 Retrieved December 9, 2015, from http://www.howtogeek.com/229308/26-actually-useful-things-you-can-do-with-siri/.
33. Klauer, S.G., Guo, F., Simons-Morton, B.G., Ouimet, M.C., Lee, S.E., Dingus, T.A., Distracted driving and risk of road crashes among novice and experienced drivers. N. Engl. J. Med. 370 (2014), 54–59.
34. Lakens, D., Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Front. Psychol. 4 (2013), 1–12, 10.3389/fpsyg.2013.00863.
35. Land, M.F., Lee, D.N., Where do we look when we steer?. Nature 369 (1994), 742–744.
36. Lee, J.D., Caven, B., Haake, S., Brown, T.L., Speech-based interaction with in-vehicle computers: the effect of speech-based e-mail on drivers’ attention to the roadway. Human Factors 43:4 (2001), 631–640, 10.1518/001872001775870340.
37. Loftus, G.R., Masson, M.E.J., Using confidence intervals in within-subject designs. Psychonomic Bull. Rev. 1:4 (1994), 476–490, 10.3758/BF03210951.
38. Maciej, J., Vollrath, M., Comparison of manual vs. speech-based interaction with in-vehicle information systems. Accident Anal. Prevent. 41:5 (2009), 924–930, 10.1016/j.aap.2009.05.007.
39. McCallum, M.C., Campbell, J.L., Richman, J.B., Brown, J.L., Wiese, E., Speech recognition and in-vehicle telematics devices: potential reductions in driver distraction. Int. J. Speech Technol. 7:1 (2004), 25–33, 10.1023/B:IJST.0000004804.85334.35.
40. McCartt, A.T., Kidd, D.G., Teoh, E.R., Driver cellphone and texting bans in the United States: evidence of effectiveness. Ann. Adv. Automotive Med. 58 (2014), 99–114.
41. McWilliams, T., Reimer, B., Mehler, B., Dobres, J., Coughlin, J.F., Effects of age and smartphone experience on driver behavior during address entry. Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘15, 2015, ACM Press, New York, New York, USA, 150–153, 10.1145/2799250.2799275.
42. Mehler, B., Reimer, B., Dobres, J., Coughlin, J.F., Assessing the Demands of Voice Based In-Vehicle Interfaces - Phase II Experiment 3-2015 Toyota Corolla (2015b) (MIT AgeLab Technical Report 2015-14)., 2015, Massachusetts Institute of Technology, Cambridge, MA.
43. Mehler, B., Reimer, B., Dobres, J., McAnulty, H., Coughlin, J.F., Assessing the Demands of Voice-Based In-Vehicle Interfaces - Phase II Experiment 1-2014 Chevrolet Impala (2014b) (MIT AgeLab Technical Report 2015-6A)., 2015, Massachusetts Institute of Technology, Cambridge, MA.
44. Mehler, B., Reimer, B., Dobres, J., McAnulty, H., Mehler, A., Munger, D., Coughlin, J.F., Further Evaluation of the Effects of a Production Level “Voice-Command” Interface on Driver Behavior: Replication and a Consideration of the Significance of Training Method. 2014, Massachusetts Institute of Technology, Cambridge, MA.
45. Mehler, B., Reimer, B., McAnulty, H., Dobres, J., Lee, J., Coughlin, J.F., Assessing the Demands of Voice Based In-Vehicle Interfaces - Phase II Experiment 2-2014 Mercedes CLA (2014t) (MIT AgeLab Technical Report 2015-8)., 2015, Massachusetts Institute of Technology, Cambridge, MA.
46. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med., 6(7), 2009, e1000097, 10.1371/journal.pmed.1000097.
47. Munger, D., Mehler, B., Reimer, B., Dobres, J., Pettinato, A., Pugh, B., Coughlin, J.F., A simulation study examining smartphone destination entry while driving. Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘14, 2014, ACM Press, New York, New York, USA, 1–5, 10.1145/2667317.2667349.
48. National Highway Traffic Safety Association, Visual-manual NHTSA driver distraction guidelines for in-vehicle electronic devices. Docket No. NHTSA-2010-0053. 2012, Department of Transportation, Washington, D.C.
49. National Highway Traffic Safety Association, Visual-manual NHTSA driver distraction guidelines for portable and aftermarket electronic devices. Docket No. NHTSA-2013-0137. 2014, Department of Transportation, Washington, D.C.
50. National Highway Traffic Safety Association (NHTSA), Traffic Safety Facts Research Note: Distracted Driving 2013. 2015, NHTSA, Washington, DC.
51. Neurauter, M., Hankey, J., Schalk, T., Wallace, G., Outbound texting. Transport. Res. Rec. 2321:1 (2012), 23–30, 10.3141/2321-04.
52. Pickrell, T., KC, S., Driver electronic device use in 2014 (Traffic Safety Factos: Research Note DOT HS 812 197). Washington, DC. 2015.
53. Ranney, T.A., Harbluk, J.L., Ian Noy, Y., Effects of voice technology on test track driving performance: implications for driver distraction. Human Factors 47:2 (2005), 439–454, 10.1518/0018720054679515.
54. Reimer, B., Mehler, B., Coughlin, J.F., Roy, N., Dusek, J.A., The impact of a naturalistic hands-free cellular phone task on heart rate and simulated driving performance in two age groups. Transport. Res. Part F: Traffic Psychol. Behav. 14:1 (2011), 13–25, 10.1016/j.trf.2010.09.002.
55. Reimer, B., Mehler, B., D'Ambrosio, L.A., Fried, R., The impact of distractions on young adult drivers with attention deficit hyperactivity disorder (ADHD). Accident Anal. Prevent. 42:3 (2010), 842–851, 10.1016/j.aap.2009.06.021.
56. Reimer, B., Mehler, B., Dobres, J., Coughlin, J.F., The Effects of a Production Level “Voice-Command” Interface on Driver Behavior: Reported Workload, Physiology, Visual Attention, and Driving Performance (Technical Report 2013-17A)., 2013, Massachusetts Institute of Technology, Cambridge, MA https://doi.org/2013-18A.
57. Reimer, B., Mehler, B., Dobres, J., Coughlin, J.F., Assessing the Demands of Voice Based In-Vehicle Interfaces - Phase II Experiment 4 - An Exploratory Study of Driver Behavior With and Without Assistive Cruise Control (ACC) (2015a) (MIT AgeLab Technical Report 2015-15)., 2015, Massachusetts Institute of Technology, Cambridge, MA.
58. Reimer, B., Mehler, B., Reagan, I., Kidd, D., Dobres, J., Multi-modal demands of a smartphone used to place calls and enter addresses during highway driving relative to two embedded systems. Ergonomics, 2016, 1–21, 10.1080/00140139.2016.1154189.
59. Rosenthal, R., DiMatteo, M.R., Meta-analysis: recent developments in quantitative methods for literature reviews. Annu. Rev. Psychol. 52 (2001), 59–82.
60. International, S.A.E., Surface Vehicle Recommended Practice: Operational Definitions of Driving Performance Measures and Statistics. Warrendale, PA. 2015.
61. Salvucci, D., Predicting the effects of in-car interface use on driver performance: an integrated model approach. Int. J. Human-Comput. Stud. 55:1 (2001), 85–107, 10.1006/ijhc.2001.0472.
62. Salvucci, D.D., Macuga, K.L., Predicting the effects of cellular-phone dialing on driver performance. Cognit. Syst. Res. 3:1 (2002), 95–102, 10.1016/S1389-0417(01)00048-1.
63. Schmidt, F., Hunter, J., (eds.) Methods of Meta-Analysis: Correcting Error and Bias in Research Findings, 3rd ed., 2014, Sage Publications, Inc, Thousand Oaks, CA.
64. Schreiner, C., Blanco, M., Hankey, J.M., Investigating the effect of performing voice recognition tasks on the detection of forward and peripheral Events. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 48, 2004, 2354–2358, 10.1177/154193120404801932.
65. Schreiner, C.S., The effect of phone interface and dialing method on simulated driving performance and user preference. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 50, 2006, 2359–2363, 10.1177/154193120605002202.
66. Serafin, C., Wen, C., Paelke, G., Green, P., Car phone usability: a human factors laboratory test. Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting, 1993, 220–224.
67. Shutko, J., Mayer, K., Lansoo, E., Tijerina, L., Driver workload effects of cell phone, music player, and text messaging tasks with the Ford SYNC voice interface versus hand-held visual-manual interfaces (Paper No. 2009-01-0786). 2009, Society of Automotive Engineering.
68. Simmons, S., Hicks, A., Caird, J.K., Safety critical events associated with cell phone distraction tasks as measured through naturalistic studies: a systematic review and meta-analysis. Accident Anal. Prevent. 87 (2016), 161–169.
69. Steel, P.D., Kammeyer-Mueller, J.D., Comparing meta-analytic moderator estimation techniques under realistic conditions. J. Appl. Psychol., 87(1), 2002, 96.
70. Strayer, D., Cooper, J.M., Turrill, J., Coleman, J.R., Hopman, R.J., The Smartphone and the Driver's Cognitive Workload: A Comparison of Apple, Google, and Microsoft's Intelligent Personal Assistants. 2015, AAA Foundation for Traffic Safety, Washington, DC.
71. Strayer, D.L., Cooper, J.M., Turrill, J., Coleman, J., Hopman, R.J., Measuring cognitive distraction in the automobile. Cognit. Res.: Principles Implications 1:16 (2016), 1–17, 10.1186/s41235-016-0018-3.
72. Strayer, D.L., Cooper, J.M., Turrill, J., Coleman, J., Medeiros-Ward, N., Biondi, F., Measuring Cognitive Distraction in the Automobile. 2013, AAA Foundation for Traffic Safety, Washington, DC.
73. Strayer, D.L., Cooper, J.M., Turrill, J., Coleman, J., Medeiros-Ward, N., Biondi, F., Measuring Cognitive Distraction in the Automobile III: A Comparison of Ten 2015 In-Vehicle Information Systems. 2015, AAA Foundation for Traffic Safety, Washington, DC.
74. Strayer, D.L., Turrill, J., Coleman, J.R., Ortiz, E.V., Cooper, J.M., Measuring Cognitive Distraction in the Automobile II: Assessing In-Vehicle Voice-Based Interactive Technologies. 2014, AAA Foundation for Traffic Safety, Washington, DC.
75. Sutton, A.J., Publication bias. Cooper, H., Hedges, L.V., Valentine, J.C., (eds.) The Handbook of Research Synthesis and Meta-analysis, 2nd ed., 2009, Russell Sage Foundation, New York, 435–452.
76. Terken, J., Visser, H.-J., Tokmakoff, A., Effects of speech-based vs handheld e-mailing and texting on driving performance and experience. Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘11, 2011, ACM Press, New York, New York, USA, 21, 10.1145/2381416.2381419.
77. Tijerina, L., Driver distraction and road safety. Smiley, A., (eds.) Human Factors in Traffic Safety, 3rd ed., 2016, Lawyers and Judges Publishing, Tuscon, AZ, 219–276.
78. Törnros, J.E.B., Bolling, A.K., Mobile phone use—effects of handheld and handsfree phones on driving performance. Accident Anal. Prevent. 37:5 (2005), 902–909, 10.1016/j.aap.2005.04.007.
79. Truschin, S., Schermann, M., Goswami, S., Krcmar, H., Designing interfaces for multiple-goal environments. ACM Trans. Comput.-Human Interact. 21:1 (2014), 1–24, 10.1145/2544066.
80. Tsimhoni, O., Smith, D., Green, P., Address entry while driving: speech recognition versus a touch-screen keyboard. Human Factors 46:4 (2004), 600–610, 10.1518/hfes.46.4.600.56813.
81. White, C., Caird, J.K., The blind date: the effects of change blindness, passenger conversation and gender on looked-but-failed-to-see (LBFTS) errors. Accident Anal. Prevent. 42 (2010), 1822–1830, 10.1016/j.aap.2010.05.003.
82. Whitener, E.M., Confusion of confidence intervals and credibility intervals in meta-analysis. J. Appl. Psychol. 75 (1990), 315–321.
83. Wickens, C.D., Multiple resources and performance prediction. Theoretical Issues Ergon. Sci. 3:2 (2002), 159–177.
84. Wickens, Multiple resources and mental workload. Human Factors 50:3 (2008), 449–455.
85. Wickens, C.D., Hollands, J.G., Bansbury, S., Parasuraman, R., Engineering Psychology and Human Performance. 4th ed., 2013, Pearson, Montréal.
86. Wilson, F.A., Stimpson, J.P., Trends in fatalities from distracted driving in the United States, 1999 to 2008. Am. J. Public Health 100:11 (2010), 2213–2219, 10.2105/AJPH.2009.187179.
87. World Health Organization (WHO), Global status report on road safety 2015. Geneva, Switzerland., 2015.
88. Yager, C., An Evaluation of the Effectiveness of Voice-To-Text Programs at Reducing Incidences of Distracted Driving (Report 600451-00011-1)., 2013, Texas A&M Transportation Institute, College Station, TX Retrieved from http://swutc.tamu.edu/publications/technicalreports/600451-00011-1.pdf.