Predicting perceived visual and cognitive distractions of drivers with multimodal features

IEEE Transactions on Intelligent Transportation Systems

Volumn 16, Issue 1, 2015, Pages 51-65

  Li, Nanxiang ^a   Busso, Carlos ^a  

^a The University of Texas at Dallas   (United States)

Author keywords

Binary classification; driver cognitive distraction; driver visual distraction; human evaluation; regularized regression

Indexed keywords

REGRESSION ANALYSIS;

BINARY CLASSIFICATION; COGNITIVE DISTRACTIONS; DRIVER VISUAL DISTRACTION; HUMAN EVALUATION; REGULARIZED REGRESSION;

BEHAVIORAL RESEARCH;

EID: 84922478095     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2014.2324414     Document Type: Article

References (48)

1. Visual-Manual NHTSA Driver Distraction Guidelines for In-Vehicle Electronic Devices," National Highway Traffic Safety Administration (NHTSA), Department of Transportation (DOT), Washington, DC, USA, Tech. Rep. NHTSA-2010-0053, Apr. 2013.
2. M. Kutila, M. Jokela, G. Markkula, and M. Rue, "Driver distraction detection with a camera vision system," in Proc. IEEE Int. Conf. Image Process. (ICIP), San Antonio, TX, USA, Sep./Oct. 2007, vol. 6, pp. 201-204.
3. Y. Liang, M. Reyes, and J. Lee, "Real-time detection of driver cognitive distraction using support vector machines," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 340-350, Jun. 2007.
4. F. Tango and M. Botta, "Evaluation of distraction in a driver-vehicle-environment framework: An application of different data-mining techniques," in Advances in Data Mining. Applications and Theoretical Aspects, vol. 5633, P. Perner, Ed. Berlin, Germany: Springer-Verlag, 2009, ser. Lecture Notes in Computer Science, pp. 176-190.
5. T. Ersal, H. Fuller, O. Tsimhoni, J. Stein, and H. Fathy, "Model-based analysis and classification of driver distraction under secondary tasks," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 3, pp. 692-701, Sep. 2010.
6. J. Jain and C. Busso, "Analysis of driver behaviors during common tasks using frontal video camera and CAN-Bus information," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), Barcelona, Spain, Jul. 2011.
7. A. Azman, Q. Meng, and E. Edirisinghe, "Non intrusive physiological measurement for driver cognitive distraction detection: Eye and mouth movements," in Proc. Int. Conf. Adv. Comput. Theory Eng. (ICACTE), Chengdu, China, Aug. 2010, vol. 3, pp. V3-595-V3-599.
8. Y. Zhang, Y. Owechko, and J. Zhang, "Driver cognitive workload estimation: A data-driven perspective," in Proc. IEEE Int. Transp. Syst., Washington, DC, USA, Oct. 2004, pp. 642-647.
9. T. Ranney, W. Garrott, and M. Goodman, "NHTSA Driver Distraction Research: Past, Present, and Future," National Highway Traffic Safety Administration,Washington, DC, USA, Tech. Rep. 2001-06-0177, Jun. 2001.
10. P. Angkititrakul, M. Petracca, A. Sathyanarayana, and J. Hansen, "UTDrive: Driver behavior and speech interactive systems for in-vehicle environments," in Proc. IEEE Int. Veh. Symp., Istanbul, Turkey, Jun. 2007, pp. 566-569.
11. Y. Peng, L. Boyle, and S. Hallmark, "Driver's lane keeping ability with eyes off road: Insights from a naturalistic study," Accident Anal. & Prevention, vol. 50, pp. 628-634, Jan. 2013.
12. D. Strayer, J. Watson, and F. Drews, "Cognitive distraction while multitasking in the automobile," in The Psychology of Learning and Motivation, vol. 54, B. Ross, Ed. Burlington, MA, USA: Academic Press, Feb. 2011, pp. 29-58.
13. Q. Wu, "An overview of driving distraction measure methods," in Proc. IEEE 10th Int. Conf. Comput.-Aided Ind. Des. & Conceptual Des. (CAID CD), Wenzhou, China, Nov. 2009, pp. 2391-2394.
14. K. Young, M. Regan, and J. Lee, "Measuring the effects of driver distraction: Direct driving performance methods and measures," in Driver Distraction: Theory, Effects, and Mitigation, M. Regan, J. Lee, and K.Young, Eds. Boca Raton, FL, USA: CRC Press, Oct. 2008, pp. 85-105.
15. J. Engström, E. Johansson, and J. Östlund, "Effects of visual and cognitive load in real and simulated motorway driving," Trans. Res. F, Traffic Psychol. Behav., vol. 8, no. 2, pp. 97-120, Mar. 2005.
16. K. M. Bach, M. Jaeger, M. Skov, and N. Thomassen, "Interacting with in-vehicle systems: Understanding, measuring, and evaluating attention," in Proc. 23rd Brit. HCI Group Annu. Conf. People Comput., Celebrating People Technol., Cambridge, U.K., Sep. 2009, pp. 453-462.
17. W. Verwey and H. Veltman, "Detecting short periods of elevated workload: A comparison of nine workload assessment techniques," J. Exp. Psychol., Appl., vol. 2, no. 3, pp. 270-285, Sep. 1996.
18. J. Jain and C. Busso, "Assessment of driver's distraction using perceptual evaluations, self assessments and multimodal feature analysis," in Proc. 5th Biennial Workshop DSP In-Veh. Syst., Kiel, Germany, Sep. 2011.
19. N. Li and C. Busso, "Using perceptual evaluation to quantify cognitive and visual driver distractions," in Smart Mobile In-Veh. Syst.-Next Generation Advancements, G. Schmidt, H. Abut, K. Takeda, and J. H. L. Hansen, Eds. New York, NY, USA: Springer-Verlag, Jan. 2014, pp. 183-207.
20. W. Piechulla, C. Mayser, H. Gehrke, and W. König, "Reducing drivers' mental workload by means of an adaptive man-machine interface," Transp. Res. F, Traffic Psychol. Behav., vol. 6, no. 4, pp. 233-248, Dec. 2003.
21. C. Busso and J. Jain, "Advances in multimodal tracking of driver distraction," in Digital Signal Processing for In-Vehicle Systems and Safety, J. Hansen, P. Boyraz, K. Takeda, and H. Abut, Eds. New York, NY, USA: Springer-Verlag, Dec. 2011, pp. 253-270.
22. A. Sathyanarayana, S. Nageswaren, H. Ghasemzadeh, R. Jafari, and J. Hansen, "Body sensor networks for driver distraction identification," in Proc. IEEE Int. Conf. Veh. Electron. Safety (ICVES), Columbus, OH, USA, Sep. 2008, pp. 120-125.
23. D. Chiang, A. Brooks, and D. Weir, "On the highway measures of driver glance behavior with an example automobile navigation system," Appl. Ergonom., vol. 35, no. 3, pp. 215-223, May 2004.
24. C. Patten, A. Kircher, J. Östlund, L. Nilsson, and O. Svenson, "Driver experience and cognitive workload in different traffic environments," Accident Anal. Prevent., vol. 38, no. 5, pp. 887-894, Sep. 2006.
25. T. Lansdown, N. Brook-Carter, and T. Kersloot, "Distraction from multiple in-vehicle secondary tasks: Vehicle performance and mental workload implications," Ergonomics, vol. 47, no. 1, pp. 91-104, Jan. 2004.
26. H. Alm and L. Nilsson, "The effects of a mobile telephone task on driver behavior in a car following situation," Accident Anal. Prevent., vol. 27, no. 5, pp. 707-715, Oct. 1995.
27. W. Tseng, H. Nguyen, J. Liebowitz, and W. Agresti, "Distractions and motor vehicle accidents: Data mining application on fatality analysis reporting system (FARS) data files," Ind. Manag. Data Syst., vol. 105, no. 9, pp. 1188-1205, 2005.
28. F. Tango, L. Minin, F. Tesauri, and R. Montanari, "Field tests and machine learning approaches for refining algorithms and correlations of driver's model parameters," Appl. Ergonom., vol. 41, no. 2, pp. 211-224, Mar. 2010.
29. M. Miyaji, M. Danno, H. Kawanaka, and K. Oguri, "Driver's cognitive distraction detection using AdaBoost on pattern recognition basis," in Proc. IEEE Int. Conf. Veh. Electron. Safety (ICVES), Columbus, OH, USA, Sep. 2008, pp. 51-56.
30. J. Lee, M. Reyes, T. Smyser, Y. Liang, and K. Thornburg, "SAfety VEhicles Using Adaptive Interface Technology (Task 5) Final Report: Phase 1," The University of Iowa, Iowa, IA, USA, Tech. Rep., Nov. 2004.
31. N. Li, J. Jain, and C. Busso, "Modeling of driver behavior in real world scenarios using multiple noninvasive sensors," IEEE Trans. Multimedia, vol. 15, no. 5, pp. 1213-1225, Aug. 2013.
32. N. Li and C. Busso, "Analysis of facial features of drivers under cognitive and visual distractions," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), San Jose, CA, USA, Jul. 2013, pp. 1-6.
33. P. Angkititrakul et al., "Getting start with UTDrive: Driver-behavior modeling and assessment of distraction for in-vehicle speech systems," in Interspeech, Antwerp, Belgium, Aug. 2007, pp. 1334-1337.
34. V. Neale, T. Dingus, S. Klauer, J. Sudweeks, and M. Goodman, "An Overview of the 100-Car Naturalistic Study and Findings," National Highway Traffic Safety Administration, Washington, DC, USA, Tech. Rep. 05-0400, pp. 1-10, Jun. 2005.
35. A. Sathyanarayana, P. Boyraz, Z. Purohit, R. Lubag, and J. Hansen, "Driver adaptive and context aware active safety systems using CANbus signals," in Proc. IEEE Int. Veh. Symp. (IV), San Diego, CA, USA, Jun. 2010, pp. 1236-1241.
36. M. Slaney, "An Efficient Implementation of the Patterson-Holdsworth Auditory Filter Bank," Apple Computer, Perception Group, Cupertino, CA, USA, Tech. Rep. 35, 1993.
37. T. Horberry, J. Anderson, M. Regan, T. Triggs, and J. Brown, "Driver distraction: The effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance," Accident Anal. Prevent., vol. 38, no. 1, pp. 185-191, Jan. 2006.
38. K. A. Brookhuis and D. de Waard, "Assessment of drivers' workload: Performance and subjective and physiological indexes," in Stress, Workload, Fatigue, P. Hancock and P. Desmond, Eds. Mahwah, NJ, USA: Lawrence Erlbaum Associates Inc., Nov. 2000, ser. Human Factors in Transportation, pp. 321-333.
39. M. Bartlett et al., "Automatic recognition of facial actions in spontaneous expressions," J. Multimedia, vol. 1, no. 6, pp. 22-35, Sep. 2006.
40. E. Vural et al., "Drowsy driver detection through facial movement analysis," in Human-Comput. Interaction, vol. 4796, M. Lew, N. Sebe, T. Huang, and E. Bakker, Eds. Berlin, Germany: Springer-Verlag, Dec. 2007, ser. Lecture Notes in Computer Science, pp. 6-18.
41. J. Whitehill and J. Movellan, "A discriminative approach to frame-byframe head pose tracking," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog. (FG), Amsterdam, The Netherlands, Sep. 2008, pp. 1-7.
42. P. Ekman and W. Friesen, Facial Action Coding System: A Technique for Measurement of Facial Movement. Palo Alto, CA, USA: Consulting Psychologists Press, 1978.
43. J. McCall and M. Trivedi, "Driver behavior and situation aware brake assistance for intelligent vehicles," Proc. IEEE, vol. 95, no. 2, pp. 374-387, Feb. 2007.
44. P. Caffier, U. Erdmann, and P. Ullsperger, "Experimental evaluation of eye-blink parameters as a drowsiness measure," Eur. J. Appl. Physiol., vol. 89, no. 3/4, pp. 319-325, May 2003.
45. C. VanVoorhis and B. Morgan, "Understanding power and rules of thumb for determining sample sizes," Tuts Quantitative Methods Psychology, vol. 3, no. 2, pp. 43-50, 2007.
46. N. Li and C. Busso, "Driver mirror-checking action detection using multimodal signals," in Proc. 6th Biennial Workshop Digit. Signal Process. In-Veh. Syst., Seoul, Korea, Sep./Oct. 2013, pp. 101-108.
47. C. Seiffert, T. Khoshgoftaar, J. Van Hulse, and A. Napolitano, "RUSBoost: Improving classification performance when training data is skewed," in Proc. Int. Conf. Pattern Recog. (ICPR), Tampa, FL, USA, Dec. 2008, pp. 1-4.
48. E. Hruschka, R. Campello, A. Freitas, and A. De Carvalho, "A survey of evolutionary algorithms for clustering," IEEE Trans. Syst., Man, Cybern., Part C: Appl. Reviews, vol. 39, no. 2, pp. 133-155, Mar. 2009.