Modeling of driver behavior in real world scenarios using multiple noninvasive sensors

IEEE Transactions on Multimedia

Volumn 15, Issue 5, 2013, Pages 1213-1225

  Li, Nanxiang ^a   Jain, Jinesh J ^b,c   Busso, Carlos ^a  

^a The University of Texas at Dallas   (United States)

^b Belkin International Inc   (United States)

^c Belkin International Inc   (United States)

Author keywords

Driver behavior; Gaussian mixture models; Multimodal feature analysis; Subjective evaluation of distraction

Indexed keywords

DRIVER BEHAVIOR; GAUSSIAN MIXTURE MODEL; GAUSSIAN MIXTURE MODEL (GMMS); IN-VEHICLE TECHNOLOGY; MULTI-CLASS CLASSIFIER; MULTIMODAL FEATURE ANALYSIS; NON-INVASIVE SENSORS; SUBJECTIVE EVALUATIONS;

ACCIDENTS; CONTROL SYSTEM SYNTHESIS; NAVIGATION SYSTEMS; REGRESSION ANALYSIS; SENSORS;

BEHAVIORAL RESEARCH;

EID: 84880779022     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2241416     Document Type: Article

References (50)

1. T. Ranney, W. Garrott, and M. Goodman, NHTSA Driver Distraction Research: Past, Present, and Future, National Highway Traffic Safety Administration, 2001, Tech. Rep. Paper No. 2001-06-0177.
2. V. Neale, T. Dingus, S. Klauer, J. Sudweeks, and M. Goodman, An Overview of the 100-Car Naturalistic Study and Findings, National Highway Traffic Safety Administration, 2005, Tech. Rep. Paper No. 05-0400.
3. T. Ranney, Driver Distraction: A Review of the Current State-of-Knowledge, National Highway Traffic Safety Administration, 2008, Tech. Rep. DOT HS 810 787.
4. M. Broy, "Challenges in automotive software engineering," in Proc. 28th Int. Conf. Software Engineering (ICSE 2006), Shanghai, China, May 2006.
5. Y. Dong, Z. Hu, K. Uchimura, and N. Murayama, "Driver inattention monitoring system for intelligent vehicles: A review," in Proc. IEEE Intelligent Vehicles Symp., Xi'an, Shaanxi, China, Jun. 2009, pp. 875-880.
6. M. Kutila, M. Jokela, G. Markkula, and M. Rue, "Driver distraction detection with a camera vision system," in Proc. IEEE Int. Conf. Image Processing (ICIP 2007), San Antonio, TX, USA, Sep. 2007, vol. 6, pp. 201-204.
7. C.-T. Lin, R.-C. Wu, S.-F. Liang, W.-H. Chao, Y.-J. Chen, and T.-P. Jung, "EEG-based drowsiness estimation for safety driving using independent component analysis," IEEE Trans. Circuits Syst. I: Reg. Papers, vol. 52, no. 12, pp. 2726-2738, Dec. 2005. (Pubitemid 43000828)
8. C. Berka, D. Levendowski, M. Lumicao, A. Yau, G. Davis, V. Zivkovic, R. Olmstead, P. Tremoulet, and P. Craven, "EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks," Aviation, Space, Environ. Med., vol. 78, no. 5, pp. 231-244, May 2007.
9. I. Damousis and D. Tzovaras, "Fuzzy fusion of eyelid activity indicators for hypovigilance-related accident prediction," IEEE Trans. Intell. Transport. Syst., vol. 9, no. 3, pp. 491-500, Sep. 2008.
10. Y. Liang, M. Reyes, and J. Lee, "Real-time detection of driver cognitive distraction using support vector machines," IEEE Trans. Intell. Transport. Syst., vol. 8, no. 2, pp. 340-350, Jun. 2007. (Pubitemid 46873214)
11. F. Putze, J.-P. Jarvis, and T. Schultz, "Multimodal recognition of cognitive workload for multitasking in the car," in Proc. Int. Conf. Pattern Recognition (ICPR 2010), Istanbul, Turkey, Aug. 2010.
12. A. Perez, M. Garcia, M. Nieto, J. Pedraza, S. Rodriguez, and J. Zamorano, "Argos: An advanced in-vehicle data recorder on a massively sensorized vehicle for car driver behavior experimentation," IEEE Trans. Intell. Transport. Syst., vol. 11, no. 2, pp. 463-473, Jun. 2010.
13. E. Murphy-Chutorian and M. Trivedi, "Head pose estimation and augmented reality tracking: An integrated system and evaluation for monitoring driver awareness," IEEE Trans. Intell. Transport. Syst., vol. 11, no. 2, pp. 300-311, Jun. 2010.
14. A. Giusti, C. Zocchi, and A. Rovetta, "A noninvasive system for evaluating driver vigilance level examining both physiological and mechanical data," IEEE Trans. Intell. Transport. Syst., vol. 10, no. 1, pp. 127-134, Mar. 2009.
15. P. Angkititrakul, M. Petracca, A. Sathyanarayana, and J. Hansen, "UT Drive: Driver behavior and speech interactive systems for in-vehicle environments," in Proc. IEEE Intelligent Vehicles Symp., Istanbul, Turkey, Jun. 2007, pp. 566-569.
16. T. Ersal, H. Fuller, O. Tsimhoni, J. Stein, and H. Fathy, "Model-based analysis and classification of driver distraction under secondary tasks," IEEE Trans. Intell. Transport. Syst., vol. 11, no. 3, pp. 692-701, Sep. 2010.
17. F. Tango and M. Botta, "Evaluation of distraction in a driver-vehicleenvironment framework: An application of different data-mining techniques," in Advances in Data Mining. Applications and Theoretical Aspects, ser. Lecture Notes in Computer Science, P. Perner, Ed. Berlin, Germany: Springer, 2009, vol. 5633, pp. 176-190.
18. P. Angkititrakul, D. Kwak, S. Choi, J. Kim, A. Phucphan, A. Sathyanarayana, and J. Hansen, "Getting start with UT Drive: Driver-behavior modeling and assessment of distraction for in-vehicle speech systems," in Proc. Interspeech 2007, Antwerp, Belgium, Aug. 2007, pp. 1334-1337.
19. I. Trezise, E. Stoney, B. Bishop, J. Eren, A. Harkness, C. Langdon, and T. Mulder, Inquiry into Driver Distraction: Report of the Road Safety Committee on the Inquiry Into Driver Distraction, Road Safety Committee, Parliament of Victoria, Melbourne, Victoria, Australia, 2006, Tech. Rep. No. 209 Session 2003-2006.
20. T. Rahman, S. Mariooryad, S. Keshavamurthy, G. Liu, J. Hansen, and C. Busso, "Detecting sleepiness by fusing classifiers trained with novel acoustic features," in Proc. 12th Annu. Conf. Int. Speech Communication Association (Interspeech'2011), Florence, Italy, Aug. 2011, pp. 3285-3288.
21. E. Vural, M. Cetin, A. Ercil, G. Littlewort, M. Bartlett, and J. Movellan, "Drowsy driver detection through facial movement analysis," in Human-Computer Interaction, ser. Lecture Notes in Computer Science, M. Lew, N. Sebe, T. Huang, and E. Bakker, Eds. Berlin, Germany: Springer, 2007, vol. 4796, pp. 6-18.
22. E. Vural, M. Bartlett, G. Littlewort, M. Cetin, A. Ercil, and J. Movellan, "Discrimination of moderate and acute drowsiness based on spontaneous facial expressions," in Proc. Int. Conf. Pattern Recognition (ICPR 2010), Istanbul, Turkey, Aug. 2010, pp. 3874-3877.
23. J. Jain and C. Busso, "Analysis of driver behaviors during common tasks using frontal video camera and CAN-Bus information," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME 2011), Barcelona, Spain, Jul. 2011.
24. M. Su, C. Hsiung, and D. Huang, "A simple approach to implementing a system for monitoring driver inattention," in Proc. IEEE Int. Conf. Systems, Man and Cybernetics (SMC 2006), Taipei, Taiwan, Oct. 2006, vol. 1, pp. 429-433.
25. M. Kutila, M. Jokela, T. Mäkinen, J. Viitanen, G. Markkula, and T. Victor, "Driver cognitive distraction detection: Feature estimation and implementation," Proc. Inst. Mech. Engineers, Part D: J. Automobile Eng., vol. 221, no. 9, pp. 1027-1040, Sep. 2007.
26. C. Busso and J. Jain, "Advances in multimodal tracking of driver distraction," in Digital Signal Processing for In-Vehicle Systems and Safety, J. Hansen, P. Boyraz, K. Takeda, and H. Abut, Eds. New York, NY, USA: Springer, 2011, pp. 253-270.
27. L. Bergasa, J. Nuevo, M. Sotelo, R. Barea, and M. Lopez, "Real-time system for monitoring driver vigilance," IEEE Trans. Intell. Transport. Syst., vol. 7, no. 1, pp. 63-77, Mar. 2006.
28. C. Ahlström and K. Kircher, "Review of real-time visual driver distraction detection algorithms," in Proc. Int. Conf. Methods and Techniques in Behavioral Research (MB 2010), Eindhoven, The Netherlands, Aug. 2010, pp. 2:1-2:4.
29. K. M. Bach, M. Jaeger, M. Skov, and N. Thomassen, "Interacting with in-vehicle systems: Understanding, measuring, and evaluating attention," in Proc. 23rd British HCI Group Annu. Conf. People and Computers: Celebrating People and Technology, Cambridge, U.K., Sep. 2009.
30. Q. Wu, "An overview of driving distractionmeasure methods," in Proc. IEEE 10th Int. Conf. Computer-Aided Industrial Design & Conceptual Design (CAID CD 2009), Wenzhou, China, Nov. 2009.
31. M. Trivedi, T. Gandhi, and J. McCall, "Looking-in and looking-out of a vehicle: Computer-vision-based enhanced vehicle safety," IEEE Trans. Intell. Transport. Syst., vol. 8, no. 1, pp. 108-120, Mar. 2007. (Pubitemid 46376159)
32. A. Azman, Q. Meng, and E. Edirisinghe, "Non intrusive physiological measurement for driver cognitive distraction detection: Eye and mouth movements," in Proc. Int. Conf. Advanced Computer Theory and Engineering (ICACTE 2010), Chengdu, China, Aug. 2010, vol. 3.
33. Z. Zhu and Q. Ji, "Real time and non-intrusive driver fatigue monitoring," in Proc. IEEE Int. Conf. Intelligent Transportation Systems, Washington, DC, USA, Oct. 2004, pp. 657-662. (Pubitemid 40196754)
34. J. McCall and M. Trivedi, "Driver behavior and situation aware brake assistance for intelligent vehicles," Proc. IEEE, vol. 95, no. 2, pp. 374-387, Feb. 2007.
35. C. Tran, A. Doshi, and M. Trivedi, "Modeling and prediction of driver behavior by foot gesture analysis," Comput. Vision Image Understand., vol. 116, no. 3, pp. 435-445, Mar. 2012.
36. A. Sathyanarayana, P. Boyraz, Z. Purohit, R. Lubag, and J. Hansen, "Driver adaptive and context aware active safety systems using CAN-bus signals," in Proc. IEEE Intelligent Vehicles Symp. (IV 2010), San Diego, CA, USA, Jun. 2010.
37. J. Yang, T. Chang, and E. Hou, "Driver distraction detection for vehicular monitoring," in Proc. Annu. Conf. IEEE Industrial Electronics Society (IECON 2010), Glendale, AZ, USA, Nov. 2010.
38. J. Harbluk, Y. Noy, P. Trbovich, and M. Eizenman, "An on-road assessment of cognitive distraction: Impacts on drivers' visual behavior and braking performance," Accident Anal. Prevent., vol. 39, no. 2, pp. 372-379, Mar. 2007. (Pubitemid 44854776)
39. A. Sathyanarayana, S. Nageswaren, H. Ghasemzadeh, R. Jafari, and J. H. L. Hansen, "Body sensor networks for driver distraction identification," in Proc. IEEE Int. Conf. Vehicular Electronics and Safety (ICVES 2008), Columbus, OH, USA, Sep. 2008.
40. K. Takeda, J. Hansen, P. Boyraz, L. Malta, C. Miyajima, and H. Abut, "International large-scale vehicle corpora for research on driver behavior on the road," IEEE Trans. Intell. Transport. Syst., vol. 12, no. 4, pp. 1609-1623, Dec. 2011.
41. H. Abut et al., "Real-world data collection with UYANIK," in In-Vehicle Corpus and Signal Processing for Driver Behavior, K. Takeda, H. Erdoǧan, J. Hansen, and H. Abut, Eds. New York, NY, USA: Springer, 2009, pp. 23-43.
42. P. Green, "The 15-second rule for driver information systems," in Proc. Intelligent Transportation Society (ITS) America Ninth Annu. Meeting, Washington, DC, USA, Apr. 1999.
43. J. Engström, E. Johansson, and J. Östlund, "Effects of visual and cognitive load in real and simulated motorway driving," Transp. Res. Part F: Traffic Psychol. Behav., vol. 8, no. 2, pp. 97-120, Mar. 2005. (Pubitemid 40743933)
44. M. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan, "Automatic recognition of facial actions in spontaneous expressions," J. Multimedia, vol. 1, pp. 22-35, Sep. 2006.
45. J. Whitehill and J. Movellan, "A discriminative approach to frame-byframe head pose tracking," in Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition (FG 2008), Amsterdam, The Netherlands, Sep. 2008.
46. P. Caffier, U. Erdmann, and P. Ullsperger, "Experimental evaluation of eye-blink parameters as a drowsiness measure," Eur. J. Appl. Physiol., vol. 89, no. 3-4, pp. 319-325, May 2003. (Pubitemid 36748690)
47. S. Klauer, T. Dingus, V. Neale, J. Sudweeks, and D. Ramsey, The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data, National Highway Traffic Safety Administration, Blacksburg, VA, USA, 2006, Tech. Rep. DOT HS 810 594.
48. T. Victor, J. Engström, and J. Harbluk, "Distraction assessment methods based on visual behavior and event detection," in Driver Distraction: Theory, Effects, and Mitigation, M. Regan, J. Lee, and K. Young, Eds. Boca Raton, FL, USA: CRC, 2008, pp. 135-165.
49. W. Mendenhall and T. Sincich, Statistics for Engineering and the Sciences. Upper Saddle River, NJ, USA: Prentice-Hall, 2006.
50. J. Jain and C. Busso, "Assessment of driver's distraction using perceptual evaluations, self assessments and multimodal feature analysis," in Proc. 5th Biennial Workshop DSP for In-Vehicle Systems, Kiel, Germany, Sep. 2011.