Real-time detection system of driver distraction using machine learning

IEEE Transactions on Intelligent Transportation Systems

Volumn 14, Issue 2, 2013, Pages 894-905

  Tango, Fabio ^a   Botta, Marco ^b  

^a CENTRO RICERCHE FIAT   (Italy)

^b UNIVERSITY OF TURIN   (Italy)

Author keywords

Accident prevention; artificial intelligence and machine learning (ML); driver distraction and inattention; intelligent supporting systems

Indexed keywords

AUTONOMOUS DRIVING; CLASSIFICATION RATES; DRIVER DISTRACTIONS; FEA-TURE SELECTIONS; IN-VEHICLE INFORMATION SYSTEM; REAL-TIME DETECTION; SUPPORTING SYSTEMS; VISUAL DISTRACTIONS;

ACCIDENT PREVENTION; ARTIFICIAL INTELLIGENCE; AUTOMOBILE DRIVERS; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; SIGNAL DETECTION; SUPPORT VECTOR MACHINES;

ACCIDENTS;

EID: 84878712470     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2013.2247760     Document Type: Article

References (56)

1. T. Ersal, H. J. A. Fuller, O. Tsimhoni, J. L. Stein, and H. K. Fathy, "Modelbased analysis and classification of driver distraction under secondary tasks, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 3, pp. 692-701, Sep. 2010.
2. M. A. Regan, C. Hallet, and C. P. Gordon, "Driver distraction and driver inattention: Definition, relationship and taxonomy, " Accid. Anal. Prev. J., vol. 43, no. 5, pp. 1771-1781, Sep. 2011.
3. C. J.-S. Wang, R. R. Knipling, and M. J. Goodman, "The role of driver inattention in crashes: New statistics from the 1995 crashworthiness data system, " in Proc. 40th AAAM, Vancouver, BC, Canada, 1996, pp. 377-392.
4. T. A. Dingus, S. G. Klauer, V. L. Neale, A. Petersen, S. E. Lee, J. Sudweeks, M. A. Perez, J. Hankey, D. Ramsey, S. Gupta, C. Bucher, Z. R. Doerzaph, J. Jermeland, and R. R. Knipling, "The 100-car naturalistic driving study, phase II-results of the 100-car field experiment, " Dept. Transp., Nat. Highway Traffic Safety Admin., Washington, DC, USA, HS 593, 2006.
5. J. Treat, N. S. Tumbas, S. T. McDonald, D. Shinar, R. D. Hume, R. E. Mayer, R. L. Stansifer, and N. J. Castellan, "Tri-level study of the causes of traffic accidents: Final report, " Federal Highway Administration, US DOT, Washington, DC, USA, Tech. Rep., 1979, vol. 1.
6. Y. Dong, Z. Hu, K. Uchimura, and N. Murayama, "Driver inattention monitoring system for intelligent vehicles: A review, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 596-614, Jun. 2011.
7. T. A. Ranney, "Driver distraction: A review of the current state-ofknowledge?" NHTSA, Washington, DC, USA, DOT HS 810 704, Apr. 2008.
8. R. L. Olson, R. J. Hanowski, J. S. Hickman, and J. Bocanegr, "Driver distraction in commercial vehicle operations, " U. S. Dept. Transportation, Washington, DC, USA, Rep. FMCSA-RRR-09-042, 2009.
9. M. Woeller, C. Blaschke, T. Schhindl, B. Schuller, B. Faerber, S. Mayer, and B. Trefflich, "Online driver distraction detection using long short-term memory, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 574-582, Jun. 2011.
10. E. D. Sussman, H. Bishop, B. Madnick, and R. Walter, "Driver inattention and highway safety, " Transp. Res. Rec., vol. 1047, pp. 40-48, 1985.
11. J. Wang, R. R. Knipling, and M. J. Goodman, "The role of driver inattention in crashes; New statistics from the 1995 crashworthiness data system (CDS), " in Proc. 40th Annu. Assoc. Adv. Autom. Med., 1996, pp. 377-392.
12. J. C. Stutts, D. W. Reinfurt, L. Staplin, and E. A. Rodgman, The Role of Driver Distraction in Traffic Crashes. Washington, DC, USA: AAA Foundation Traffic Safety, 2001.
13. J. K. Caird and R. E. Dewar, "Driver distraction, " in Human Factors in Traffic Safety, R. E. Dewar and R. Olsen, Eds., 2nd ed. Tucson, AZ, USA: Lawyers & Judges Publ., 2007, pp. 195-229.
14. D. Haigney and S. J. Westerman, "Mobile (cellular) phone use and driving: A critical review of research methodology, " Ergonomics, vol. 44, no. 2, pp. 132-143, Feb. 2001. (Pubitemid 32058492)
15. P.-N. Tan, Introduction to Data Mining. Pearson. Boston, MA, USA: Addison-Wesley, 2005.
16. P. Baldi and S. Brunak, Bioinformatics: The Machine Learning Approach, 2nd ed. Cambridge, MA, USA: MIT Press, 2001.
17. A. Pentland and A. Liu, "Modeling and prediction of human behavior, " Neural Comput., vol. 11, no. 1, pp. 229-242, Jan. 1999.
18. L. Qiao, M. Sato, and H. Takeda, "Learning algorithm of environmental recognition in driving vehicle, " IEEE Trans. Syst., Man, Cybern., vol. 25, no. 6, pp. 917-925, Jun. 1995.
19. F. Tango and M. Botta, "Evaluation of distraction in a driver-vehicleenvironment framework: An application of different data-mining techniques, " in Proc. 9th ICDM, Leipzig, Germany, 2009, pp. 176-190.
20. C. Blaschke, F. Breyer, B. Färber, J. Freyer, and R. Limbacher, "Driver distraction based lane-keeping assistance, " Transp. Res. Part F, Traffic Psychol. Behav., vol. 12, no. 4, pp. 288-299, Jul. 2009.
21. H. Zhang, M. R. H. Smith, and G. J. Witt, "Identification of real-time diagnostic measures of visual distraction with an automatic eye-tracking system, " Hum. Factors, vol. 48, no. 4, pp. 805-821, 2006. (Pubitemid 46036207)
22. J. Hoel, M. Jaffard, and P. Van Elslande, "Attentional competition between tasks and its implications, " presented at the Proc. Eur. Conf. Human Centred Des. Intell. Transp. Syst., Apr. 29 and 30, 2010. [Online]. Available: http://www.conference2010. humanist-vce. eu/
23. J. D. Lee, K. L. Young, and M. A. Regan, "Defining driver distraction, " in Driver Distraction: Theory, Effects, and Mitigation, M. A. Regan, J. D. Lee, and K. L. Young, Eds. Boca Raton, FL, USA: CRC, 2008, pp. 31-40.
24. F. Tango, L. Minin, R. Montanari, and M. Botta, "Non-intrusive detection of driver distraction using machine learning algorithms, " in Proc. 19th ECAI, Lisbon, Portugal, Aug. 16-19, 2010, pp. 157-162.
25. V. N. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995.
26. N. Cristianini and J. S. Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U. K. : Cambridge Univ. Press, 2000.
27. H. Byun and S. W. Lee, "Applications of support vector machines for pattern recognition: A survey, " in Proc. 1st Int. Workshop Pattern Recog. SVM, Niagara Falls, ON, Canada, 2002, pp. 213-236.
28. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ, USA: Prentice-Hall, 1999.
29. J. L. Elman, "Finding structure in time, " Cognit. Sci., vol. 14, no. 2, pp. 179-211, Mar. 1990.
30. M. Mitchell, Machine Learning. New York, NY, USA: McGraw-Hill, 1997.
31. J. C. Bezdec, Pattern Recognition with, Fuzzy Objective Function Algorithms. New York, NY, USA: Plenum, 1981.
32. A. Kaufmann and M. M. Gupta, Introduction to Fuzzy Arithmetic. New York, NY, USA: Reinhold, 1985.
33. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system, " IEEE Trans. Syst., Man, Cybern., no. 3, pp. 665-685, May/Jun. 1993.
34. M. Sugeno, Industrial Applications of Fuzzy Control. Amsterdam, The Netherlands: Elsevier, 1985.
35. C. D. Wickens, "Multiple resources and performance prediction, " Theor. Issues Ergonom. Sci., vol. 3, no. 2, pp. 159-177, 2002.
36. S. Mattes, "The lane change task as a tool for driver distraction evaluation, " in Quality of Work and Products in Enterprises of the Future, H. Strasser and H. Bubb, Eds. Stuttgart, Germany: Ergonomia Verlag, 2003, pp. 57-60.
37. K. Young, M. Regan, and M. Hammer, "Driver distraction a review of the literature, " Accident Research Center, Monash Univ., Victoria, Australia, Tech. Rep. 206, Nov. 2003.
38. Y. Zhang, Y. Owechko, and J. Zhang, "Driver cognitive workload estimation: A data-driven perspective, " in Proc. IEEE Intell. Transp. Syst. Conf., Washington, DC, USA, 2004, pp. 642-647. (Pubitemid 40196751)
39. F. Tango, R. Aras, and O. Pietquin, "Automation effects on driver's behaviour when integrating a PADAS and a distraction classifier, " in Proc. HCI, Orlando, FL, USA, Jul. 9-14, 2011, pp. 503-512.
40. F. Tango, R. Aras, and O. Pietquin, "Batch reinforcement learning for optimizing driving assistance strategies, " in Proc. NIPS Conf., Vancouver, BC, Canada, Dec. 10 and 11, 2010.
41. M. H. Kutila, M. Jokela, T. Mäkinen, J. Viitanen, G. Markkula, and T. W. Victor, "Driver cognitive distraction detection: Feature estimation and implementation, " Proc. Inst. Mech. Eng., Part D, J. Automobile Eng., vol. 221, no. 9, pp. 1027-1040, Sep. 2007.
42. D. de Waard, K. A. Brookhuis, and N. Hernandez-Gress, "The feasibility of detecting phone-use related driver distraction, " Int. J. Veh. Des., vol. 26, no. 1, pp. 85-95, Aug. 2003. (Pubitemid 32534700)
43. T. D'Orazio, M. Leo, C. Guaragnella, and A. Distante, "A visual approach for driver inattention detection, " Pattern Recognit., vol. 40, no. 8, pp. 2341-2355, Aug. 2007. (Pubitemid 46574771)
44. Q. Ji, P. Lan, and C. Looney, "A probabilistic framework for modeling and real-time monitoring human fatigue, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 36, no. 5, pp. 862-875, Sep. 2006.
45. J. A. Healey and R. W. Picard, "Detecting stress during real-world driving tasks using physiological sensors, " IEEE Trans. Intell. Transp. Syst., vol. 6, no. 2, pp. 156-166, Jun. 2005. (Pubitemid 40925766)
46. Y. Liang, M. L. Reyes, and J. D. Lee, "Real-time detection of driver cognitive distraction using support vector machines, " IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 340-350, Jun. 2007. (Pubitemid 46873214)
47. Y. Liang, J. D. Lee, and M. L. Reyes, "Nonintrusive detection of driver cognitive distraction in real time using Bayesian networks, " Transp. Res. Rec., J. Transp. Res. Board, vol. 2018, pp. 1-8, 2007. (Pubitemid 351345443)
48. Y. Liang and J. D. Lee, Driver Cognitive Distraction Detection Using Eye Movements. Berlin, Germany: Springer-Verlag, 2008, pp. 285-300.
49. T. Kumagai and M. Akamatsu, "Prediction of human driving behavior using dynamic Bayesian networks, " IEICE Trans. Inf. Syst., vol. E89-D, no. 2, pp. 857-860, Feb. 2006.
50. L. Minin, T. Bellet, P. Mayenobe, M. Baumann, S. Briest, M. Alonso, M. H. Vega, Ó. Martín, E. Muhrer, M. Vollrath, R. Montanari, F. Tango, and R. Heers, "Report on the influence of relevant factors (characteristics, state, situation) on driving behavior and driving errors, " ISI-PADAS EU Project, 2009, Internal Project Deliverable.
51. P. Jiménez, L. M. Bergasa, J. Nuevo, I. G. Daza, and N. Hernández, "Gaze fixation system for the evaluation of driver distractions induced by IVIS, " IEEE Trans. Intell. Transp. Syst., vol. 13, no. 3, pp. 1167-1178, Sep. 2012.
52. D. Sandberg, "Detecting driver sleepiness, " PhD. dissertation, Dept. Appl. Mech. Chalmers Univ. Technol., Göteborg, Sweden, 2011.
53. L. M. Bergasa, J. Nuevo, M. A. Sotelo, R. Barea, and E. Lopez, "Realtime system for monitoring driver vigilance, " IEEE Trans. Intell. Transp. Syst., vol. 7, no. 1, pp. 63-77, Mar. 2006.
54. J. Greenberg, B. Artz, and L. Cathey, "The effect of lateral motion cues during simulated driving, " in Proc. DSC North Amer., Dearborn, MI, USA, 2003, [CD-ROM].
55. P. E. Green, T. Wada, J. Oberholtzer, P. A. Green, J. Schweitzer, and H. Eoh, "How do distracted and normal driving differ: An analysis of the ACAS naturalistic driving data, " Univ. Michigan Transp. Res. Inst., Arbor, MI, USA, Tech. Rep. UMTRI-2006-35, 2007.
56. J. S. Hickman, R. J. Hanowski, and J. Bocanegra, "Distraction in commercial trucks and buses: Assessing prevalence and risk in conjunction with crashes and near-crashes, " U. S. Dept. Transp., Washington, DC, USA, FMCSA-RRR-10-049, 2010.