Optical flow and driver's kinematics analysis for state of alert sensing

Sensors (Switzerland)

Volumn 13, Issue 4, 2013, Pages 4225-4257

  Jiménez Pinto, Javier ^a   Torres Torriti, Miguel ^a  

^a PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

Author keywords

Alert state sensing; Driver assistance; Driver's kinematics; Fatigue detection; Head tracking; PERCLOS

Indexed keywords

ACCIDENTS; AUTOMOBILE DRIVERS; BUS DRIVERS; CAMERAS; EXPERIMENTS; MOTOR TRANSPORTATION; OPTICAL FLOWS;

ALERT STATE SENSING; DRIVER ASSISTANCE; FATIGUE DETECTION; HEAD TRACKING; PERCLOS;

KINEMATICS;

EID: 84876012534     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s130404225     Document Type: Article

References (66)

1. Wolrd Health Organization. Data and statistics of the World Health Organization, 2012. Available online: http://www.who.int/research/en/ (accessed on 11 March 2013).
2. World Health Organization. The World Health Report 2004-Changing History. Annex Table 2: Deaths by Cause, Sex and Mortality Stratum in WHO Regions, Estimates for 2002; WHO Press: Geneva, Switzerland, 2004.
3. Pedan, M., Scurfield, R., Sleet, D., Mohan, D., Hyder, A.A., Jarawan, E., Mathers, C., Eds.; World Report on Road Traffic Injury Prevention; WHO Press: Geneva, Switzerland, 2004.
4. World Health Organization. World Report on Child Injury Prevention; WHO Press: Geneva, Switzerland, 2008.
5. Powell, N.B.; Chau, J.K. Sleepy driving. J. Med. Clin. North Am. 2010, 94, 531-540.
6. May, J.F.; Baldwin, C.L. Driver fatigue: The importance of identifying causal factors of fatigue when considering detection and countermeasure technologies. Transp. Res. Part F: Traffic Psychol. Behav. 2009, 12, 218-224.
7. Yang, J.H.; Mao, Z.H.; Tijerina, L.; Pilutti, T.; Coughlin, J.; Feron, E. Detection of driver fatigue caused by sleep deprivation. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 2009, 39, 694-705.
8. Lal, S.K.L.; Craig, A. A critical review of the psychophysiology of driver fatigue. Biol. Psychol. 2001, 55, 173-194.
9. Zhao, C.; Zhao, M.; Liua, J.; Zheng, C. Electroencephalogram and electrocardiograph assessment of mental fatigue in a driving simulator. Accid. Anal. Prev. 2012, 45, 83-90.
10. Liang, W.C.; Yuan, J.; Sun, D.C.; Lin, M.H. Changes in physiological parameters induced by indoor simulated driving: Effect of lower body exercise at mid-term break. Sensors 2009, 9, 6913-6933.
11. Jung, S.J.; Shin, H.S.; Chung, W.Y. Highly sensitive driver health condition monitoring system using nonintrusive active electrodes. Sens. Actuators B: Chem. 2012, 171-172, 691-698.
12. Forsman, P.; Vila, B.; Short, R.; Mott, C.; van Dongen, H. Efficient driver drowsiness detection at moderate levels of drowsiness. Accid. Anal. Prev. 2013, 50, 341-350.
13. Dehnavi, M.; Eshghi, M. Design and implementation of a real time and train less eye state recognition system. EURASIP J. Adv. Signal Process. 2012, 30, 1-12.
14. Wierwille, W.; Ellsworth, L.; Wreggit, S.; Fairbanks, R.; Kirn, C. Research on Vehicle Based Driver Status/Performance Monitoring: Development, validation, and Refinement of Algorithms for Detection of Driver Drowsiness; Final Report DOT HS 808 247; Technical Report, National Highway Traffic Safety Administration, Washington, DC, USA, 1994.
15. Dinges, D.F.; Mallis, M.M.; Maislin, G.; Powell, J.W. Evaluation of Techniques for Ocular Measurement as Index of Fatigue and the Basis for Alertness Management.; Final Report DOT HS 808 762; Technical Report, National Highway Traffic Safety Administration: Washington, DC, USA, 1998.
16. Dong, W.; Wu, X. Driver Fatigue Detection Based on the Distance of Eyelid. In Proceedings of 2005 IEEE International Workshop on the VLSI Design and Video Technology, Suzhou, China, 28-30 May 2005; pp. 365-368.
17. Horng, W.B.; Chen, C.Y.; Chang, Y.; Fan, C.H. Driver Fatigue Detection Based on Eye Tracking and Dynamic Template Matching. In Proceedings of the IEEE International Conference Networking, Sensing and Control, Taipei, Taiwan, March 2004; Volume 1, pp. 7-12.
18. Qin, H.; Gao, Y.; Gan, H. Precise Eye Location in Driver Fatigue State Surveillance System. In Proceedings of IEEE International Conference on the Vehicular Electronics and Safety, ICVES, Beijing, China, December 2007; pp. 1-6.
19. Rongben, W.; Lie, G.; Bingliang, T.; Lisheng, J. Monitoring Mouth Movement for Driver Fatigue or Distraction with One Camera. In Proceedings of The 7th International IEEE Conference on Intelligent Transportation Systems, Washington DC, USA, October 2004; pp. 314-319.
20. Singh, S.; Papanikolopoulos, N. Monitoring Driver Fatigue Using Facial Analysis Techniques. In Proceedings of IEEE/IEEJ/JSAI International Conference on the Intelligent Transportation Systems, Tokyo, Japan, October 1999; pp. 314-318.
21. Tabrizi, P.R.; Zoroofi, R.A. Open/Closed Eye Analysis for Drowsiness Detection. In Proceedings of the First Workshops on Image Processing Theory, Tools and Applications, IPTA, Sousse, Tunisia, November 2008; pp. 1-7.
22. Flores, M.J.; Armingol, J.M.; de la Escalera, A. Driver drowsiness warning system using visual information for both diurnal and nocturnal illumination conditions. EURASIP J. Adv. Signal Process. 2010, 3, 1-19.
23. Flores, M.; Armingol, J.; Escalera, A. Real-Time Drowsiness Detection System for an Intelligent Vehicle. In Proceedings of the Intelligent Vehicles Symposium, Eindhoven, Netherlands, June 2008; pp. 637-642.
24. Hong, T.; Qin, H.; Sun, Q. An Improved Real Time Eye State Identification System in Driver Drowsiness Detection. In Proceedings of IEEE International Conference on the Control and Automation, ICCA 2007, Guangzhou, China, May 2007; pp. 1449-1453.
25. Lu, H.; Zhang, W.; Yang, D. Eye Detection Based on Rectangle Features and Pixel-Pattern-Based Texture Features. In Proceedings of International Symposium on the Intelligent Signal Processing and Communication Systems, ISPACS 2007, Xiamen, China, November 2007; pp. 746-749.
26. Sigari, M.H. Driver Hypo-Vigilance Detection Based on Eyelid Behavior. In Proceedings of Seventh International Conference on the Advances in Pattern Recognition, ICAPR'09, Kolkata, India, 4-6 February 2009; pp. 426-429.
27. Xu, C.; Zheng, Y.; Wang, Z. Efficient Eye States Detection in Real-Time for Drowsy Driving Monitoring System. In Proceedings of International Conference on the Information and Automation, ICIA 2008, Zhangjiajie, China, June 2008; pp. 170-174.
28. Zhang, Z.; Shu Zhang, J. Driver Fatigue Detection Based Intelligent Vehicle Control. In Proceedings of 18th International Conference on the Pattern Recognition, ICPR 2006, Hong Kong, China, August 2006; Volume 2, pp. 1262-1265.
29. Fan, X.; Yin, B.C.; Sun, Y.F. Yawning Detection for Monitoring Driver Fatigue. In Proceedings of the 2007 IEEE International Conference on the Machine Learning and Cybernetics, Hong Kong, China, August 2007; Volume 2, pp. 664-668.
30. Flores, M.; Armingol, J.M.; de la Escalera, A. Driver drowsiness detection system under infrared illumination for an intelligent vehicle. IET Intell. Transp. Syst. 2011, 5, 241-251.
31. Bergasa, L.; Nuevo, J.; Sotelo, M.; Barea, R.; López, M. Real-time system for monitoring driver vigilance. Intell. Transp. Syst. IEEE Trans. 2006, 7, 63-77.
32. Garcia, I.; Bronte, S.; Bergasa, L.M.; Almazán, J.; Yebes, J. Vision-based Drowsiness Detector for Real Driving Conditions. In Proceedings of the IEEE 2012 Intelligent Vehicles Symposium, Madrid, Spain, 3-7 June 2012.
33. Park, I.; Ahn, J.H.; Byun, H. Efficient Measurement of Eye Blinking under Various Illumination Conditions for Drowsiness Detection Systems. In Proceedings of the 18th International Conference on Pattern Recognition, ICPR 2006, Hong Kong, China, 20-24 August 2006; Volume 1, pp. 383-386.
34. Gu, H.; Ji, Q.; Zhu, Z. Active Facial Tracking for Fatigue Detection. In Proceedings of Sixth IEEE Workshop on the Applications of Computer Vision, (WACV 2002), Orlando, FL, USA, 3-4 December 2002; pp. 137-142.
35. Elsner, A.; Burns, S.; Weiter, J.; Delori, F. Infrared imaging of sub-retinal structures in the human ocular fundus. Vision Res. 1996, 36, 191-205.
36. Holz, F.G.; Spaide, R.F. Medical Retina; Essentials in Ophthalmology, Springer-Verlag: Berlin/Heidelberg, Germany, 2007.
37. D'Orazio, T.; Leo, M.; Spagnolo, P.; Guaragnella, C. A Neural System for Eye Detection in a Driver Vigilance Application. In Proceedings of the 7th International IEEE Conference on the Intelligent Transportation Systems, Washington, DC, USA, 3-6 October 2004; pp. 320-325.
38. Suzuki, M.; Yamamoto, N.; Yamamoto, O.; Nakano, T.; Yamamoto, S. Measurement of Driver's Consciousness by Image Processing. A Method for Presuming Driver's Drowsiness by Eye-Blinks coping with Individual Differences. In Proceedings of the 2006 IEEE International Conference on the Systems, Man and Cybernetics, Taipei, Taiwan, 8-11 October 2006; Volume 4, pp. 2891-2896.
39. Dong, W.; Qu, P.; Han, J. Driver Fatigue Detection Based on Fuzzy Fusion. In Proceedings of the Chinese Control and Decision Conference, CCDC 2008, Yantai, China, 2-4 July 2008; pp. 2640-2643.
40. Fan, X.; Yin, B.; Sun, Y. Nonintrusive Driver Fatigue Detection. In Proceedings of the IEEE International Conference on the Networking, Sensing and Control, ICNSC 2008, Sanya, China, 6-8 April 2008; pp. 905-910.
41. Ito, T.; Mita, S.; Kozuka, K.; Nakano, T.; Yamamoto, S. Driver Blink Measurement by the Motion Picture Processing and Its Application to Drowsiness Detection. In Proceedings of the 5th IEEE International Conference on the Intelligent Transportation Systems, Singapore, 3-6 September 2002; pp. 168-173.
42. Wang, Q.; Yang, W.; Wang, H.; Guo, Z.; Yang, J. Eye Location in Face Images for Driver Fatigue Monitoring. In Proceedings of the 6th International Conference on ITS Telecommunications, Chengdu, China, 21-23 June 2006; pp. 322-325.
43. Sahayadhas, A.; Sundaraj, K.; Murugappan, M. Detecting driver drowsiness based on sensors: A review. Sensors 2012, 12, 16937-16953.
44. Jimenez-Pinto, J.; Torres-Torriti, M. Face salient points and eyes tracking for robust drowsiness detection. Robotica 2012, 30, 731-741.
45. Guggisberg, A.G.; Mathis, J.; Herrmann, U.S.; Hess, C.W. The functional relationship between yawning and vigilance. Behav. Brain Res. 2007, 179, 159-166.
46. Guggisberg, A.G.; Mathis, J.; Schnider, A.; Hess, C.W. Why do we yawn? Neurosci. Biobehav. Rev. 2010, 34, 1267-1276.
47. Vural, E.; Cetin, M.; Ercil, A.; Littlewort, G.; Bartlett, M.; Movellan, J. Drowsy Driver Detection Through Facial Movement Analysis. In Proceedings of the 2007 IEEE International Workshop on Human-Computer Interaction, HCI'07, Rio de Janeiro, Brazil, October 2007; pp. 6-18.
48. Gutierrez-Alvarez, A.M. Do your patients suffer from excessive yawning? Acta Psychiatr. Scand. 2007, 115, 80-81.
49. van den Berg, J. Sleepiness and head movements. Ind. Health 2006, 44, 564-576.
50. Abe, T.; Nonomura, T.; Komada, Y.; Asaoka, S.; Sasai, T.; Ueno, A.; Inoue, Y. Detecting deteriorated vigilance using percentage of eyelid closure time during behavioral maintenance of wakefulness tests. Int. J. Psychophysiol. 2011, 82, 269-274.
51. Rosario, H.D.; Solaz, J.; Rodriguez, N.; Bergasa, L. Controlled inducement and measurement of drowsiness in a driving simulator. IET Intell. Transp. Syst. 2010, 4, 280-288.
52. Nuevo, J.; Bergasa, L.M.; Llorca, D.F.; Ocaña, M. Face tracking with automatic model construction. Image Vision Comput. 2011, 29, 209-218.
53. Schiffman, H.R. Sensation and Perception. An Integrated Approach, 5th ed.; John Wiley and Sons, Inc.: Hoboken, NJ, USA, 2001.
54. Paul, A.; Boyle, L.N.; Tippin, J.; Rizzo, M. Variability of Driving Performance During Microsleeps. In Proceedings of the Third International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design; Rockport, Maine, USA, 27-30 June 2005; pp. 433-440.
55. Viola, P.; Jones, M. Rapid Object Detection Using a Boosted Cascade of Simple Features. In Proceedings of the 16th IEEE Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA, 8-14 December 2001; Volume I, pp. 511-518.
56. Shi, J.; Tomasi, C. Good Features to Track. In Proceedings of the 9th IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, June 1994; pp. 593-600.
57. Lucas, B.; Kanade, T. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the Imaging Understanding Workshop, Washington DC, USA, April 1981; pp. 121-130.
58. Ching, R.P. Relationship Between Head Mass and Circumference in Human Adults; Technical Report; University of Washington: Seattle, WA, USA, 2007.
59. Dodgson, N.A. Variation and Extrema of Human Interpupillary Distance. In Proceedings of SPIE: Stereoscopic Displays and Virtual Reality Systems XI, San Jose, CA, USA, January 2004; Volume 5291, pp. 36-46.
60. Bertsekas, D.P. Nonlinear Programming, 2nd ed.; Athena Scientific: Nashua, North Hampshire, USA, 1999; p. 780.
61. Press, W.H.; Teukolsky, S.A.; Vetterling, W.T.; Flannery, B.P. Numerical Recipes 3rd Edition: The Art of Scientific Computing, 3rd ed.; Cambridge University Press: New York, NY, USA, 2007.
62. Grace, R.; Byrne, V.; Bierman, D.; Legrand, J.M. andGricourt, D.; Davis, B.; Staszewski, J.; Carnahan, B. A drowsy driver detection system for heavy vehicles. In Proceedings of the Digital Avionics Systems Conference, Bellevue, WA, USA, 31 October-7 Novermber 1998; Volume 2, 1-8.
63. Harris, M.G.; Chin, R.S.; Lee, D.S.; Tarot, M.H.; Dobkins, C.E. Ultraviolet Transmittance of the Vistakon disposable contact lenses. Cont. Lens. Anterior Eye. 2000, 23, 10-15.
64. Stephens, G.L.; Davis, J.K. Duane's Ophthalmology, Ch. 51D Ophthalmic Lens Tints and Coatings, cd-rom 2006 ed.; Volume 1, Lippincott Williams & Wilkins: Philadelphia, Pennsylvania, USA, 2006. Available online: http://www.oculist.net/downaton502/prof/ebook/duanes/pages/v1/v1c051d.html (accessed on 11 March 2013).
65. Sperian Protection Americas Inc. Uvex Lens Technology; Sperian Protection Americas Inc., Smithfield, RI, USA, 2008; p. 23. Brochure.
66. Van Gaal, R.; Schuerkamp, U.; Pospisil, D.; Harrington, P. Racer Free Car Simulation, 2012. Available online: http://www.racer.nl/ (accessed on 11 March 2013).