A vision-based system for monitoring the loss of attention in automotive drivers

IEEE Transactions on Intelligent Transportation Systems

Volumn 14, Issue 4, 2013, Pages 1825-1838

  Dasgupta, Anirban ^a   George, Anjith ^a   Happy, S L ^a   Routray, Aurobinda ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Driver's alertness; Haar classifier; Kalman filter; Local binary pattern (LBP); Object detection; Percentage of eye closure (PERCLOS); Principal component analysis (PCA); Support vector machine (SVM)

Indexed keywords

DRIVER'S ALERTNESS; HAAR CLASSIFIERS; LOCAL BINARY PATTERNS; OBJECT DETECTION; PERCENTAGE OF EYE CLOSURE (PERCLOS);

COMPUTER ARCHITECTURE; FEATURE EXTRACTION; KALMAN FILTERS; PRINCIPAL COMPONENT ANALYSIS; SUPPORT VECTOR MACHINES; WINDOWS OPERATING SYSTEM;

BEHAVIORAL RESEARCH;

EID: 84890431938     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2013.2271052     Document Type: Article

References (64)

1. J. Connor, G. Whitlock, R. Norton, and R. Jackson, "The role of driver sleepiness in car crashes: A systematic review of epidemiological studies," Accid. Anal. Prev., vol. 33, no. 1, pp. 31-41, Jan. 2001.
2. K. Hayachi, K. Ishihara, H. Hashimoto, and K. Oguri, "Individualized drowsiness detection during driving by pulse wave analysis with neural network," in Proc. 8th Int. IEEE Conf. Intell. Transp. Syst., Vienna, Austria, 2005, pp. 901-906. (Pubitemid 44250320)
3. T. Ito, S. Mita, K. Kozuka', T. Nakano, and S. Yamarnoto, "Driver blink measurement by the motion picture processing and its application to drowsiness detection," in Proc. IEEE 5th Int. Conf. Intell. Transp. Syst., Singapore, 2002, pp. 168-173.
4. L. Fletcher, N. Apostoloff, L. Petersson, and A. Zelinsky, "Vision in and out of vehicles," IEEE Intell. Syst., vol. 18, no. 3, pp. 12-17, May/Jun. 2003.
5. P. Smith, N. V. Lobo, and M. Shah, "Determining driver visual attention with one camera," IEEE Trans. Intell. Transp. Syst., vol. 4, no. 4, pp. 205-218, Dec. 2003.
6. S. Gupta, S. Kar, and A. Routray, "Fatigue in human drivers: A study using ocular, Psychometric, physiological signals," in Proc. IEEE Students' TechSym, 2010, pp. 234-240.
7. M. Matousek, "A method for assessing alertness fluctuations from EEG spectra," Electroencephalogr. Clin. Neurophysiol., vol. 55, no. 1, pp. 108-113, Jan. 1983. (Pubitemid 13171326)
8. C. Cajochen, J. M. Zeitzer, C. Czeisler, and D. J. Dijk, "Doseresponse relationship for light intensity and ocular and electroencephalographic correlates of human alertness," Behav. Brain Res., vol. 115, no. 1, pp. 75-83, Oct. 2000.
9. R. R. Knipling and W. W. Wierwille, "Vehicle-based drowsy driver detection: Current status and future prospects," in Proc. IVHS Amer. 4th Annu. Meeting, Apr. 1994, pp. 2-24.
10. L. Dhupati, S. Kar, A. Rajaguru, and A. Routray, "A novel drowsiness detection scheme based on speech analysis with validation using simultaneous EEG recordings," in Proc. IEEE CASE, 2010, pp. 917-921.
11. Q. Ji, "Non-invasive techniques for monitoring human fatigue," Univ. Nevada, Reno, NV, USA, 2003, DTIC Document.
12. W. E. L. Wierwille, S. Wreggit, R. Fairbanks, and C. Kirn, "Research on vehicle based driver status/performance monitoring: Development, validation, and refinement of algorithms for detection of driver drowsiness," Nat. Highway Traffic Safety, Washington, DC, USA, 1994.
13. Z. Zhu and Q. Ji, "Real time and non-intrusive driver fatigue monitoring," in Proc. IEEE Conf. Intell. Transp. Syst., Washington, DC, USA, 2004, pp. 657-662. (Pubitemid 40196754)
14. R. J. Hanowski, D. S. Bowman, W. W. Wierwille, A. Alden, and R. Carroll, "PERCLOS+: Development of a robust field measure of driver drowsiness," in Proc. 15th World Congr. Intell. Transp. Syst., 2008.
15. R. I. Hammoud, G. Witt, R. Dufour, A. Wilhelm, and T. Newman, "On driver eye closure recognition for commercial vehicles," presented at the SAE Commercial Vehicles Engineering Congress Exhib., Chicago, IL, USA, 2008, Paper 2008-01-2691.
16. D. Bowman, W. Schaudt, and R. Hanowski, "Advances in Drowsy Driver Assistance Systems Through Data Fusion," in Handbook of Intelligent Vehicles. New York, NY, USA: Springer-Verlag, 2012, pp. 895-912.
17. W. W. Wierwille, "Historical perspective on slow eyelid closure: Whence PERCLOS?" in Proc. Ocular Meas. Driver Alertness, 1999, pp. 31-53.
18. W. W. Wierwille, "Desired attributes of a drowsy driver monitoring system and candidate technologies for implementation," in Proc. Ocular Meas. Driver Alertness, USA, 1999, pp. 130-143.
19. W. Qing, S. B. Xi, X. Bin, and Z. Junjie, "A PERCLOS-Based driver fatigue recognition," in Proc. 3rd Int. Symp. Inf. Process., 2010, pp. 437-441.
20. D. F. Dinges, M. M. Mallis, G. Maislin, and J. W. Powell, "Evaluation of techniques for ocular measurement as an index of fatigue and the basis for alertness management," Nat. Highway Traffic Safety Admin., Washington, DC, USA, 1998.
21. S. Kar, M. Bhagat, and A. Routray, "EEG signal analysis for the assessment and quantification of driver's fatigue," Transp. Res. Part F, vol. 13, no. 5, pp. 297-306, Sep. 2010.
22. S. Kar, A. Routray, and B. P. Nayak, "Functional network changes associated with sleep deprivation and fatigue during simulated driving: Validation using blood biomarkers," Clin. Neurophysiol., vol. 122, no. 5, pp. 966-974, May 2011.
23. R. Onken, "DAISY, an adaptive, knowledge-based driver monitoring and warning system," in Proc. Intell. Veh. Symp., 1994, pp. 3-10.
24. S. Singh and N. Papanikolopoulos, "Monitoring driver fatigue using facial analysis techniques," in Proc. IEEE/IEEJ/JSAI Int. Conf. Intell. Transp. Syst., 1999, pp. 314-318. (Pubitemid 30565875)
25. E. M. Ayoob, A. Steinfeld, and R. Grace, "Identification of an 'appropriate' drowsy driver detection interface for commercial vehicle operations," in Proc. Human Factors Ergonom. Soc. Annu. Meeting, 2003, pp. 1840-1844.
26. L. Fletcher, L. Petersson, and A. Zelinsky, "Driver assistance systems based on vision in and out of vehicles," in Proc. IEEE Intell. Veh. Symp., 2003, pp. 322-327.
27. Q. Ji, Z. Zhu, and P. Lan, "Real-time nonintrusive monitoring and prediction of driver fatigue," IEEE Trans. Veh. Technol., vol. 53, no. 4, pp. 1052-1068, Jul. 2004.
28. R. Hanowski, J. Hickman, M. Blanco, and G. Fitch, "Long-haul truck driving and traffic safety: Studying drowsiness and truck driving safety using a naturalistic driving method," in Sleep, Sleepiness and Traffic Safety, J. C. Verster, Ed. Hauppauge, NY, USA: Nova Sci. Publ., 2010.
29. L. M. Bergasa, J. Nuevo, M. A. Sotelo, R. Barea, and M. E. Lopez, "Realtime system for monitoring driver vigilance," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 1, pp. 63-77, Mar. 2006.
30. M. Eriksson and N. P. Papanikolopoulos, "Driver fatigue: A vision-based approach to automatic diagnosis," Transp. Res. Part C, Emerg. Technol., vol. 9, no. 6, pp. 399-413, Dec. 2001. (Pubitemid 32778981)
31. M. Sacco and R. Farrugia, "Driver fatigue monitoring system using support vector machines," in Proc. 5th Int. Symp. Commun. Control Signal Process., 2012, pp. 1-5.
32. J. Huang and H. Wechsler, "Eye detection using optimal wavelet packets and radial basis functions (RBFs)," Int. J. Pattern Recognit. Artif. Intell., vol. 13, no. 7, pp. 1-18, 1999.
33. G. C. Feng and P. C. Yuen, "Multi-cues eye detection using gray intensity image," Pattern Recognit., vol. 34, no. 5, pp. 1033-1046, May 2001. (Pubitemid 32228830)
34. S. A. Sirohey and A. Rosenfeld, "Eye detection in a face image using linear and nonlinear filters," Pattern Recognit., vol. 34, no. 7, pp. 1367-1391, Mar. 2001. (Pubitemid 32424904)
35. P. Viola and M. M. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, May 2004.
36. Y. Freund and R. E. Schaphire, "A decision-theoretic generalization of on-line learning and an application to boosting," in Computational Learning Theory: Eurocolt 95. New York, NY, USA: Springer-Verlag, 1995, pp. 23-37.
37. Z. Zhou and X. Geng, "Projection functions for eye detection," Pattern Recognit., vol. 37, no. 5, pp. 1049-1056, May 2004. (Pubitemid 38473843)
38. J. Song, Z. Chia, and J. Liub, "A robust eye detection method using combined binary edge and intensity information," Pattern Recognit., vol. 39, no. 6, pp. 1110-1125, Jun. 2006.
39. P. Wang, M. B. Green, Q. Ji, and J. Wayman, "Automatic eye detection and its validation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2005, p. 164.
40. S. Asteriadis, N. Nikolaidis, A. Hajdu, and I. Pitas, "An eye detection algorithm using pixel to edge information," in Proc. ICSSP, 2006.
41. M. Eriksson and N. P. Papanikolopoulos, "Eye-tracking for detection of driver fatigue," in Proc. Int. Conf. Intell. Transp. Syst., Boston, MA, USA, 1997, pp. 314-319.
42. T. D'Orazio, M. Leo, C. Guaragnella, and A. Distante, "A visual approach for driver inattention detection," Pattern Recognit., vol. 40, no. 8, pp. 2341-2355, Aug. 2007. (Pubitemid 46574771)
43. T. Hong and H. Qin, "Driver's drowsiness detection in embedded system," in Proc. Int. Conf. Veh. Electron. Safety, 2007, pp. 1-5.
44. L. Liying and Q. Haoxiang, "The study of driver fatigue monitor algorithm combined PERCLOS and AECS," in Proc. Int. Conf. Comput. Sci. Softw. Eng., 2008, pp. 349-352.
45. D.W. Hansen and R. I. Hammoud, "An improved likelihood model for eye tracking," J. Comput. Vis. Image Understand. (CVIU), vol. 106, no. 2/3, pp. 220-230, May 2007. (Pubitemid 46670740)
46. T. A. Dingus, H. Hardee, and W. W. Wierwile, "Development of models for on-board detection of driver impairment," Accid. Anal. Prev., vol. 19, no. 4, pp. 271-283, Aug. 1987.
47. M. Singhvi, A. Dasgupta, and A. Routray, "A real time algorithm for detection of spectacles leading to eye detection," in Proc. IEEE 4th Int. Conf. Intell. Human Comput. Interact., 2012, pp. 1-6.
48. N. Seo, Tutorial: Opencv Haartraining (Rapid Object Detection With A Cascade Of Boosted Classifiers Based On Haar-Like Features). [Online]. Available: http://note.sonots.com/SciSoftware/haartraining.html
49. S. Gupta, A. Dasgupta, and A. Routray, "Analysis of training of parameters in haar," in Proc. IEEE Int. Conf. Image Inf. Process., Shimla, India, 2011, pp. 1-4.
50. Gonzales and Woods, Digital Image Processing, 2nd ed. Englewood Cliffs, NJ, USA: Prentice-Hall, 1992.
51. T. Fawett, Roc Graphs: Notes And Practical Considerations For Researchers 2004.
52. P. K. Mohanty, S. Sarkar, and R. Kasturi, "Designing affine transformations based face recognition algorithms," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2005.
53. J. J. Lien, T. Kanade, J. F. Cohn, and C. Li, "Detection, tracking, and classification of action units in facial expression," Robot. Autonom. Syst., vol. 31, no. 3, pp. 131-146, May 2000.
54. Y.-T. Kim, "Contrast enhancement using brightness preserving bihistogram equalization," IEEE Trans. Consum. Electron., vol. 43, no. 1, pp. 1-8, Feb. 1997. (Pubitemid 127827459)
55. V. Ramesh and P. Meer, "Real-time tracking of non-rigid objects using mean shift," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Hilton Head, SC, USA, 2000, pp. 142-149.
56. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: A unifying framework," Int. J. Comput. Vis., vol. 56, no. 3, pp. 221-255, Feb./Mar. 2004.
57. Y. T. Chan, "A Kalman filter based tracking scheme with input estimation," IEEE Trans. Aerosp. Electron. Syst., vol. AES-15, no. 2, pp. 237-244, Mar. 1979. (Pubitemid 9452654)
58. J. Yang, "Two-dimensional PCA: A new approach to appearance-based face representation and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 131-137, Jan. 2004.
59. E. Zahran, A. Abbas, M. Dessouky, M. Ashour, and K. Sharshar, "High performance face recognition using PCA and ZM on fused LWIR and VISIBLE images on the wavelet domain," in Proc. ICCES, 2009, pp. 449-454.
60. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006. (Pubitemid 46405714)
61. B. Bhowmick and K. S. C. Kumar, "Detection and classification of eye state in IR camera for driver drowsiness identification," in Proc. IEEE Int. Conf. Signal Image Process. Appl., 2009, pp. 340-345.
62. O. Chapelle, P. Haffner, and V. N. Vapnik, "Support vector machines for histogram-based image classification," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1055-1064, Sep. 1999.
63. M. G. Lenné, T. J. Triggs, and J. R. Redman, "Time of day variations in driving performance," Accid. Anal. Prev., vol. 29, no. 4, pp. 431-437, Jul. 1997. (Pubitemid 127383872)
64. T. Åkersted, B. Peters, A. Anund, and G. Kecklund, "Impaired alertness and performance driving home from the night shift: A driving simulator study," J. Sleep Res., vol. 14, no. 1, pp. 17-20, Mar. 2005. (Pubitemid 40403058)