On-line detection of drowsiness using brain and visual information

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 42, Issue 3, 2012, Pages 764-775

  Picot, Antoine ^a   Charbonnier, Sylvie ^b   Caplier, Alice ^b  

^a UNIVERSITY OF CHICAGO   (United States)

^b UNIV GRENOBLE ALPES   (France)

Author keywords

Blinking analysis; cascading rules decision; drowsiness; electroencephalographic (EEG); electrooculographic (EOG); fuzzy logic

Indexed keywords

BLINKING ANALYSIS; CASCADING RULES DECISION; DROWSINESS; ELECTROENCEPHALOGRAPHIC (EEG); ELECTROOCULOGRAPHIC (EOG);

BRAIN; FUZZY LOGIC;

DETECTORS;

EID: 84860127261     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2011.2164242     Document Type: Article

References (35)

1. J. Connor, "The role of driver sleepiness in car crashes: A review of the epidemiological evidence," in Drugs, Driving and Traffic Safety. New York: Springer-Verlag, 2009, pp. 187-205.
2. J. Yang, Z. Mao, L. Tijerina, J. Coughlin, and E. Feron, "Detection of driver fatigue caused by sleep deprivation," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 39, no. 4, pp. 694-705, Jul. 2009.
3. T. Pilutti and G. Ulsoy, "Identification of driver state for lane-keeping tasks," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 29, no. 5, pp. 486-502, Sep. 1999.
4. Q. Ji, P. Lan, and C. Looney, "A probabilistic frame work formodeling and real-time monitoring human fatigue," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 36, no. 5, pp. 862-875, Sep. 2006.
5. A. Picot, S. Charbonnier, and A. Caplier, "Monitoring drowsiness on-line using a single encephalographic channel," in Recent Advances in Biomedical Engineering. Rijeka, Croatia: IN-TECH, 2009, pp. 145-164.
6. G. Renner and S. Mehring, "Lane departure and drowsiness-Two major accident causes-One safety system," Transport Res. Lab., Berkshire, U.K., Tech. Rep., 1997.
7. M. Gillberg, G. Kecklund, and T. Akerstedt, "Sleepiness and performance of professional drivers in a truck simulator-Comparisons between day and night driving," J. Sleep Res., vol. 5, no. 1, pp. 12-15, Mar. 1996.
8. A. Muzet, T. Pébayle, J. Langrognet, and S. Otmani, "AWAKE Pilot Study No. 2: Testing steering grip sensor measures," CEPA, Gatineau, QC, Canada, Tech. Rep. IST-2000-28062, 2003.
9. T. Vöhringer-Kuhnt, T. Baumgarten, K. Karrer, and S. Briest, "Wierwille's method of driver drowsiness evaluation revisited," in Proc. Int. Conf. Traffic Transp. Psychol., 2004, vol. 3, pp. 5-9.
10. T. Akerstedt and M. Gillberg, "Subjective and objective sleepiness in the active individual," Int. J. Neurosci., vol. 52, no. 1/2, pp. 29-37, May 1990.
11. S. Otmani, T. Pebayle, J. Rogé, and A. Muzet, "Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers," Physiol. Behav., vol. 84, no. 5, pp. 715-724, Apr. 2005.
12. P. Caffier, U. Erdmann, and P. Ullsperger, "Experimental evaluation of eyeblink parameters as a drowsiness measure," Eur. J. Appl. Physiol., vol. 89, no. 3/4, pp. 319-325, May 2003.
13. N. Galley, R. Schleicher, and L. Galley, "Blink parameter as indicators of driver's sleepiness-Possibilities and limitations," Vis. Veh., vol. 10, pp. 189-196, 2004.
14. K. Ben Khalifa, M. Bédoui,M. Dogui, and F. Alexandre, "Alertness states classification by SOM and LVQ neural networks," Int. J. Inf. Technol., vol. 1, no. 4, pp. 228-231, 2004.
15. R. Rosipal, B. Peters, G. Kecklund, T. Akerstedt, G. Gruber, M. Woertz, P. Anderer, and G. Dorffner, "EEG-based drivers' drowsiness monitoring using a hierarchical Gaussian mixture model," in Proc. Hum. Comput. Interact., 2007, vol. 16, pp. 294-303.
16. A. Yildiz, M. Akin, M. Poyraz, and G. Kirbas, "Application of adaptive neuro-fuzzy inference system for vigilance level estimation by using wavelet-entropy feature extraction," J. Expert Syst. Appl., vol. 36, no. 4, pp. 7390-7399, May 2009.
17. H. Su and G. Zheng, "A partial least squares regression-based fusion model for predicting the trend in drowsiness," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 38, no. 5, pp. 1085-1092, Sep. 2008.
18. A. Picot, A. Caplier, and S. Charbonnier, "Drowsiness detection based on visual signs: Blinking analysis based on high frame rate video," in Proc. IEEE Instrumen. Meas. Tech. Conf., Austin, TX, 2010, pp. 801-804.
19. A. Picot, A. Caplier, and S. Charbonier, "Comparison between EOG and high frame rate camera for drowsiness detection," in Proc. IEEE Workshop Appl. Comput. Vis., Snowbird, UT, 2009, pp. 1-6.
20. S. Boverie, A. Giralt, and J.-M. L. Quellec, "Diagnostic fusion for in vehicle driver vigilance assessment," in Proc. 17th IFAC World Congr., Seoul, Korea, 2008, vol. 17, no. 1, pp. 12 825-12 830.
21. L. Bergasa, J. Nuevo, M. Sotelo, R. Barea, and M. E. López, "Real-time system for monitoring driver vigilance," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 1, pp. 63-77, Mar. 2006.
22. J. Jimenez-Pinto and M. Torres-Torriti, "Driver alert state and fatigue detection by salient points analysis," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2009, pp. 455-461.
23. S. Khardi and N. Hernandez-Gress, "Validation d'un nouveau système hybride de diagnostic de l'état de vigilance du conducteur," Recherche-Transport-Sécurité, vol. 66, pp. 101-112, Jan.-Mar. 2000.
24. H. Su and G. Zheng, "A non-intrusive drowsiness related accident prediction model based on D-S evidence theory," in Proc 1st Int. Conf. Bioinformat. Biomed. Eng., Wuhan, China, 2007, pp. 570-573.
25. I. Damousis, I. Cester, S. Nikolaou, and D. Tzovaras, "Psychological indicators based sleep onset prediction for the avoidance of driving accidents," in Proc. 29th IEEE EMBS Conf., Lyon, France, 2007, pp. 6700-6705.
26. J. Hanley and B. McNeil, "The meaning and use of the area under a receiver operating characteristic (ROC) curve," Radiol., vol. 143, no. 1, pp. 29-36, Apr. 1982.
27. K. Blinowska and P. Durka, "Electroencephalography (EEG)," in Wiley Encyclopedia of Biomedical Engineering. Hoboken, NJ: Wiley, 2006.
28. S. Makeig, T.-P. Jung, and T. J. Sejnowski, "Awareness during drowsiness: Dynamics and electrophysiological correlates," Can. J. Exp. Psychol., vol. 54, no. 4, pp. 266-273, Dec. 2000.
29. R.-S. Huang, T.-P. Jung, and S. Makeig, "Tonic changes in EEG power spectra during simulated driving," in Proc. Found. Augmented Cognit. Neuroergonom. Oper. Neurosci.-Lecture Notes in Computer Science, 2009, pp. 394-403.
30. J. Ragot, M. Darouach, D. Maquin, and G. Bloch, Validation de données et diagnostic, Traité des nouvelles technologies, 1990.
31. K. Karrer, T. Vöhringer-Kuhnt, T. Baumgarten, and S. Briest, "The role of individual differences in driver fatigue prediction," in Proc. 3rd Int. Conf. Traffic Transp. Psychol., Nottingham, U.K., 2004, pp. 5-9.
32. H. Sharabaty, D. Esteve, and B. Jammes, "Automatic EOG analysis: A first step toward automatic drowsiness scoring during wake sleep transitions," Somnologie, vol. 12, no. 3, pp. 227-232, Sep. 2008.
33. A. Bonnefond, J. Rogé, and A. Muzet, "Behavioural reactivation and subjective assessment of the state of vigilance-Application to simulated car driving," Int. J. Occupat. Safety Ergonom., vol. 12, no. 3, pp. 221-229, 2006.
34. Q. McNemar, "Note on the sampling error of the difference between correlated proportions or percentages," Psychometrika, vol. 12, no. 2, pp. 153-157, Jun. 1947.
35. A. Picot, S. Charbonnier, and A. Caplier, "EOG-based drowsiness detection: Comparison between a fuzzy system and two supervised learning classifiers," in Proc. 18th IFAC World Congr., Milano, Italy, 2011, pp. 1-6.