Hybrid computer vision system for drivers' eye recognition and fatigue monitoring

Neurocomputing

Volumn 126, Issue , 2014, Pages 78-94

  Cyganek, Bogusław ^a   Gruszczyński, Sławomir ^a  

^a AGH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Poland)

Author keywords

Driver monitoring; Eye recognition; Tensor processing

Indexed keywords

DRIVER MONITORING; EYE RECOGNITION; FATIGUE MONITORING; HIGHER ORDER SINGULAR VALUE DECOMPOSITION; REALTIME PROCESSING; RECOGNITION ACCURACY; SOFTWARE IMPLEMENTATION; VISUAL SYSTEMS;

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; HYBRID COMPUTERS; TENSORS;

BEHAVIORAL RESEARCH;

ACCURACY; ALGORITHM; ARTICLE; ATTENTION; BIOLOGICAL MODEL; BIOLOGICAL MONITORING; CAMERA; CLASSIFIER; COMPARATIVE STUDY; COMPUTER PROGRAM; COMPUTER SYSTEM; CONTROLLED STUDY; DRIVER; EYE RECOGNITION; FALSE POSITIVE RESULT; FATIGUE; HIGHER ORDER SINGULAR VALUE DECOMPOSITION CLASSIFIER; HUMAN; HUMAN EXPERIMENT; HYBRID COMPUTER VISION SYSTEM; IMAGE ANALYSIS; IMAGE PROCESSING; LIGHT EMITTING DIODE; MALE; NEAR INFRARED SPECTROSCOPY; NORMAL HUMAN; PATTERN RECOGNITION; PRIORITY JOURNAL; SOMNOLENCE; TRAFFIC SAFETY; VALIDATION STUDY; VISUAL SYSTEM FUNCTION;

EID: 84887618598     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.01.048     Document Type: Article

References (62)

1. Abraham A., Corchado E., Corchado J.M. Hybrid learning machines. Neurocomputing 2009, 72(13-15):2729-2730.
2. Agilent Technologies Inc. Application Note 1118: Compliance of Infrared Communication Products to IEC 825-1 and CENELEC EN 60825-1, 1999.
3. Ahlstrom C., Victor T., Wege C., Steinmetz E. Processing of eye/head-tracking data in large-scale naturalistic driving data sets. IEEE Transactions on Intelligent Transportation Systems 2012, 13(2):553-564.
4. AlliedVision: http://www.alliedvisiontec.com/emea/products/cameras/firewire/guppy-pro/f-031bc.html.
5. Bergasa L.M., Nuevo J., Sotelo M.A., Barea R., Lopez E. Visual monitoring of driver inattention. Comput. Intel. in Automotive Applications 2008, 132:25-51. SCI.
6. Campadelli P., Lanzarotti R., Lipori G. Eye localization: a survey. NATO Science Series 2006.
7. Chiang C-C., Tai W-K., Yang M-T., Huang Y-T., Huang C-J. A novel method for detecting lips, eyes and faces in real time. Real-Time Imaging 2003, 9:277-287.
8. Chong Y., Chen W., Li Z., Lam W.H.K., Zheng C., Li Q. Integrated real-time vision-based preceding vehicle detection in urban roads. Neurocomputing 2013, 116:144-149.
9. Cichocki A., Zdunek R., Phan A.H., Amari S-I. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation 2009, Wiley.
10. D. Comaniciu, V. Ramesh, P. Meer: Real-time tracking of non-rigid objects using mean shift, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition CVPR '00, vol. 2, 2000, pp. 142-149.
11. Corchado E., Abraham A.C., de Carvalho L.F. Hybrid intelligent algorithms and applications. Information Science 2010, 180(14):2633-2634.
12. Corchado E., Graña M., Woźniak M. New trends and applications on hybrid artificial intelligence systems. Neurocomputing 2012, 75(1):61-63.
13. F.C. Crow, Summed-area table for texture mapping, in: Proceedings of Computer Graphics SIGGRAPH'84, vol. 18, no. 3, 1984, pp. 207-212.
14. Cyganek B., Siebert J.P. An Introduction to 3D Computer Vision Techniques and Algorithms 2009, Wiley.
15. Cyganek B. An Analysis of the Road Signs Classification Based on the Higher-Order Singular Value Decomposition of the Deformable Pattern Tensors, Advanced Concepts for Intelligent Vision Systems Acivs 2010, LNCS 6475 2010, 191-202. Springer.
16. B. Cyganek, Image segmentation with a hybrid ensemble of one-class support vector machines, in: M. Graña Romay et al. (Eds.), Proceedings of the International Conference on Hybrid Artificial Intelligence Systems, Springer, San Sebastian, Spain, HAIS 2010, Part I, LNAI 6076, 2010, pp. 256-263.
17. Cyganek B. A software framework for tensor representation and decompositions for object recognition. Image Processing & Communications 2010, 15(2):5-16.
18. B. Cyganek, S. Gruszczyński, Visual system for drivers' eye recognition, in: E. Corchado, M. Kurzyński, M. Woźniak (Eds.), Proceedings of the International Conference on Hybrid Artificial Intelligence Systems, HAIS 2011, Part I, LNAI 6678, Springer, Heidelberg, 2011, pp. 436-443.
19. B. Cyganek, Adding parallelism to the hybrid image processing library in multi-threading and multi-core systems, in: Proceedings of the 2nd IEEE International Conference on Networked Embedded Systems for Enterprise Applications (NESEA 2011), Perth, Australia, 2011.
20. J. Derrac, S. García, F. Herrera, A First Study on the Use of Coevolutionary Algorithms for Instance and Feature Selection. HAIS 2009, Lecture Notes in Computer Science 5572, Springer, 2009, pp. 557-564.
21. Dong Y., Hu Z., Uchimura K., Murayama N. Driver inattention monitoring system for intelligent vehicles: a review. IEEE Transactions on Intelligent Transportation Systems 2011, 12(2):596-614.
22. Du Y., Hu Q., Ma P., Su X. Driver status recognition by neighborhood covering rules. Lecture Notes on Computer Science 2011, 6954:327-336.
23. I. García, S. Bronte, L.M. Bergasa, N. Hernandez, B. Delgado, M. Sevillano, Vision-based drowsiness detector for a Realistic Driving Simulator, in: Proceedings of the 13th International IEEE Annual Conference on Intelligent Transportation Systems Madeira Island, Portugal, 2010.
24. I. García, S. Bronte, L.M. Bergasa, J. Almazán, J. Yebes, Vision-based drowsiness detector for Real Driving Conditions, in: Proceedings of the 2012 Intelligent Vehicles Symposium, Alcalá de Henares, Spain, 2012.
25. Golub G.H., Van Loan C.F. Matrix Computations 1996, The Johns Hopkins University Press. 3rd edition.
26. Golz M., Sommer D., Trutschel U., Sirois B., Edwards D. Evaluation of fatigue monitoring technologies. Somnologie 2010, 14:187-199.
27. Hsu R.-L., Abdel-Mottaleb M., Jain A.K. Face detection in color images. IEEE PAMI 2002, 24(5):696-707.
28. http://www.aide-eu.org/press_corner.html.
29. 〈http://ec.europa.eu/transport/road_safety/users/professional-drivers/index_en.htm〉.
30. 〈http://heavyroute.fehrl.org/?m=32&id_directory=367〉.
31. 〈http://www.wiley.com/legacy/wileychi/cyganek3dcomputer/material.html〉.
32. M.J. Jones, J.M. Rehg, Statistical color models with application to pixel-level human skin detection, in: Proceedings of the IEEE International Conference Pattern Recognition, vol. 1, 2000, pp. 1056-1059.
33. T. Kawaguchi, D Hidaka, M Rizon, Detection of eyes from human faces by Hough transform and separability filter, in: Proceedings of the International Conference Image Processing, vol. 1, 2000, pp. 49-52.
34. Kittler J., Hatef M., Duing R.P.W., Matas J. On combining classifiers. IEEE PAMI 1998, 20(3):226-239.
35. Kolda T.G., Bader B.W. Tensor decompositions and applications. SIAM Review 2008.
36. R. Kothari, J.L. Mitchell, Detection of eye locations in unconstrained visual images, in: Proceedings of the International Conference in Image Processing, vol. 3, 1996, pp. 519-522.
37. Kuncheva L.I. Combining Pattern Classifiers 2004, Wiley.
38. L. de Lathauwer, Signal Processing Based on Multilinear Algebra. Ph.D. Dissertation, Katholieke Universiteit Leuven, 1997.
39. de L.Lathauwer, Moor de B, Vandewalle J. A multilinear singular value decomposition. SIAM Journal on Matrix Analysis and Applications 2000, 21(4):1253-1278.
40. Lee B-G., Chung W-Y. Driver alertness monitoring using fusion of facial features and bio-signals. IEEE Sensors Journal 2012, 12(7):2416-2422.
41. Lee S.J., Jo J., Jung H.G., Park K.R., Kim J. Real-time gaze estimator based on driver's head orientation for forward collision warning system. IEEE Transactions on Intelligent Transportation Systems 2011, 12(1):254-267.
42. Lee W.O., Lee E.C., Park K.R. Blink detection robust to various facial poses. Journal of Neuroscience Methods 2010, 193:356-372.
43. Lenskiy A.A., Lee J-S. Driver's eye blinking detection using novel color and texture segmentation algorithms. International Journal of Control, Automation, and Systems 2012, 10(2):317-327.
44. Y. Ma, X. Ding, Z. Wang, N. Wang, Robust precise eye location under probabilistic framework, in: Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, 2004, pp. 339-344.
45. D'Orazio T., Leo M., Guaragnella C., Distante A. A visual approach for driver inattention detection. Pattern Recognition 2007, 40:2341-2355.
46. Pedrycz W., Aliev R. Logic-oriented neural networks for fuzzy neurocomputing. Neurocomputing 2009, 73(1-3):10-23.
47. P. Peer, J. Kovac, F. Solina, Human skin colour clustering for face detection, in: Proceedings of the EUROCON 2003-International Conference on Computer as a Tool, 2003.
48. Phung S.L., Bouzerdoum A., Chai D. Skin segmentation using color pixel classification: analysis and comparison. IEEE PAMI 2005, 27(1):148-154.
49. Polikar R. Ensemble based systems in decision making. IEEE Circuits and Systems Magazine 2006, 21-45.
50. Press W.H., Teukolsky S.A., Vetterling W.T., Flannery B.P. Numerical Recipes in C. The Art of Scientific Computing 2007, Cambridge University Press. Third Edition.
51. Razmpa E., Niat K.S., Saedi B. Urban bus drivers' sleep problems and crash accidents. Indian Journal of Otolaryngology and Head & Neck Surgery 2011, 63(3):269-273.
52. R. Rosipal, B. Peters, G. Kecklund, T. Åkerstedt, G. Gruber, M. Woertz, P. Anderer, G. Dorffner, EEG-based drivers' drowsiness monitoring using a hierarchical Gaussian mixture model, in: Proceedings of the HCII2007-Augmented Cognition, 2007.
53. Savas B., Eldén L. Handwritten digit classification using higher order singular value decomposition. Pattern Recognition 2007, 40:993-1003.
54. Senaratne R., Jap B., Lal S., Hsu A., Halgamuge S., Fischer P. Comparing two video-based techniques for driver fatigue detection: classification versus optical flow approach. Machine Vision and Applications 2011, 22:597-618.
55. B. Sun, J. Feng, A fast algorithm for image Euclidean distance, in: Proceedings of the Chinese Conference on Pattern Recognition CCPR '08, 2008, pp. 1-5.
56. M.A.O. Vasilescu, D. Terzopoulos, Multilinear analysis of image ensembles: TensorFaces, in: Proceedings of the European Conference on Computer Vision, Denmark, 2002, pp. 447-460.
57. Viola P., Jones M.J. Robust real-time face detection. International Journal of Computer Vision 2004, 57(2):137-154.
58. P. Wang, M. Green, Q. Ji, J. Wayman, Automatic eye detection and its validation, in: CVPR'05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 03, 2003, pp. 164-171.
59. Wang L., Zhang Y., Feng J. On the Euclidean distances of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005, 27(8):1334-1339.
60. M. Wozniak, M. Zmyslony, Designing fusers on the basis of discriminants-evolutionary and neural methods of training, in: San Sebastian, Spain, M. Graña Romay et al. (Eds.), The International Conference on Hybrid Artificial Intelligence Systems, HAIS 2010, Part I, LNAI 6076, 2010, pp. 590-597.
61. Zhu Z., Ji Q. Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Computer Vision and Image Understanding 2005, 98:124-154.
62. Zhou Z.H., Geng X. Projection functions for eye detection. Pattern Recognition 2004, 37(5):1049-1056.