Driver alertness monitoring using fusion of facial features and bio-signals

IEEE Sensors Journal

Volumn 12, Issue 7, 2012, Pages 2416-2422

  Lee, Boon Giin ^a   Chung, Wan Young ^a  

^a Pukyong National University   (South Korea)

Author keywords

Android based smartphone; dynamic Bayesian network; fatigue; features fusion; photoplethysmograph

Indexed keywords

BIOSIGNALS; CURRENT DRIVING; DISCRETE METHOD; DRIVER BEHAVIOR; DRIVER DROWSINESS; DRIVER FATIGUE; DRIVER SAFETY; DYNAMIC BAYESIAN NETWORKS; FACIAL FEATURE; FATIGUE DETECTION; MONITORING SYSTEM; MULTIPLE FEATURES; PHOTOPLETHYSMOGRAPH; SENSORY DATA; VIDEO SENSORS;

EYE MOVEMENTS; FATIGUE OF MATERIALS; ROBOTS; SIGNAL ENCODING; SMARTPHONES;

SENSORS;

EID: 84861898531     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2012.2190505     Document Type: Article

References (30)

1. N. Xu, "A survey of sensor network applications," IEEE Commun. Mag., vol. 40, no. 8, pp. 1-9, Aug. 2002.
2. M. Ying, "Application of sensor networks," Dept. Comput. Sci., Friedrich-Alexander-Univ. Erlangen-Nuremberg, Nuremberg, Germany, May 2005.
3. R. L. Lai and C. L. Liu, "A fuzzy control massage seat for awaking drowsy drivers," in Proc. 7th Ind. Eng. Manage. Syst. Conf., Bangkok, Thailand, 2006, pp. 618-623.
4. L. M. Bergasa, J. Nuevo, M. A. Sotelo, R. Barea, and M. E. Lopez, "Real-time system for monitoring driver vigilance," IEEE Trans. Intell. Transport. Syst., vol. 7, no. 1, pp. 63-77, Mar. 2006.
5. T. Kasukabe, M. Hiraoka, O. Yamamoto, M. Yamada, and T. Nakano, "Development of system for comprehensively measuring driving ability for elderly safe driving," in Proc. Conf. Mach. Vis. Appl., Yokohama, Japan, May 2009, pp. 443-446.
6. J. Pauwelussen and P. J. Feenstra, "Driver behavior analysis during ACC activation and deactivation in a real traffic environment," IEEE Trans. Intell. Transport. Syst., vol. 11, no. 2, pp. 329-338, Jun. 2010.
7. J. D. Lee, J. D. Li, L. C. Liu, and C. M. Chen, "A novel driving pattern recognition and status monitoring system," in Proc. Pacific-Rim Symp. Image Video Technol., Hsinchu, Taiwan, Dec. 2006, pp. 504-512.
8. S. F. Zhao, G. H. Xu, and T. F. Tao, "Detecting driver's drowsiness using multiwavelet packet energy spectrum," in Proc. Int. Congr. Image Signal Process., Tianjin, China, Oct. 2009, pp. 1-5.
9. Y. S. Lee and W. Y. Chung, "Video sensor based eye tracking and blink detection to automated drowsy driving warning system using image processing," in Proc. 13th Int. Meet. Chem. Sensors, Perth, Australia, Jul. 2010, p. 358.
10. J. H. Yang, Z. H. Mao, L. Tijerina, T. Pilutti, J. F. Coughlin, and E. Feron, "Detection of driver fatigue caused by sleep deprivation," IEEE Trans. Syst. Man Cybern. Part A.: Syst. Humans, vol. 39, no. 4, pp. 697-705, Jul. 2009.
11. J. Wang and Y. Gong, "Recognition of multiple drivers' emotional state," in Proc. 19th Int. Conf. Pattern Recognit., Tampa, FL, Dec. 2008, pp. 1-4.
12. H. S. Shin, S. J. Jung, J. J. Kim, and W. Y. Chung, "Real time car driver's condition monitoring system," in Proc. IEEE Sensors, Nov. 2010, pp. 951-954.
13. P. Bouchner, R. Pieknik, S. Novontny, J. Pekny, M. Hajny, and C. Borzová, "Fatigue of car drivers -detection and classification based on experiments on car simulators," in Proc. 6th Int. Conf. Simul., Model., Optim., Lisbon, Portugal, Sep. 2006, pp. 727-732.
14. R. N. Khushaba, S. Kodagoda, S. Lal, and G. Dissanayake, "Driver drowsiness classification using fuzzy wavelet-packet-based featureextraction algorithm," IEEE Trans. Biomed. Eng., vol. 58, no. 1, pp. 121-131, Jan. 2011.
15. C. T. Lin, Y. C. Chen, T. Y. Huang, T. T. Chiu, L. W. Ko, and S. F. Liang, "Development of wireless brain computer interface with embedded multitask scheduling and its application on real-time driver's drowsiness detection and warning," IEEE Trans. Biomed. Eng., vol. 55, no. 5, pp. 1582-1591, May 2008.
16. M. M. Bundele and R. Banerjee, "Detection of fatigue vehicular driver using skin conductance and oximetry pulse: A neural network approach," in Proc. 11th Int. Conf. Inf. Integr. Web-Based Appl. Serv., 2009, pp. 739-744.
17. G. S. Yang, Y. Z. Lin, and P. Bhattacharya, "A driver fatigue recognition model based on information fusion and dynamic Bayesian network," Int. J. Inf. Sci., vol. 180, no. 10, pp. 1942-1954, May 2010.
18. S. V. Deshmukh, D. P. Radake, and K. N. Hande, "Driver fatigue detection using sensor network," Int. J. Eng. Sci. Technol., NCICT Conf., Special Issue, pp. 89-92, Feb. 2011.
19. A. Giusti, C. Zocchi, and A. Rovetta, "A noninvasive system for evaluating driver vigilance level examining both physiological and mechanical data," IEEE Trans. Intell. Transport. Syst., vol. 10, no. 1, pp. 127-134, Mar. 2009.
20. A. Eskandarian and R. A. Sayed, "Analysis of driver impairment, fatigue, and drowsiness and an unobstrusive vehicle-based detection scheme," in Proc. 1st Int. Conf. Traffic Accidents, Dec. 2005, pp. 35-49.
21. Y. L. Liang, M. L. Reyes, and J. D. Lee, "Real-time detection of driver cognitive distraction using support vector machines," IEEE Trans. Intell. Transport. Syst., vol. 8, no. 2, pp. 340-350, Jun. 2007. (Pubitemid 46873214)
22. W. H. Liao, W. H. Zhang, Z. W. Zhu, and Q. Ji, "A real-time human stress monitoring system using dynamic Bayesian network," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshop, San Diego, CA, Jun. 2005, p. 70.
23. 2," in Proc. 30th Annu. Int. IEEE EMBS Conf., Vancouver, BC, Canada, Aug. 2008, pp. 1529-1532.
24. A. Shabtai, Y. Fledel, U. Kanonov, Y. Elovici, and S. Dolev, "Google android: A state-of-the-art review of security mechanisms," Comput. Inf. Sci., vol. 126, no. 8950, pp. 1-42, 2009.
25. Achro HD [Online]. Available: http://huins.com/en/m12.php?m=rd&no=100
26. Achro PC100 [Online]. Available: http://huins.com/en/m12.php?m=rd&no= 101
27. Z. L. Zheng and F. Yang, "Enhanced active shape model for facial feature localization," in Proc. Int. Conf. Mach. Learn. Cybern., Jul. 2008, pp. 2841-2845.
28. C. Zocchi, A. Rovetta, and F. Fanfulla, "Physiological parameters variation during driving simulations," in Proc. IEEE/ASME Int. Conf. Adv. Intell. Mech., Sep. 2007, pp. 1-6.
29. H. Park, S. Oh, and M. Hahn, "Drowsy driving detection based on human pulse wave by photoplethysmography signal processing," in Proc. 3rd Int. Univer. Commun. Symp., 2009, pp. 89-92.
30. Q. Wu, B. X. Sun, B. Xie, and J. J. Zhao, "A perclos-based driver fatigue recognition application for smart vehicle space," in Proc. 3rd Int. Symp. Inf. Process., Oct. 2010, pp. 437-441.