Blink detection robust to various facial poses

Journal of Neuroscience Methods

Volumn 193, Issue 2, 2010, Pages 356-372

  Lee, Won Oh ^a   Lee, Eui Chul ^b   Park, Kang Ryoung ^a  

^a Dongguk University   (South Korea)

^b National Institute for Mathematical Sciences   (South Korea)

Author keywords

Eye blink detection; Facial pose; Lucas Kanade Tomasi; Support vector machine

Indexed keywords

ACCURACY; ADULT; ARTICLE; EYELID CLOSURE; EYELID REFLEX; FACIAL EXPRESSION; FEMALE; HUMAN; HUMAN EXPERIMENT; ILLUMINATION; IMAGE ANALYSIS; IMAGE PROCESSING; LEARNING ALGORITHM; MALE; METHODOLOGY; NORMAL HUMAN; PRIORITY JOURNAL; SUPPORT VECTOR MACHINE; TECHNIQUE;

ALGORITHMS; BLINKING; COMPUTER SIMULATION; EYE; FACE; HUMANS; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; POSTURE;

EID: 78049389904     PISSN: 01650270     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jneumeth.2010.08.034     Document Type: Article

References (54)

1. Bala L.P., Talmi K., Liu J. Automatic detection and tracking of faces and facial features in video sequences. Proceedings of picture coding symposium 1997, 251-256.
2. Barbato G., Ficca G., Muscettola G., Fichele M., Beatrice M., Rinaldi F. Diurnal variation in spontaneous eye-blink rate. Psychiatry Res 2000, 93(2):145-151.
3. Bentivoglio A.R., Bressman S.B., Cassetta E., Carretta D., Tonali P., Albanese A. Analysis of blink rate patterns in normal subjects. Mov Disord 1997, 12(6):1028-1034.
4. Bouguet J.Y. Pyramidal implementation of the Lucas Kanade feature tracker description of the algorithm 2003, Intel Corporation, Microprocessor Research Labs. OpenCV Documents.
5. Chau M., Betke M. Real time eye tracking and blink detection with USB cameras 2005, Boston University Computer Science, Technical Report No. 2005-12.
6. Chen W.H., Chiang T.J., Hsu M.C., Liu J.S. The validity of eye blink rate in Chinese adults for the diagnosis of Parkinson's disease. Clin Neurol Neurosurg 2003, 105:90-92.
7. Crowley J.L., Berard F. Multi-modal tracking of faces for video communications. Proceedings of international conference on CVPR 1997, 640-645.
8. Declerck C.H., Brabander B., Boone C. Spontaneous eye blink rates vary according to individual differences in generalized control perception. Percep Mot Skills 2006, 102:721-735.
9. Deuschl G., Goddemeier C. Spontaneous and reflex activity of facial muscles in dystonia, Parkinson's disease, and in normal subjects. J Neurol Neurosurg Psychiatry 1998, 64(3):320-324.
10. Divjak M., Bischof H. Real-time video-based eye blink analysis for detection of low blink-rate during computer use. Proceedings of the 1st international workshop on tracking humans for the evaluation of their motion in image sequence (THEMIS) 2008, 99-107.
11. Divjak M., Bischof H. Eye blink based fatigue detection for prevention of computer vision syndrome. Proceedings of international conference on mach. vis. app. 2009, 350-353.
12. Doughty M.J. Consideration of three types of spontaneous eyeblink activity in normal humans: during reading and video display terminal use, in primary gaze, and while in conversation. Optom Vis Sci 2001, 78(10):712-715.
13. Doughty M.J. Further assessment of gender- and blink pattern-related differences in the spontaneous eyeblink activity in primary gaze in young adult humans. Optom Vis Sci 2002, 79(7):439-447.
14. Doughty M.J., Naase T. Further analysis of the human spontaneous eye blink rate by a cluster analysis-based approach to categorize individuals with 'normal' versus 'frequent' eye blink activity. Eye Contact Lens 2006, 32:294-299.
15. Freund Y., Schapire R.E. A short introduction to boosting. J. Jpn Soc Artif Intel 1999, 771-780.
16. Fukuda K. Eye blinks: new indices for the detection of deception. J Psychophysiol 2001, 40(3):239-245.
17. Gonzalez R.C., Woods R.E. Digital image processing 2002, Prentice-Hall, Inc. 2nd ed.
18. Gorodnichy D.O. Second order change detection and its application to blink-controlled perceptual interfaces. Proceedings of international assoc. of sci. and tech. for development 2003, 140-145.
19. Grauman K., Betke M., Gips J., Bradski G.R. Communication via eye blinks - detection and duration analysis in real time. Proceedings of international conference on CVPR 2001, 1010-1017.
20. Hansen D.W., Pece A.E.C. Eye tracking in the wild. Comput Vis Image Understand 2005, 98:155-181.
21. Heishman R., Duric Z. Using image flow to detect eye blinks in color videos. Proceedings of the 8th IEEE workshop on applications of comput. vision 2007, 52.
22. Hong L., Yuwen W., Hongbin Z. Eye states detection from color facial image sequence. Proc SPIE 2002, 4875:693-698.
23. [accessed on 2010.03.10]. http://www-ai.cs.uni-dortmund.de/SOFTWARE/MYSVM/index.html.
24. [accessed on 2010.03.10]. http://www-prima.inrialpes.fr/FGnet/data/01-TalkingFace/talking_face.html.
25. [accessed on 2010.03.10]. http://www.cs.ucl.ac.uk/staff/M.Sewell/winsvm/.
26. [accessed on 2010.03.10]. http://www.cs.zju.edu.cn/~gpan/.
27. [accessed on 2010.03.10]. http://www.logitech.com/en-us/webcam-communications/webcams.
28. Kawato S., Tetsutani N. Detection and tracking of eyes for gaze-camera control. Proceedings of international conference on vision interface 2002, 348-355.
29. Lalonde M., Byrns D., Gagnon L., Teasdale N., Laurendeau D. Real-time eye blink detection with GPU-based SIFT tracking. Proceedings of the fourth Canadian conference on computer and robot vision 2007, 481-487.
30. Lienhart R., Maydt J. An extended set of haar-like features for rapid object detection. Proceedings of international conference on image processing, vol. 1 2002, 900-903.
31. Mitelman R., Joshua M., Adler A., Bergman H. A noninvasive, fast and inexpensive tool for the detection of eye open/closed. J Neurosci Methods 2009, 178:350-356.
32. Moriyama T., Kanade T., Cohn J.F., Xiao J., Ambadar Z., Gao J., et al. Automatic recognition of eye blinking in spontaneously occurring behavior. Proceedings of international conference on pattern recog., vol. 4 2002, 78-81.
33. Morris T., Blenkhorn P., Zaidi F. Blink detection for real-time eye tracking. J Network Comput Apps 2002, 25(2):129-143.
34. Nam G.P., Kang B.J., Park K.R. Face recognition robust to the variation of illumination on mobile device based on SVM. KSII Trans Internet Inform Syst 2010, 4(1):25-44.
35. Naveen N.S., Gregory S.R., Emily E.E., Mark W., Michael J.S., Richard W.S., et al. A computer analysis of reflex eyelid motion in normal subjects and in facial neuropathy. Clin Biomech 2000, 15:766-771.
36. Nøjgaard J.K., Christensen K.B., Wolkoff P. The effect on human eye blink frequency of exposure to limonene oxidation products and methacrolein. Toxicol Lett 2005, 156(2):241-251.
37. Pan G., Sun L., Wu Z., Lao S. Eyeblink-based anti-spoofing in face recognition from a generic webcamera. Proceedings of the 11th IEEE international conference on computer vision (ICCV'07) 2007.
38. Park H.A., Park K.R. Iris recognition based on score level fusion by using SVM. Pattern Recog Lett 2007, 28(1):94-104.
39. Richard J., Larsen, Morris L.M. An introduction to mathematical statistics and its applications 2000, p. 282, ISBN 0139223037. 3rd ed.
40. Sforza C., Rango M., Galante D., Bresolin N., Ferrario V.F. Spontaneous blinking in healthy persons: an optoelectronic study of eyelid motion. Ophthal Physiol Opt 2008, 28(4):345-353.
41. Shi J., Tomasi C. Good features to track. Proceedings of the international conference on CVPR 1994, 593-600.
42. Sirohey S., Rosenfeld A., Duric Z. A method of detecting and tracking irises and eyelids in video. Pattern Recog 2002, 35(6):1389-1401.
43. Stern J.A., Boyer D., Schroeder D. Blink rate: a possible measure of fatigue. J Human Factors Ergon Soc 1994, 36(2):285-297.
44. Sun W.S., Baker R.S., Chuke J.C., Rouholiman R., Hasan S.A., Gaza W., et al. Age-related changes in human blinks. Invest Ophthalmol Vis Sci 1997, 38(1):92-99.
45. Tan H., Zhang Y.J. Detecting eye blink states by tracking iris and eyelids. Pattern Recog Lett 2006, 27:667-675.
46. Tian Y., Kanade T., Cohn J.F. Dual-state parametric eye tracking. Proceedings the international conference on automatic face and gesture recog. 2000, 26-30.
47. Tomasi C., Kanade T. Detection and tracking of point features: technical report CMU-CS-91-132 1991, Carnegie Mellon University.
48. Torricellia D.B., Goffredoa M.C., Confortoa S., Schmid M. An adaptive blink detector to initialize and update a view-based remote eye gaze tracking system in a natural scenario. Pattern Recog Lett 2009, 30(12):1144-1450.
49. VanderWerf F., Brassinga P., Reits D., Aramideh M., Visser B.O. Eyelid movements: behavioral studies of blinking in humans under different stimulus conditions. J Neurophysiol 2003, 89:2784-2796.
50. Vapnik V. Statistical learning theory 1998, John Wiley & Sons, NY, USA.
51. Viola P., Jones M. Robust real-time face detection. J Comput Vis 2004, 57(2):137-154.
52. Williamson A., Chamberlain T. Review of on-road driver fatigue monitoring devices: technical report 2005, NSW Injury Risk Management Research Centre.
53. Wilson G. An analysis of mental workload in pilots during flight using multiple psychophysiological measures. J Aviation Psychol 2002, 12(1):3-18.
54. Wolkoff P., Nøjgaard J.K., Franck C., Skov P. The modern office environment desiccates the eyes?. Indoor Air 2006, 16(4):258-265.