An eye localization, tracking and blink pattern recognition system: Algorithm and evaluation

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 6, Issue 2, 2010, Pages

  Wu, Junwen ^a   Trivedi, Mohan M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Eye blink detection; Human computer interface; Particle filtering; Video processing

Indexed keywords

BAYESIAN CRITERION; BENCHMARK DATA; BLINK DETECTION SYSTEM; BLINK DURATION; COARSE TO FINE; DETECTION RATES; EXPERIMENTAL EVALUATION; EXPERIMENTAL SETUP; EYE BLINK; EYE DETECTION; EYE LOCALIZATION; EYE-TRACKING; FACIAL FEATURE DETECTION; FEATURE SPACE; FEATURE SUBSPACE; FUNDAMENTAL PROBLEM; GAUSSIAN MIXTURES; HUMAN COMPUTER INTERFACES; IMAGE PATCHES; INTERACTIVE PARTICLES; LOGISTIC REGRESSIONS; OBJECT DETECTION; OBSERVATION MODEL; PARTICLE FILTER; PARTICLE FILTERING; POSTERIOR PROBABILITY; PROBABILITY LEARNING; TRACKING ACCURACY; VIDEO PROCESSING;

BINARY TREES; EVOLUTIONARY ALGORITHMS; EYE PROTECTION; INDEPENDENT COMPONENT ANALYSIS; INTERFACES (COMPUTER); NONLINEAR FILTERING; PATTERN RECOGNITION SYSTEMS; PROBABILITY; VIDEO SIGNAL PROCESSING;

PROBABILITY DENSITY FUNCTION;

EID: 77950163425     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/1671962.1671964     Document Type: Article

References (41)

1. ALEX, M., VASILESCU, O., AND TERZOPOULOS, D. 2002. Multilinear analysis of image ensembles: Tensorfaces. In Proceedings of the European Conference on Computer Vision.
2. BELL, A. AND SEJNOWSKI, T. 1995. An information-maximization approach to blind separation and blind deconvolution. Neural Computation 7, 1129-1159.
3. BELLMAN, R. E. 1961. Adaptive Control Processes. Princeton University Press.
4. CHANG, C. AND ANSARI, R. 2005. Kernel particle filter for visual tracking. IEEE Signal Process. Lett. 12, 3, 242-245.
5. CHAU, M. AND BETKE, M. 2005. Real time eye tracking and blink detection with USB cameras. Tech. Rep. Boston University Computer Science, 2005-2012
6. COHN, J. F., XIAO, J., MORIYAMA, T., AMBADAR, Z., AND KANADE, T. 2003. Automatic recognition of eye blinking in spontaneously occurring behavior. Behav. Research Methods, Instruments Computers 35, 2, 420-428.
7. DUDA, R., HART, P., AND STORK, D. 2000. Pattern Classification (2nd ed.). Wiley Interscience.
8. FLETCHER, L., PETERSSON, L., APOSTOLOFF, N., AND ZELINSKY, A. 2003. Vision in and out of vehicles. IEEE Intell. Syst.
9. GHINEA, G., DJERABA, C., GULLIVER, S. R., AND COYNE, K. P. 2007. Introduction to special issue on eye-tracking applications in multimedia systems. ACM Trans. Multimedia Comput. Comm. Appl. 3, 4.
10. GORODNICHY, D. 2003. Second order change detection, and its application to blink-controlled perceptual interfaces. In Proceedings of the International Association of Science and Technology for Development (IASTED) Conference on Visualization, Imaging and Image Processing (VIIP).
11. GRAUMAN, K., BETKE, M., LOMBARDI, J., GIPS, J., AND BRADSKI, G. 2003. Communication via eye blinks and eyebrow raises: Video-based human-computer interfaces. Universal Access Inform. Society 2, 4, 359-373.
12. GUAN, Y., FLEISSNER, R., JOYCE, P., AND KRONE, S. M. 2006. Markov chain Monte Carlo in small worlds. Statist. Comput. 16, 2, 193-202.
13. GUSTAFSSON, F., GUNNARSSON, F., BERGMAN, N., FORSSELL, U., JANSSON, J., KARLSSON, R., AND NORDLUND, P. 2002. Particle filters for positioning, navigation, and tracking. IEEE Trans. Signal Proc. 50, 425-435.
14. HE, X., CAI, D., AND NIYOGI, P. 2005a. Tensor subspace analysis. In Proceedings of the Conference on Neural Information Processing Systems (NIPS).
15. HE, X., YAN S., HU, Y., NIYOGI, P., AND ZHANG, H.-J. 2005b. Face recognition using Laplacian faces. IEEE Trans. Patt. Anal. Mach. Intell. 27, 3 (Mar.).
16. HSU, R. L., ABDEL-MOTTALEB, M., AND JAIN, A. K. 2002. Face detection in color images. IEEE Trans. Patt. Anal. Mach. Intell. 24, 5, 696-706.
17. HUANG, K. AND TRIVEDI, M. M. 2001. Networked omnivision arrays for intelligent environment. In Proceedings of the 4th IEEE International Workshop on Applications and Science of Soft Computing.
18. HUANG, K. AND TRIVEDI, M. M. 2003. Driver head pose and view estimation with single omnidirectional video stream. In Proceedings of the 1st International Workshop on In-Vehicle Cognitive Computer Vision Systems, in Conjunction with the 3rd International Conference on Computer Vision Systems.
19. ISARD,M. AND BLAKE, A. 1998. Condensation-conditional density propagation for visual tracking. Inter. J. Comput. Vision 29, 1.
20. JI, Q. AND YANG, X. 2002. Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imag. 8, 5, 357-377.
21. KOJIMA, N., KOZUKA, K., NAKANO, T., AND YAMAMOTO, S. 2001. Detection of consciousness degradation and concentration of a driver for friendly information service. In Proceedings of the IEEE International Vehicle Electronics Conference.
22. LEE, M., COHEN, I., AND JUNG, S. 2002. Particle filter with analytical inference for human body tracking. In Proceedings of the IEEE Workshop on Motion and Video Computing.
23. MORIYAMA, T., KANADE, T., COHN, J. F., XIAO, J., AMBADAR, Z., GAO, J., AND IMAMURA, H. 2002. Automatic recognition of eye blinking in spontaneously occurring behavior. In Proceedings of the International Conference on Pattern Recognition (ICPR).
24. MORRIS, T., ZAIDI, F., AND BLENKHORN, P. 2002. Blink detection for real-time eye tracking. J. Netw. Comput. Appl. 25, 2, 129-143.
25. NGUYEN, K. 2002. Differences in the infrared bright pupil response of human eyes. In Proceedings of the Eye Tracking Research and Applications Symposium.
26. NISHIYAMA, K. 2005. Fast and effective generation of the proposal distribution for particle filters. Signal Process 85, 12, 2412-2417.
27. OKUMA, K., TALEGHANI, A., DE FREITAS, N., LITTLE, J. J., AND LOWE, D. G. 2004. A boosted particle filter: Multitarget detection and tracking. In Proceedings of the European Conference on Computer Vision.
28. ONOE,Y.,YOKOYA,N.,YAMAZAWA, K., AND TAKEMURA,H. 1998. Visual surveillance and monitoring system using an omnidirectional video camera. In Proceedings of the 14th International Conference on Pattern Recognition.
29. PANTIC, M., PENTLAND, A.,NIJHOLT, A., ANDHUANG, T. S. 2006. Human computing and machine understanding of human behavior: a survey. In Proceedings of the 8th International Conference on Multimodal Interfaces (ICMI). 239-248.
30. PHILLIPS, P. J.,MOON, H., RIZVI, S. A., AND RAUSS, P. J. 2000. The feret evaluation methodology for face recognition algorithms. IEEE Trans. Patt. Anal. Mach. Intell. 22.
31. ROWEIS, S. T. AND SAUL, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science, 290.
32. RUI, Y. AND CHEN, Y. 2001. Better proposal distributions: Object tracking using unscented particle filter. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR).
33. RURAINSK, Y., AND EISERT, P. 2003. Template-based eye and mouth detection for 3D video conferencing. In Proceedings of the International Workshop on Very Low Bitrate Video.
34. SCHNEIDERMAN, H. 2004. Learning a restricted Bayesian network for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
35. SHEN, C., BROOKS, M. J., AND VAN DEN HENGEL, A. 2005. Augmented particle filtering for efficient visual tracking. In Proceedings of the IEEE International Conference on Image Processing.
36. SMITH, P., SHAH, M., AND D. A. V. LOBO, N. 2000. Monitoring head/eye motion for driver alertness with one camera. In Proceedings of the 15th IEEE International Conference on Pattern Recognition.
37. TRIVEDI, M. M., HUANG, K. S., AND MIKIC, I. 2005. Dynamic context capture and distributed video arrays for intelligent spaces. IEEE Trans. Syst. Man, Cybern. A Syst. Humans 35, 1 (Jan.), 145-163.
38. VEERARAGHAVAN, H. AND PAPANIKOLOPOULOS, N. P. 2001. Detecting driver fatique through the use of advanced face monitoring techniques. Tech. rep. University of Minnesota, Center for Transportation Studies.
39. WANG, P., MATTHEW, B. G., QIANG, J., AND WAYMAN, W. J. 2005. Automatic eye detection and its validation. In Proceedings of the IEEE Workshop on Face Recognition Grand Challenge Experiments (in Conjunction With CVPR).
40. WELCH, G. AND BISHOP, G. 1995. An introduction to the Kalman filter. Tech. rep. University of North Carolina at Chapel Hill, Chapel Hill, NC.
41. ZHU, S. C. 2003. Statistical modeling and conceptualization of visual patterns. IEEE Trans. Patt. Anal. Mach. Intell. 25, 6, 691-712.