Robust real-time eye detection and tracking under variable lighting conditions and various face orientations

Computer Vision and Image Understanding

Volumn 98, Issue 1, 2005, Pages 124-154

  Zhu, Zhiwei ^a   Ji, Qiang ^a  

^a RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Eye tracking; Kalman filtering; Mean shift; Support vector machine

Indexed keywords

CAMERAS; EYE MOVEMENTS; FACE RECOGNITION; GLASS; KALMAN FILTERING; LIGHTING; OBJECT RECOGNITION; TRACKING (POSITION);

EYE TRACKING; MEAN SHIFT; REAL-TIME EYE DETECTION; SUPPORT VECTOR MACHINES;

REAL TIME SYSTEMS;

EID: 10044286099     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cviu.2004.07.012     Document Type: Article

References (43)

1. Q. Ji, X. Yang, Real time visual cues extraction for monitoring driver vigilance, in: Proc. Int. Workshop on Computer Vision Systems, Vancouver, Canada, 2001.
2. Q. Ji, Z. Zhu, Eye and gaze tracking for interactive graphic display, in: Second Int. Symp. on Smart Graphics, Hawthorne, NY, USA, 2002.
3. A. Yuille, P. Hallinan, D. Cohen, Feature extraction from faces using deformable templates, Int. J. Comput. Vis. 8(2) (1992) 99-111.
4. X. Xie, R. Sudhakar, H. Zhuang, On improving eye feature extraction using deformable templates, Pattern Recognit. 27 (1994) 791-799.
5. [S] K.M. Lam, H. Yan, Locating and extracting the eye in human face images, Pattern Recognit. 29 (1996) 771-779.
6. L. Zhang, Estimation of eye and mouth corner point positions in a knowledge-based coding system, in: Proc. SPIE, vol. 2952. Berlin, Germany, 1996, pp. 21-18.
7. M. Kampmann, L. Zhang, Estimation of eye, eyebrow and nose features in videophone sequences, in: Int. Workshop on Very Low Bitrate Video Coding (VLBV 98), Urbana, USA, 1998.
8. G.C. Feng, P.C. Yuen, Variance projection function and its application to eye detection for human face recognition, Int. J. Comput. Vis. 19 (1998) 899-906.
9. G.C. Feng, P.C. Yuen, Multi-cues eye detection on gray intensity image, Pattern Recognit. 34 (2001) 1033-1046.
10. M. Nixon, Eye spacing measurement for facial recognition, in: Proc. of the Society of Photo-Optical Instrument Engineers, 1985.
11. P.W. Hallinan, Recognizing human eyes, in: SPIE Proceedings, vol. 1570, Geometric Methods in Computer Vision, 1991, pp. 212-226.
12. A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'94), Seattle, WA, 1994.
13. W. min Huang and R. Mariani, Face detection and precise eyes location, in: Proc. Int. Conf. on Pattern Recognition (ICPR'00), 2000.
14. J. Huang, H. Wechsler, Eye detection using optimal wavelet packets and radial basis functions (rbfs), Int. J. Pattern Recognit. Artif. Intell. 13 (7) (1999) 1009-1025.
15. S. Kawato, J. Ohya, Two-step approach for real-time eye tracking with a new filtering technique, in: Proc. Int. Conf. on System, Man & Cybernetics, 2000, pp. 1366-1371.
16. S. Kawato, J. Ohya, Real-time detection of nodding and head-shaking by directly detecting and tracking the between-eyes, in: Proc. 4th IEEE Int. Conf. on Automatic Face and Gesture Recognition, 2000, pp. 40-45.
17. S. Kawato, N. Tetsutani, Real-time detection of between-the-eyes with a circle frequency filter, in: Proc. of ACCV2002, vol. I, 2002, pp. 442-447.
18. S. Kawato, N, Tetsutani, Detection and tracking of eyes for gaze-camera control, in: Proc. 15th Int. Conf. on Vision Interface, 2002.
19. Y. Tian, T. Kanade, J.F. Cohn, Dual-state parametric eye tracking, in: Proc. 4th IEEE Int. Conf. on Automatic Face and Gesture Recognition, 2000.
20. J. Waite, J. Vincent, A probabilistic framework for neural network facial feature location, Br. Telecom Technol. J. 10 (3) (1992) 20-29.
21. M. Reinders, R. Koch, and J. Gerbrands, Locating facial features in image sequences using neural networks, in: Proc. Second Int. Conf. on Automatic Face and Gesture Recognition, Killington, USA, 1997.
22. S.A. Sirohey, A. Rosenfeld, Eye detection, in: Technical Report CAR-TR-896, Center for Automation Research, University of Maryland, College Park, MD, 1998.
23. S.A. Sirohey, A. Rosenfeld, Eye detection in a face image using linear and nonlinear filters, Pattern Recognit. 34 (2001) 1367-1391.
24. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: International Joint Conference on Artificial Intelligence.
25. M. Motwani and Q. Ji, 3d face pose discrimination using wavelets, in: In Proceedings of IEEE International Conference on Image Processing, Thessaloniki, Greece, 2001.
26. H. Schneiderman and T. Kanade, A statistical method for 3d object detection applied to faces and cars, in: In IEEE Conference of Computer Vision ans Pattern Recognition, 2000.
27. Y. Ebisawa and S. Satoh, Effectiveness of pupil area detection technique using two light sources and image difference method, in: Proceedings of the 15th Annual Int. Conf. of the IEEE Eng. in Medicine and Biology Society, San Diego, CA, 1993, pp. 1268-1269.
28. Y. Ebisawa, Improved video-based eye-gaze detection method, IEEE Trans. Instrument. Meas. 47 (2) (1998) 948-955.
29. C. Morimoto, D. Koons, A. Amir, M. Flickner, Pupil detection and tracking using multiple light sources, Technical Report RJ-10117, IBM Almaden Research Center, 1998.
30. C. Morimoto, M. Flickner, Real-time multiple face detection using active illumination, in: Proc. fourth IEEE Int. Conf. on Automatic Face and Gesture Recognition 2000, Grenoble, France, 2000.
31. A. Haro, M. Flickner, I. Essa. Detecting and tracking eyes by using their physiological properties, dynamics, and appearance, in: Proceedings IEEE CVPR 2000, Hilton Head Island, South Carolina, 2000.
32. Lc Technologies. Available from: 〈http//www.eyegaze.com.〉.
33. Anon, Applied science laboratories. Available from: 〈http//www.a-s-l.com.com.〉.
34. Z. Zhu, Q. Ji, K. Fujimura, K. chih Lee, Combining Kalman filtering and mean shift for real time eye tracking under active ir illumination, in: Int. Conf. on Pattern Recognition, Quebec, Canada, 2002.
35. Z. Zhu, K. Fujimura, Q. Ji, Real-time eye detection and tracking under various light conditions, in: Symposium on Eye Tracking Research and Applications, New Orleans, LA, USA, 2002.
36. C. Cortes, V. Vapnik, Support-vector networks, Mach. Learn. 20 (1995) 273-297.
37. J. Huang, D. Ii, X. Shao, H. Wechsler, Pose discrimination and eye detection using support vector machines (svms), in: Proc. of NATO-ASI on Face Recognition: From Theory to Applications, 1998, pp. 528-536.
38. D. Comaniciu, V. Ramesh, P. Meer, Real-time tracking of non-rigid objects using mean shift, in: IEEE Conf. on Comp. Vis. and Pat. Rec., Hilton Head Island, South Carolina, 2000.
39. T.E. Hutchinson, Eye movement detection with improved calibration and speed. U.S. patent 4950069.
40. Q. Ji, X. Yang, Real-time eye, gaze, and face pose tracking for monitoring driver vigilance, in: Real-Time Imaging, 2002, pp 357-377.
41. A.W. Fitzgibbon, R.B. Fisher, A buyers guide to conic fitting, in: Proc. fifth British Machine Vision Conference, 1995, pp. 513-522.
42. A. Blake, R. Curwen, A. Zisserman, A framework for spatio-temporal control in the tracking of visual contours, Int. J. Comput, Vis. 11 (2) (1993) 127-145.
43. P.S. MaybeckStochastic Models, Estimation and Control, vol. 1, Academic Press, 1979.