A literature survey on robust and efficient eye localization in real-life scenarios

Pattern Recognition

Volumn 46, Issue 12, 2013, Pages 3157-3173

  Song, Fengyi ^a   Tan, Xiaoyang ^a   Chen, Songcan ^a   Zhou, Zhi Hua ^b  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

^b NANJING UNIVERSITY   (China)

Author keywords

Computer vision; Eye localization; Survey

Indexed keywords

AMBIENT ENVIRONMENT; EXPRESSION ANALYSIS; EYE LOCALIZATION; GAZE ESTIMATION; GLOBAL ASPECTS; LITERATURE SURVEY; POSE ESTIMATION; TRAINING IMAGE;

ALGORITHMS; COMPUTER VISION; SURVEYING; SURVEYS;

FACE RECOGNITION;

EID: 84881062562     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.05.009     Document Type: Article

References (117)

1. Y. Adini, Y. Moses, and S. Ullman Face recognition: the problem of compensating for changes in illumination direction IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 721 732
2. T. Ahonen, A. Hadid, and M. Pietikainen Face description with local binary patterns: application to face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 28 12 2006 2037 2041
3. S. Asteriadis, N. Nikolaidis, and I. Pitas Facial feature detection using distance vector fields Pattern Recognition 42 7 2009 1388 1398
4. G.H. Bakir, T. Hofmann, B. Schölkopf, A.J. Smola, B. Taskar, and S.V.N. Vishwanathan Predicting Structured Data (Neural Information Processing) 2007 The MIT Press ISBN 0262026171
5. O. Barinova, V. Lempitsky, P. Kohli, On the detection of multiple object instances using hough transforms, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 2233-2240.
6. P.N. Belhumeur, and D.J. Kriegman What is the set of images of an object under all possible illumination conditions International Journal of Computer Vision 28 3 1998 245 260
7. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman Eigenfaces vs. fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720
8. C.M. Bishop Pattern Recognition and Machine Learning (Information Science and Statistics) 2006 Springer-Verlag New York, Inc. Secaucus, NJ, USA ISBN 0387310738
9. M. Blaschko, C. Lampert, Learning to localize objects with structured output regression, in: Proceedings of European Conference on Computer Vision, 2008, pp. 2-15.
10. D.S. Bolme, B.A. Draper, J.R. Beveridg, Average of synthetic exact filters, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 2105-2112.
11. R. Brunelli, and T. Poggio Face recognition: features versus templates IEEE Transactions on Pattern Analysis and Machine Intelligence 15 10 1993 1042 1052
12. P. Campadelli, and R. Lanzarotti Fiducial point localization in color images of face foregrounds Image and Vision Computing 22 11 2004 863 872
13. P. Campadelli, R. Lanzarotti, G. Lipori, Precise eye localization through a general-to-specific model definition, in: Proceedings of the British Machine Vision Conference, vol. 1, 2006, pp. 187-196.
14. P. Campadelli, R. Lanzarotti, G. Lipori, Eye localization: a survey, in: The Fundamentals of Verbal and Non-verbal Communication and the Biometrical Issue NATO Science Series, vol. 18, 2007, pp. 234-245.
15. P. Campadelli, R. Lanzarotti, and G. Lipori Precise eye and mouth localization International Journal of Pattern Recognition and Artificial Intelligence 23 3 2009 359 377
16. Z. Cao, Q. Yin, X. Tang, J. Sun, Face recognition with learning-based descriptor, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 2707-2714.
17. G. Chow, and X. Li Towards a system for automatic facial feature detection Pattern Recognition 26 1993 1739 1755
18. C. Colombo, and A. Del Bimbo Real-time head tracking from the deformation of eye contours using a piecewise affine camera Pattern Recognition Letters 20 7 1999 721 730
19. T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham Active shape models-their training and application Computer Vision and Image Understanding 61 1 1995 38 59
20. The JAFFE database. http://www.kasrl.org/jaffe.html.
21. J. Deng, and F. Lai Region-based template deformation and masking for eye-feature extraction and description Pattern Recognition 30 1997 403 419
22. M.R. Everingham, A. Zisserman, Regression and classification approaches to eye localization in face images, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2006, pp. 441-448.
23. The BioID face database. http://www.bioid.com/index.php?q=downloads/ software/bioid-face-database.html.
24. B. Fasel, and J. Luettin Automatic facial expression analysis: a survey Pattern Recognition 36 1 2003 259 275
25. P.F. Felzenszwalb, and D.P. Huttenlocher Pictorial structures for object recognition International Journal of Computer Vision 61 1 2005 55 79
26. P.F. Felzenszwalb, R.B. Girshick, D. McAllester, and D. Ramanan Object detection with discriminatively trained part-based models IEEE Transactions on Pattern Analysis and Machine Intelligence 32 9 2010 1627 1645
27. G.C. Feng, and P.C. Yuen Variance projection function and its application to eye detection for human face recognition Pattern Recognition Letters 19 9 1998 899 906
28. M.A. Fischler, and R.A. Elschlager The representation and matching of pictorial structures IEEE Transactions on Computers 22 1 1973 67 92
29. Y. Fu, H. Yan, J. Li, and R. Xiang Robust facial features localization on rotation arbitrary multi-view face in complex background Journal of Computers 6 2 2011 337 342
30. Z. Fu, A. Robles-Kelly, On mixtures of linear SVMs for nonlinear classification, in: Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition, 2008, pp. 489-499.
31. C. Garcia, and M. Delakis Convolutional face finder: a neural architecture for fast and robust face detection IEEE Transactions on Pattern Analysis and Machine Intelligence 26 11 2004 1408 1423
32. A. Geetha, V. Ramalingam, S. Palanivel, and B. Palaniappan Facial expression recognition - a real time approach Expert Systems with Applications 36 1 2009 303 308
33. R. Gross, V. Brajovic, An image preprocessing algorithm for illumination invariant face recognition, in: International Conference on Audio- and Video-Based Biometric Person Authentication, 2003, pp. 1055-1055.
34. C. Guo, Q. Ma, L. Zhang, Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
35. F. Guodail, E. Lange, and T. Iwamoto Face recognition system using local autocorrelations and multiscale integration IEEE Transactions on Pattern Analysis and Machine Intelligence 18 10 1996 1024 1028
36. M. Hamouz, J. Kittler, J.K. Kamarainen, P. Paalanen, H. Kalviainen, and J. Matas Feature-based affine invariant localization of faces IEEE Transactions on Pattern Analysis and Machine Intelligence 27 9 2005 1490 1495
37. D.W. Hansen, and Q. Ji In the eye of the beholder: a survey of models for eyes and gaze IEEE Transactions on Pattern Analysis and Machine Intelligence 32 3 2010 478 500
38. B. Heflin, W. Scheirer, T.E. Boult, For your eyes only, in: Proceedings of IEEE Workshop on the Applications of Computer Vision, 2012, pp. 193-200.
39. Face Recognition Homepage. http://www.face-rec.org/databases/.
40. R.L. Hsu, M. Abdel Mottaleb, and A.K. Jain Face detection in color images IEEE Transactions on Pattern Analysis and Machine Intelligence 24 5 2002 696 706
41. G.B. Huang, V. Jain, E. Learned-Miller, Unsupervised joint alignment of complex images, in: Proceedings of IEEE International Conference on Computer Vision, 2007, pp. 1-8.
42. G.B. Huang, M. Mattar, T. Berg, E. Learned-Miller, Labeled faces in the wild: a database for studying face recognition in unconstrained environments, Technical Report 07-49, University of Massachusetts, Amherst, October 2007.
43. J. Huang, and H. Wechsler Visual routines for eye location using learning and evolution IEEE Transactions on Evolutionary Computation 4 1 2000 73 82
44. V. Jain, E. Learned-Miller, Online domain adaptation of a pre-trained cascade of classifiers, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 577-584.
45. R. Javier, V. Rodrigo, and C. Mauricio Recognition of faces in unconstrained environments: a comparative study European Association for Signal Processing Journal on Advances in Signal Processing 1-19 2009 2009
46. O. Jesorsky, K. Kirchberg, R. Frischholz, Robust face detection using the Hausdorff distance, in: Proceedings of International Conference on Audio- and Video-Based Biometric Person Authentication, 2001, pp. 90-95.
47. X. Jin, X. Tan, L. Zhou, Face alignment using local hough voting, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2013.
48. J.L. Crowley, N. Gourier, D. Hall, Facial features detection robust to pose, illumination and identity, in: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, 2004, pp. 617-622.
49. D.J. Jobson, Z.U. Rahman, and G.A. Woodell A multiscale retinex for bridging the gap between color images and the human observation of scenes IEEE Transactions on Image Processing 6 7 1997 965 976
50. S. Kawato, J. Ohya, Real-time detection of nodding and head-shaking by directly detecting and tracking the between-eyes, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2000, pp. 40-45.
51. S. Kim, S.T. Chung, S. Jung, D. Oh, J. Kim, S. Cho, Multi-scale Gabor feature based eye localization, in: Proceedings of World Academy of Science, vol. 21, 2007, pp. 483-487.
52. M. Kostinger, P. Wohlhart, P.M. Roth, H. Bischof, Annotated facial landmarks in the wild: a large-scale, real-world database for facial landmark localization, in: Proceedings of IEEE International Conference on Computer Vision, 2011, pp. 2144-2151.
53. R. Kothari, J.L. Mitchell, Detection of eye locations in unconstrained visual images, in: Proceedings of International Conference on Image Processing, vol. 3, 1996, pp. 519-522.
54. T. Kozakaya, T. Shibata, M. Yuasa, and O. Yamaguchi Facial feature localization using weighted vector concentration approach Image and Vision Computing 28 5 2010 772 780
55. B. Kroon, S. Maas, S. Boughorbel, and A. Hanjalic Eye localization in low and standard definition content with application to face matching Computer Vision and Image Understanding 113 8 2009 921 933
56. N. Kumar, P.N. Belhumeur, S.K. Nayar, FaceTracer: a search engine for large collections of images with faces, in: Proceedings of European Conference on Computer Vision, October 2008, 2008, pp. 340-353.
57. N. Kumar, A.C. Berg, P. N. Belhumeur, S. K. Nayar, Attribute and simile classifiers for face verification, in: Proceedings of IEEE International Conference on Computer Vision, 2009, pp. 365-372.
58. K. Lam, and H. Yan Locating and extracting the eye in human face images Pattern Recognition 29 1996 771 779
59. C.H. Lampert, M.B. Blaschko, T. Hofmann, Beyond sliding windows: object localization by efficient subwindow search, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
60. K.C. Lee, J. Ho, and D. Kriegman Acquiring linear subspaces for face recognition under variable lighting IEEE Transactions on Pattern Analysis and Machine Intelligence 27 5 2005 684 698
61. A. Lehmann, B. Leibe, and L. Van Gool Fast PRISM: branch and bound hough transform for object class detection International Journal of Computer Vision 94 2 2011 175 197
62. B. Leibe, A. Leonardis, B. Schiele, An implicit shape model for combined object categorization and segmentation, in: Towards Category-Level Object Recognition, vol. 4170, 2006, pp. 508-524.
63. B. Leibe, A. Leonardis, and B. Schiele Robust object detection with interleaved categorization and segmentation International Journal of Computer Vision 77 1 2008 259 289
64. S.Z. Li, R.F. Chu, S.C. Liao, and L. Zhang Illumination invariant face recognition using near-infrared images IEEE Transactions on Pattern Analysis and Machine Intelligence 29 4 2007 627 639
65. W. Li, Y. Wang, and Y. Wang Eye location via a novel integral projection function and radial symmetry transform International Journal of Digital Content Technology and its Applications 5 8 2011 70 80
66. D.G. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
67. Y. Ma, X. Ding, Z. Wang, N. Wang, Robust precise eye location under probabilistic framework, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2004, pp. 339-344.
68. A. Mahalanobis, B.V.K. Kumar, and D. Casasent Minimum average correlation energy filters Applied Optics 26 17 1987 3633 3640
69. A. Mahalanobis, B.V.K. Vijaya Kumar, S. Song, S.R.F. Sims, and J.F. Epperson Unconstrained correlation filters Applied Optics 33 17 1994 3751 3759
70. S. Maji, A.C. Berg, Max-margin additive classifiers for detection, in: Proceedings of IEEE International Conference on Computer Vision, 2009, pp. 40-47.
71. S. Maji, A.C. Berg, J. Malik, Classification using intersection kernel support vector machines is efficient, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
72. J. Marques, N.M. Orlans, A.T. Piszcz, Effects of eye position on eigenface-based face recognition scoring, Technical Paper of the MITRE Corporation, October 2003.
73. K. Mikolajczyk, and C. Schmid A performance evaluation of local descriptors IEEE Transactions on Pattern Analysis and Machine Intelligence 27 10 2005 1615 1630
74. B. Moghaddam, and A. Pentland Probabilistic visual learning for object representation IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 696 710
75. L. Nanni, and A. Lumini Combining face and eye detectors in a high-performance face-detection system IEEE MultiMedia 19 2012 20 27
76. M.H. Nguyen, J. Perez, F. De La TORRE, Facial feature detection with optimal pixel reduction SVMs, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2008, pp. 1-6.
77. Z. Niu, S. Shan, S. Yan, X. Chen, W. Gao, 2D cascaded AdaBoost for eye localization, in: International Conference on Pattern Recognition, 2006, pp. 1216-1219.
78. M. Nixon, Eye spacing measurement for facial recognition, in: Proceedings of Society of Photo-Optical Instrument Engineers, vol. 575, 1985, pp. 279-285.
79. M.M. Nordstrøm, M. Larsen, J. Sierakowski, M.B. Stegmann, The IMM face database - an annotated dataset of 240 face images, Technical report, Informatics and Mathematical Modelling, Technical University of Denmark, May 2004.
80. V. Ojansivu, J. Heikkilä, Blur insensitive texture classification using local phase quantization, in: Proceedings of International Conference on Image and Signal Processing, Lecture Notes in Computer Science, 2008, pp. 236-243.
81. A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1994, pp. 84-91.
82. P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss The FERET evaluation methodology for face-recognition algorithms IEEE Transactions on Pattern Analysis and Machine Intelligence 22 10 2000 1090 1104
83. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, Jin Chang, K. Hoffman, J. Marques, Jaesik Min, W. Worek, Overview of the face recognition grand challenge, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 947-954.
84. Z. Qian, and D. Xu Automatic eye detection using intensity filtering and K-means clustering Pattern Recognition Letters 31 12 2010 1633 1640
85. T. Riopka, T. Boult, The eyes have it, in: Proceedings of ACM SIGMM Multimedia Biometrics Methods and Applications Workshop, 2003, pp. 9-16.
86. H.A. Rowley, S. Baluja, and T. Kanade Neural network-based face detection IEEE Transactions on Pattern Analysis and Machine Intelligence 20 1 1998 23 38
87. J.M. Saragih, S. Lucey, J.F. Cohn, Deformable model fitting with a mixture of local experts, in: Proceedings of IEEE International Conference on Computer Vision, 2009, pp. 2248-2255.
88. H.J. Seo, and P. Milanfar Training-free, generic object detection using locally adaptive regression kernels IEEE Transactions on Pattern Analysis and Machine Intelligence 32 2010 1688 1704
89. S. Shan, Y. Chang, W. Gao, B. Cao, P. Yang, Curse of mis-alignment in face recognition: problem and a novel mis-alignment learning solution, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2004, pp. 314-320.
90. M. Pietikainen, T. Ojala, and D. Harwood A comparative study of texture measures with classification based on feature distributions Pattern Recognition 29 1996 51 59
91. X. Tan, and B. Triggs Enhanced local texture feature sets for face recognition under difficult lighting conditions IEEE Transactions on Image Processing 19 2010 1635 1650
92. X. Tan, F. Song, Z.H. Zhou, S. Chen, Enhanced pictorial structures for precise eye localization under uncontrolled conditions, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 20-25 June 2009, 2009, pp. 1621-1628.
93. X. Tang, Z. Ou, T. Su, H. Sun, P. Zhao, Robust precise eye location by AdaBoost and SVM techniques, in: Proceedings of International Conference on Advances in Neural Networks, 2005, pp. 93-98.
94. Y. Tian, T. Kanade, J.F. Cohn, Dual-state parametric eye tracking, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2000, pp. 110-115.
95. S. Ullman Visual routines Cognition 18 1984 97 159
96. M. Uricár, V. Franc, V. Hlavác, Detector of facial landmarks learned by the structured output SVM, in: Proceedings of International Conference on Computer Vision Theory and Applications, vol. 1, 2012, pp. 547-556.
97. R. Valenti, T. Gevers, Accurate eye center location and tracking using isophote curvature, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
98. P. Viola, and M.J. Jones Robust real-time face detection International Journal of Computer Vision 57 2 2004 137 154
99. J. Wang, L. Yin, and J. Moore Using geometric properties of topographic manifold to detect and track eyes for human-computer interaction ACM Transactions on Multimedia Computing, Communications, and Applications 3 4 2007
100. J.G. Wang, and E. Sung Frontal-view face detection and facial feature extraction using color and morphological operations Pattern Recognition Letters 20 10 1999 1053 1068
101. P. Wang, M. Green, Q. Ji, J. Wayman, Automatic eye detection and its validation, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 3, 2005, pp. 164-172.
102. L. Wiskott, J.-M. Fellous, N. Krüger, and C. von der Malsburg Face recognition by elastic bunch graph matching IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 775 779
103. X. Xie, R. Sudhakar, and H. Zhuang On improving eye feature extraction using deformable templates Pattern Recognition 27 1994 791 799
104. F. Xiong, Y. Zhang, G. Zhang, A pupil localization algorithm based on adaptive Gabor filtering and negative radial symmetry, in: Proceedings of International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition, vol. 4679, 2007, pp. 87-96.
105. R. Xu, B. Zhang, Q. Ye, J. Jiao, Human detection in images via L1-norm minimization learning, in: IEEE International Conference on Acoustics Speech and Signal Processing, 2010, pp. 3566-3569.
106. S. Yan, S. Shan, X. Chen, W. Gao, Locally Assembled Binary (LAB) feature with feature-centric cascade for fast and accurate face detection, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-7.
107. F. Yang, J. Huang, P. Yang, D. Metaxas, Eye localization through multiscale sparse dictionaries, in: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, 2011, pp. 514-518.
108. P. Yang, B. Du, S. Shan, W. Gao, A novel pupil localization method based on GaborEye model and radial symmetry operator, in: Proceedings of International Conference on Image Processing, vol. 1, 2004, pp. 67-70.
109. D. Yi, Z. Lei, S.Z. Li, A robust eye localization method for low quality face images, in: Proceedings of International Joint Conference on Biometrics, 2011, pp. 1-6.
110. A.L. Yuille, D.S. Cohen, P.W. Hallinan, Feature extraction from faces using deformable templates, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1989, pp. 104-109.
111. A.L. Yuille, P.W. Hallinan, and D.S. Cohen Feature extraction from faces using deformable template International Journal of Computer Vision 8 2 1992 99 111
112. W. Zhang, H. Chen, P. Yao, B. Li, Z. Zhuang, Precise eye localization with AdaBoost and fast radial symmetry, in: International Conference on Computational Intelligence and Security, vol. 1, 2006, pp. 725-730.
113. W. Zhao, R. Chellappa, A. Rosenfeld, and P.J. Phillips Face recognition: a literature survey ACM Computing Surveys 2003 399 458
114. Z.H. Zhou, and X. Geng Projection functions for eye detection Pattern Recognition 37 5 2004 1049 1056
115. X. Zhu and D. Ramanan, Face detection, pose estimation, and landmark localization in the wild, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 2879-2886.
116. Z. Zhu, and Q. Ji Robust real-time eye detection and tracking under variable lighting conditions and various face orientations Computer Vision and Image Understanding 98 1 2005 124 154
117. Z. Zhu, K. Fujimura, Q. Ji, Real-time eye detection and tracking under various light conditions, in: Proceedings of the 2002 Symposium on Eye Tracking Research and Applications, vol. 25, 2002, pp. 139-144.