Combining head pose and eye location information for gaze estimation

IEEE Transactions on Image Processing

Volumn 21, Issue 2, 2012, Pages 802-815

  Valenti, Roberto ^a   Sebe, Nicu ^b   Gevers, Theo ^a,c  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF TRENTO   (Italy)

^c UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

Author keywords

Eye center location; gaze estimation; head pose estimation

Indexed keywords

EYE LOCALIZATION; EYE LOCATION; GAZE ESTIMATION; HEAD POSE; HEAD POSE ESTIMATION; HYBRID SCHEME; MEAN ERRORS; OPERATING RANGES; POSE ESTIMATION; TRANSFORMATION MATRICES;

ESTIMATION; FACE RECOGNITION; GESTURE RECOGNITION; LINEAR TRANSFORMATIONS;

MOTION ESTIMATION;

ARTICLE; BODY POSTURE; EYE; EYE MOVEMENT; HEAD; HEAD MOVEMENT; HISTOLOGY; HUMAN; IMAGE PROCESSING; METHODOLOGY; PHYSIOLOGY; VIDEORECORDING;

EYE; EYE MOVEMENTS; HEAD; HEAD MOVEMENTS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; POSTURE; VIDEO RECORDING;

EID: 84856293813     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2162740     Document Type: Article

References (51)

1. J. S. Agustin, J. P. Hansen, and J. Mateo, "Gaze beats mouse: Hands-free selection by combining gaze and emg," in Proc. CHI, 2008, pp. 3039-3044.
2. K. H. An and M. Chung, "3D head tracking and pose-robust 2D texture map-based face recognition using a simple ellipsoid model," in Proc. Intell. Robots Syst., 2008, pp. 307-312.
3. S. Asteriadis, N. Nikolaidis, A. Hajdu, and I. Pitas, "An eye detection algorithm using pixel to edge information," in Proc. Int. Symp. Control, Commun. Signal Process., 2006.
4. S. Ba andJ. Odobez, "A probabilistic framework for joint head tracking and pose estimation," in Proc. ICPR, 2004, pp. 264-267.
5. S. Ba and J. Odobez, "From camera head pose to 3D global roomhead pose using multiple camera views," in Proc. Int. Workshop Classification Events Activities Relationships, 2007.
6. L. Bai, L. Shen, and Y. Wang, "A novel eye location algorithm based on radial symmetry transform," in Proc. ICPR, 2006, pp. 511-514.
7. L. Brown, "3D head tracking using motion adaptive texture-mapping," in Proc. CVPR, 2001, pp. I-998-I-1003.
8. P. Campadelli, R. Lanzarotti, and G. Lipori, "Precise eye localization through a general-to-specific model definition," in Proc. BMVC, 2006, pp. 187-198.
9. M. La Cascia, S. Sclaroff, and V. Athitsos, "Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 4, pp. 322-336, Apr. 2000.
10. COGAIN, Communication by gaze interaction: Gazing into the future [Online]. Available: http://www.cogain.org 2006
11. T. Cootes, G. Edwards, and C. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001. (Pubitemid 32585279)
12. D. Cristinacce, T. Cootes, and I. Scott, "A multi-stage approach to facial feature detection," in Proc. BMVC, 2004, pp. 277-286.
13. N. A. Dogson, "Variation and extrema of human interpupillary distance," Proc. SPIE, vol. 5291, pp. 36-46, 2004.
14. A. Doshi and M. M. Trivedi, "On the roles of eye gaze and head pose in predicting driver's intent to change lanes," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 3, 2009.
15. C. C. Gordon, B. Bradtmiller, T. Churchill, C. E. Clauser, J. T. Mc-Conville, I. O. Tebbetts, and R. A. Walker, Anthropometric survey of us army personnel: Methods and summary statistics U.S. Army Natick Res., Natick, MA, Tech. Rep. NATICK/TR-89/044, 1988.
16. M. Hamouz, J. Kittlerand, J. K. Kamarainen, P. Paalanen, H. Kalvi-ainen, and J. Matas, "Feature-based affine-invariant localization of faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 9, pp. 1490-1495, Sep. 2005. (Pubitemid 41387779)
17. D. W. Hansen and J. P. Hansen, "Eye typing with common cameras," in Proc. Symp. Eye Track. Res. Appl., 2006, p. 55. (Pubitemid 44758648)
18. Y.Hu, L.Chen, Y. Zhou, and H.Zhang, "Estimating face posebyfacial asymmetry and geometry," in Proc. Autom. Face Gesture Recog., 2004, pp. 651-656.
19. K. Huang and M. Trivedi, "Robust real-time detection, tracking and pose estimation of faces in video streams," in Proc. ICPR, 2004, pp. 965-968.
20. O. Jesorsky, K. J. Kirchberg, and R. Frischholz, "Robust face detection using the Hausdorff distance," in Proc. Audio Video Biometric Pers. Authentication, 1992, pp. 90-95.
21. Q.Ji and X.Yang, "Real-time eye, gaze and face pose tracking for monitoring driver vigilance," Real Time Imaging, vol. 8, no. 5, pp. 357-377, Oct. 2002.
22. S. Kim, S.-T. Chung, S. Jung, D. Oh, J. Kim, and S. Cho, "Multi-scale Gabor feature based eye localization," in Proc. World Acad. Sci., Eng. Technol., 2007, pp. 483-487.
23. J. Koenderink and A. J. van Doorn, "Surface shape and curvature scales," Image Vis. Comput., vol. 10, no. 8, pp. 557-565, Oct. 1992.
24. B. Kroon, A. Hanjalic, and S. M. Maas, "Eye localization for face matching: Is it always useful and under what conditions?," in Proc. CIVR, 2008, pp. 379-388.
25. A. Lablack, F. Maquet, and C. Djeraba, "Determination of the visual field of persons in a scene," in Proc. VISAPP, Jan. 2008, pp. 313-316.
26. S. R. Langton, H. Honeyman, and E. Tessler, "The influence of head contour and nose angle on the perception of eye-gaze direction," Pe r-cept. Psychophys., vol. 66, no. 5, pp. 752-771, Jul. 2004. (Pubitemid 39470705)
27. X.Liu, N. Krahnstoever, T. Yu, and P. Tu, "What are customers looking at?," in Proc. AVSS, 2007, pp. 405-410.
28. Y. Matsumoto and A. Zelinsky, "An algorithm for real-time stereo vision implementation of headpose and gaze direction measurement," in Proc. FG, 2000, pp. 499-505.
29. L. Morency and T. Darrell, "Head gesture recognition in intelligent interfaces: The role of context in improving recognition," in Proc. IUI, 2006, pp. 32-38. (Pubitemid 44074847)
30. L. Morency, A. Rahimi, and T. Darrell, "Adaptive view based appearance models," in Proc. CVPR, 2003, pp. I-803-I-810.
31. E. Murphy-Chutorian and M. Trivedi, "Head pose estimation in computer vision: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 4, pp. 607-626, Apr. 2009.
32. R. Newman, Y. Matsumoto, S. Rougeaux, and A. Zelinsky, "Real-time stereo tracking for head pose and gaze estimation," in Proc. Autom. Face Gesture Recog., 2000, pp. 122-128.
33. Z. Niu, S. Shan, S. Yan, X. Chen, and W. Gao, "2D cascaded adaboost for eye localization," in Proc. ICPR, 2006, pp. 1216-1219. (Pubitemid 46532422)
34. J. Panero and M. Zelnik, Human Dimension and Interior Space: A Source Book of Design Reference Standards. New York: Watson-Guptill, 1979.
35. D. Reisfeld, H. Wolfson, and Y. Yeshurun, "Context free attentional operators: The generalized symmetry transform," Int. J. Comput. Vis., vol. 14, no. 2, pp. 119-130, Mar. 1995.
36. N. Robertson and I. Reid, "Estimating gaze direction from low-resolution faces in video," in Proc. ECCV, 2006, pp. 402-415. (Pubitemid 44029743)
37. D. Russakoff and M. Herman, "Head tracking using stereo," Mach. Vis. Appl., vol. 13, no. 3, pp. 164-173, 2002. (Pubitemid 41200800)
38. K. Smith, S. O. Ba, J.-M. Odobez, and D. Gatica-Perez, "Tracking the visual focus of attention for a varying number of wandering people," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 7, pp. 1212-1229, Jul. 2008.
39. R. Stiefelhagen and J. Zhu, "Head orientation and gaze direction in meetings," in Proc. Conf. Hum. Factors Comput. Syst., 2002, pp. 858-859.
40. J. Sung, T. Kanade, and D. Kim, "Pose robust face tracking by combining active appearance models and cylinder head models," Int. J. Comput. Vis., vol. 80, no. 2, pp. 260-274, Nov. 2008.
41. J. Tu, T. Huang, and H. Tao, "Accurate head pose tracking in low resolution video," inProc. Autom. Face Gesture Recog., 2006, pp. 573-578. (Pubitemid 44711410)
42. M. Türkan, M. Pardás, and A. Çetin, "Human eye localization using edge projection," in Proc. Comput. Vis. Theory Appl., 2007, pp. 410-415.
43. R. Valenti, UvAEyes, eye annotations for the Boston University head pose dataset [Online]. Available: http://staff.sci-ence.uva.nl/rvalenti/index.php? content=UvAEyes
44. R. Valenti and T. Gevers, "Accurate eye center location and tracking using isophote curvature," in Proc. CVPR, 2008, pp. 1-8.
45. R. Valenti, J. Staiano, N. Sebe, and T. Gevers, "Webcam-based visual gaze estimation," in Proc. Int. Conf. Image Anal. Process., 2009, pp. 662-671.
46. R. Valenti, Z. Yucel, and T. Gevers, "Robustifying eye center localization by head pose cues," in Proc. CVPR, 2009, pp. 612-618.
47. P. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, May 2004.
48. M. Voit and R. Stiefelhagen, "Deducing the visual focus of attention from head pose estimation in dynamic multi-view meeting scenarios," in Proc. ICMI, 2008, pp. 173-180.
49. J. Xiao, T. Kanade, and J. Cohn, "Robust full motion recovery of head by dynamic templates and re-registration techniques," in Proc. FG, 2002, pp. 163-169.
50. Y. Zhang and C. Kambhamettu, "3D head tracking under partial occlusion," Pattern Recognit., vol. 35, no. 7, pp. 1545-1557, Jul. 2002. (Pubitemid 34440052)
51. Z. H. Zhou and X. Geng, "Projection functions for eye detection," Pattern Recognit., vol. 37, no. 5, pp. 1049-1056, May 2004. (Pubitemid 38473843)