An investigation on the feasibility of uncalibrated and unconstrained gaze tracking for human assistive applications by using head pose estimation

Sensors (Switzerland)

Volumn 14, Issue 5, 2014, Pages 8363-8379

  Cazzato, Dario ^a   Leo, Marco ^b   Distante, Cosimo ^b  

^a UNIVERSITY OF SALENTO   (Italy)

^b ISTITUTO NAZIONALE DI OTTICA   (Italy)

Author keywords

Gaze estimation; Gaze tracking; Head pose estimation; Human computer interaction

Indexed keywords

CALIBRATION; HUMAN COMPUTER INTERACTION; TRACKING (POSITION);

ASSISTIVE APPLICATIONS; EXPERIMENTAL TEST; GAZE ESTIMATION; GAZE TRACKING; HEAD POSE ESTIMATION; STATE-OF-THE-ART METHODS; SUPERVISED PATTERN RECOGNITION; UNCONSTRAINED ENVIRONMENTS;

IMAGE RECOGNITION;

EID: 84900473181     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s140508363     Document Type: Article

References (41)

1. Jellinger, K. Cognitive Processes in Eye Guidance. Eur. J. Neurol. 2006, 13, doi:10.1111/ j.1468-1331.2006.01356.x.
2. Mateo, J.C.; San Agustin, J.; Hansen, J.P. Gaze beats mouse: Hands-free selection by combining gaze and emg. In Proceedings of the CHI'08 Extended Abstracts on Human Factors in Computing Systems, Florence, Italy, 5-10 April 2008; pp. 3039-3044.
3. Doshi, A.; Trivedi, M.M. Attention estimation by simultaneous observation of viewer and view. In Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), San Francisco, CA, USA, 13-18 June 2010; pp. 21-27.
4. Wetzel, P.A.; Krueger-Anderson, G.; Poprik, C.; Bascom, P. An Eye Tracking System for Analysis of Pilots' Scan Paths; Human Resources Directorate, Aircrew Training Research Division, U.S. Air Force, Armstrong Laboratory: Brooks City-Base, TX, USA, 1997.
5. Waizenegger, W.; Atzpadin, N.; Schreer, O.; Feldmann, I.; Eisert, P. Model based 3D gaze estimation for provision of virtual eye contact. In Proceedings of the 2012 19th IEEE International Conference on Image Processing (ICIP), Orlando, FL, USA, 30 September-3 October 2012; pp. 1973-1976.
6. Pieters, R. A review of eye-tracking research in marketing. Rev. Market. Res. 2008, 4, 123-147.
7. Hansen, D.; Ji, Q. In the eye of the beholder: A survey of models for eyes and gaze. IEEE Pattern Anal. Mach. Intell. 2012, doi:10.1109/TPAMI.2009.30.
8. Morimoto, C.H.; Mimica, M.R. Eye gaze tracking techniques for interactive applications. Comput. Vis. Image Underst. 2005, 98, 4-24.
9. Guestrin, E.D.; Eizenman, M. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomed. Eng. 2006, 53, 1124-1133.
10. Nakazawa, A.; Nitschke, C. Point of Gaze Estimation through Corneal Surface Reflection in an Active Illumination Environment. In Computer Vision-ECCV 2012; Springer: Berlin/Heidelberg, Germany, 2012; pp. 159-172.
11. Villanueva, A.; Cabeza, R. A novel gaze estimation system with one calibration point. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 2008, 38, 1123-1138.
12. Zhu, Z.; Ji, Q. Novel eye gaze tracking techniques under natural head movement. IEEE Trans. Biomed. Eng. 2007, 54, 2246-2260.
13. Yoo, D.H.; Chung, M.J. A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Comput. Vis. Image Underst. 2005, 98, 25-51.
14. Noureddin, B.; Lawrence, P.; Man, C. A non-contact device for tracking gaze in a human computer interface. Comput. Vis. Image Underst. 2005, 98, 52-82.
15. Funes Mora, K.; Odobez, J.M. Gaze estimation from multimodal Kinect data. In Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern RecognitionWorkshops (CVPRW), Providence, RI, USA, 16-21 June 2012; pp. 25-30.
16. Chen, J.; Ji, Q. 3D gaze estimation with a single camera without IR illumination. In Proceedings of the 19th International Conference on IEEE Pattern Recognition (ICPR 2008), Tampa, FL, USA, 8-11 December 2008; pp. 1-4.
17. Kohlbecher, S.; Bardinst, S.; Bartl, K.; Schneider, E.; Poitschke, T.; Ablassmeier, M. Calibration-free eye tracking by reconstruction of the pupil ellipse in 3D space. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications. Savannah, GA, USA, 26-28 March 2008; pp. 135-138.
18. Ince, I.F.; Kim, J.W. A 2D eye gaze estimation system with low-resolution webcam images. EURASIP J. Adv. Signal Process. 2011, 2011, 1-11.
19. Janko, Z.; Hajder, L. Improving Human-Computer Interaction by gaze tracking. In Proceedings of the 2012 IEEE 3rd International Conference on IEEE Cognitive Infocommunications (CogInfoCom), Kosice, Slovakia, 2-5 December 2012; pp. 155-160.
20. Valenti, R.; Sebe, N.; Gevers, T. Combining head pose and eye location information for gaze estimation. IEEE Trans. Image Process. 2012, 21, 802-815.
21. Stiefelhagen, R.; Zhu, J. Head orientation and gaze direction in meetings. In Proceedings of the CHI'02 Extended Abstracts on Human Factors in Computing Systems, Minneapolis, MN, USA, 20-25 April 2002; pp. 858-859.
22. Langton, S.R.; Honeyman, H.; Tessler, E. The influence of head contour and nose angle on the perception of eye-gaze direction. Percept. Psychophys. 2004, 66, 752-771.
23. Brolly, X.L.; Stratelos, C.; Mulligan, J.B. Model-based head pose estimation for air-traffic controllers. In Proceedings of the 2003 International Conference on IEEE Image Processing (ICIP 2003), Barcelona, Spain, 14-17 September 2003; Volume 2, doi:10.1109/ICIP.2003.1246629.
24. Robertson, N.; Reid, I.; Brady, J. What are you looking at? gaze estimation in medium-scale images. In Proceedings of the HAREM Workshop (in assoc. with BMVC), Oxford, UK, 9 September 2005.
25. Ba, S.O.; Odobez, J.M. Recognizing visual focus of attention from head pose in natural meetings. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 2009, 39, 16-33.
26. Zhang, W.Z.; Wang, Z.C.; Xu, J.K.; Cong, X.Y. A Method of Gaze Direction Estimation Considering Head Posture. Int. J. Signal Process. Image Process. Pattern Recognit. 2013, 6, 103-111.
27. Benfold, B.; Reid, I. Unsupervised learning of a scene-specific coarse gaze estimator. In Proceedings of the 2011 IEEE International Conference on IEEE Computer Vision (ICCV), Barcelona, Spain, 6-13 November 2011; pp. 2344-2351.
28. Nabati, M.; Behrad, A. Robust facial 2D motion model estimation for 3D head pose extraction and automatic camera mouse implementation. In Proceedings of the 2010 5th International Symposium on IEEE Telecommunications (IST), Tehran, Iran, 4-6 December 2010; pp. 817-824.
29. Asteriadis, S.; Karpouzis, K.; Kollias, S. Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation. Int. J. Comput. Vis. 2013, 107, 1-24.
30. Xiao, R.; Li, M.J.; Zhang, H.J. Robust multipose face detection in images. IEEE Trans. Circuits Syst. Video Technol. 2004, 14, 31-41.
31. Viola, P.; Jones, M. Rapid object detection using a boosted cascade of simple features. In Proceedings of the 2001 IEEE Computer Society Conference on IEEE Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, USA, 8-14 December 2001; Volume 1, pp. 511-518.
32. Cootes, T.; Edwards, G.; Taylor, C. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23, 681-685.
33. Zhou, M.; Liang, L.; Sun, J.; Wang, Y. AAM based face tracking with temporal matching and face segmentation. In Proceedings of the 2010 IEEE Conference on IEEE Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, 13-18 June 2010; pp. 701-708.
34. Besl, P.; McKay, N.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14, 239-256.
35. Ahlberg, J. Candide-3-an Updated Parameterised Face; Report No. LiTH-ISY-R-2326, Department of Electrical Engineering, Linkping University, Linkping, Sweden, 2001
36. Li, Z.; Sastry, S.S.; Murray, R. A Mathematical Introduction to Robotic Manipulation; CRC Press: Boca Raton, FL, USA, 1994.
37. MSDN-Microsoft. Available online: http://msdn.microsoft.com/en-us/library/jj131033.aspx (accessed on 1 April 2014).
38. Lu, F.; Okabe, T.; Sugano, Y.; Sato, Y. A Head Pose-free Approach for Appearance-Based Gaze Estimation. In Proceedings of the BMVC, Dundee, Scotland, 29 August-2 September 2011; pp. 1-11.
39. Lu, F.; Okabe, T.; Sugano, Y.; Sato, Y. Learning gaze biases with head motion for head pose-free gaze estimation. Image Vis. Comput. 2014, 32, 169-179.
40. Sugano, Y.; Matsushita, Y.; Sato, Y.; Koike, H. An Incremental Learning Method for Unconstrained Gaze Estimation. In Computer Vision-ECCV 2008; Springer: Berlin/Heidelberg, Germany, 2008; pp. 656-667.
41. Guestrin, E.; Eizenman, E. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomed. Eng. 2006, 53, 1124-1133.