Appearance-based gaze estimation in the wild

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 4511-4520

  Zhang, Xucong ^a   Sugano, Yusuke ^a   Fritz, Mario ^a   Bulling, Andreas ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; NEURAL NETWORKS;

CONTROLLED LABORATORIES; CONVOLUTIONAL NEURAL NETWORK; CROSS-DATASET EVALUATION; MULTIPLE DATA SETS; REAL WORLD SETTING; RESEARCH CHALLENGES; STATE OF THE ART; STATE-OF-THE-ART METHODS;

PATTERN RECOGNITION;

EID: 84959187547     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7299081     Document Type: Conference Paper

References (53)

1. F. Alnajar, T. Gevers, R. Valenti, and S. Ghebreab. Calibration-free gaze estimation using human gaze patterns. In Proc. ICCV, 2013.
2. T. Baltrusaitis, P. Robinson, and L.-P. Morency. Continuous conditional neural fields for structured regression. In Proc. ECCV, pages 593-608, 2014.
3. S. Baluja and D. Pomerleau. Non-intrusive gaze tracking using artificial neural networks. Technical report, OTIC Document, 1994.
4. J. Chen and Q. Ji. 3d gaze estimation with a single camera without ir illumination. In Proc. ICPR, pages 1-4, 2008.
5. J. Chen and Q. Ji. Probabilistic gaze estimation without active personal calibration. In Proc. CVPR, pages 609-616, 2011.
6. J. Choi, B. Ahn, 1. ParI, and I. S. Kweon. Appearance-based gaze estimation using kinect. In Proc. URAl, pages 260-261, 20l3.
7. R.-E. Fan, K.-w. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. Liblinear: A library for large linear classification. The Journal of Machine Learning Research, 9:1871-1874, 2008.
8. K. A. Funes Mora, F. Monay, and J.-M. Odobez. Eyediap: A database for the development and evaluation of gaze estimation algorithms from rgb and rgb-d cameras. In Proc. ETRA, pages 255-258, 2014.
9. K. A. Funes Mora and J.-M. Odobez. Gaze estimation from multi modal kinect data. In Proc. CVPRW, pages 25-30, 2012.
10. K. A. Funes Mora and J.-M. Odobez. Person independent 3d gaze estimation from remote rgb-d cameras. In Proc. ICIP, 2013.
11. K. A. Funes Mora and J.-M. Odobez. Geometric generative gaze estimation (g3e) for remote rgb-d cameras. In Proc. CVPR, pages 1773-1780, 2014.
12. D. W. Hansen and Q. Ji. In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(3):478-500, 2010.
13. C. Hennessey, B. Noureddin, and P. Lawrence. A single camera eye-gaze tracking system with free head motion. In Proc. ETRA, pages 87-94, 2006.
14. G. B. Huang, M. Mattar, T. Berg, E. Learned-Miller, et al. Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In Workshop on Faces in'Real-Lije'Images: Detection, Alignment, and Recognition, 2008.
15. M. X. Huang, T. C. Kwok, G. Ngai, H. V. Leong, and S. C. Chan. Building a self-learning eye gaze model from user interaction data. In Proc. MM, pages 1017-1020, 2014.
16. T. Ishikawa, S. Baker, I. Matthews, and T. Kanade. Passive driver gaze tracking with active appearance models. In Proc. 11th World Congress on Intelligent Transportation Systems, 2004.
17. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. ArXiv preprint arXiv:1408. 5093, 2014.
18. L. Jianfeng and L. Shigang. Eye-model-based gaze estimation by rgb-d camera. In Proc. CVPRW, pages 606-610, 2014.
19. R. Larson and M. Csikszentmihalyi. The experience sampling method. New Directions for Methodology of Social & Behavioral Science, 1983.
20. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
21. V. Lepetit, F. Moreno-Noguer, and P. Fua. EPnP: An accurate o(n) solution to the PnP problem. International Journal of Computer Vision, 81(2):155-166, 2009.
22. J. Li and Y. Zhang. Learning surf cascade for fast and accurate object detection. In Proc. CVPR, pages 3468-3475, 2013.
23. Y. Li, X. Hou, C. Koch, J. Rehg, and A. Yuille. The secrets of salient object segmentation. In Proc. CVPR, 2014.
24. K. Liang, Y. Chahir, M. Molina, C. Tijus, and F. Jouen. Appearance-based gaze tracking with spectral clustering and semi-supervised Gaussian process regression. In Proc. ETSA, pages 17-23, 2013.
25. F. Lu, T. Okabe, Y. Sugano, and Y. Sato. Learning gaze biases with head motion for head pose-free gaze estimation. Image and Vision Computing, 32(3): 169-179, 2014.
26. F. Lu, Y. Sugano, T. Okabe, and Y. Sato. Head pose-free appearance-based gaze sensing via eye image synthesis. In Proc. ICPR, pages 1008-1011, 2012.
27. F. Lu, Y. Sugano, T. Okabe, and Y. Sato. Adaptive linear regression for appearance-based gaze estimation. IEEE Trans. PAMI, 36(10):2033-2046, Oct 2014.
28. P. Majaranta and A. Bulling. Eye tracking and eye-based human-computer interaction. In Advances in Physiological Computing, pages 39-65. Springer, 2014.
29. c. D. McMurrough, V. Metsis, J. Rich, and F. Makedon. An eye tracking dataset for point of gaze detection. In Proc. ETRA, pages 305-308, 2012.
30. C. H. Morimoto, A. Amir, and M. Flickner. Detecting eye position and gaze from a single camera and 2 light sources. In Proc. ICPR, pages 314-317, 2002.
31. C. H. Morimoto and M. R. Mimica. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding, 98(1):4-24, 2005.
32. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Ng. Multimodal deep learning. In Proc. ICML, pages 689-696, 2011.
33. R. Rodrigues, J. A. Barreto, and U. Nunes. Camera pose estimation using images of planar mirror reflections. In Proc. ECCV, pages 382-395, 2010.
34. T. Schneider, B. Schauerte, and R. Stiefel hagen. Manifold alignment for person independent appearance-based gaze estimation. In Proc. ICPR, 2014.
35. W. Sewell and O. Komogortsev. Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network. In Ext. Abstracts CHI, pages 3739-3744, 2010.
36. S.-W. Shih and J. Liu. A novel approach to 3-d gaze tracking using stereo cameras. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 34(1):234-245, 2004.
37. B. A. Smith, Q. Yin, S. K. Feiner, and S. K. Nayar. Gaze locking: passive eye contact detection for human-object interaction. In Proc. UIST, pages 271-280, 2013.
38. Y. Sugano, Y. Matsushita, and Y. Sato. Appearance-based gaze estimation using visual saliency. IEEE Trans. on PAMI, 35(2):329-341, Feb 2013.
39. Y. Sugano, Y. Matsushita, and Y. Sato. Learning-bysynthesis for appearance-based 3d gaze estimation. In Proc. CVPR, pages 1821-1828, 2014.
40. Y. Sugano, Y. Matsushita, Y. Sato, and H. Koike. An incremental learning method for unconstrained gaze estimation. In Proc. ECCV, pages 656-667, 2008.
41. L. Sun, M. Song, Z. Liu, and M.-T. Sun. Realtime gaze estimation with online calibration. In Proc. ICME, pages 1-6, 2014.
42. K.-H. Tan, D. J. Kriegman, and N. Ahuja. Appearance-based eye gaze estimation. In Proc. W ACV, pages 191-195, 2002.
43. A. Torralba and A. A. Efros. Unbiased look at dataset bias. In Proc. CVPR, pages 1521-1528. IEEE, 2011.
44. R. Valenti, N. Sebe, and T. Gevers. Combining head pose and eye location information for gaze estimation. IEEE Transactions on Image Processing, 21(2):802-815, 2012.
45. A. Villanueva, V. Ponz, L. Sesma-Sanchez, M. Ariz, S. Porta, and R. Cabeza. Hybrid method based on topography for robust detection of iris center and eye corners. ACM Transactions on Multimedia Computing, Communications, and Applications, 9(4):25, 2013.
46. U. Weidenbacher, G. Layher, P.-M. Strauss, and H. Neumann. A comprehensive head pose and gaze database. In Proc. lET, pages 455-458, 2007.
47. F. Wilcoxon. Individual comparisons by ranking methods. Biometrics bulletin, pages 80-83, 1945.
48. O. Williams, A. Blake, and R. Cipolla. Sparse and semisupervised visual mapping with the SA 3GP. In Proc. CVPR, pages 230-237, 2006.
49. E. Wood and A. Bulling. Eyetab: Model-based gaze estimation on unmodified tablet computers. In Proc. ETRA, pages 207-210, 2014.
50. H. Yamazoe, A. Utsumi, T. Yonezawa, and S. Abe. Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions. In Proc. ETRA, pages 245-250, 2008.
51. D. H. Yoo and M. J. Chung. A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Computer Vision and Image Understanding, 98(1):25-51, 2005.
52. Z. Zhu and Q. Ji. Eye gaze tracking under natural head movements. In Proc. CVPR, pages 918-923, 2005.
53. Z. Zhu, Q. Ji, and K. P. Bennett. Nonlinear eye gaze mapping function estimation via support vector regression. In Proc. ICPR, pages 1132-1135, 2006.