Learning to look up: Realtime monocular gaze correction using machine learning

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 4667-4675

  Kononenko, Daniil ^a   Lempitsky, Victor ^a  

^a SKOLKOVO INSTITUTE OF SCIENCE AND TECHNOLOGY   (Russian Federation)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION; LAPTOP COMPUTERS; LEARNING ALGORITHMS; PATTERN RECOGNITION; SUPERVISED LEARNING; VIDEO CONFERENCING;

DECISION FOREST; GAZE DIRECTION; REAL TIME; REGISTERED IMAGES; SUPERVISED MACHINE LEARNING; TRAINING SETS; TRAINING TIME; WEB CAMERA;

LEARNING SYSTEMS;

EID: 84959255544     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7299098     Document Type: Conference Paper

References (26)

1. Project webpage. http://tinyurl. com/gazecorr, accessed 6-April-2014.
2. Y. Amit and D. Geman. Shape quantization and recognition with randomized trees. Neural Computation, 9:1545-1588, 1997.
3. L. Breiman. Random forests. Machine Learning, 45(1):5-32, Oct. 2001.
4. T. Cham, S. Krishnamoorthy, and M. Jones. Analogous view transfer for gaze correction in video sequences. In Seventh International Conference on Control, Automation, Robotics and Vision, ICARCV 2002, Singapore, 2-5 December 2002, Proceedings, pages 1415-1420, 2002.
5. A. Criminisi, J. Shotton, A. Blake, and P. H. Torr. Gaze manipulation for one-to-one teleconferencing. In IEEE In-ternational Conference on Computer Vision (ICCV), pages 191-198, 2003.
6. P. Dollár and C. L. Zitnick. Structured forests for fast edge detection. In IEEE International Conference on Computer Vision (ICCV), pages 1841-1848, 2013.
7. G. Fanelli, M. Dantone, J. Gall, A. Fossati, and L. J. V. Gool. Random forests for real time 3d face analysis. International Journal of Computer Vision, 101(3):437-458, 2013.
8. S. R. Fanello, C. Keskin, P. Kohli, S. Izadi, J. Shotton, A. Criminisi, U. Pattacini, and T. Paek. Filter forests for learning data-dependent convolutional kernels. In Computer Vision and Pattern Recognition (CVPR), pages 1709-1716, 2014.
9. J. Gall and V. S. Lempitsky. Class-specific hough forests for object detection. In Computer Vision and Pattern Recogni-tion (CVPR), pages 1022-1029, 2009.
10. D. Giger, J.-C. Bazin, C. Kuster, T. Popa, and M. Gross. Gaze correction with a single webcam. In IEEE Interna-tional Conference on Multimedia & Expo, 2014.
11. J. Jancsary, S. Nowozin, T. Sharp, and C. Rother. Regression tree fields-an efficient, non-parametric approach to image labeling problems. In Computer Vision and Pattern Recog-nition (CVPR), pages 2376-2383, 2012.
12. A. Jones, M. Lang, G. Fyffe, X. Yu, J. Busch, I. McDowall, M. T. Bolas, and P. E. Debevec. Achieving eye contact in a one-to-many 3D video teleconferencing system. ACM Trans. Graph. , 28(3), 2009.
13. V. Kazemi and J. Sullivan. One millisecond face alignment with an ensemble of regression trees. In Computer Vision and Pattern Recognition (CVPR), pages 1867-1874, 2014.
14. C. Kuster, T. Popa, J.-C. Bazin, C. Gotsman, and M. Gross. Gaze correction for home video conferencing. volume 31, page 174. ACM, 2012.
15. V. Lepetit, P. Lagger, and P. Fua. Randomized trees for realtime keypoint recognition. In Computer Vision and Pattern Recognition (CVPR), pages 775-781, 2005.
16. K.-I. Okada, F. Maeda, Y. Ichikawaa, and Y. Matsushita. Multiparty videoconferencing at virtual social distance: Majic design. In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, CSCW '94, pages 385-393, 1994.
17. S. Ren, X. Cao, Y. Wei, and J. S. 0001. Face alignment at 3000 fps via regressing local binary features. In CVPR, pages 1685-1692, 2014.
18. J. Shotton, R. B. Girshick, A. W. Fitzgibbon, T. Sharp, M. Cook, M. Finocchio, R. Moore, P. Kohli, A. Criminisi, A. Kipman, and A. Blake. Efficient human pose estimation from single depth images. IEEE Trans. Pattern Anal. Mach. Intell. , 35(12):2821-2840, 2013.
19. B. A. Smith, Q. Yin, S. K. Feiner, and S. K. Nayar. Gaze locking: passive eye contact detection for human-object interaction. In Proceedings of the 26th annual ACM sympo-sium on User interface software and technology, pages 271-280. ACM, 2013.
20. Wikipedia. Uncanny valley - Wikipedia, the free encyclopedia, 2014. [Online; accessed 12-November-2014].
21. L. Wolf, Z. Freund, and S. Avidan. An eye for an eye: A single camera gaze-replacement method. In Computer Vision and Pattern Recognition (CVPR), pages 817-824, 2010.
22. X. Xiong and F. De la Torre. Supervised descent method and its applications to face alignment. In Computer Vision and Pattern Recognition (CVPR), pages 532-539, 2013.
23. R. Yang and Z. Zhang. Eye gaze correction with stereovision for video-teleconferencing. In ECCV (2), pages 479-494, 2002.
24. P. Yin, A. Criminisi, J. M. Winn, and I. A. Essa. Tree-based classifiers for bilayer video segmentation. In Computer Vision and Pattern Recognition (CVPR), 2007.
25. B. Yip and J. S. Jin. Face re-orientation using ellipsoid model in video conference. In Proc. 7th IASTED Interna-tional Conference on Internet and Multimedia Systems and Applications, pages 245-250, 2003.
26. J. Zhu, R. Yang, and X. Xiang. Eye contact in video conference via fusion of time-of-flight depth sensor and stereo. 3D Research, 2(3):1-10, 2011.