Eye contact in video conference via fusion of time-of-flight depth sensor and stereo

3D Research

Volumn 2, Issue 3, 2011, Pages 1-10

  Zhu, Jiejie ^a   Yang, Ruigang ^b   Xiang, Xueqing ^c  

^a UTOPIACOMPRESSION CORPORATION   (United States)

^b UNIVERSITY OF KENTUCKY   (United States)

^c ZHEJIANG UNIVERSITY   (China)

Author keywords

Eye gaze; Stereo; Time of Flight

Indexed keywords

STEREO IMAGE PROCESSING;

BLIND EVALUATIONS; DEPTH SENSORS; EYE CONTACT; EYE-GAZE; PRIOR KNOWLEDGE; STEREO; TIME OF FLIGHT; USER STUDY;

VIDEO CAMERAS;

EID: 84870159862     PISSN: None     EISSN: 20926731     Source Type: Journal    
DOI: 10.1007/3DRes.03(2011)5     Document Type: Article

References (23)

1. J. N. Bailenson, A. C. Beall, J. Loomis, J. Blascovich, and M. Turk (2004) Transformed social interaction: Decoupling representation from behavior and form in collaborative virtual environments, Presence: Teleoper. Virtual Environ, 13(4): 428-441.
2. J. Carranza, C. Theobalt, M. A. Magnor, H. Seidel (2003) Free-viewpoint video of human actors, ACM Transactions on Graphics, pp. 569-577.
3. T. J. Cham, S. Krishnamoorthy, M. Jones (2002) Analogous view transfer for gaze correction in video sequences, Intl. Conf. Automaticion, Robotics, Control and Vision, pp. 1415-1420.
4. A. Criminisi, J. Shotton, A. Blake, P. H. S. Torr (2003) Gaze manipulation for one-to-one teleconferencing, Proceedings of the Ninth IEEE International Conference on Computer Vision.
5. D. T. Guinnip, S. Lai, R. Yang (2004) View-dependent textured splatting for rendering live scenes, SIGGRAPH' 04: ACM SIGGRAPH 2004 Posters, pp. 51.
6. J. Jerald, M. Daily (2002) Eye gaze correction for videoconferencing, ETRA' 02: Proceedings of the 2002 symposium on Eye tracking research & applications, (New York, NY, USA), pp. 77-81.
7. M. L. Knapp and J. A. Hall (2007) Nonverbal Communication in Human Interaction (5th Edision). Wadworth: Thomas Learning.
8. J. Kollarits, C. Woodworth, R. Gitlin (1995) An eye-contact camera/display system for videophone applications using a conventional direct-view lcd, SID Digest.
9. W. Li, J. Zhou, B. Li, M. Ibrahim Sezan (2006) Virtual view specification and synthesis in free viewpoint television application, 3DPVT' 06: Proceedings of the Third International Symposium on 3D Data Processing, Visualization, pp. 464-471.
10. M. Lehmann, R. Kaufmann, F. Lustenberger, B. Bttgen, T. Oggier (2004) Ccd/cmos lock-in pixel for range imaging: Challenges, limitations and state-of-the-art, CSEM, Swiss Center for Electronics and Microtechnology.
11. X. Ma, and Z. Deng (2009) Natural eye motion synthesis by modeling gaze-head coupling, Proceedings of Virtual Reality Conference, pp. 143-150.
12. D. Roberts, R. Wolff, J. Rae, A. Steed, R. Aspin, M. McIntyre, A. Pena, O. Oyekoya, W. Steptoe (2009) Communicating eye-gaze across a distance: Comparing an eye-gaze enabled immersive collaborative virtual environment, aligned video conferencing, and being together, Proceedings of Virtual Reality Conference pp. 135-142.
13. R. J. Rost (2004) OpenGL(R) Shading Language. Redwood City, CA, USA: Addison Wesley Longman Publishing Co.
14. D. Scharstein and R. Szeliski (2001) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms, International Journal of Computer Vision47: 7-42.
15. S. Seitz and C. Dyer (1996) View morphing, SIGGRAPH 96, pp. 21-30.
16. E. Tola, C. Zhang, Q. Cai, Z. Zhang (2009) Virtual View Generation with a Hybrid Camera Array, Tech. rep., CVLAB in EP.
17. R. Yang, and Z. Zhang (2004) Eye gaze correction with stereovision for video-teleconferencing, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(7): 956-960.
18. R. Yang, C. S. Kurashima, H. Towles, A. Nashel, M. K. Zuffo (2007) Immersive video teleconferencing with usersteerable views, Presence: Teleoper. Virtual Environ, 16(2): 188-205.
19. B. Yip, and J. Jin (2003) An effective eye gaze correction operation for video conference using antirotation formulas, Proceedings of the Fourth Pacific Rim Conference on Multimedia, Information, Communications and Signal Processing, pp. 699-703, IEEE Computer Society.
20. J. J. Zhu, L. Wang, R. Yang, D. James (2008) Fusion of time-of-flight depth and stereo for high accuracy depth maps, IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
21. J. J. Zhu, M. Liao, R. Yang, Z. G. Pan (2009) Joint depth and alpha matte optimization via fusion of stereo and time-of-flight sensor, IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
22. C. L. Zitnick, J. Gemmell, K. Toyama (1999) Manipulation of video eye gaze and head orientation for video teleconferencing, Tech. rep.
23. Z. Zhang (2000) A flexible new technique for camera calibration, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11): 1330-1334.