Natural eye motion synthesis by modeling Gaze-Head coupling

Proceedings - IEEE Virtual Reality

Volumn , Issue , 2009, Pages 143-150

  Ma, Xiaohan ^a   Deng, Zhigang ^a  

^a University of Houston   (United States)

Author keywords

Digital avatars; Eye motion; Facial animation; Gaze Head coupling

Indexed keywords

AUTOMATED GENERATION; COMPONENT ANALYSIS; COUPLING MODELS; COUPLING PATTERN; DIGITAL AVATARS; EYE MOTION; EYE-GAZE; FACIAL ANIMATION; GAZE-HEAD COUPLING; HEAD MOTION; HEAD MOVEMENTS; HUMAN SUBJECTS; MOTION SYNTHESIS; OPTICAL MOTION CAPTURE; STATE-OF-THE-ART ALGORITHMS; USER STUDY;

ANIMATION; VIDEO CAMERAS; VIRTUAL REALITY;

EYE MOVEMENTS;

EID: 67649852627     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VR.2009.4811014     Document Type: Conference Paper

References (35)

1. A. Bahill, D. Andler, and L. Stark. Most naturally occurring human saccades have magnitudes of 15 deg or less. Investigative Ophthalmol, 14(6):468-469, 1975.
2. E. Bizzi. Central programming and peripheral feedback during eyehead coordination in monkeys. Bibl. Ophthal., (82):220-232, 1972.
3. C. Blakemore and M. Donaghy. Co-ordination of head and eyes in the gaze changing behaviour of cats. J Physiol., (300):317-335, 1980.
4. M. Brand and A. Hertzmann. Style machines. In Proc. of Siggraph 2000, pages 183-192, 2000.
5. C. Busso, Z. Deng, M. Grimm, U. Neumann, and S. Narayanan. Rigid head motion in expressive speech animation: Analysis and synthesis. IEEE Transaction on Audio, Speech and Language Processing, 15(3):1075-1086, March 2007.
6. C. Busso, Z. Deng, U. Neumann, and S. Narayanan. Natural head motion synthesis driven by acoustic prosody features. Computer Animation and Virtual Worlds, 16(3-4):283-290, July 2005.
7. J. Cassell, C. Pelachaud, N. Badler, M. Steedman, B. Achorn, T. Becket, B. Douville, S. Prevost, and M. Stone. Animated conversation: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In Proc. of ACM SIGGRAPH' 94, pages 413-420, 1994.
8. J. Cassell, H. Vilhjalmsson, and T. Bickmore. Beat: The behavior expression animation toolkit. In Computer Graphics (Proc. of ACM SIGGRAPH'01), pages 477-486, Los Angeles, 2001.
9. M. Costa, T. Chen, and F. Lavagetto. Visual prosody analysis for realistic motion synthesis of 3d head models. In Proc. of Int'l Conf. on Augmented, Virtual Environments and Three-Dimensional Imaging, Ornos, Mykonos, Greece, 2001.
10. Z. Deng, C. Busso, S. S. Narayanan, and U. Neumann. Audio-based head motion synthesis for avatar-based telepresence systems. In Proc. of ACM SIGMM 2004 Workshop on Effective Telepresence, pages 24- 30, New York, NY, Oct. 2004.
11. Z. Deng, J. P. Lewis, and U. Neumann. Practical eye movement model using texture synthesis. In Proc. of ACM SIGGRAPH 2003 Sketches and Applications, San Diego, 2003.
12. Z. Deng, J. P. Lewis, and U. Neumann. Automated eye motion synthesis using texture synthesis. IEEE Computer Graphics and Applications, pages 24-30, March/April 2005.
13. Z. Deng and U. Neumann. Data-Driven 3D Facial Animation. Springer-Verlag Press, 2007.
14. E. G. Freedman and D. L. Sparks. Coordination of the eyes and head: movement kinematics. Experimental Brain Research, 131(1):22-32, 3 2000.
15. M. Garau, M. Slater, S. Bee, and M. A. Sasse. The impact of eye gaze on communication using humanoid avatars. In Proc. of ACM CHI'01, pages 309-316, 2001.
16. H. P. Graf, E. Cosatto, V. Strom, and F. J. Huang. Visual prosody: Facial movements accompanying speech. In Proc. of IEEE Int'l Conf. on Automatic Face and Gesture Recognition(FG'02), May 2002.
17. M. G. Kendall and B. Babington-Smith. On the method of paired comparisons. Biometrika, 31:324-345, 1940.
18. S. C. Khullar and N. Badler. Where to look? automating visual attending behaviors of virtual human characters. In Proc. of the Third ACM Conf. on Autonomous Agents, pages 16-23, 1999.
19. N. D. L. Itti and F. Pighin. Realistic avatar eye and head animation using a neurobiological model of visual attention. In Proc. SPIE, volume 5200, pages 64-78, 2004.
20. P. Ledda, A. Chalmers, T. Troscianko, and H. Seetzen. Evaluation of tone mapping operators using a high dynamic range display. In ACM SIGGRAPH 2005 Papers, pages 640-648, 2005.
21. S. P. Lee, J. B. Badler, and N. I. Badler. Eyes alive. ACM Trans. Graph., 21(3):637-644, 2002.
22. R. J. Leigh and D. S. Zee. The Neurology of Eye Movements. Oxford University Press, 1999.
23. Y. Li, T.Wang, and H.-Y. Shum. Motion texture: a two-level statistical model for character motion synthesis. ACMTrans. Graph., 21(3):465- 472, 2002.
24. S. Masuko and J. Hoshino. Head-eye animation corresponding to a conversation for cg characters. Computer Graphics Forum (Proc. of Eurographics 07), 26(3):303-312, 2007.
25. V. Pavlovic, J. M. Rehg, and J. MacCormick. Learning switching linear models of human motion. In NIPS, pages 981-987, 2000.
26. D. D. Salvucci and J. H. Goldberg. Identifying fixations and saccades in eye-tracking protocols. In Proc. of ETRA 2000, pages 71-78, 2000.
27. S. Siegel. Nonparametric statistics for the behavioral sciences. McGRAW-HILL BOOK COMPANY, INC., 1956.
28. W. Steptoe and A. Steed. High-fidelity avatar eye-representation. In Proc. of IEEE Virtual Reality'08, pages 111-114, 2008.
29. M. Stone, D. DeCarlo, I. Oh, C. Rodriguez, A. Stere, A. Lees, and C. Bregler. Speaking with hands: creating animated conversational characters from recordings of human performance. In ACM SIGGRAPH 2004 Papers, pages 506-513, 2004.
30. D. L. Torre and M. J. Black. Dynamic coupled component analysis. In Proc. of CVPR'01, pages 643-650, 2001.
31. R. Vertegaal, G. V. Derveer, and H. Vons. Effects of gaze onmultiparty mediated communication. In Proc. of GI'00, pages 95-102, 2000.
32. R. Vertegaal, R. Slagter, G. V. Derveer, and A. Nijholt. Eye gaze patterns in conversations: There is more to conversational agents than meets the eyes. In Proc. of ACM CHI'01, pages 301-308, 2001.
33. V. Vinayagamoorthy, M. Garau, A. Steed, and M. Slater. An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience. Computer Graphics Forum, 23(1):1- 11, 2004.
34. J. M.Wang, D. J. Fleet, and A. Hertzmann. Gaussian process dynamical models for human motion. IEEE Trans. PAMI, pages 283-298, Feb 2008.
35. T. Warabi. The reaction time of eye-head coordination in man. Neurosci. Lett., (6):47-51, 1977.