Video-realistic image-based eye animation via statistically driven state machines

Visual Computer

Volumn 26, Issue 9, 2010, Pages 1201-1216

  Weissenfeld, Axel ^a   Liu, Kang ^a   Ostermann, Jörn ^a  

^a LEIBNIZ UNIVERSITY HANNOVER   (Germany)

Author keywords

Computer vision; Eye animation; Sample based image synthesis; Talking heads

Indexed keywords

DIALOG SYSTEMS; EYE ANIMATION; EYE BLINK; EYE CONTROL; EYE MOVEMENT MODEL; HUMAN SUBJECTS; IMAGE BASED SYSTEM; IMAGE SYNTHESIS; IMAGE-BASED MODELS; MULTIMEDIA APPLICATIONS; NEW MODEL; REALISTIC IMAGES; RENDERING ENGINE; SPOKEN LANGUAGES; STATE MACHINE; STATISTICAL ANALYSIS; SUBJECTIVE TESTS; TALKING-HEADS; VIRTUAL OPERATORS;

ANIMATION; COMPUTER VISION; LINGUISTICS; THREE DIMENSIONAL;

EYE MOVEMENTS;

EID: 77955768894     PISSN: 01782789     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00371-009-0401-x     Document Type: Article

References (42)

1. Ostermann, J., Weissenfeld, A.: Talking faces-technologies and applications. In: ICPR'04: Proceedings of the Pattern Recognition, vol. 3, pp. 826-833 (2004)
2. F. Pighin J. Hecker D. Lischinski R. Szeliski D.H. Salesin 1998 Synthesizing realistic facial expressions from photographs Comput. Graph. 32 75 84
3. Parke, F.I.: Computer generated animation of faces. In: ACM'72: Proceedings of the ACM Annual Conference, pp. 451-457 (1972)
4. Bregler, C., Covell, M., Slaney, M.: Video rewrite: driving visual speech with audio. In: Proc. ACM SIGGRAPH'97, in Computer Graphics Proceedings, Annual Conference Series (1997)
5. Ezzat, T., Geiger, G., Poggio, T.: Trainable videorealistic speech animation. In: Proc. ACM SIGGRAPH, pp. 388-397 (2002)
6. E. Cosatto H.P. Graf 2000 Photo-realistic talking heads from image samples IEEE Trans. Multimedia 2 3 152 163 10.1109/6046.865480
7. Cassell, J., Torres, O.: Turn taking vs. discourse structure: how best to model multimodal conversation. In: Wilks, Y. (ed.) Machine Conversations. Kluwer Academic, The Hague (1998)
8. J. Cassell C. Pelachaud N. Badler M. Steedman B. Achorn T. Becket B. Douville S. Prevost M. Stone 1994 Animated conversation: rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents Comput. Graph. 28 413 420
9. Colburn, A., Cohen, M., Drucker, S.: The role of eye gaze in avatar mediated conversational interfaces MSR-TR-2000-81. Microsoft Research (2000)
10. Heylen, D., van Es, I., van Dijk, E.M.A.G., Nijholt, A.: Experimenting with the Gaze of a Conversational Agent, Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems. Kluwer Academic, Dordrecht (2005)
11. I. Poggi C. Pelachaud F. de Rosis 2000 Eye communication in a conversational 3D synthetic agent AI Commun. 13 3 169 182
12. Fukayama, A., Ohno, T., Mukawa, N., Sawaki, M., Hagita, N.: Messages embedded in gaze of interface agents-impression management with agent's gaze. In: CHI'02: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 41-48 (2002)
13. Garau, M., Slater, M., Bee, S., Sasse, M.A.: The impact of eye gaze on communication using humanoid avatars. In: CHI'01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 309-316 (2001)
14. Zh. Deng J.P. Lewis U. Neumann 2005 Automated eye motion using texture synthesis IEEE Comput. Graph. Appl. 25 24 30 10.1109/MCG.2005.35 (Pubitemid 40556055)
15. Park Lee, S., Badler, J.B., Badler, N.I.: Eyes alive. In: SIGGRAPH'02: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 637-644 (2002)
16. E.G. Freedman D.L. Sparks 2000 Coordination of the eyes and head: movement kinematics Exp. Brain Res. 131 22 32 10.1007/s002219900296
17. Maand, X., Deng, Z.: Natural eye motion synthesis by modeling gaze-head coupling. In: VR'09: Proceedings of the 2009 IEEE Virtual Reality Conference, pp. 143-150 (2009)
18. Cosatto, E.: Sample-based talking-head synthesis. PhD thesis, Signal Processing Lab, Swiss Federal Institute of Technology, Lausanne, Switzerland, 2002
19. Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)
20. S. Masuko J. Hoshino 2006 Generating head-eye movement for virtual actor Syst. Comput. Jpn. 37 12 33 44 10.1002/scj.20513 (Pubitemid 44600727)
21. M. von Cranach R. Schmid M.W. Vogel 1969 Über einige Bedingungen des Zusammenhanges von Lidschlag und Blickbewegung Psychol. Forsch. 33 68 78 10.1007/BF00424617
22. Condon, W.S., Ogsten, W.D.: A segmentation of behavior. J. Psych. Res., 221-235 (1967)
23. Kuipers, J.: Quaternions and Rotation Sequences. Princeton University Press, Princeton (1998)
24. Young, S., Evermann, G., Gales, M., Hain, Th., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P.: HTK Book. Cambridge University Engineering Department, Cambridge (2005)
25. Huang, X., Hon, H.-W.: Spoken Language Processing: A Guide to Theory, Algorithm, and System Development. Prentice Hall PTR, New York (2001)
26. J. Zheng H. Franco F. Weng A. Sankar H. Bratt 2000 Word-level rate of speech modeling using rate-specific phones and pronunciations Proc. ICASSP 3 1775 1778
27. J. Terken 1994 Fundamental frequency and perceived prominence of accented syllables J. Acoust. Soc. Am. 95 3662 3665 10.1121/1.409936 (Pubitemid 24189519)
28. Kennedy, L., Ellis, D.: Pitch-based emphasis detection for the characterization of meeting recordings. In: IEEE Automatic Speech Recognition and Understanding Workshop (ASRU 2003), pp. 243-248 (2003)
29. Arons, B.: Pitch-based emphasis detection for segmenting speech recordings. In: Proc. ICSLP'94, pp. 1931-1934 (1994)
30. LCTechnologies, Eyegaze systems. http://www.eyegaze.com (2007)
31. A.N. Kolmogorov 1941 Confidence limits for an unknown distribution function Ann. Math. Stat. 12 461 483 10.1214/aoms/1177731684
32. Aitchison, J., Brown, J.A.C.: The Lognormal Distribution. Cambridge University Press, Cambridge (1973)
33. E. Limpert W.A. Stahel M. Abbt 2001 Log-normal distributions across the sciences: keys and clues BioScience 51 5 341 352 10.1641/0006-3568(2001) 051[0341:LNDATS]2.0.CO;2
34. A. Kendon 1967 Some functions of gaze-direction in social interaction Acta Psychol. 26 22 63 10.1016/0001-6918(67)90005-4
35. G.R. Barnes 1979 Vestibulo-ocular function during coordinated head and eye movements to acquire visual targets J. Physiol. 287 127 147
36. J.S. Stahl 1999 Amplitude of human head movements associated with horizontal saccades Exp. Brain Res. 126 1 41 54 10.1007/s002210050715 (Pubitemid 29192214)
37. F.C. Donders 1848 Beitrag zur Lehre von den Bewegungen des menschlichen Auges Hollaendis. Beitr. Anat. Physiol. Wiss. 1 104 145
38. H. Helmholtz 1863 On the normal movements of the human eye Arch. Ophthalmol. IX 153 214
39. T. Haslwanter 1995 Mathematics of three-dimensional eye rotations Vis. Res. 35 1727 1739 10.1016/0042-6989(94)00257-M
40. H.D. Schworm J. Ygge T. Pansell G. Lennerstrand 2002 Assessment of ocular counterroll during head tilt using binocular video oculography Invest. Ophthalmol. Vis. Sci. 43 3 662 667
41. ITU Telecom: Standardization Sector of ITU, Methodology for the Subjective Assessment of the Quality of Television Pictures. Recommendation ITU-R BT.500-11 (2002)
42. ITU International Telecom: Union, Telecom. sector, Subjective video quality assessment methods for multimedia applications. Recommendation ITU-T P.910 (1999)