Empirical modeling of human face kinematics during speech using motion clustering

Journal of the Acoustical Society of America

Volumn 118, Issue 1, 2005, Pages 405-409

  Lucero, Jorge C ^a   Maciel, Susanne T R ^a,c   Johns, Derek A ^b   Munhall, Kevin G ^b  

^a UNIVERSITY OF BRASILIA   (Brazil)

^b QUEEN S UNIVERSITY   (Canada)

^c CNPq ^*  (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMATION; BIOMECHANICS; COMPUTER SIMULATION; KINEMATICS; MATHEMATICAL MODELS; MOTION ESTIMATION;

EMPIRICAL MODELING; HUMAN FACE KINEMATICS; KINEMATIC SIGNALS; UNIQUE PRIMARY MARKER;

FACE RECOGNITION;

ALGORITHM; ARTICLE; BIOMECHANICS; FACE; FACE MUSCLE; HUMAN; KINEMATICS; MATHEMATICAL MODEL; MOVEMENT (PHYSIOLOGY); PRIORITY JOURNAL; SPEECH;

ALGORITHMS; BIOMECHANICS; CLUSTER ANALYSIS; FACIAL MUSCLES; HUMANS; MODELS, BIOLOGICAL; MOTION; MOVEMENT; SPEECH;

EID: 22144434412     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.1928807     Document Type: Article

References (15)

1. Badin, P., Bailly, G., and Revéret, L. (2002). "Three-dimensional linear articulatory modeling of tongue, lips, and face, based on MRI and video images." J. Phonetics 30, 533-553.
2. Beskow, J. (2004). "Trainable articulatory control models for visual speech synthesis," International Journal of Speech Technology 7, 335-349.
3. Bevacqua E., and Pelachaud C. (2004). "Expressive audio-visual speech," Computer Animation and Virtual Worlds 15, 297-304.
4. Cohen, M. M., and Massaro, D. W. (1990). "Synthesis of visible speech," Behav. Res. Methods Instrum. Comput. 22, 260-263.
5. Davis, H., and Silverman, S. R. (Eds.) (1970). Hearing and Deafness, 3rd ed. (Holt, Rinehart and Winston, New York).
6. Ekman, P., Friesen, W. V., and Hager, J. C. (2002). The Facial Action Coding System, 2nd ed. (Research Nexus eBook, Salt Lake City).
7. Fidaleo, D., and Neumann, U. (2002). "CoArt: Co-articulation region analysis for control of 2D characters," Proceedings of Computer Animation 2002, pp. 17-24
8. Kincaid, D., and Cheney, W. (2002). Numerical Analysis: Mathematics of Scientific Computing (Brooks/Cole, Pacific Grove, CA).
9. Kuratate, T., Yehia, H., and Vatikiotis-Bateson, E. (1998). "Kinematics-based synthesis of realistic talking faces," in International Conference on Auditory-Visual Speech Processing (AVSP'98), edited by D. Burnham, J. Robert-Ribes, and E. Vatikiotis-Bateson (Causal Productions, Terrigal-Sydney, Australia), pp. 185-190.
10. Lucero, J. C, and Munhall, K. G. (1999). "A model of facial biomechanics for speech production," J. Acoust. Soc. Am. 106, 2834-2842.
11. Munhall, K. G., and Vatikiotis-Bateson, E. (1998). "The moving face during speech communication," in Hearing By Eye, Part 2: The Psychology of Speechreading and Audiovisual Speech, edited by R. Campbell, B. Dodd, and D. Burnham (Taylor & Francis Psychology, London).
12. Ouni, S., Cohen, D. M., and Massaro, D. W. (2005). "Training Baldi to be multilingual: A case study for an Arabic Badr," Speech Commun. 45, 115-137.
13. Pitermann, M., and Munhall, K. G. (2001). "An inverse dynamics approach to face animation," J. Acoust. Soc. Am. 110, 1570-1580.
14. Terzopoulos. D., and Waters, K. (1990). "Physically-based facial modeling, analysis, and animation," Journal of Visualization and Computer Animation 1, 73-80.
15. Zhang, Y., Prakash, E. C., and Sung, E. (2004). "Anew physical model with mutilayer architecture for facial expression animation using dynamic adaptive mesh," IEEE Trans. Vis. Comput. Graph. 10, 339-352.