Range- and domain-specific exaggeration of facial speech

Journal of Vision

Volumn 5, Issue 10, 2005, Pages 793-807

  Hill, Harold C H ^a   Troje, Nikolaus F ^b,d   Johnston, Alan ^c  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b RUHR UNIVERSITY BOCHUM   (Germany)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d QUEEN S UNIVERSITY   (Canada)

Author keywords

Animation; Biological motion; Exaggeration; Facial speech

Indexed keywords

ANALYSIS OF VARIANCE; ANGER; ARTICLE; ASSOCIATION; CONTROLLED STUDY; EMOTION; EXPERIMENTAL DESIGN; FACIAL EXPRESSION; HUMAN; HUMAN EXPERIMENT; MOVEMENT PERCEPTION; NORMAL HUMAN; SPEECH; TASK PERFORMANCE; VIDEORECORDING;

EMOTIONS; FACIAL EXPRESSION; FACIAL MUSCLES; HUMANS; MOTION PICTURES; MOVEMENT; SPEECH;

EID: 29544436226     PISSN: 15347362     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/5.10.4     Document Type: Article

References (54)

1. Amaya, K., Bruderlin, A., & Calvert, A. (1996). Emotion from motion. Paper presented at the Graphics Interface.
2. Auberge, V., & Cathiard, M. (2003). Can we hear the prosody of smile? Speech Communication, 40, 87-97.
3. Bassili, J. N. (1978). Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology. Human Perception and Performance, 4(3), 373-379.
4. Bassili, J. N. (1979). Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology, 37(11), 2049-2058.
5. Brennan, S. E. (1985). The caricature generator. Leonardo, 18, 170-178.
6. Bruderlin, A., & Williams, L. (1995). Motion signal processing. Paper presented at the SIGGRAPH: International Conference on Computer Graphics and Interactive Techniques.
7. Burt, D. M., & Perrett, D. I. (1995). Perception of age in adult Caucasian males faces: Computer graphics manipulation of shape and colour information. Proceedings of the Royal Society of London. Series B, 259, 137-143.
8. Calder, A. J., Young, A. W., Rowland, D., & Perrett, D. I. (1997). Computer enhanced emotion in facial expression. Proceedings of the Royal Society of London. Series B, B264, 919-925.
9. Campbell, R., Zihl, J., Massaro, D., Munhall, K., & Cohen, M. M. (1997). Speechreading in the akinetopsic patient. L.M. Brain, 120(Pt 10), 1793-1803.
10. Dohen, M., Loevenbruck, H., Cathiard, M.-A., & Schwartz, J.-L. (2004). Visual perception of contrastive focus in reiterant French speech. Speech Communication, 44, 155-172.
11. Ekman, P. (1982). Emotion in the human face. Cambridge: Cambridge University Press.
12. Essa, I. E., & Pentland, A. P. (1997). Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7), 757-763.
13. Giese, M., Knappmeyer, B., Thornton, I. M., & Bülthoff, H. H. (2002). Spatiotemporal exaggeration of complex biological movements [Abstract]. Perception, 31(Supplement), 61.
14. Giese, M., & Poggio, T. (2000). Morphable models for the analysis and synthesis of complex motion patterns. International Journal of Computer Vision, 38(1), 59-73.
15. Giese, M., & Poggio, T. (2003). Neural mechanisms for the recognition of biological movements. Nature Reviews Neuroscience, 4, 179-192.
16. Hill, H., & Johnston, A. (2001). Categorizing sex and identity from the biological motion of faces. Current Biology, 11(11), 880-885.
17. Hill, H., & Pollick, F. E. (2000). Exaggerating temporal differences enhances recognition of individuals from point light displays. Psychological Science, 11, 223-228.
18. Hodgins, J. K., & Pollard, N. S. (1997). Adapting simulated behaviours for new characters. Paper presented at the Sigraph '97, Los Angeles.
19. Kamachi, M., Bruce, V., Mukaida, S., Gyoba, J., Yoshikawa, S., & Akamatsu, S. (2001). Dynamic properties influence the perception of facial expression. Perception, 30, 875-887.
20. Kelso, J. A., Vatikiotis-Bateson, E., Saltzman, E., & Kay, B. (1985). A qualitative dynamic analysis of reiterant speech production: Phase portraits, kinematics, and dynamic modeling. Journal of the Acoustic Society of America, 77, 266-280.
21. Knappmeyer, B., Thornton, I. M., & Bülthoff, H. H. (2003). The use of facial motion and facial form during the processing of identity. Vision Research, 43, 1921-1936.
22. Lander, K., & Bruce, V. (2000). Recognizing famous faces: Exploring the benefits of facial motion. Ecological Psychology, 12(4), 259-272.
23. Lasseter, J. (1987). Principal of traditional animation applied to 3D computer animation. Computer Graphics, 21(4), 35-44.
24. Laybourne, K. (1998). The animation book. New York: Three Rivers Press.
25. Lucero, J. C., & Munhall, K. (1999). A model of facial biomechanic for speech production. Journal of the Acoustic Society of America, 106, 2834-2843.
26. Murray, I., & Arnott, J. (1993). Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion. Journal of the Acoustic Society of America, 2, 1097-1108.
27. Neri, P., Morrone, M. C., & Burr, D. C. (1998). Seeing biological motion. Nature, 395, 894-896.
28. Nichols, D. P. (1993). Testing simple effects in MANOVA. Retrieved 23/6/2003 from ftp://ftp.spss.com/pub/spss/statistics/nichols/articles/simple.txt.
29. Ostry, D. J., & Munhall, K. (1985). Control of rate and duration of speech movements. Journal of the Acoustical Society of America, 77, 640-648.
30. Parke, F. I., & Waters, K. (1996). Computer facial animation. Wellesley, Massachusetts: A K Peters Ltd.
31. Perrett, D. I., Less, K. J., Penton Voak, I., Rowland, D., Yoshikawa, S., Burt, D. M., et al. (1998). Effects of sexual dimorphism on facial attractiveness. Nature, 394, 884-887.
32. Perrett, D. I., May, K. A., & Yoshikawa, S. (1994). Facial shape and judgements of female attractiveness. Nature, 368, 239-242.
33. Pollick, F. E., Fidopiastis, C. M., & Braden, V. (2001). Recognizing the style of spatially exaggerated tennis serves. Perception, 30, 323-338.
34. Pollick, F. E., Hill, H., Calder, A. J., & Paterson, H. (2003). Recognizing expressions from spatially and temporally modified movements. Perception, 32, 813-826.
35. Pollick, F. E., Paterson, H., Bruederlin, A., & Sanford, A. J. (2001). Perceiving effect from arm movement. Cognition, 82, B51-B61.
36. Ramsay, J. O., & Silverman, B. W. (1997). Functional data analysis. New York: Springer-Verlag.
37. Rhodes, G. (1996). Superportaits. Hove, East Sussex: Psychology Press.
38. Rhodes, G., Brennan, S. E., & Carey, S. (1987). Identification and ratings of caricatures: Implications for mental representations of faces. Cognitive Psychology, 19, 473-497.
39. Rosenblum, L. D., Johnson, J. A., & Saldaña, H. M. (1996). Point-light facial displays enhance comprehension of speech in noise. Journal of Speech and Hearing Research, 39(6), 1159-1170.
40. Rosenblum, R. D., & Saldaña, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology. Human Perception and Performance, 22(2), 318-331.
41. Rowland, D., & Perrett, D. I. (1995). Manipulating facial appearance through shape and color. IEEE Computer Graphics and Applications, 15(5), 70-76.
42. Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech processing. In R. Campbell (Ed.), Hearing by eye: The psychology of lipreading (pp. 3-51). Hove, UK: Erlbaum.
43. Tartter, V. (1994). Hearing smiles and frowns in normal and whisper registers. Journal of the Acoustic Society of America, 96(4), 2101-2107.
44. Thomas, F., & Johnston, O. (1981). Disney animation: The illusion of life (1st ed.). New York: Abbeville Press.
45. Troje, N. F. (2002a). Decomposing biological motion: A framework for analysis and synthesis of human gait patterns. Journal of Vision, 2(5), 371-387, http://journalofvision.org/2/5/2/, doi:10.1167/2.5.2.
46. Troje, N. F. (2002b). The little difference: Fourier-based gender classification from biological motion. In M. Lappe (Ed.), Dynamic perception (pp. 115-120). Berlin: Aka Verlag.
47. Unuma, M., Anjyo, K., & Takeuchi, R. (1995). Fourier principals for emotion-based human figure animation. Paper presented at the SIGGRAPH: International conference on computer graphics and interactive techniques.
48. Vatikiotis-Bateson, E., & Kelso, J. A. S. (1993). Rhythm type and articulatory dynamics in English, French, and Japanese. Journal of Phonetics, 21, 231-265.
49. Vatikiotis-Bateson, E., & Ostry, D. J. (1995). An analysis of the dimensionality of jaw motion in speech. Journal of Phonetics, 23, 101-117.
50. Vetter, T., & Troje, N. F. (1997). Separation of texture and shape in images of faces for image coding and synthesis. Journal of the Optical Society of America. A, Optics, Image Science and Vision, 14, 2152-2161.
51. Waters, K. (1987). A muscle model for animating three-dimensional facial expression. Paper presented at the SIGGRAPH.
52. Waters, K., & Terzopoulos, D. (1992). The computer synthesis of expressive faces. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 335(1273), 87-93.
53. Winer, B. J., Brown, D. R., & Michels, K. M. (1991). Statistical principals in experimental design (3rd ed.). New York: McGraw-Hill.
54. Yacoob, Y., & Black, M. J. (1999). Parameterized modeling of recognition of activities. Computer Vision and Image Understanding, 73(2), 232-247.