The moving face during speech communication

Hearing Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech

Volumn , Issue , 2013, Pages 123-139

  Munhall, Kevin G ^a   Vatikiotis Bateson, Eric ^b  

^a QUEEN S UNIVERSITY   (Canada)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84964546021     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203098752-14     Document Type: Chapter

References (58)

1. Abry, C. & Boë, L.J. (1986). Laws for lips. Speech Communication, 5, 97-104.
2. Badin, P., Motoki, K., Miki, N., Ritterhaus, D. & Lallouache, M.T. (1994). Some geometric and acoustic properties of the lip horn. Journal of the Acoustical Society of Japan (E), 15, 243-53.
3. Black, M. & Yacoob, Y. (1995). Tracking and recognising rigid and non-rigid facial motions using local parametric models of image motion. Proceedings of the Fifth International Conference on Computer Vision (ICCV’95). Boston.
4. Boyce, S.E. (1988). The influence of phonological structure on articulatory organization in Turkish and in English: Vowel harmony and coarticulation. Unpublished doctoral dissertation. Yale University.
5. Campbell, R. (1982). Asymmetries in moving faces. British Journal of Psychology, 73, 95-103.
6. Daniloff, R.G. & Moll, K.L. (1968). Coarticulation of lip rounding. Journal of Speech and Hearing Research, 11, 707-21.
7. Demorest, M.E. & Bernstein, L.E. (1992). Sources of variability in speechreading sentences: A generalizability analysis. Journal of Speech and Hearing Research, 35, 876-91.
8. DeNil, L. & Abbs, J.H. (1991). Influence of speaking rate on the upper lip, lower lip, and jaw peak velocity sequencing during bilabial closing movements. Journal of the Acoustical Society of America, 89, 845-9.
9. Eigsti, I.-M., Munhall, K.G., Yano, S. & Vatikiotis-Bateson, E. (1995). Effects of listener expectation on eye movement behavior during audio-visual perception. Journal of the Acoustical Society of America, 97, 3287.
10. Fairbanks, G. (1960). Voice and Articulation Drillbook. New York: Harper and Row.
11. Ferrado, V., Chiarella, S., Poggio, C. & Tartaglia, G. (1994). Distance form symmetry: A three-dimensional evaluation of facial asymmetry. Journal of Oral Maxillofacial Surgery, 52, 1126-32.
12. Folkins, J.W. & Canty, J. (1986). Movements of the upper and lower lips during speech: Interactions between lips with the jaw fixed at different position. Journal of Speech and Hearing Research, 29, 348-56.
13. Fromkin, V.A. (1964). Lip positions in American English vowels. Language and Speech, 7, 215-25
14. Fujimura, O. (1961). Bilabial stop and nasal consonants: A motion picture study and its acoustical implications. Journal of Speech and Hearing Research, 4, 233-47.
15. Gagné, J.-P., Querengesser, C, Folkeard, P., Munhall, K.G. & Masterson, V. (1995). Auditory, visual and audiovisual speech intelligibility for sentence-length stimuli: An investigation of conversational and clear speech. The Volta Review, 95(1), 33-51.
16. Gracco, V.L. (1988). Timing factors in the coordination of speech movements. Journal of Neuroscience, 8, 4628-34.
17. Gracco, V.L. (1994). Some organizational characteristics of speech movement control. Journal of Speech and Hearing Research, 37, 4-27.
18. Gracco, V.L. & Abbs, J.H. (1986). Variant and invariant characteristics of speech movements. Experimental Brain Research, 65, 156-66.
19. Gracco, V.L. & Abbs, J.H. (1988). Central patterning of speech movements. Experimental Brain Research, 71, 515-26.
20. Green, K.P. & Miller, J.L. (1985). On the role of visual rate information in phonetic perception. Perception and Psychophysics, 38(3), 269-76.
21. Guiard-Marigny, T., Ostry, D.J. & Benoît, C. (1995). Speech intelligibility of synthetic lips and jaw. Proceedings of the 13th International Congress of Phonetic Sciences (3) (pp. 222-5). Stockholm, Sweden.
22. Hirayama, M., Vatikiotis-Bateson, E., Gracco, V.L. & Kawato, M. (1994). Neural network prediction of lip shape from EMG in Japanese speech. Proceedings of the International Conference on Spoken Language Processing (ICSLP-94) (2) (pp. 587-90). Yokahama, Japan.
23. Horn, B.K.P. (1987). Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America, 4, 629-42.
24. Jeffers, J. & Barley, M. (1971). Speechreading (lipreading). Springfield, IL: Charles C. Thomas Publisher.
25. Lee, Y.V., Terzopoulos, D. & Waters, K. (1995). Realistic modeling for facial animation. In R. Cook (Ed.), Proceedings of SIGGRAPH '95 (pp. 55-62). Los Angeles: ACM SIGGRAPH.
26. Linker, W. (1982). Articulatory and acoustic correlates of labial activity in vowels: A cross-linguistic study. UCLA Working Papers in Phonetics, 56, 1-154.
27. Löfqvist, A. & Gracco, V. (1996). Labial kinematics in stop consonant production. Journal of the Acoustical Society America, 99, 2472 (A).
28. Lubker, J.F. & Gay, T.J. (1982). Anticipatory labial coarticulation: Experimental, biological and linguistic variables. Journal of the Acoustical Society of America, 71, 437-48.
29. Markel, J. & Gray, A. (1976). Linear Prediction of Speech. Springer-Verlag: New York.
30. McClean, M.D., Kroll, R.M. & Loftus, N.S. (1990). Kinematic analysis of lip closure in stutterers’ fluent speech. Journal of Speech and Hearing Research, 33, 755-60.
31. McGarr, N.S., Löfqvist, A. & Seider-Story, R. (1987). Jaw kinematics in hearing-impaired speakers. Proceedings of the 11th International Congress of Phonetic Sciences (4) (pp. 173-6). Tallinn: Academy of Sciences of the ESSR.
32. McGurk, H. & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-8.
33. McNeill, D. (1992). Hand and mind. Chicago: University of Chicago Press.
34. Muller, E.M. & MacLeod, G. (1982). Perioral biomechanics and its relation to labial motor control. Paper presented at the meeting of the Acoustical Society of America, Chicago.
35. Munhall, K.G., Gribble, P., Sacco, L. & Ward, M. (1996). Temporal constraints on the McGurk effect. Perception and Psychophysics, 58, 351-62.
36. Ohala, J.J. (1975). The temporal regulation of speech. In G. Fant & M.A.A. Tatham (Eds), Auditory Analysis and Perception of Speech. London: Academic Press.
37. Ostry, D.J. & Munhall, K.G. (1985). Control of rate and duration of speech movements. Journal of the Acoustical Society of America, 77, 640-48.
38. Ostry, D.J. & Munhall, K.G. (1994). Control of jaw orientation and position in mastication and speech. Journal of Neurophysiology, 71, 1515-32.
39. Perkell, J.S. (1986). Coarticulation strategies: Preliminary implications of a detailed analysis of lower lip protrusion movements. Speech Communication, 5, 47-68.
40. Pozzo, T., Berthoz, A. & Lefort, L. (1989). Head kinematic during various motor tasks in humans. Progress in Brain Research, 50, 377-83.
41. Pulaski, P., Zee, D. & Robinson, D. (1981). The behavior of the vestibulo-ocular reflex at high velocities of head rotation. Brain Research, 222, 159-65.
42. Ramsay, J.O., Munhall, K.G., Gracco, V.L. & Ostry, D.J. (1996). Functional data analyses of lip motion. Journal of the Acoustical Society of America, 99, 3718-27.
43. Remez, R., Lipton, J. & Fellowes, J. (1996). Perceiving the difference between spontaneous and read speech: The role of physical duration. Journal of the Acoustical Society of America, 99, 2493.
44. Rosenblum, L.D. (1994). How special is audiovisual speech integration? Current Psychology of Cognition, 13, 110-16.
45. Segal, B. & Katsarkas, A. (1988). Long-term deficits of goal-directed vestibulo-ocular function following total unilateral loss of peripheral vestibular function. Acta Otolaryngol (Stockholm), 106, 102-10.
46. Smeele, P., Hahnlen, L., Stevens, E., Kuhl, P. & Meltzoff, A.N. (1995). Investigating the role of specific facial information in audiovisual speech perception (abstract). Journal of the Acoustical Society of America, 98, 5aSC7.
47. Smith, A. (1992). The control of orofacial movements in speech. Critical Reviews in Oral Biology and Medicine, 3, 233-67.
48. Smith, B.L. & McLean-Muse, A. (1987). Kinematic characteristics of postvocalic labial stop consonants produced by children and adults. Phonetica, 44, 227-37.
49. Sumby, W. H. & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-15.
50. Sussman, H.M., MacNeilage, P.F. & Hanson, R.J. (1973). Labial and mandibular dynamics during the production of bilabial consonants: Preliminary observations. Journal of Speech and Hearing Research, 16, 397-420.
51. Terzopoulos, D. & Waters, K. (1990). Physically-based facial modeling, analysis, and animation. Visualization and Computer Animation, 1, 73-80.
52. Vatikiotis-Bateson, E. & Kelso, J.A.S. (1993). Rhythm type and articulatory dynamics in English, French and Japanese. Journal of Phonetics, 21, 231-65.
53. Vatikiotis-Bateson, E. & Ostry, D.J. (1995). An analysis of the dimensionality of jaw motion in speech. Journal of Phonetics, 23, 101-17.
54. Vatikiotis-Bateson, E. & Yehia, H. (1996). Physiological modeling of facial motion during speech. Transactions of the Technical Committee on Psychological and Physiological Acoustics, H-96-65, 1-8.
55. Vatikiotis-Bateson, E., Eigsti, I.-M. & Yano, S. (1994). Listener eye movement behavior during audiovisual perception. Proceedings of the International Conference on spoken Language Processing-94, 527-30.
56. Vatikiotis-Bateson, E., Eigsti, I.-M., Yano, S. & Munhall, K.G. (in press). Listener eye movement behavior during audiovisual perception. Perception and Psychophysics.
57. Vatikiotis-Bateson, E., Munhall, K.G., Hirayama, M., Lee, Y.V. & Terzopolous, D. (1996). Dynamics of facial motion in speech: Kinematic and electromyographic studies of orofacial structures. In D.G. Stork & M. Hennecke (Eds), Speechreading by Humans and Machines. NATO-ASI Series F (150) (pp. 221-32). Berlin: Springer-Verlag.
58. Wolf, M.E. & Goodale, M.A. (1987). Oral asymmetries during verbal and nonverbal movements of the mouth. Neuropsychologia, 25, 375-96.