The relevance of visual prosody for studies in language and speech-language pathology

International Journal of Speech-Language Pathology

Volumn 11, Issue 4, 2009, Pages 282-286

  Swerts, Marc ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Autism; Diagnosis; Facial expressions; Therapy; Visual prosody

Indexed keywords

EID: 74049092620     PISSN: 17549515     EISSN: 17549507     Source Type: Journal    
DOI: 10.1080/17549500902906347     Document Type: Review

References (48)

1. Adrien, J. L., Lenoir, P., Martineau, J., Perrot, A., Hameury, L., Larmande, C., & Sauvage, D. (1993). Blind ratings of early symptoms of autism based upon family home movies. Journal of the American Academy of Child and Adolescent Psychiatry, 32, 617-626.
2. Barkhuysen, P., Krahmer, E., & Swerts, M. (2005). Problem detection in human-machine interactions based on facial expressions of users. Speech Communication, 45, 343-359.
3. Barkhuysen, P., Krahmer, E., & Swerts, M. (2008). The interplay between the auditory and visual modality for end-of-utterance detection. Journal of the Acoustical Society of America, 123, 354-365.
4. Baron-Cohen, S. (1995). Mindblindness: An essay on autism and theory of mind. Boston, MA: MIT Press.
5. Baron-Cohen, S., & Staunton, R. (1994). Do children with autism acquire the phonology of their peers? An examination of group identification through the window of bilingualism. First Language, 14, 241-248.
6. Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The "reading the mind in the eyes" test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry and Allied Disciplines, 42, 241-251.
7. Cavé , C., Guaitella, I., Bertrand, R., Santi, S., Harlay, F., & Espesser, R. (1996). About the relationship between eyebrow movements and F0 variations. Proceedings of the International Conference on Spoken Language Processing (ICSLP) (pp. 2175-2179). Philadelphia, PA.
8. Chartrand, T. L., & Bargh, J. A. (1999). The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology, 76, 893-910.
9. Crystal, D. (2009). Persevering with prosody. International Journal of Speech-Language Pathology, 11, 257.
10. Dapretto, M., Davies, M. S., Pfeifer, J. H., Scott, A. A., Sigman, M., Brookheimer, S. Y., & Iacoboni, M. (2005). Understanding emotions in others: mirror neuron dysfunction in chidren with autism spectrum disorders. Nature Neuroscience, 6, 28-30.
11. de Gelder, B., Vroomen, J., & van der Heide, L. (1991). Face recognition and lip-reading in autism. European Journal of Cognitive Psychology, 3, 69-86.
12. DeCasper, A. J., & Fifer, W. P. (1980). On human bonding: Newborns prefer their mother's voices. Science, 208, 1174-1176.
13. Dijkstra C., Krahmer E., & Swerts, M. (2006). Manipulating uncertainty: The contribution of different audiovisual prosodic cues to the perception of confidence. Proceedings of the Speech Prosody 2006 Conference. Dresden, May.
14. Dohen, M., & Loevenbruck, H. (2009). Interaction of audition and vision for the perception of prosodic contrastive focus. Language and Speech, 52, 177-206.
15. Dohen, M., Loevenbruck, H., Cathiard, M.-A., & Schwartz, J.-L. (2004). Visual perception of contrastive focus in reiterant French speech. Speech Communication, 44, 155-172.
16. Egenfeldt-Nielsen, S. (2005). Beyond edutainment. Exploring the educational potential of computer games. PhD thesis, University of Copenhagen.
17. Ekman, P. (2003). Emotions revealed. Understanding faces and feelings. London: Weidenfeld & Nicolson.
18. Goswami, U. (2008). Cognitive development. The learning brain. Hove: Psychology press.
19. Hadar, U., Steiner, T. J., Grant, E. C., & Rose, F. C. (1983). Head movement correlates of juncture and stress at sentence level. Language and Speech, 26, 117-129.
20. Kaiser, S., & Wehrle, T. (1996). Situated emotional problem solving in interactive computer games. In N. H. Frijda (Ed.), Proceedings of the IXth Conference of the International Society for Research on Emotions (pp. 276-280). Toronto.
21. Krahmer, E., & Swerts, M. (Eds.) (2009). Special double issue on Audiovisual Prosody. Language and Speech, 52, 129-386.
22. Krahmer, E., & Swerts, M. (2004). More about brows: a crosslinguistic study via analysis-by-synthesis. In Z. Ruttkay, et al. (Eds.), From brows to trust: Evaluating embodied conversational agents (pp. 191-216). Dordrecht: Kluwer.
23. Krahmer, E., & Swerts, M. (2005). How children and adults produce and perceive uncertainty in audiovisual speech. Language and Speech, 48, 29-53.
24. Krahmer, E., & Swerts, M. (2007). The effect of visual beats on prosodic prominence: acoustic analyses, auditory perception, and visual perception. Journal of Memory and Language, 57, 396-414.
25. Magnée, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C. (2008a). Atypical processing of fearful face-voice pairs in pervasive developmental disorder: An ERP study. Clinical Neurophysiology, 119, 2004-2010.
26. Magnée, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C. (2008b). Audiovisual speech integration in pervasive developmental disorder: Evidence from event-related potentials. The Journal of Child Psychology and Psychiatry, 49, 995-1000.
27. Massaro, D. W., & Bosseler, A. (2003). Perceiving speech by ear and eye: Multimodal integration by children with autism. Journal on Developmental and Learning Disorders, 7, 111-144.
28. McCann, J., & Peppé , S. (2003). Prosody in autism spectrum disorders: A critical review. International Journal of Language and Communication Disorders, 38, 325-350.
29. McGee, G., & Morrier, M. (2003). Clinical implications of research in nonverbal behaviour of children with autism. In P. Philippot, R. S. Feldman, & E. J. Coats (Eds.), Nonverbal behaviour in clinical settings. Oxford: Oxford University Press.
30. McIntosh, D. N., Reichmann-Decker, A., Winkielman, P., & Wilbarger, J. (2006). When the social mirror breaks: Deficits in automatic, but not voluntary, mimicry of emotional facial expressions in autism. Developmental Science, 9, 295-302.
31. Mehler, J., Lambertz, G., Jusczyk, P. W., & Amiel-Tison, C. (1986). Discrimination de la langue maternelle par le nouveaune ́. Comptes rendus de l'Académie des Sciences de Paris 303, série, III, 637-640.
32. Nakano, Y. I., Reinstein, G., Stocky, T., & Cassell, J. (2003). Towards a model of face-to-face grounding. Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL). Sapporo, Japan.
33. Peppé , S. J. E. (2009). Why is prosody in speech-language pathology so difficult? International Journal of Speech-Language Pathology, 11, 258-271.
34. Peppé , S., & McCann, J. (2003). Assessing intonation and prosody in children with atypical language development: The PEPS-C test and the revised version. Clinical Linguistics and Phonetics, 17, 345-354.
35. Pickering, M. J., & Garrod, S. (2004). Towards a mechanistic psychology of dialogue. Behavioral and Brain Sciences, 27, 169-225.
36. Rapin, I., & Dunn, M. (1997). Language disorders in children with autism. Seminars in Pediatric Neurology, 4, 86-92.
37. Rutherford, M.D., Baron-Cohen, S., & Wheelwright, S. (2002). Reading the mind in the voice: Sensitivity in childhood psychopathology. Journal of Autism and Developmental Disorders, 32, 189-194.
38. Salen, K., & Zimmerman, E. (2003). Rules of play. Game design fundamentals. Cambridge, MA: MIT Press.
39. Scarborough, R., Keating, P., Mattys, S. L., Cho, T., Alwan, A., & Auer, E. T. (2009). Optical phonetics and visual perception of lexical and phrasal stress in English. Language and Speech, 52, 135-175.
40. Sehaba, K., Estraillier, P., & Lambert, D. (2005). Interactive educational games for autistic children with agent-based system. Lecture Notes in Computer Science (LNCS), 3711, 422-432.
41. Shahid, S., Krahmer, E., & Swerts, M. (2007). Audiovisual emotional speech of game playing children: Effects of age and culture. Proceedings of Interspeech 2007. Antwerp, August.
42. Shriberg, L. D., Paul, R., McSweeny, J. L., Klin, A., Cohen, D. J., & Volkmar, F. R. (2001). Speech and prosody characteristics of adolescents and adults with high-functioning autism and Asperger's Syndrome. Journal of Speech, Language, and Hearing Research, 44, 1097-1115.
43. Srinivasan, R. & Massaro, D. (2003). Perceiving prosody from the face and voice: Distinguishing statements from echoic questions in English. Language and Speech, 46, 1-22.
44. Swerts, M., & Krahmer, E. (2005). Audiovisual prosody and feeling of knowing. Journal of Memory and Language, 53, 81-94.
45. Swerts, M., & Krahmer, E. (2008). Facial expression and prosodic prominence: Effects of modality and facial area. Journal of Phonetics, 36, 219-238.
46. Teunisse, J.-P., & de Gelder, B. (2003). Face processing in adolescents with autistic disorder: The inversion and composite effects. Brain and Cognition, 52, 285-294.
47. Walters, A. S., Barrett, R. P., & Feinstein, C. (1990). Social relatedness and autism: Current research, issues, directions. Research in Developmental Disabilities, 11, 303-326.
48. Williams, J. H. G., Massaro, D. W., Peel, N. J., Bosseler, A., & Suddendorf, T. (2004). Visual-auditory integration during speech imitation in autism. Research in Developmental Disabilities, 25, 595-1575