Auditory, visual, and auditory - Visual perception of emotions by individuals with cochlear implants, hearing aids, and normal hearing

Journal of Deaf Studies and Deaf Education

Volumn 14, Issue 4, 2009, Pages 449-464

  Most, Tova ^a   Aviner, Chen ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ANALYSIS OF VARIANCE; ARTICLE; AUDITORY STIMULATION; CHILD; COCHLEA PROSTHESIS; COMPARATIVE STUDY; EMOTION; FEMALE; HEARING; HEARING AID; HUMAN; MALE; PERCEPTION DEAFNESS; PHOTOSTIMULATION; PSYCHOLOGICAL ASPECT; VISION;

ACOUSTIC STIMULATION; ADOLESCENT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; CHILD; COCHLEAR IMPLANTS; EMOTIONS; FEMALE; HEARING AIDS; HEARING LOSS, SENSORINEURAL; HUMANS; MALE; PHOTIC STIMULATION; VISUAL PERCEPTION;

EID: 70249089042     PISSN: 10814159     EISSN: 14657325     Source Type: Journal    
DOI: 10.1093/deafed/enp007     Document Type: Article

References (70)

1. Bachara, G. H., Raphael, J., & Phelan, W. J. (1980). Empathy development in deaf preadolescents. American Annals of the Deaf, 125, 38-41.
2. Banse, R., & Scherer, K. (1996). Acoustic profiles in emotion expression. Journal of Personality and Social Psychology, 70, 614-636.
3. Bergeson, T. R., Pisoni, D. B., & Davis, R. A. O. (2005). Development of audiovisual comprehension skills in prelingually deaf children with cochlear implants. Ear and Hearing, 26, 149-164.
4. Blamey, P. J., Sarant, J. Z., Paatsch, L. E., Barry, J. G., Bow, C. P., Wales, R. J., et al. (2001). Relationships among speech perception, production, language, hearing loss, and age in children with impaired hearing. Journal of Speech, Language & Hearing Research, 44, 264-285.
5. Boothroyd, A. (1988). Perception of speech pattern contrasts from auditory presentation of voice fundamental frequency. Ear and Hearing, 9, 313-321.
6. Boothroyd, A., & Eran, O. (1994). Auditory speech perception capacity of child implant users expressed as equivalent hearing loss. Volta Review, 96, 151-168.
7. Burns, K. L., & Beier, E. G. (1973). Significance of vocal and visual channels in the decoding of emotional meaning. Journal of Communication, 23, 118-130.
8. Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 527-551.
9. Calmels, M. N., Saliba, I., Wanna, G., Cochard, N., Fillaux, J., Deguine, O., et al. (2004). Speech perception and speech intelligibility in children after cochlear implantation. International Journal of Pediatric Otorhinolaryngology, 68, 347-351.
10. Carney, A. R., Kienle, M., & Miyamoto, R. T. (1990). Speech perception with a single-channel cochlear implant. Journal of Speech and Hearing Research, 33, 229-237.
11. Carroll, J., & Zeng, F. G. (2007). Fundamental frequency discrimination and speech perception in noise in cochlear implant simulations. Hearing Research, 231, 42-53.
12. De Sonneville, L. M. J., Verschoor, C. A., Njioktjien, C., Op het Veld, V., Toorenaar, N., & Vranken, M. (2002). Facial identity and facial emotions: Speed, accuracy, and processing strategies in children and adults. Journal of Clinical and Experimental Neuropsychology, 24, 200-213.
13. Dyck, M., & Denver, E. (2003). Can the emotion recognition ability of deaf children be enhanced? A pilot study. Journal of Deaf Studies and Deaf Education, 8, 348-356.
14. Dyck, M., Farrugia, C., Shochet, I., & Holmes-Brown, M. (2004). Emotion recognition/understanding ability in hearing or vision-impaired children: Do sounds, sights, or words make the difference? Journal of Psychology and Psychiatry, 45, 789-800.
15. Einot, I., & Gabriel, K. R. (1975). A study of the powers of several methods of multiple comparisons. Journal of the American Statistical Association, 70, 351.
16. El-Hakim, H., Papsin, B., Mount, R., Levasseur, J., Panesar, J., Stevens, D., et al. (2001). Vocabulary acquisition rate after cochlear implantation and the impact of age at implantation. International Journal of Pediatric Otorhinolaryngology, 59, 187-194.
17. Ekman, P. (1999). Facial expressions. In T. Dalgleish & M. Power (Eds.), Handbook of cognition and emotion (pp. 45-60). New York: John Wiley & Sons.
18. Geier, L., Barker, M. J., Opie, J., & Fisher, L. (2000). Speech perception in postlingually deafened adult Clarion users with long-term deafness. In S. Waltzman & N. Cohen (Eds.), Cochlear implants (pp. 336-337). New York: Theme Medical Publishers.
19. Gestoettner, W. K., Hamzavi, J., Egelierlier, B., & Baumgartner, W. D. (2000). Speech perception performance in prelingually deaf children with cochlear implants. Acta Otolaryngology, 120, 209-213.
20. Grant, K. W., Walden, E. W., & Seitz, P. F. (1998). Auditoryvisual speech recognition by hearing impaired subjects: Consonant recognition, sentence recognition and auditoryvisual integration. Journal of the Acoustical Society of America, 103, 2677-2690.
21. Gray, C., Hosie, J., Russell, P., Scott, C., & Hunter, N. (2007). Attribution of emotions to story characters by severely and profoundly deaf children. Journal of Developmental and Physical Disabilities, 19 145-159.
22. Harrison, R., Gordon, K., & Mount, R. (2005). Is there a critical period for cochlear implantation in congenitally deaf children? Analyses of hearing and speech perception performance after implantation. Developmental Psychobiology, 46, 252-261.
23. Hess, U., Kappas, A., & Scherer, K. R. (1988). Multichannel communication of emotion: Synthetic signal processing. In K. R. Scherer (Ed.), Facets of emotion: Recent research (pp. 161-182). Hillsdale (NJ): Lawrence Erlbaum Associates.
24. Hosie, J. A., Gray, C. D., Russell, P. A., Scott, C., & Hunter, N. (1998). The matching of facial expressions by deaf and hearing children and their production and comprehension of emotion labels. Motivation and Emotion, 22, 293-312.
25. Huang, T., Wang, S., & Liu, S. (1995). Tone perception of Mandarin-speaking postlingually deaf implantees using the Nucleus 22-channel cochlear mini system. Annals of Otology, Rhinology and Laryngology, 166(Suppl), 294-298.
26. Kishon-Rabin, L., Taitelbaum, R., Muchnic, C., Ghetler, I., Kronenberg, J., & Hildesheimer, M. (2002). Development of speech perception and production in children with cochlear implants. Analysis of Otology, Rhinology and Laryngology, 111, 85-89.
27. Lachs, L., Pisoni, D. B., & Kirk, K. I. (2001). Use of audiovisual information in speech perception by prelingually deaf children with cochlear implants: A first report. Ear and Hearing, 22, 236-251.
28. Lee, K., Van Hasselt, C., Chiu, S., & Cheung, D. (2002). Cantonese tone perception ability of cochlear implant children in comparison with normal-hearing children. International Journal of Pediatric Otorhinolaryngology, 63, 137-147.
29. Ling, D., & Ling, A. H. (1978). Aural habilitation: The foundations of verbal learning in hearing-impaired children. Washington, DC: The Alexander Graham Bell Association for the Deaf.
30. Luo, X., Fu, Q., & Galvin, J. J. (2007). Vocal emotion recognition by normal hearing listeners and cochlear implant users. Trends in Amplification, 11, 301-315.
31. McCullough, S., Emmorey, K., & Sereno, M. (2005). Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners. Cognitive Brain Research, 22, 193-203.
32. Mellon, N. K. (2000). Psychosocial development of children in deafness. In J. K. Niparko (Ed.), Cochlear implants: Principles and practices (pp. 319-321). Philadelphia, PA: Lippincott Williams & Wilkins.
33. Meyer, T., Svirski, M., Kirk, K., & Miyamoto, R. (1998). Improvements in speech perception by children with profound prelingual hearing loss: Effects of device, communication mode, and chronological age. Journal of Speech, Language, and Hearing Research, 41, 846-858.
34. Mildner, V., Sindija, B., & Zrinski, K. V. (2006). Speech perception of children with cochlear implants and children with traditional hearing aids. Clinical Linguistics and Phonetics, 20, 219-229.
35. Mitterbach, A., Zierfofer, C., Schatzer, R., & Kals, M. (2005). Encoding fine time structure with channels specific sampling sequences Conference on Implantable Auditory Prosthesis, Pacific Grove, CA.
36. Montagne, B., Kessels, R. P. C., Frigerio, E., De Haan, E., & Perret, D. I. (2005). Sex differences in the perception of affective facial expressions: Do men really lack emotional sensitivity? Cognitive Processing, 6, 136-141.
37. Moore, B. (1996). Perceptual consequences of cochlear hearing loss and their implications for the design of hearing aids. Ear and Hearing, 17, 136-141.
38. Most, T., & Greenbank, A. (2000). Auditory, visual, and auditory-visual perception of emotions by adolescents with and without learning disabilities and its relation to their social skills. Learning Disabilities Research & Practice, 15, 171-178.
39. Most, T., & Peled, M. M. (2007). Perception of suprasegmental features of speech by children with cochlear implants and children with hearing aids. Journal of Deaf Studies and Deaf Education, 12, 350-361.
40. Most, T., Weisel, A., & Zaychik, A. (1993). Auditory, visual and auditory-visual identification of emotions by hearing and hearing-impaired adolescents. British Journal of Audiology, 27, 247-253.
41. Mozziconacci, S. (2002). Prosody and emotion. Proceedings of Speech Prosody, Aix-en-Provence, France.
42. Murray, I. R., & Arnott, J. L. (1993). Toward the simulation of emotion in synthetic speech: A review on the literature on human vocal emotion. Journal of the Acoustical Society of America, 93, 1097-1108.
43. Nygaard, L. C., & Queen, J. S. (2008). Communicating emotions: Linking affective prosody and word meaning. Journal of Experimental Psychology: Human Perception and Performance, 34, 1017-1030.
44. Oh, S. H., Kim, C. S., Kang, E. J., Lee, D. S., Lee, H. J., Chang, S. O., et al. (2003). Speech perception after cochlear implantation over a 4-year time period. Acta Otolaryngologica, 123, 148-153.
45. O'Halpin, R., Falkoner, A., Rosen, S., & Viani, L. (2006). The perception of stress and intonation by children with cochlear implants Paper Presented at the 8th European Symposium of Pediatric Cochlear Implantation, March 2006, Venice, Italy.
46. Oster, A. M., & Risberg, A. (1986). The identification of the mood of a speaker by hearing-impaired listeners. SLT-Quarterly Progress Status Report, 4, 79-90.
47. Peng, S. C., Tomblin, J. B., & Turner, C. W. (2008). Production and perception of speech intonation in pediatric cochlear implant recipients and individuals with normal hearing. Ear And Hearing, 29, 336-351.
48. Pereira, C. (2000). The perception of vocal affect by cochlear implants. In S. B. Waltzman & N. L. Cohen (Eds.), Cochlear Implants (pp. 343-345). New York, NY: Thieme.
49. Peters, K. P. (2006). Emotion recognition in speech: Discrimination, identification, and the effects of talker and sentence variability. Unpublished doctoral dissertation, Washington University.
50. Peterson, C., & Siegal, M. (1995). Deafness, conversation, and theory of mind. Journal of Psychology and Psychiatry, 36, 459-474.
51. Rieffe, C., & Terwogt, M. M. (2000). Deaf children's understanding of emotions: Desires take precedence. Journal of Child Psychology and Psychiatry, 41, 601-618.
52. Rigo, T. G., & Liberman, D. A. (1989). Nonverbal sensitivity of normal hearing and hearing-impaired older adults. Ear and Hearing, 10, 184-189.
53. Rollman, S. A., & Harrison, R. D. (1996). A comparison of deaf and hearing subjects in visual nonverbal sensitivity and information processing. American Annals of the Deaf, 141, 37-41.
54. Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143-165.
55. Scherer, K. R., & Ellgring, H. (2007). Multimodal expression of emotion: Affect programs or componential appraisal patterns? Emotion, 7, 158-171.
56. Shackman, J. A., & Pollak, S. D. (2005). Experiential influences on multimodal perception of emotion. Child Development, 76(5), 1116-1126.
57. Shinall, A. R. (2005). Emotion perception in pre-kindergarten school children at central institute for the deaf. Unpublished master's thesis, Washington University.
58. Schorr, E., Fox, N., Wassenhove, V., & Knudsen, E. (2005). Auditory-visual fusion in speech perception in children with cochlear implants. Proc Natl Acad Sci USA, 102, 18748-18750.
59. Seung-Ha,O., Chong-Sun,K., Eun, J.K., Dong, S.L., Hyo, J. L., Sun, C., et al. (2003). Speech perception after cochlear implantation over a 4-year time period. Acta Otolaryngologica Supplement, 552, 55-63.
60. Sincoff, J. B., & Rosenthal, R. (1985). Content-masking method as determinants of results of studies of nonverbal communication. Journal of Nonverbal Behavior, 9(2), 121-129.
61. Sullivan, S., Ruffman, T., & Hutton, S. B. (2007). Age differences in emotion recognition skills and the visual scanning of emotion faces. Journal of Gerontology, 62, 53-60.
62. Taitelbaum-Swead, R., Kishon-Rabin, L., Kaplan-Neeman, R., Muchnic, C., Kronenberg, J., & Hildesheimer, M. (2005). Speech perception of children using Nucleus, Clarion or Med-El cochlear implants. International Journal of Pediatric Otorhinolaryngology, 69, 1675-1683.
63. Wagner, H. L., McDonald, C. J., & Manstead, A. S. R. (1986). Communication of individual emotions by spontaneous facial expressions. Journal of Personality and Social Psychology, 50, 737-743.
64. Wallbott, H. G., & Scherer, K. R. (1986). Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51, 690-699.
65. Walker-Andrews, A. S., & Lennon, E. (1991). Infants' discrimination of vocal expressions: Contributions of auditory and visual information. Infant Behavior and Development, 14, 131-142.
66. Waltzman, S., & Hochberg, I. (1990). Perception of speech pattern contrasts using a multichannel cochlear implant. Ear and Hearing, 11 50-55.
67. Weisel, A. (1985). Deafness and perception of nonverbal expression of emotion. Perception Motor Skills, 61, 515-522.
68. Weisel, A., & Bar-Lev, H. (1992). Role taking ability, nonverbal sensitivity, language and social adjustment of deaf adolescents. Educational Psychology, 12, 3-13.
69. Williams, C., & Stevens, K. (1972). Emotions and speech: Some acoustical correlates. Journal of the Acoustical Society of America, 52, 1238-1250.
70. Wu, J. L., & Yang, H. M. (2003). Speech perception of Mandarin Chinese speaking young children after cochlear implant use: Effect of age at implantation. International Journal of Pediatric Otorhinolaryngology, 67, 247-253.