Recognition of facial expressions and prosodic cues with graded emotional intensities in adults with asperger syndrome

Journal of Autism and Developmental Disorders

Volumn 43, Issue 9, 2013, Pages 2099-2113

  Doi, Hirokazu ^a   Fujisawa, Takashi X ^a   Kanai, Chieko ^b   Ohta, Haruhisa ^b   Yokoi, Hideki ^b   Iwanami, Akira ^b   Kato, Nobumasa ^b   Shinohara, Kazuyuki ^a  

^a NAGASAKI UNIVERSITY GRADUATE SCHOOL OF BIOMEDICAL SCIENCES   (Japan)

^b SHOWA UNIVERSITY SCHOOL OF MEDICINE   (Japan)

Author keywords

Asperger syndrome; Configural processing; Facial expression; Inversion effect; Prosody

Indexed keywords

ADULT; ARTICLE; ASPERGER SYNDROME; ASSOCIATION; CLINICAL ARTICLE; CONTROLLED STUDY; EMOTION; FACIAL EXPRESSION; HUMAN; MALE; PRIORITY JOURNAL; RECOGNITION; TASK PERFORMANCE;

ADULT; ASPERGER SYNDROME; CUES; EMOTIONS; FACIAL EXPRESSION; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; RECOGNITION (PSYCHOLOGY); SOCIAL PERCEPTION;

EID: 84883160930     PISSN: 01623257     EISSN: 15733432     Source Type: Journal    
DOI: 10.1007/s10803-013-1760-8     Document Type: Article

References (86)

1. R Adolphs L Sears J Piven 2001 Abnormal processing of social information from faces in autism Journal of Cognitive Neuroscience 13 232 240 11244548 10.1162/089892901564289
2. C Ashwin S Baron-Cohen S Wheelwright M O'Riordan ET Bullmore 2007 Differential activation of the amygdala and the 'social brain' during fearful face-processing in Asperger syndrome Neuropsychologia 45 2 14 16806312 10.1016/j.neuropsychologia.2006.04.014
3. H Asperger 1944 Die 'Autistischen Psychopathen' im Kindesalter Archiv fur Psychiatrie und Nervenkrankheiten 117 76 136 10.1007/BF01837709
4. KF Baker AA Montgomery R Abramson 2010 Brief report: Perception and lateralization of spoken emotion by youths with high-functioning forms of autism Journal of Autism and Developmental Disorders 40 123 129 19653088 10.1007/s10803-009-0841-1
5. H Banno H Hata M Morise T Takahashi T Irino H Kawahara 2007 Implementation of realtime STRAIGHT speech manipulation system: Report on its first implementation Acoustic Science and Technology 28 140 146 10.1250/ast.28.140
6. S Baron-Cohen T Jolliffe C Mortimore M Robertson 1997 Another advanced test of theory of mind: Evidence from very high functioning adults with autism or Asperger syndrome Journal of Child Psychology and Psychiatry 38 813 822 9363580 10.1111/j.1469-7610.1997.tb01599.x
7. JJ Barton RL Hefter MV Cherkasova DS Manoach 2007 Investigations of face expertise in the social developmental disorders Neurology 69 860 870 17724288 10.1212/01.wnl.0000267842.85646.f2
8. J Boucher V Lewis GM Collis 2000 Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children Journal of Child Psychology and Psychiatry and Allied Disciplines 41 847 857 10.1111/1469-7610.00672
9. VJ Bourne 2011 Examining the effects of inversion on lateralisation for processing facial emotion Cortex 47 690 695 20541184 10.1016/j.cortex.2010.04. 003
10. R Brennand A Schepman P Rodway 2011 Vocal emotion perception in pseudo-sentences by secondary-school children with autism spectrum disorder Research in Autism Spectrum Disorders 5 1567 1573 10.1016/j.rasd.2011.03.002
11. AJ Calder AW Young J Keane M Dean 2000 Configural information in facial expression perception Journal of Experimental Psychology: Human Perception and Performance 26 527 551 10811161 10.1037/0096-1523.26.2.527
12. S Carey 1992 Becoming a face expert Philosophical Transactions of Royal Society of London: Series B: Biological Science 335 95 102 10.1098/rstb.1992. 0012
13. RF Caron AJ Caron RS Myers 1982 Abstraction of invariant face expressions in infancy Child Development 53 1008 1015 7128251 10.2307/1129141
14. C Chevallier I Noveck F Happé D Wilson 2011 What's in a voice? Prosody as a test case for the theory of mind account of autism Neuropsychologia 9 507 517 10.1016/j.neuropsychologia.2010.11.042
15. HD Critchley 2005 Neural mechanisms of autonomic, affective, and cognitive integration Journal of Comparative Neurology 493 154 166 16254997 10.1002/cne.20749
16. G Dawson AN Meltzoff J Osterling J Rinaldi E Brown 1998 Children with autism fail to orient to naturally occurring social stimuli Journal of Autism and Developmental Disorders 28 479 485 9932234 10.1023/A:1026043926488
17. B De Gelder J Vroomen 2000 The perception of emotions by ear and by eye Cognition and Emotion 14 289 311 10.1080/026999300378824
18. B Derntl EM Seidel E Kainz CC Carbon 2009 Recognition of emotional expressions is affected by inversion and presentation time Perception 38 1849 1862 20192133 10.1068/p6448
19. H Doi T Amamoto Y Okishige M Kato K Shinohara 2010 The own-sex effect in facial expression recognition NeuroReport 21 564 568 20386486 10.1097/WNR.0b013e328339b61a
20. H Doi A Kato A Hashimoto N Masataka 2008 Role of biological-motion information in recognition of facial expressions by young children Perception 37 1399 1411 18986066 10.1068/p5673
21. H Doi K Ueda K Shinohara 2009 Learning gaze direction perception-An investigation by behavioral and neurocomputational approaches Psychologia 52 224 234 10.2117/psysoc.2009.224
22. P Ekman 1992 Are there basic emotions? Psychological Review 99 550 553 1344638 10.1037/0033-295X.99.3.550
23. S Faja E Aylward R Bernier G Dawson 2008 Becoming a face expert: A computerized face-training program for high-functioning individuals with autism spectrum disorders Developmental Neuropsychology 33 1 24 18443967 10.1080/87565640701729573
24. S Faja SJ Webb K Merkle E Aylward G Dawson 2009 Brief report: Face configuration accuracy and processing speed among adults with high-functioning autism spectrum disorders Journal of Autism and Developmental Disorders 39 532 538 18751880 10.1007/s10803-008-0635-x
25. U Frith 1991 Asperger and his syndrome. In autism and Asperger syndrome Cambridge University Press London 10.1017/CBO9780511526770 Frith, U. (1991). Asperger and his syndrome. In autism and Asperger syndrome. London: Cambridge University Press.
26. I Gauthier MJ Tarr 2002 Unraveling mechanisms for expert object recognition: Bridging brain activity and behavior Journal of Experimental Psychology: Human Perception and Performance 28 431 446 11999864 10.1037/0096-1523.28.2.431
27. I Gauthier P Williams MJ Tarr J Tanaka 1998 Training 'greeble' experts: A framework for studying expert object recognition processes Vision Research 38 2401 2428 9798007 10.1016/S0042-6989(97)00442-2
28. F Grabenhorst ET Rolls 2011 Value, pleasure and choice in the ventral prefrontal cortex Trends in Cognitive Sciences 15 56 67 21216655 10.1016/j.tics.2010.12.004
29. TF Gross 2008 Recognition of immaturity and emotional expressions in blended faces by children with autism and other developmental disabilities Journal of Autism and Developmental Disorders 38 297 311 17549617 10.1007/s10803-007-0391-3
30. RB Grossman RH Bemis DP Skwerer H Tager-Flusberg 2010 Lexical and affective prosody in children with high-functioning Autism Journal of Speech, Language, and Hearing Research 53 778 793 20530388 10.1044/1092-4388(2009/08- 0127)
31. JB Grossman A Klin AS Carter FR Volkmar 2000 Verbal bias in recognition of facial emotions in children with Asperger syndrome Journal of Child Psychology and Psychiatry and Allied Disciplines 41 369 379 10.1111/1469-7610. 00621
32. Grossman, R. B., & Tager-Flusberg, H. (2012). "Who Said That?" Matching of Low- and High-Intensity Emotional Prosody to Facial Expressions by adolescents with ASD. Journal of Autism and Developmental Disorders, 42, 2546-2557.
33. Hadjikhani, N., Joseph, R. M., Snyder, J., Chabris, C. F., Clark, J., Steele, S., et al. (2004). Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. NeuroImage, 22, 1141-1150.
34. F Happé RA Charlton 2012 Aging in autism spectrum disorders: A mini-review Gerontology 58 70 78 21865667 10.1159/000329720
35. RP Hobson J Ouston A Lee 1988 What's in a face? The case of autism British Journal of Psychology 79 441 453 3208000 10.1111/j.2044-8295.1988. tb02745.x
36. K Humphreys N Minshew GL Leonard M Behrmann 2007 A fine-grained analysis of facial expression processing in high-functioning adults with autism Neuropsychologia 45 685 695 17010395 10.1016/j.neuropsychologia.2006.08.003
37. A Järvinen-Pasley S Peppé G King-Smith P Heaton 2008 The relationship between form and function level receptive prosodic abilities in autism Journal f Autism and Developmental Disorders 38 1328 1340 10.1007/s10803-007-0520-z
38. T Jolliffe S Baron-Cohen 1997 Are people with autism and Asperger syndrome faster than normal on the Embedded Figures Test? Journal of Child Psychology and Psychiatry 38 527 534 9255696 10.1111/j.1469-7610.1997.tb01539.x
39. CRG Jones A Pickles M Falcaro AJS Marsden F Happé SK Scott D Sauter J Tregay RJ Phillips G Baird E Simonoff T Charman 2011 A multimodal approach to emotion recognition ability in autism spectrum disorders Journal of Child Psychology and Psychiatry and Allied Disciplines 2 275 285
40. N Kanwisher G Yovel 2006 The fusiform face area: A cortical region specialized for the perception of faces Philosophical Transactions of the Royal Society Series B 361 2109 2128 10.1098/rstb.2006.1934
41. J Kätsyri S Saalasti K Tiippana L von Wendt M Sams 2008 Impaired recognition of facial emotions from low-spatial frequencies in Asperger syndrome Neuropsychologia 46 1888 1897 18314147 10.1016/j.neuropsychologia.2008.01.005
42. Kawahara, H., Morise, M., Takahashi, T., Nisimura, R., Irino, T., & Banno, H. (2008). Tandem-STRAIGHT: A temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, F0, and aperiodicity estimation. ICASSP 2008: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3933-3936.
43. NM Kleinhans T Richards K Weaver LC Johnson J Greenson G Dawson E Aylward 2010 Association between amygdala response to emotional faces and social anxiety in autism spectrum disorders Neuropsychologia 48 3665 3670 20655320 10.1016/j.neuropsychologia.2010.07.022
44. P Korpilahti E Jansson-Verkasalo ML Mattila S Kuusikko K Suominen S Rytky DL Pauls I Moilanen 2007 Processing of affective speech prosody is impaired in Asperger syndrome Journal of Autism and Developmental Disorders 37 1539 1549 17086440 10.1007/s10803-006-0271-2
45. B Kreifelts T Ethofer W Grodd M Erb D Wildgruber 2007 Audiovisual integration of emotional signals in voice and face: An event-related fMRI study NeuroImage 37 1445 1456 17659885 10.1016/j.neuroimage.2007.06.020
46. ME Kret B De Gelder 2012 A review on sex differences in processing emotional signals Neuropsychologia 50 1211 1221 22245006 10.1016/j. neuropsychologia.2011.12.022
47. T Kujala T Lepistö T Nieminen-Von Wendt P Näätänen R Näätänen 2005 Neurophysiological evidence for cortical discrimination impairment of prosody in Asperger syndrome Neuroscience Letters 383 260 265 15885908 10.1016/j.neulet.2005.04.048
48. D Kumar N Srinivasan 2011 Emotion perception is mediated by spatial frequency content Emotion 11 1144 1151 21942699 10.1037/a0025453
49. S Kuusikko H Haapsamo E Jansson-Verkasalo T Hurtig M-L Mattila H Ebeling K Jussila S Bölte I Moilanen 2009 Emotion recognition in children and adolescents with autism spectrum disorders Journal of Autism and Developmental Disorders 39 938 945 19205857 10.1007/s10803-009-0700-0
50. A Lacroix M Guidetti B Rogé J Reilly 2009 Recognition of emotional and nonemotional facial expressions: A comparison between Williams syndrome and autism Research in Developmental Disabilities 30 976 985 19286347 10.1016/j.ridd.2009.02.002
51. A Lahaie L Mottron M Arguin C Berthiaume B Jemel D Saumier 2006 Face perception in high-functioning autistic adults: Evidence for superior processing of face parts, not for a configural face-processing deficit Neuropsychology 20 30 41 16460220 10.1037/0894-4105.20.1.30
52. T Langdell 1978 Recognition of faces: An approach to the study of autism Journal of Child Psychology and Psychiatry 19 255 268 681468 10.1111/j.1469-7610.1978.tb00468.x
53. MJ Law Smith B Montagne DI Perrett M Gill L Gallagher 2010 Detecting subtle facial emotion recognition deficits in high-functioning Autism using dynamic stimuli of varying intensities Neuropsychologia 48 2777 2781 20227430 10.1016/j.neuropsychologia.2010.03.008
54. R Le Grand CJ Mondloch D Maurer HP Brent 2001 Neuroperception. Early visual experience and face processing Nature 410 890 11309606 10.1038/35073749
55. JM Leppänen JK Hietanen 2004 Positive facial expressions are recognized faster than negative facial expressions, but why? Psychological Research 69 22 29 14648224 10.1007/s00426-003-0157-2
56. JL Lindner LA Rosén 2006 Decoding of emotion through facial expression, prosody and verbal content in children and adolescents with Asperger's syndrome Journal of Autism and Developmental Disorders 36 769 777 16639533 10.1007/s10803-006-0105-2
57. B Lopez N Donnelly JA Hadwin SR Leekam 2004 Face processing in high-functioning adolescents with autism: Evidence for weak central coherence Visual Cognition 11 673 688 10.1080/13506280344000437
58. MJCM Magnée B De Gelder H Van Engeland C Kemner 2007 Facial electromyographic responses to emotional information from faces and voices in individuals with pervasive developmental disorder Journal of Child Psychology and Psychiatry and Allied Disciplines 48 1122 1130 10.1111/j.1469-7610.2007. 01779.x
59. D Maurer RL Grand CJ Mondloch 2002 The many faces of configural processing Trends in Cognitive Sciences 6 255 260 12039607 10.1016/S1364- 6613(02)01903-4
60. CA Mazefsky DP Oswald 2007 Emotion perception in Asperger's syndrome and high-functioning autism: The importance of diagnostic criteria and cue intensity Journal of Autism and Developmental Disorders 37 1086 1095 17180461 10.1007/s10803-006-0251-6
61. L Mottron JA Burack G Iarocci S Belleville JT Enns 2003 Locally oriented perception with intact global processing among adolescents with high-functioning autism: Evidence from multiple paradigms Journal of Child Psychology and Psychiatry 44 904 913 12959498 10.1111/1469-7610.00174
62. CA Nelson PA Morse LA Leavitt 1979 Recognition of facial expressions by seven-month-old infants Child Development 50 1239 1242 535438 10.2307/1129358
63. D Neth AM Martinez 2009 Emotion perception in emotionless face images suggests a norm-based representation Journal of Vision 9 1 11 19271875 10.1167/9.1.5
64. D Neth AM Martinez 2010 A computational shape-based model of anger and sadness justifies a configural representation of faces Vision Research 50 1693 1711 20510267 10.1016/j.visres.2010.05.024
65. K O'Connor 2007 Brief report: Impaired identification of discrepancies between expressive faces and voices in adults with Asperger's syndrome Journal of Autism and Developmental Disorders 37 2008 2013 17273935 10.1007/s10803-006- 0345-1
66. J Osterling G Dawson 1994 Early recognition of children with autism: A study of first birthday home videotapes Journal of Autism and Developmental Disorders 24 247 257 8050980 10.1007/BF02172225
67. KA Pelphrey JP Morris G Mccarthy KS Labar 2007 Perception of dynamic changes in facial affect and identity in autism Social Cognitive and Affective Neuroscience 2 140 149 18174910 10.1093/scan/nsm010
68. L Pessoa R Adolphs 2010 Emotion processing and the amygdala: From a 'low road' to 'many roads' of evaluating biological significance Nature Reviews Neuroscience 11 773 782 20959860 10.1038/nrn2920
69. RCM Philip HC Whalley AC Stanfield R Sprengelmeyer IM Santos AW Young AP Atkinson AJ Calder EC Johnstone SM Lawrie J Hall 2010 Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders Psychological Medicine 40 1919 1929 20102666 10.1017/S0033291709992364
70. KM Rump JL Giovannelli NJ Minshew MS Strauss 2009 The development of emotion recognition in individuals with autism Child Development 80 1434 1447 19765010 10.1111/j.1467-8624.2009.01343.x
71. MD Rutherford S Baron-Cohen S Wheelwright 2002 Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism Journal of Autism and Developmental Disorders 32 189 194 12108620 10.1023/A:1015497629971
72. MD Rutherford KA Clements AB Sekuler 2007 Differences in discrimination of eye and mouth displacement in autism spectrum disorders Vision Research 47 2099 2110 17559905 10.1016/j.visres.2007.01.029
73. MD Rutherford DN McIntosh 2007 Rules versus prototype matching: Strategies of perception of emotional facial expressions in the autism spectrum Journal of Autism and Developmental Disorders 37 187 196 16897386 10.1007/s10803-006-0151-9
74. W Sato T Kochiyama S Yoshikawa 2011 The inversion effect for neutral and emotional facial expressions on amygdala activity Brain Research 1378 84 90 21215733 10.1016/j.brainres.2010.12.082
75. KR Scherer 1981 Speech and emotional states J Darby (eds) Speech evaluation in psychiatry Grune & Stratton New York 171 187 Scherer, K. R. (1981). Speech and emotional states. In J. Darby (Ed.), Speech evaluation in psychiatry (pp. 171-187). New York: Grune & Stratton.
76. Schultz, R. T., Gauthier, I., Klin, A., Fulbright, R. K., Anderson, A. W., Volkmar, F., et al. (2000). Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Archives of General Psychiatry, 57, 331-340.
77. RT Schultz DJ Grelotti A Klin J Kleinman C Van der Gaag R Marois P Skudlarski 2003 The role of the fusiform face area in social cognition: Implications for the pathobiology of autism Philosophical Transactions of Royal Society of London: Series B: Biological Science 358 415 427 10.1098/rstb.2002. 1208
78. SR Schweinberger C Casper N Hauthal JM Kaufmann H Kawahara N Kloth DMC Robertson AP Simpson R Zäske 2008 Auditory adaptation in voice perception Current Biology 18 684 688 18450448 10.1016/j.cub.2008.04.015
79. A Senju V Southgate S White U Frith 2009 Mindblind eyes: An absence of spontaneous theory of mind in Asperger syndrome Science 325 883 885 19608858 10.1126/science.1176170
80. JS Stevens S Hamann 2012 Sex differences in brain activation to emotional stimuli: A meta-analysis of neuroimaging studies Neuropsychologia 50 1578 1593 22450197 10.1016/j.neuropsychologia.2012.03.011
81. JP Teunisse B de Gelder 1994 Do autistics have a generalized face processing deficit? International Journal of Neuroscience 77 1 10 7989155 10.3109/00207459408986014
82. JP Teunisse B de Gelder 2003 Face processing in adolescents with autistic disorder: The inversion and composite effects Brain and Cognition 52 285 294 12907173 10.1016/S0278-2626(03)00042-3
83. HL Wagner 1993 On measuring performance in category judgment studies of nonverbal behavior Journal of Nonverbal Behavior 17 3 28 10.1007/BF00987006
84. Watanabe, T., Yahata, N., Abe, O., Kuwabara, H., Inoue, H., Takano, Y., et al. (2012). Diminished medial prefrontal activity behind autistic social judgments of incongruent information. PLoS ONE, 7, art. no. e39561.
85. HH Yang AN Savostyanov AC Tsai M Liou 2011 Face recognition in Asperger syndrome: A study on EEG spectral power changes Neuroscience Letters 492 84 88 21281694 10.1016/j.neulet.2011.01.061
86. AW Young D Rowland AJ Calder NL Etcoff A Seth DI Perrett 1997 Facial expression megamix: Tests of dimensional and category accounts of emotion recognition Cognition 63 271 313 9265872 10.1016/S0010-0277(97)00003-6