Severe multisensory speech integration deficits in high-functioning school-aged children with autism spectrum disorder (ASD) and their resolution during early adolescence

Cerebral Cortex

Volumn 25, Issue 2, 2015, Pages 298-312

  Foxe, John J ^a,c   Molholm, Sophie ^a,c   Del Bene, Victor A ^a,b   Frey, Hans Peter ^a   Russo, Natalie N ^a,d   Blanco, Daniella ^a,c   Saint Amour, Dave ^e,f   Ross, Lars A ^a,g  

^a Children's Evaluation and Rehabilitation Center (CERC)   (United States)

^b ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^c CITY UNIVERSITY OF NEW YORK   (United States)

^d SYRACUSE UNIVERSITY   (United States)

^e UNIVERSITY OF MONTREAL   (Canada)

^f UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

^g ADELPHI UNIVERSITY   (United States)

Author keywords

autism spectrum disorders; cross modal; development; sensory integration; speech in noise

Indexed keywords

ADOLESCENT; ARTICLE; AUTISM; CHILD; CONTROLLED STUDY; EYE TRACKING; HUMAN; MAJOR CLINICAL STUDY; MULTISENSORY SPEECH INTEGRATION DEFICIT; NOISE; PHENOTYPE; PRESCHOOL CHILD; PRIORITY JOURNAL; SCHOOL CHILD; SIGNAL NOISE RATIO; SPEECH DISORDER; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TASK PERFORMANCE; WORD RECOGNITION; AUDITORY STIMULATION; CHILD DEVELOPMENT; CROSS-SECTIONAL STUDY; EYE MOVEMENT; INTELLIGENCE; MOVEMENT PERCEPTION; PATTERN RECOGNITION; PHOTOSTIMULATION; PSYCHOLOGICAL RATING SCALE;

ACOUSTIC STIMULATION; ADOLESCENT; CHILD; CHILD DEVELOPMENT; CHILD DEVELOPMENT DISORDERS, PERVASIVE; CHILD, PRESCHOOL; CROSS-SECTIONAL STUDIES; EYE MOVEMENTS; HUMANS; INTELLIGENCE; MOTION PERCEPTION; NOISE; PATTERN RECOGNITION, PHYSIOLOGICAL; PHOTIC STIMULATION; PSYCHIATRIC STATUS RATING SCALES; SPEECH PERCEPTION;

EID: 84924937903     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bht213     Document Type: Article

References (87)

1. Alcantara JI, Weisblatt EJ, Moore BC, Bolton PF. 2004. Speech-in-noise perception in high-functioning individuals with autism or Asper-ger's syndrome. J Child Psychol Psychiatry. 45(6):1107-1114.
2. Anagnostou E, Taylor MJ. 2011. Review of neuroimaging in autism spectrum disorders: what have we learned and where we go from here. Mol Autism. 2(1):4.
3. Anderson JS, Druzgal TJ, Froehlich A, DuBray MB, Lange N, Alexander AL, Abildskov T, Nielsen JA, Cariello AN, Cooperrider JR et al. 2011. Decreased interhemispheric functional connectivity in autism. Cereb Cortex. 21(5):1134-1146.
4. Bebko JM, Weiss JA, Demark JL, Gomez P. 2006. Discrimination of temporal synchrony in intermodal events by children with autism and children with developmental disabilities without autism. J Child Psychol Psychiatry. 47(1):88-98.
5. Blake R, Turner LM, Smoski MJ, Pozdol SL, Stone WL. 2003. Visual recognition of biological motion is impaired in children with autism. Psychol Sci. 14(2):151-157.
6. Brandwein AB, Foxe JJ, Russo NN, Altschuler TS, Gomes H, Molholm S. 2011. The development of audiovisual multisensory integration across childhood and early adolescence: a high-density electrical mapping study. Cereb Cortex. 21(5):1042-1055.
7. Brandwein AB, Foxe JJ, Butler JS, Russo NN, Altschuler TS, Gomes H, Molholm S. 2013. The development of multisensory integration in high-functioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs. Cereb Cortex. 23(6):1329-1341.
8. Calvert GA, Campbell R, Brammer MJ. 2000. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol. 10(11):649-657.
9. Chen YH, Edgar JC, Holroyd T, Dammers J, Thonnessen H, Roberts TP, Mathiak K. 2010. Neuromagnetic oscillations to emotional faces and prosody. Eur J Neurosci. 31(10):1818-1827.
10. Coltheart M. 1981. The MRC psycholinguistic database. Q J Exp Psychol. 33:497-505.
11. Cook J, Saygin AP, Swain R, Blakemore SJ. 2009. Reduced sensitivity to minimum-jerk biological motion in autism spectrum conditions. Neuropsychologia. 47(14):3275-3278.
12. Courchesne E, Pierce K. 2005. Why the frontal cortex in autism might be talking only to itself: local over-connectivity but long-distance disconnection. Curr Opin Neurobiol. 15(2):225-230.
13. de Gelder B, Vroomen J, van der Heide L. 1991. Face recognition and lip-reading in autism. Eur J Cogn Psychol. 3(1):69-86.
14. DePape AM, Hall GB, Tillmann B, Trainor LJ. 2012. Auditory processing in high-functioning adolescents with autism spectrum disorder. PLoS One. 7(9):e44084.
15. Erber NP. 1969. Interaction of audition and vision in the recognition of oral speech stimuli. J Speech Hear Res. 12(2):423-425.
16. Falchier A, Clavagnier S, Barone P, Kennedy H. 2002. Anatomical evidence of multimodal integration in primate striate cortex. J Neuro-sci. 22(13):5749-5759.
17. Falchier A, Schroeder CE, Hackett TA, Lakatos P, Nascimento-Silva S, Ulbert I, Karmos G, Smiley JF. 2010. Projection from visual areas V2 and prostriata to caudal auditory cortex in the monkey. Cereb Cortex. 20(7):1529-1538.
18. Fiebelkorn IC, Foxe JJ, McCourt ME, Dumas KN, Molholm S. 2013. Atypical category processing and hemispheric asymmetries in high-functioning children with autism: revealed through high-density EEG mapping. Cortex. 49(5):1259-1267.
19. Fletcher PT, Whitaker RT, Tao R, DuBray MB, Froehlich A, Ravichan-dran C, Alexander AL, Bigler ED, Lange N, Lainhart JE. 2010. Microstructural connectivity of the arcuate fasciculus in adolescents with high-functioning autism. Neuroimage. 51(3): 1117-1125.
20. Foss-Feig JH, Kwakye LD, Cascio CJ, Burnette CP, Kadivar H, Stone WL, Wallace MT. 2010. An extended multisensory temporal binding window in autism spectrum disorders. Exp Brain Res. 203 (2):381-389.
21. Foxe JJ, Molholm S. 2009. Ten years at the multisensory forum: musings on the evolution of a field. Brain Topogr. 21(3-4):149-154.
22. Foxe JJ, Schroeder CE. 2005. The case for feedforward multisensory convergence during early cortical processing. Neuroreport. 16(5): 419-423.
23. Frey HP, Honey C, Konig P. 2008. What's color got to do with it? The influence of color on visual attention in different categories. J Vis. 8 (14):6.1-6.17.
24. Frey HP, Molholm S, Lalor EC, Russo NN, Foxe JJ. 2013. Atypical cortical representation of peripheral visual space in children with an autism spectrum disorder. Eur J Neurosci. 38:2125-2138.
25. Gori M, Del Viva M, Sandini G, Burr DC. 2008. Young children do not integrate visual and haptic form information. Curr Biol. 18 (9):694-698.
26. Gori M, Sandini G, Burr D. 2012. Development of visuo-auditory integration in space and time. Front Integr Neurosci. 6:77.
27. Hillock AR, Powers AR, Wallace MT. 2011. Binding of sights and sounds: age-related changes in multisensory temporal processing. Neuropsychologia. 49(3):461-467.
28. Hubert B, Wicker B, Moore DG, Monfardini E, Duverger H, Da Fonseca D, Deruelle C. 2007. Brief report: recognition of emotional and non-emotional biological motion in individuals with autistic spectrum disorders. J Autism Dev Disord. 37(7):1386-1392.
29. Iarocci G, McDonald J. 2006. Sensory integration and the perceptual experience of persons with autism. J Autism Dev Disord. 36 (1):77-90.
30. Iarocci G, Rombough A, Yager J, Weeks DJ, Chua R. 2010. Visual influences on speech perception in children with autism. Autism. 14 (4):305-320.
31. Irwin JR, Tornatore LA, Brancazio L, Whalen DH. 2011. Can children with autism spectrum disorders hear a speaking face? Child Dev. 82 (5):1397-1403.
32. Jones CR, Swettenham J, Charman T, Marsden AJ, Tregay J, Baird G, Si-monoff E, Happe F. 2011. No evidence for a fundamental visual motion processing deficit in adolescents with autism spectrum disorders. Autism Res. 4(5):347-357.
33. Just MA, Cherkassky VL, Keller TA, Minshew NJ. 2004. Cortical activation and synchronization during sentence comprehension in high-functioning autism: evidence of underconnectivity. Brain. 127 (Pt 8):1811-1821.
34. Just MA, Cherkassky VL, Keller TA, Kana RK, Minshew NJ. 2007. Functional and anatomical cortical underconnectivity in autism: evidence from an fMRI study of an executive function task and corpus callosum morphometry. Cereb Cortex. 17(4):951-961.
35. Keane BP, Rosenthal O, Chun NH, Shams L. 2010. Audiovisual integration in high functioning adults with autism. Res Autism Spectr Disord. 4(2):276-289.
36. Kikuchi Y, Senju A, Akechi H, Tojo Y, Osanai H, Hasegawa T. 2011. Atypical disengagement from faces and its modulation by the control of eye fixation in children with autism spectrum disorder. J Autism Dev Disord. 41(5):629-645.
37. Klin A, Lin DJ, Gorrindo P, Ramsay G, Jones W. 2009. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature. 459(7244):257-261.
38. Kucera H, Francis WN. 1967. Computational analysis of present-day American English. Providence (RI): Brown University Press.
39. Kujala T, Lepisto T, Nieminen-von Wendt T, Naatanen P, Naatanen R. 2005. Neurophysiological evidence for cortical discrimination impairment of prosody in Asperger syndrome. Neurosci Lett. 383 (3):260-265.
40. Kuusikko S, Haapsamo H, Jansson-Verkasalo E, Hurtig T, Mattila ML, Ebeling H, Jussila K, Bolte S, Moilanen I. 2009. Emotion recognition in children and adolescents with autism spectrum disorders. J Autism Dev Disord. 39(6):938-945.
41. Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT. 2011. Altered auditory and multisensory temporal processing in autism spectrum disorders. Front Integr Neurosci. 4:129.
42. Lee JE, Bigler ED, Alexander AL, Lazar M, DuBray MB, Chung MK, Johnson M, Morgan J, Miller JN, McMahon WM et al. 2007. Diffusion tensor imaging of white matter in the superior temporal gyrus and temporal stem in autism. Neurosci Lett. 424(2):127-132.
43. Lord C, Risi S, Lambrecht L, Cook EH, Jr., Leventhal BL, DiLavore PC, Pickles A, Rutter M. 2000. The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 30(3):205-223.
44. Lord C, Rutter M, Le Couteur A. 1994. Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 24(5):659-685.
45. Ma WJ, Zhou X, Ross LA, Foxe JJ, Parra LC. 2009. Lip-reading aids word recognition most in moderate noise: a Bayesian explanation using high-dimensional feature space. PLoS One. 4(3):e4638.
46. Marco EJ, Hinkley LB, Hill SS, Nagarajan SS. 2011. Sensory processing in autism: a review of neurophysiologic findings. Pediatr Res. 69 (5 Pt 2):48R-54R.
47. McGurk H, MacDonald J. 1976. Hearing lips and seeing voices. Nature. 264(5588):746-748.
48. Meredith MA, Nemitz JW, Stein BE. 1987. Determinants of multisen-sory integration in superior colliculus neurons. I. Temporal Factors. J Neurosci. 7(10):3215-3229.
49. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ. 2002. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res. 14(1):115-128.
50. Molholm S, Sehatpour P, Mehta AD, Shpaner M, Gomez-Ramirez M, Ortigue S, Dyke JP, Schwartz TH, Foxe JJ. 2006. Audio-visual multi-sensory integration in superior parietal lobule revealed by human intracranial recordings. J Neurophysiol. 96(2):721-729.
51. Mongillo EA, Irwin JR, Whalen DH, Klaiman C, Carter AS, Schultz RT. 2008. Audiovisual processing in children with and without autism spectrum disorders. J Autism Dev Disord. 38(7):1349-1358.
52. Muller RA, Shih P, Keehn B, Deyoe JR, Leyden KM, Shukla DK. 2011. Underconnected, but how? A survey of functional connectivity MRI studies in autism spectrum disorders. Cereb Cortex. 21 (10):2233-2243.
53. Nackaerts E, Wagemans J, Helsen W, Swinnen SP, Wenderoth N, Alaerts K. 2012. Recognizing biological motion and emotions from point-light displays in autism spectrum disorders. PLoS One. 7(9): e44473.
54. Noris B, Barker M, Nadel J, Hentsch F, Ansermet F, Billard A. 2011. Measuring gaze of children with autism spectrum disorders in naturalistic interactions. Conf Proc IEEE Eng Med Biol Soc. 2011:5356-5359.
55. Parron C, Da Fonseca D, Santos A, Moore DG, Monfardini E, Deruelle C. 2008. Recognition of biological motion in children with autistic spectrum disorders. Autism. 12(3):261-274.
56. Paul R, Augustyn A, Klin A, Volkmar FR. 2005. Perception and production of prosody by speakers with autism spectrum disorders. J Autism Dev Disord. 35(2):205-220.
57. Power JD, Barnes KA, Snyder AZ, Schlaggar BL, Petersen SE. 2012. Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. Neuroimage. 59(3):2142-2154.
58. Robertson CE, Kravitz DJ, Freyberg J, Baron-Cohen S, Baker CI. 2013. Tunnel vision: sharper gradient of spatial attention in autism. J Neurosci. 33(16):6776-6781.
59. Ross LA, Molholm S, Blanco D, Gomez-Ramirez M, Saint-Amour D, Foxe JJ. 2011. The development of multisensory speech perception continues into the late childhood years. Eur J Neurosci. 33 (12):2329-2337.
60. Ross LA, Saint-Amour D, Leavitt VM, Javitt DC, Foxe JJ. 2007a. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex. 17(5): 1147-1153.
61. Ross LA, Saint-Amour D, Leavitt VM, Molholm S, Javitt DC, Foxe JJ. 2007b. Impaired multisensory processing in schizophrenia: deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophr Res. 97(1-3):173-183.
62. Rudie JD, Shehzad Z, Hernandez LM, Colich NL, Bookheimer SY, Iaco-boni M, Dapretto M. 2012. Reduced functional integration and segregation of distributed neural systems underlying social and emotional information processing in autism spectrum disorders. Cereb Cortex. 22(5):1025-1037.
63. Russo N, Foxe JJ, Brandwein AB, Altschuler T, Gomes H, Molholm S. 2010. Multisensory processing in children with autism: high-density electrical mapping of auditory-somatosensory integration. Autism Res. 3(5):253-267.
64. Russo N, Zecker S, Trommer B, Chen J, Kraus N. 2009. Effects of background noise on cortical encoding of speech in autism spectrum disorders. J Autism Dev Disord. 39(8):1185-1196.
65. Rutherford MD, Troje NF. 2012. IQ predicts biological motion perception in autism spectrum disorders. J Autism Dev Disord. 42 (4):557-565.
66. Saalasti S, Katsyri J, Tiippana K, Laine-Hernandez M, von Wendt L, Sams M. 2012. Audiovisual speech perception and eye gaze behavior of adults with Asperger syndrome. J Autism Dev Disord. 42 (8):1606-1615.
67. Saint-Amour D, De Sanctis P, Molholm S, Ritter W, Foxe JJ. 2007. Seeing voices: high-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia. 45(3):587-597.
68. Saygin AP, Cook J, Blakemore SJ. 2010. Unaffected perceptual thresholds for biological and non-biological form-from-motion perception in autism spectrum conditions. PLoS One. 5(10):e13491.
69. Schroeder CE, Foxe J. 2005. Multisensory contributions to low-level, "unisensory" processing. Curr Opin Neurobiol. 15(4):454-458.
70. Scott SK, Blank CC, Rosen S, Wise RJ. 2000. Identification of a pathway for intelligible speech in the left temporal lobe. Brain. 123(Pt 12):2400-2406.
71. Senkowski D, Saint-Amour D, Gruber T, Foxe JJ. 2008. Look who's talking: the deployment of visuo-spatial attention during multisensory speech processing under noisy environmental conditions. Neuroimage. 43(2):379-387.
72. Shams L, Kamitani Y, Shimojo S. 2000. Illusions. What you see is what you hear. Nature. 408(6814):788.
73. Shams L, Kamitani Y, Shimojo S. 2002. Visual illusion induced by sound. Brain Res Cogn Brain Res. 14(1):147-152.
74. Shukla DK, Keehn B, Muller RA. 2011. Tract-specific analyses of diffusion tensor imaging show widespread white matter compromise in autism spectrum disorder. J Child Psychol Psychiatry. 52 (3):286-295.
75. Smiley JF, Falchier A. 2009. Multisensory connections of monkey auditory cerebral cortex. Hear Res. 258(1-2):37-46.
76. Smith EG, Bennetto L. 2007. Audiovisual speech integration and lip-reading in autism. J Child Psychol Psychiatry. 48(8):813-821.
77. Stevenson RA, Van Der Klok RM, Pisoni DB, James TW. 2011. Discrete neural substrates underlie complementary audiovisual speech integration processes. Neuroimage. 55(3):1339-1345.
78. Stienen BM, Tanaka A, de Gelder B. 2011. Emotional voice and emotional body postures influence each other independently of visual awareness. PLoS One. 6(10):e25517.
79. Sumby WH, Pollack I. 1954. Visual contribution to speech intelligibility in noise. J Acoust Soc Am. 26:212-215.
80. Tanner JM. 1986. Normal growth and techniques of growth assessment. Clin Endocrinol Metab. 15(3):411-451.
81. Taylor N, Isaac C, Milne E. 2010. A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. J Autism Dev Disord. 40(11): 1403-1411.
82. Tremblay C, Champoux F, Voss P, Bacon BA, Lepore F, Theoret H. 2007. Speech and non-speech audio-visual illusions: a developmental study. PLoS One. 2(1):e742.
83. van der Smagt MJ, van Engeland H, Kemner C. 2007. Brief report: can you see what is not there? Low-level auditory-visual integration in autism spectrum disorder. J Autism Dev Disord. 37(10):2014-2019.
84. Van Dijk KR, Sabuncu MR, Buckner RL. 2012. The influence of head motion on intrinsic functional connectivity MRI. Neuroimage. 59 (1):431-438.
85. Vissers ME, Cohen MX, Geurts HM. 2012. Brain connectivity and high functioning autism: a promising path of research that needs refined models, methodological convergence, and stronger behavioral links. Neurosci Biobehav Rev. 36(1):604-625.
86. Williams JH, Massaro DW, Peel NJ, Bosseler A, Suddendorf T. 2004. Visual-auditory integration during speech imitation in autism. Res Dev Disabil. 25(6):559-575.
87. Yeatman JD, Dougherty RF, Ben-Shachar M, Wandell BA. 2012. Development of white matter and reading skills. Proc Natl Acad Sci USA. 109(44):E3045-E3053.