The development of multisensory integration in high-functioning autism: High-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs

Cerebral Cortex

Volumn 23, Issue 6, 2013, Pages 1329-1341

  Brandwein, Alice B ^a,b   Foxe, John J ^a,b,c,d,e   Butler, John S ^a   Russo, Natalie N ^a   Altschuler, Ted S ^a,c,d   Gomes, Hilary ^a,b,c,d   Molholm, Sophie ^a,c,d,e  

^a Children's Evaluation and Rehabilitation Center (CERC)   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

^c Department of Psychology ^*  (United States)

^d Program in Cognitive Neuroscience ^*  (United States)

^e NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

Author keywords

auditory; electrophysiology; ERPs; multimodal; visual

Indexed keywords

ADOLESCENT; ARTICLE; AUDITORY EVOKED RESPONSE STIMULATOR; AUDITORY STIMULATION; AUTISM; CHILD; ELECTROPHYSIOLOGY; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; PRIORITY JOURNAL; REACTION TIME; SCHOOL CHILD; SENSORY STIMULATION; VISUAL STIMULATION;

AUDITORY; ELECTROPHYSIOLOGY; ERPS; MULTIMODAL; VISUAL;

ACOUSTIC STIMULATION; ADOLESCENT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BRAIN MAPPING; CHILD; CHILD DEVELOPMENT DISORDERS, PERVASIVE; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; PERCEPTUAL DISORDERS; PHOTIC STIMULATION; PROBABILITY; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSICS; REACTION TIME; VISUAL PERCEPTION;

EID: 84877301882     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhs109     Document Type: Article

References (104)

1. Anagnostou E, Taylor MJ. 2011. Review of neuroimaging in autism spectrum disorders: what have we learned and where we go from here. Mol Autism. 2:4.
2. APA. 2000. Diagnostic and statistical manual of mental disorders: DSM-IV-TR, 4th ed., text revision. Washington (DC): American Psychiatric Association.
3. Asperger H. 1944. Die "Autistischen Psychopathen" im Kindesalter. Eur Arch Psychiatry Clin Neurosci. 117:76-136.
4. Ayres AJ, Tickle LS. 1980. Hyper-responsivity to touch and vestibular stimuli as a predictor of positive response to sensory integration procedures by autistic children. Am J Occup Ther. 34:375-381.
5. Bair WN, Kiemel T, Jeka JJ, Clark JE. 2007. Development of multisen-sory reweighting for posture control in children. Exp Brain Res. 183:435-446.
6. Barnea-Goraly N, Kwon H, Menon V, Eliez S, Lotspeich L, Reiss AL. 2004. White matter structure in autism: preliminary evidence from diffusion tensor imaging. Biol Psychiatry. 55:323-326.
7. Baron-Cohen S, Richler J, Bisarya D, Gurunathan N, Wheelwright S. 2003. The systematizing quotient: an investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. In: Frith U, Hill CE, editors. Autism: mind and brain. Oxford: Oxford University Press.
8. Belmonte MK, Allen G, Beckel-Mitchener A, Boulanger LM, Carper RA, Webb SJ. 2004. Autism and abnormal development of brain connectivity. J Neurosci. 24:9228-9231.
9. Ben-Sasson A, Hen L, Fluss R, Cermack S, Engel-Yeger B, Gal E. 2009 A meta-analysis of sensory modulation symptoms in individuals with autism spectrum disorders. J Autism Dev Disord. 39:1-11
10. Bergman P, Escalona S. 1949. Unusual sensitivities in very young children. Psychoanal Study Child. 4:333-352.
11. Brandwein AB, Foxe JJ, Russo NN, Altschuler TS, Gomes H, Molholm S. 2011. The development of audiovisual multisensory integration across childhood and early adolescence: a high-density electrical mapping study. Cereb Cortex. 21:1042-1055.
12. Butler JS, Molholm S, Fiebelkorn IC, Mercier MR, Schwartz TH, Foxe JJ. 2011. Common or redundant neural circuits for duration processing across audition and touch. J Neurosci. 31:3400-3406.
13. Buxhoeveden DP, Semendeferi K, Buckwalter J, Schenker N, Switzer R, Courchesne E. 2006. Reduced minicolumns in the frontal cortex of patients with autism. Neuropathol Appl Neurobiol. 32:483-491.
14. Casanova MF, Buxhoeveden DP, Switala AE, Roy E. 2002. Minicolum-nar pathology in autism. Neurology. 58:428-432.
15. Ceponiene R, Rinne T, Naatanen R. 2002. Maturation of cortical sound processing as indexed by event-related potentials. Clin Neurophy-siol. 113:870-882.
16. Cheung P, Sui A. 2009. A comparison of patterns of sensory processing in children with and without developmental disabilities. Res Dev Disabil. 30:1468-1480.
17. Courchesne E, Pierce K. 2005. Brain overgrowth in autism during a critical time in development: implications for frontal pyramidal neuron and interneuron development and connectivity. Int J Dev Neurosci. 23:153-170.
18. Courchesne E, Redcay E, Morgan JT, Kennedy DP. 2005. Autism at the beginning: microstructural and growth abnormalities underlying the cognitive and behavioral phenotype of autism. Dev Psycho-pathol. 17:577-597.
19. Crane L, Goddard L, Pring L. 2009. Sensory processing in adults with autism spectrum disorders. Autism. 13:215-228.
20. de Gelder B, Vroomen J, van der Heide L. 1991. Face recognition and lip-reading in autism. Eur J Cognit Psychol. 3:69-86.
21. Dunn M, Gomes H, Gravel J. 2008. Mismatch negativity in children with autism and typical development. J Autism Dev Disord. 38:52-71.
22. Fiebelkorn IC, Foxe JJ, Butler JS, Molholm S. 2011. Auditory facilitation of visual-target detection persists regardless of retinal eccentricity and despite wide audiovisual misalignments. Exp Brain Res. 213:167-174.
23. Flom R, Bahrick LE. 2007. The development of infant discrimination of affect in multimodal and unimodal stimulation: the role of inter-sensory redundancy. Dev Psychol. 43:238-252.
24. Foss-Feig JH, Kwakye LD, Cascio CJ, Burnette CP, Kadivar H, Stone WL, Wallace MT 2010. An extended multisensory temporal binding window in autism spectrum disorders. Exp Brain Res. 203:381-389.
25. Foxe JJ, Molholm S. 2009. Ten years at the Multisensory Forum: musings on the evolution of a field. Brain Topogr. 21:149-154.
26. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE. 2000. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res. 10:77-83
27. Foxe JJ, Ross LA, Saint-Amour D, Leavitt VM, Blanco D, Molholm S. 2009. The breakdown of multisensory speech perception in autism and schizophrenia. In: 10th International Multisensory Research Forum (IMRF), New York, p. 309-310.
28. Foxe JJ, Schroeder C. 2005. The case for feedforward multisensory convergence during early cortical processing. Neuroreport. 16:419-423.
29. Foxe JJ, Simpson G. 2002. Flow of activation from V1 to frontal cortex in humans: a framework for defining "early" visual processing. Exp Brain Res. 142:139-150.
30. Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM. 2002. Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J Neuro-physiol. 88:540-543.
31. Giard MH, Peronnet F. 1999. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci. 11:473-490.
32. Gingras G, Rowland BA, Stein BE. 2009. The differing impact of multisensory and unisensory integration on behavior. J Neurosci. 29:4897-4902.
33. Gomes H, Dunn M, Ritter W, Kurtzberg D, Brattson A, Kreuzer JA, Vaughan HG, Jr. 2001. Spatiotemporal maturation of the central and lateral N1 components to tones. Brain Res Dev Brain Res. 129:147-155.
34. Gori M, Del Viva M, Sandini G, Burr DC. 2008. Young children do not integrate visual and haptic form information. Curr Biol. 18:694-698.
35. Guthrie D, Buchwald JS. 1991. Significance testing of difference potentials. Psychophysiology. 28:240-244.
36. Hermelin B, O'Connor N. 1970. Psychological experiments with autistic children. Oxford, UK: Pergamon Press.
37. Hileman CM, Henderson H, Mundy P, Newell L, Jaime M. 2011. Developmental and individual differences on the P1 and N170 ERP components in children with and without autism. Dev Neuropsy-chol. 36:214-236.
38. Hill EL, Frith U. 2003. Understanding autism: insights from mind and brain. In: Frith U, Hill EL, editors. Autism: mind and brain. Oxford: Oxford University Press.
39. Hillock AR, Powers AR, Wallace MT. 2011. Binding of sights and sounds: age-related changes in multisensory temporal processing. Neuropsychologia. 49:461-467.
40. Hirai M, Watanabe S, Honda Y, Kakigi R. 2009. Developmental changes in point-light walker processing during childhood and adolescence: an event-related potential study. Neuroscience. 161:311-325.
41. Iarocci G, Rombough A, Yager J, Weeks DJ, Chua R. 2010. Visual influences on speech perception in children with autism. Autism. 14:305-320.
42. Irwin JR, Tornatore LA, Brancazio L, Whalen DH. 2011. Can children with autism spectrum disorders "hear" a speaking face? Child Dev. 85:1397-1403.
43. Just MA, Cherkassky VL, Keller TA, Kana RK, Minshew NJ. 2007. Functional and anatomical cortical underconnectivity in autism: evidence from an FMRI study of an executive function task and corpus callosum morphometry. Cereb Cortex. 17:951-961.
44. Just MA, Cherkassky VL, Keller TA, Minshew NJ. 2004. Cortical activation and synchronization during sentence comprehension in high-functioning autism: evidence of underconnectivity. Brain. 127:1811-1821.
45. Kanner L. 1943. Autistic disturbances of affective contact. Nervous Child. 2:217-250.
46. Kern J, Trivedi M, Garver C, Grannemann B, Andrews A, Salva J, Johnson D, Mehta J, Schroeder J. 2006. The pattern of sensory processing abnormalities in autism. Autism. 10:480-494.
47. Kern J, Trivedi M, Grannemann B, Garver C, Johnson D, Andrews A, Salva J, Mehta J, Schroeder J. 2007. Sensory correlations in autism. Autism. 11:123-134.
48. Kientz MA, Dunn W. 1997. A comparison of the performance of children with and without autism on the sensory profile. Am J Occup Ther. 51:530-537.
49. Klemen J, Chambers CD. 2012. Current perspectives and methods in studying neural mechanisms of multisensory interactions. Neuro-sci Biobehav Rev. 36:111-133
50. Kogan MD, Blumberg SJ, Schieve LA, Boyle CA, Perrin JM, Ghandour RM, Singh GK, Strickland BB, Trevathan E, van Dyck PC. 2009 Prevalence of parent-reported diagnosis of autism spectrum disorder among children in the US, 2007. Pediatrics. 124:1395-1403
51. Koshino H, Kana RK, Keller TA, Cherkassky VL, Minshew NJ, Just MA. 2008. fMRI investigation of working memory for faces in autism: visual coding and underconnectivity with frontal areas. Cereb Cortex. 18:289-300.
52. Kuefner D, de Heering A, Jacques C, Palmero-Soler E, Rossion B. 2010. Early visually evoked electrophysiological responses over the human brain (P1, N170) show stable patterns of face-sensitivity from 4 years to adulthood. Front Hum Neurosci. 3:67.
53. Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT 2011. Altered auditory and multisensory temporal processing in autism spectrum disorders. Front Integr Neurosci. 4:129.
54. Lane AE, Dennis SJ, Geraghty ME. 2011. Brief report: further evidence of sensory subtypes in autism. J Autism Dev Disord. 41:826-831
55. Lane AE, Young RL, Baker AE, Angley MT. 2010. Sensory processing subtypes in autism: association with adaptive behavior. J Autism Dev Disord. 40:112-122.
56. Lewkowicz DJ. 2003. Learning and discrimination of audiovisual events in human infants: the hierarchical relation between inter-sensory temporal synchrony and rhythmic pattern cues. Dev Psychol. 39:795-804.
57. Lewkowicz DJ, Ghazanfar AA. 2009. The emergence of multisensory systems through perceptual narrowing. Trends Cogn Sci. 13:470-478.
58. Lippe S, Roy MS, Perchet C, Lassonde M. 2007. Electrophysiological markers of visuocortical development. Cereb Cortex. 17:100-107.
59. Lord C, Rutter M, DiLavore PC, Risi S. 1994. Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 24:659-685
60. Lord C, Rutter M, DiLavore PC, Risi S. 1999. Autism diagnostic observation schedule. Los Angeles (CA): Western Psychological Services.
61. Ma WJ, Zhou X, Ross LA, Foxe JJ, Parra LC. 2009. Lip-reading aids word recognition most in moderate noise: a Bayesian explanation using high-dimensional feature space. PLoS ONE. 4:e4638.
62. Magnee MJ, de Gelder B, van Engeland H, Kemner C. 2008. Audiovisual speech integration in pervasive developmental disorder: evidence from event-related potentials. J Child Psychol Psychiatry. 49:995-1000.
63. Manly BF. 1991. Randomization and Monte Carlo methods in biology. London: Chapman & Hall.
64. Marco EJ, Hinkley LB, Hill SS, Nagarajan SS. 2011. Sensory processing in autism: a review of neurophysiologic findings. Pediatr Res. 69:48R-54R.
65. Miller J. 1982. Divided attention: evidence for coactivation with redundant signals. Cogn Psychol. 14:247-279.
66. Molholm S, Martinez A, Shpaner M, Foxe JJ. 2007. Object-based attention is multisensory: co-activation of an object's representations in ignored sensory modalities. Eur J Neurosci. 26:499-509.
67. Molholm S, Ritter W, Javitt DC, Foxe JJ. 2004. Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex. 14:452-465.
68. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ. 2002. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res. 14:115-128.
69. Mongillo EA, Irwin JR, Whalen DH, Klaiman C, Carter AS, Schultz RT 2008. Audiovisual processing in children with and without autism spectrum disorders. J Autism Dev Disord. 38:1349-1358.
70. Muller RA. 2007. The study of autism as a distributed disorder. Ment Retard Dev Disabil Res Rev. 13:85-95
71. Muller RA, Shih P, Keehn B, Deyoe JR, Leyden KM, Shukla DK. 2011. Underconnected, but how? A survey of functional connectivity MRI studies in autism spectrum disorders. Cereb Cortex. 21:2233-2243.
72. Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ. 2005. Grabbing your ear: rapid audi-tory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex. 15:963-974.
73. Neil PA, Chee-Ruiter C, Scheier C, Lewkowicz DJ, Shimojo S. 2006. Development of multisensory spatial integration and perception in humans. Dev Sci. 9:454-464.
74. O'Neill M, Jones RS. 1997. Sensory-perceptual abnormalities in autism: a case for more research? J Autism Dev Disord. 27:283-293.
75. Ozonoff S, Pennington BF, Rogers SJ. 1991. Executive function deficits in high-functioning autistic individuals: relationship to theory of mind. J Child Psychol Psychiatry. 32:1081-1105
76. Perrin F, Pernier J, Bertrand O, Echallier JF. 1989. Spherical splines for scalp potential and current density mapping. Electroencepha-logr Clin Neurophysiol. 72:184-187.
77. Perrin F, Pernier J, Bertrand O, Giard MH, Echallier JF. 1987 Mapping of scalp potentials by surface spline interpolation. Elec-troencephalogr Clin Neurophysiol. 66:75-81.
78. Ponton CW, Eggermont JJ, Kwong B, Don M. 2000. Maturation of human central auditory system activity: evidence from multichannel evoked potentials. Clin Neurophysiol. 111:220-236.
79. Rippon G, Brock J, Brown C, Boucher J. 2007. Disordered connectivity in the autistic brain: challenges for the "new psychophysiol-ogy". Int J Psychophysiol. 63:164-172.
80. Rogers SJ, Ozonoff S. 2005. Annotation: what do we know about sensory dysfunction in autism? A critical review of the empirical evidence. J Child Psychol Psychiatry. 46:1255-1268.
81. Ross LA, Molholm S, Blanco D, Gomez-Ramirez M, Saint-Amour D, Foxe JJ. 2011. The development of multisensory speech perception continues into the late childhood years. Eur J Neurosci. 33:2329-2337.
82. Ross LA, Saint-Amour D, Leavitt VM, Javitt DC, Foxe JJ. 2007a. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex. 17: 1147-1153.
83. Ross LA, Saint-Amour D, Leavitt VM, Molholm S, Javitt DC, Foxe JJ. 2007b. Impaired multisensory processing in schizophrenia: deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophr Res. 97:173-183
84. Russo N, Foxe JJ, Brandwein AB, Altschuler T, Gomes H, Molholm S. 2010. Multisensory processing in children with autism: high-density electrical mapping of auditory-somatosensory integration. Autism Res. 3:253-267.
85. Schipul SE, Keller TA, Just MA. 2011. Inter-regional brain communication and its disturbance in autism. Front Syst Neurosci. 5:10.
86. Schultz RT, Grelotti DJ, Klin A, Kleinman J, Van der Gaag C, Marois R, Skudlarksi P. 2003. The role of the fusiform face area in social cognition: implications for the pathobiology of autism. In: Frith U, Hill CE, editors. Autism: mind and brain. Oxford: Oxford University Press.
87. Senkowski D, Saint-Amour D, Gruber T, Foxe JJ. 2008. Look who's talking: the deployment of visuo-spatial attention during multisen-sory speech processing under noisy environmental conditions. Neuroimage. 43:379-387.
88. Smith EG, Bennetto L. 2007. Audiovisual speech integration and lip-reading in autism. J Child Psychol Psychiatry. 48:813-821.
89. Stein B, Meredith MA, Huneycutt WS, McDade L. 1989. Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J Cogn Neurosci. 1:12-24.
90. Stein BE, Huneycutt WS, Meredith MA. 1988. Neurons and behavior: the same rules of multisensory integration apply. Brain Res. 448:355-358.
91. Stein BE, Rowland BA. 2011. Organization and plasticity in multisen-sory integration: early and late experience affects its governing principles. Prog Brain Res. 191:145-163.
92. Stein BE, Stanford TR, Ramachandran R, Perrault TJ, Jr, Rowland BA. 2009. Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectiveness. Exp Brain Res. 198:113-126.
93. Talsma D, Doty TJ, Woldorff MG. 2007. Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cereb Cortex. 17:679-690.
94. Taylor N, Isaac C, Milne E. 2010. A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. J Autism Dev Disord. 40:1403-1411.
95. Teder-Salejarvi WA, McDonald JJ, Di Russo F, Hillyard SA. 2002. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res Cogn Brain Res. 14:106-114.
96. Ulrich R, Miller J, Schroter H. 2007. Testing the race model inequality: an algorithm and computer programs. Behav Res Methods. 39:291-302.
97. van der Smagt MJ, van Engeland H, Kemner C. 2007. Brief report: can you see what is not there? Low-level auditory-visual integration in autism spectrum disorder. J Autism Dev Disord. 37:2014-2019
98. Wallace MT, Roberson GE, Hairston WD, Stein BE, Vaughan JW, Schir-illo JA. 2004. Unifying multisensory signals across time and space. Exp Brain Res. 158:252-258.
99. Wass S. 2011. Distortions and disconnections: disrupted brain connectivity in autism. Brain Cogn. 75:18-28.
100. Wechsler D. 1999. Wechsler abbreviated scale of intelligence. San Antonio (TX): Psychological Corporation.
101. Werner S, Noppeney U. 2010. Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J Neurosci. 30:2662-2675.
102. Williams JH, Massaro DW, Peel NJ, Bosseler A, Suddendorf T. 2004. Visual-auditory integration during speech imitation in autism. Res Dev Disabil. 25:559-575.
103. Wing L. 1969. The handicaps of autistic children-a comparative study. J Child Psychol Psychiatry. 10:1-40.
104. Zimmer U, Itthipanyanan S, Grent-'t-Jong T, Woldorff MG. 2010. The electrophysiological time course of the interaction of stimulus conflict and the multisensory spread of attention. Eur J Neurosci. 31:1744-1754.