Multisensory representation of frequency across audition and touch: High density electrical mapping reveals early sensory-perceptual coupling

Journal of Neuroscience

Volumn 32, Issue 44, 2012, Pages 15338-15344

  Butler, John S ^a   Foxe, John J ^a   Fiebelkorn, Ian C ^a   Mercier, Manuel R ^a   Molholm, Sophie ^a  

^a ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; EVOKED AUDITORY RESPONSE; EVOKED SOMATOSENSORY RESPONSE; FEMALE; FREQUENCY DISCRIMINATION; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; MISMATCH NEGATIVITY; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; TACTILE STIMULATION; TOUCH; VIBRATION SENSE;

ADULT; BRAIN MAPPING; CLUSTER ANALYSIS; ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGICAL PHENOMENA; FEMALE; HEARING; HUMANS; MALE; PHOTIC STIMULATION; PITCH PERCEPTION; TOUCH; VIBRATION; YOUNG ADULT;

EID: 84868087239     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1796-12.2012     Document Type: Article

References (52)

1. Amenedo E, Escera C (2000) The accuracy of sound duration representation in the human brain determines the accuracy of behavioural perception. Eur J Neurosci 12:2570-2574. CrossRef Medline
2. Andres AJ, Oram Cardy JE, Joanisse MF (2011) Congruency of auditory sounds and visual letters modulates mismatch negativity and P300 eventrelated potentials. Int J Psychophysiol 79:137-146. CrossRef Medline
3. Brandwein AB, Foxe JJ, Russo NN, Altschuler TS, Gomes H, Molholm S (2011) The development of audiovisual multisensory integration across childhood and early adolescence: a high-density electrical mapping study. Cereb Cortex 21:1042-1055. CrossRef Medline
4. Brandwein AB, Foxe JJ, Butler JS, Russo NN, Altschuler TS, Gomes H, Molholm S (2012) The development of multisensory integration in highfunctioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs. Cereb Cortex. Advance online publication. Retrieved May 24, 2012. doi: 10.1093/cercor/bhs109. CrossRef Medline
5. Butler JS, Molholm S, Fiebelkorn IC, Mercier MR, Schwartz TH, Foxe JJ (2011) Common or redundant neural circuits for duration processing across audition and touch. J Neurosci 31:3400-3406. CrossRef Medline
6. Calvert GA, Brammer MJ, Iversen SD (1998) Crossmodal identification. Trends Cogn Sci 2:247-253. CrossRef Medline
7. De Sanctis P, Molholm S, Shpaner M, Ritter W, Foxe JJ (2009) Right hemispheric contributions to fine auditory temporal discriminations: Highdensity electrical mapping of the Duration mismatch negativity (MMN). Front Integr Neurosci 3:5. CrossRef Medline
8. Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57:11-23. CrossRef Medline
9. Fiebelkorn IC, Foxe JJ, Butler JS, Molholm S (2011) Auditory facilitation of visual-target detection persists regardless of retinal eccentricity and despite wide audiovisual misalignments. Exp Brain Res 213:167-174. CrossRef Medline
10. Foxe JJ (2009) Multisensory integration: frequency tuning of audio-tactile integration. Curr Biol 19:R373-R375. CrossRef Medline
11. Foxe JJ, Schroeder CE (2005) The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16:419-423. CrossRef Medline
12. Foxe JJ, Simpson GV (2002) Flow of activation from V1 to frontal cortex in humans. A framework for defining "early" visual processing. Exp Brain Res 142:139-150. CrossRef Medline
13. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE (2000) Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10:77-83. CrossRef Medline
14. Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM (2002) Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J Neurophysiol 88:540-543. Medline
15. Froyen D, Van Atteveldt N, Bonte M, Blomert L (2008) Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds. Neurosci Lett 430:23-28. CrossRef Medline
16. Fu KM, Johnston TA, Shah AS, Arnold L, Smiley J, Hackett TA, Garraghty PE, Schroeder CE (2003) Auditory cortical neurons respond to somatosensory stimulation. J Neurosci 23:7510-7515. Medline
17. Giard MH, Lavikainen J, Reinikainen K, Perrin F, Bertrand O, Pernier J, Näätänen R (1995) Separate representation of stimulus frequency, intensity, and duration in auditory sensory memory: an event-related potential and dipole-model analysis. J Cogn Neurosci. 7:133-143. CrossRef
18. Guest S, Catmur C, Lloyd D, Spence C (2002) Audiotactile interactions in roughness perception. Exp Brain Res 146:161-171. CrossRef Medline
19. Guthrie D, Buchwald JS (1991) Significance testing of difference potentials. Psychophysiology 28:240-244. CrossRef Medline
20. Horváth J, Czigler I, Jacobsen T, Maess B, Schröger E, Winkler I (2008) MMNor no MMN: no magnitude of deviance effect on theMMNamplitude. Psychophysiology 45:60-69. CrossRef Medline
21. Jacobsen T, Schröger E (2001) Is there pre-attentive memory-based comparison of pitch? Psychophysiology 38:723-727. CrossRef Medline
22. Jacobsen T, Schröger E, Horenkamp T, Winkler I (2003) Mismatch negativity to pitch change: varied stimulus proportions in controlling effects of neural refractoriness on human auditory event-related brain potentials. Neurosci Lett 344:79-82. CrossRef Medline
23. Jousmäki V, Hari R (1998) Parchment-skin illusion: sound-biased touch. Curr Biol 8:R190. Medline
24. Kekoni J, Hämäläinen H, Saarinen M, Gröhn J, Reinikainen K, Lehtokoski A, Näätänen R (1997) Rate effect and mismatch responses in the somatosensory system: ERP-recordings in humans. Biol Psychol 46:125-142. CrossRef Medline
25. Keniston LP, Henderson SC, Meredith MA (2010) Neuroanatomical identification of crossmodal auditory inputs to interneurons in somatosensory cortex. Exp Brain Res 202:725-731. CrossRef Medline
26. Lehmann D, Skrandies W (1980) Reference-free identification of components of checkerboard-evoked multichannel potential fields. Electroencephalogr Clin Neurophysiol 48:609-621. CrossRef Medline
27. Manly BFJ (1991) Randomization and Monte Carlo methods in biology, Ed 1. New York: Chapman and Hall.
28. Meredith MA, Allman BL (2009) Subthreshold multisensory processing in cat auditory cortex. Neuroreport 20:126-131. CrossRef Medline
29. Meredith MA, Keniston LR, Dehner LR, Clemo HR (2006) Crossmodal projections from somatosensory area SIV to the auditory field of the anterior ectosylvian sulcus (FAES) in Cat: further evidence for subthreshold forms of multisensory processing. Exp Brain Res 172:472-484. CrossRef Medline
30. Meredith MA, Allman BL, Keniston LP, Clemo HR (2009) Auditory influences on non-auditory cortices. Hear Res 258:64-71. CrossRef Medline
31. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14:115-128. CrossRef Medline
32. Molholm S, Martinez A, Ritter W, Javitt DC, Foxe JJ (2005) The neural circuitry of pre-attentive auditory change-detection: an fMRI study of pitch and duration mismatch negativity generators. Cereb Cortex 15: 545-551. CrossRef Medline
33. Möttönen R, Krause CM, Tiippana K, Sams M (2002) Processing of changes in visual speech in the human auditory cortex. Brain Res Cogn Brain Res 13:417-425. CrossRef Medline
34. Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ (2005) Grabbing your ear: rapid auditorysomatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 15:963-974. CrossRef Medline
35. Näätänen R (1992) Attention and brain function. Hillsdale, NJ: Erlbaum.
36. Näätänen R, Paavilainen P, Rinne T, Alho K (2007) The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clin Neurophysiol 118:2544-2590. CrossRef Medline
37. Paavilainen P, Valppu S, Näätänen R (2001) The additivity of the auditory feature analysis in the human brain as indexed by the mismatch negativity: 1+1 approximate to 2 but 1+1+1 < 3. Neurosci Lett 301:179-182. CrossRef Medline
38. Pantev C, Lappe C, Herholz SC, Trainor L (2009) Auditory-somatosensory integration and cortical plasticity in musical training. Ann NY Acad Sci 1169:143-150. CrossRef Medline
39. Perrin F, Pernier J, Bertrand O, Giard MH, Echallier JF (1987) Mapping of scalp potentials by surface spline interpolation. Electroencephalogr Clin Neurophysiol 66:75-81. CrossRef Medline
40. Perrin F, Pernier J, Bertrand O, Echallier JF (1989) Spherical splines for scalp potential and current-density mapping. Electroencephalogr Clin Neurophysiol 72:184-187. CrossRef Medline
41. Saint-Amour D, De Sanctis P, Molholm S, Ritter W, Foxe JJ (2007) Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia 45:587-597. CrossRef Medline
42. Schroeder CE, Foxe J (2005) Multisensory contributions to low-level, 'unisensory' processing. Curr Opin Neurobiol 15:454-458. CrossRef Medline
43. Schroeder CE, Foxe JJ (2002) The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res Cogn Brain Res 14:187-198. CrossRef Medline
44. Schroeder CE, Lindsley RW, Specht C, Marcovici A, Smiley JF, Javitt DC (2001) Somatosensory input to auditory association cortex in the macaque monkey. J Neurophysiol 85:1322-1327. Medline
45. Stein B, Meredith MA (1993) The merging of the senses. Cambridge, MA: MIT.
46. Stevens SS (1934) The volume and intensity of tones. Am J Psychol 46:397-408. CrossRef
47. Wilson EC, Reed CM, Braida LD (2009) Integration of auditory and vibrotactile stimuli: effects of phase and stimulus-onset asynchrony. J Acoust Soc Am 126:1960-1974. CrossRef Medline
48. Wilson EC, Braida LD, Reed CM (2010a) Perceptual interactions in the loudness of combined auditory and vibrotactile stimuli. J Acoust Soc Am 127:3038-3043. CrossRef Medline
49. Wilson EC, Reed CM, Braida LD (2010b) Integration of auditory and vibrotactile stimuli: effects of frequency. J Acoust Soc Am 127: 3044-3059. CrossRef Medline
50. Winkler I, Horváth J, Weisz J, Trejo LJ (2009) Deviance detection in congruent audiovisual speech: evidence for implicit integrated audiovisual memory representations. Biol Psychol 82:281-292. CrossRef Medline
51. Wolff C, Schröger E (2001) Human pre-attentive auditory changedetection with single, double, and triple deviations as revealed by mismatch negativity additivity. Neurosci Lett 311:37-40. CrossRef Medline
52. Yau JM, Olenczak JB, Dammann JF, Bensmaia SJ (2009) Temporal frequency channels are linked across audition and touch. Curr Biol 19:561-566. CrossRef Medline