Hearing Illusory Sounds in Noise: The Timing of Sensory-Perceptual Transformations in Auditory Cortex

Neuron

Volumn 64, Issue 4, 2009, Pages 550-561

  Riecke, Lars ^a   Esposito, Fabrizio ^a,b   Bonte, Milene ^a   Formisano, Elia ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

sysneuro

Indexed keywords

ACOUSTICS; ADULT; ARTICLE; AUDITORY CORTEX; BEHAVIOR; ELECTROENCEPHALOGRAM; HEARING; HUMAN; HUMAN EXPERIMENT; NOISE; NORMAL HUMAN; OSCILLATION; PRIORITY JOURNAL; SOUND; STIMULUS RESPONSE; TASK PERFORMANCE;

ACOUSTIC STIMULATION; ADULT; AUDITORY CORTEX; ELECTROENCEPHALOGRAPHY; HEARING; HUMANS; ILLUSIONS; NOISE; PSYCHOMOTOR PERFORMANCE; SOUND; TIME FACTORS; YOUNG ADULT;

EID: 70449787953     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2009.10.016     Document Type: Article

References (98)

1. Alain C., and Bernstein L.J. From sounds to meaning: the role of attention during auditory scene analysis. Curr. Opin. Otolaryngol. Head Neck Surg. 16 (2008) 485-489
2. Alegre M., Gurtubay I.G., Labarga A., Iriarte J., Malanda A., and Artieda J. Alpha and beta oscillatory changes during stimulus-induced movement paradigms: effect of stimulus predictability. Neuroreport 14 (2003) 381-385
3. Alegre M., Labarga A., Gurtubay I.G., Iriarte J., Malanda A., and Artieda J. Movement-related changes in cortical oscillatory activity in ballistic, sustained and negative movements. Exp. Brain Res. 148 (2003) 17-25
4. Alegre M., Gurtubay I.G., Labarga A., Iriarte J., Valencia M., and Artieda J. Frontal and central oscillatory changes related to different aspects of the motor process: a study in go/no-go paradigms. Exp. Brain Res. 159 (2004) 14-22
5. Alegre M., Imirizaldu L., Valencia M., Iriarte J., Arcocha J., and Artieda J. Alpha and beta changes in cortical oscillatory activity in a go/no go randomly-delayed-response choice reaction time paradigm. Clin. Neurophysiol. 117 (2006) 16-25
6. Bonte M., Valente G., and Formisano E. Dynamic and task-dependent encoding of speech and voice by phase reorganization of cortical oscillations. J. Neurosci. 29 (2009) 1699-1706
7. Braaten R.F., and Leary J.C. Temporal induction of missing birdsong segments in European starlings. Psychol. Sci. 10 (1999) 162-166
8. Bregman A.S. Auditory Scene Analysis: The Perceptual Organization of Sound (1990), MIT Press, Cambridge, MA
9. Buzsaki G., and Draguhn A. Neuronal oscillations in cortical networks. Science 304 (2004) 1926-1929
10. Cacace A.T., and McFarland D.J. Spectral dynamics of electroencephalographic activity during auditory information processing. Hear. Res. 176 (2003) 25-41
11. Canolty R.T., Edwards E., Dalal S.S., Soltani M., Nagarajan S.S., Kirsch H.E., Berger M.S., Barbaro N.M., and Knight R.T. High gamma power is phase-locked to theta oscillations in human neocortex. Science 313 (2006) 1626-1629
12. Carlyon R.P. How the brain separates sounds. Trends Cogn. Sci. 8 (2004) 465-471
13. Chait M., Poeppel D., and Simon J.Z. Auditory temporal edge detection in human auditory cortex. Brain Res. 1213 (2008) 78-90
14. Ciocca V. The auditory organization of complex sounds. Front. Biosci. 13 (2008) 148-169
15. Ciocca V., and Bregman A.S. Perceived continuity of gliding and steady-state tones through interrupting noise. Percept. Psychophys. 42 (1987) 476-484
16. Cusack R. The intraparietal sulcus and perceptual organization. J. Cogn. Neurosci. 17 (2005) 641-651
17. Dale A.M., and Sereno M.I. Improved localization of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: a linear approach. J. Cogn. Neurosci. 5 (1993) 162-176
18. Dale A.M., Liu A.K., Fischl B.R., Buckner R.L., Belliveau J.W., Lewine J.D., and Halgren E. Dynamic statistical parametric mapping: combining fMRI and MEG for high-resolution imaging of cortical activity. Neuron 26 (2000) 55-67
19. Delgutte B. Physiological mechanisms of psychophysical masking: observations from auditory-nerve fibers. J. Acoust. Soc. Am. 87 (1990) 791-809
20. Delorme A., and Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134 (2004) 9-21
21. Delorme A., Sejnowski T.J., and Makeig S. Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis. Neuroimage 34 (2007) 1443-1449
22. Engel A.K., and Singer W. Temporal binding and the neural correlates of sensory awareness. Trends Cogn. Sci. 5 (2001) 16-25
23. Esposito F., Mulert C.F., and Goebel R. Combined distributed source and single-trial EEG-fMRI modeling: application to effortful decision making processes. Neuroimage 47 (2009) 112-121
24. Esposito F., Aragri A., Piccoli T., Tedeschi G., Goebel R., and Di Salle F. Distributed analysis of simultaneous EEG-fMRI time-series: modeling and interpretation issues. Magn. Reson. Imaging 27 (2009) 1120-1130
25. Fishbach A., Nelken I., and Yeshurun Y. Auditory edge detection: a neural model for physiological and psychoacoustical responses to amplitude transients. J. Neurophysiol. 85 (2001) 2303-2323
26. Fritz J.B., Elhilali M., David S.V., and Shamma S. Auditory attention - Focusing the searchlight on sound. Curr. Opin. Neurobiol. 17 (2007) 437-455
27. Fritz J.B., Elhilali M., David S.V., and Shamma S. Does attention play a role in dynamic receptive field adaptation to changing acoustic salience in A1?. Hear. Res. 229 (2007) 186-203
28. Grau C., Fuentemilla L., and Marco-Pallarés J. Functional neural dynamics underlying auditory event-related N1 and N1 suppression response. Neuroimage 36 (2007) 522-531
29. Griffiths T.D., and Warren J.D. The planum temporale as a computational hub. Trends Neurosci. 25 (2002) 348-353
30. Heinrich A., Alain C., and Schneider B. Within- and between-channel gap detection in the human auditory cortex. Neuroreport 15 (2004) 2051-2056
31. Heinrich A., Carlyon R.P., Davis M.H., and Johnsrude I.S. Illusory vowels resulting from perceptual continuity: a functional magnetic resonance imaging study. J. Cogn. Neurosci. 20 (2008) 1737-1752
32. Herdener M., Esposito F., Di Salle F., Lehmann C., Bach D.R., Scheffler K., and Seifritz E. BOLD correlates of edge detection in human auditory cortex. Neuroimage 36 (2007) 194-201
33. Houtgast T. Psychophysical evidence for lateral inhibition in hearing. J. Acoust. Soc. Am. 51 (1972) 1885-1894
34. Husain F.T., Lozito T.P., Ulloa A., and Horwitz B. Investigating the neural basis of the auditory continuity illusion. J. Cogn. Neurosci. 17 (2005) 1275-1292
35. Inui K., Okamoto H., Miki K., Gunji A., and Kakigi R. Serial and parallel processing in the human auditory cortex: A magnetoencephalographic study. Cereb. Cortex 16 (2006) 18-30
36. Joutsiniemi S.L., Hari R., and Vilkman V. Cerebral magnetic responses to noise bursts and pauses of different durations. Audiology 28 (1989) 325-333
37. Jung T.P., Makeig S., Westerfield M., Townsend J., Courchesne E., and Sejnowski T.J. Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects. Clin. Neurophysiol. 111 (2000) 1745-1758
38. Jung T.P., Makeig S., Humphries C., Lee T.W., McKeown M.J., Iragui V., and Sejnowski T.J. Removing electroencephalographic artifacts by blind source separation. Psychophysiology 37 (2000) 163-178
39. Kahana M.J., Seelig D., and Madsen J.R. Theta returns. Curr. Opin. Neurobiol. 11 (2001) 739-744
40. Kaiser J., Birbaumer N., and Lutzenberger W. Event-related beta desynchronization indicates timing of response selection in a delayed- response paradigm in humans. Neurosci. Lett. 312 (2001) 149-152
41. Kaiser J., Lennert T., and Lutzenberger W. Dynamics of oscillatory activity during auditory decision making. Cereb. Cortex 17 (2007) 2258-2267
42. Kiebel S.J., Tallon-Baudry C., and Friston K.J. Parametric analysis of oscillatory activity as measured with EEG/MEG. Hum. Brain Mapp. 26 (2005) 170-177
43. Klimesch W. EEG alpha and theta rhythmicities reflect cognitive and memory performance: a review and analysis. Brain Res. Brain Res. Rev. 29 (1999) 169-195
44. Klimesch W., Freunberger R., Sauseng P., and Gruber W. A short review of slow phase synchronization and memory: Evidence for control processes in different memory systems?. Brain Res. 1235 (2008) 31-44
45. Kolev V., Rosso O.A., and Yordanova J. A transient dominance of theta ERP component characterizes passive auditory processing: evidence from a developmental study. Neuroreport 13 (2001) 2791-2796
46. Lakatos P., Shah A.S., Knuth K.H., Ulbert I., Karmos G., and Schroeder C.E. An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. J. Neurophysiol. 94 (2005) 1904-1911
47. Lakatos P., Chen C.M., O'Connell M.N., Mills A., and Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53 (2007) 279-292
48. Lakatos P., Karmos G., Mehta A.D., Ulbert I., and Schroeder C.E. Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 320 (2008) 110-113
49. Lee T.W., Girolami M., Bell A.J., and Sejnowski T.J. A unifying information-theoretic framework for independent component analysis. Comput. Math. Appl. 39 (2000) 1-21
50. Leopold D.A., and Logothetis N.K. Multistable phenomena: Changing views in perception. Trends Cogn. Sci. 3 (1999) 254-264
51. Lin F.H., Witzel T., Hämäläinen M.S., Dale A.M., Belliveau J.W., and Stufflebeam S.M. Spectral spatiotemporal imaging of cortical oscillations and interactions in the human brain. Neuroimage 23 (2004) 582-595
52. Lin F.H., Belliveau J.W., Dale A.M., and Hämäläinen M.S. Distributed current estimates using cortical orientation constraints. Hum. Brain Mapp. 27 (2006) 1-13
53. Lin F.H., Witzel T., Ahlfors S.P., Stufflebeam S.M., Belliveau J.W., and Hämäläinen M.S. Assessing and improving the spatial accuracy in MEG source localization by depth-weighted minimum-norm estimates. Neuroimage 31 (2006) 160-171
54. Lister J.J., Maxfield N.D., and Pitt G.J. Cortical evoked response to gaps in noise: within-channel and across-channel conditions. Ear Hear. 28 (2007) 862-878
55. Luo H., and Poeppel D. Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron 54 (2007) 1001-1010
56. Makeig S., Jung T.P., Bell A.J., Ghahremani D., and Sejnowski T.J. Blind separation of auditory event-related brain responses into independent components. Proc. Natl. Acad. Sci. USA 94 (1997) 10979-10984
57. McFarland D.J., and Cacace A.T. Separating stimulus-locked and unlocked components of the auditory event-related potential. Hear. Res. 193 (2004) 111-120
58. Michalewski H.J., Starr A., Nguyen T.T., Kong Y.Y., and Zeng F.G. Auditory temporal processes in normal-hearing individuals and in patients with auditory neuropathy. Clin. Neurophysiol. 116 (2005) 669-680
59. Micheyl C., Carlyon R.P., Shtyrov Y., Hauk O., Dodson T., and Pullvermüller F. The neurophysiological basis of the auditory continuity illusion: A mismatch negativity study. J. Cogn. Neurosci. 15 (2003) 747-758
60. Micheyl C., Tian B., Carlyon R.P., and Rauschecker J.P. Perceptual organization of tone sequences in the auditory cortex of awake macaques. Neuron 48 (2005) 139-148
61. Micheyl C., Carlyon R.P., Gutschalk A., Melcher J.R., Oxenham A.J., Rauschecker J.P., Tian B., and Wilson E.C. The role of auditory cortex in the formation of auditory streams. Hear. Res. 229 (2007) 116-131
62. Miller G.A., and Licklider J.C.R. The intelligibility of interrupted speech. J. Acoust. Soc. Am. 22 (1950) 167-173
63. Miller C.T., Dibble E., and Hauser M.D. Amodal completion of acoustic signals by a nonhuman primate. Nat. Neurosci. 4 (2001) 783-784
64. Monto S., Palva S., Voipio J., and Palva J.M. Very slow EEG fluctuations predict the dynamics of stimulus detection and oscillation amplitudes in humans. J. Neurosci. 28 (2008) 8268-8272
65. Mukamel R., Gelbard H., Arieli A., Hasson U., Fried I., and Malach R. Coupling between neuronal firing, field potentials, and fMRI in human auditory cortex. Science 309 (2005) 951-954
66. Näätänen R., Tervaniemi M., Sussman E., Paavilainen P., and Winkler I. 'Primitive intelligence' in the auditory cortex. Trends Neurosci. 24 (2001) 283-288
67. Nakajima Y., Sasaki T., Kanafuka K., Miyamoto A., Remijn G., and ten Hoopen G. Illusory recouplings of onsets and terminations of glide tone components. Percept. Psychophys. 62 (2000) 1413-1425
68. Pantev C., Eulitz C., Hampson S., Ross B., and Roberts L.E. The auditory evoked "off" response: sources and comparison with the "on" and the "sustained" responses. Ear Hear. 17 (1996) 255-265
69. Petkov C.I., O'Connor K.N., and Sutter M.L. Illusory sound perception in macaque monkeys. J. Neurosci. 23 (2003) 9155-9161
70. Petkov C.I., O'Connor K.N., and Sutter M.L. Encoding of illusory continuity in primary auditory cortex. Neuron 54 (2007) 153-165
71. Pfurtscheller G., and Lopes da Silva F.H. Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110 (1999) 1842-1857
72. Poeppel D. The analysis of speech in different temporal integration windows: Cerebral lateralization as 'asymmetric sampling in time'. Speech Commun. 41 (2003) 245-255
73. Pratt H., Bleich N., and Mittelman N. The composite N1 component to gaps in noise. Clin. Neurophysiol. 116 (2005) 2648-2663
74. Pressnitzer D., and Hupe J.M. Temporal dynamics of auditory and visual bistability reveal common principles of perceptual organization. Curr. Biol. 16 (2006) 1351-1357
75. Repp B.H. Perceptual restoration of a 'missing' speech sound: auditory induction or illusion?. Percept. Psychophys. 51 (1992) 14-32
76. Riecke L., Van Opstal J., Goebel R., and Formisano E. Hearing illusory sounds in noise: Sensory-perceptual transformations in primary auditory cortex. J. Neurosci. 27 (2007) 12684-12689
77. Riecke L., Van Opstal A.J., and Formisano E. The auditory continuity illusion: A parametric investigation and filter model. Percept. Psychophys. 70 (2008) 1-12
78. Riecke L., Mendelsohn D., Schreiner C., and Formisano E. The continuity illusion adapts to the auditory scene. Hear. Res. 247 (2009) 71-77
79. Rupp A., Gutschalk A., Hack S., and Scherg M. Temporal resolution of the human primary auditory cortex in gap detection. Neuroreport 13 (2002) 2203-2207
80. Samuel A.G., and Ressler W.H. Attention within auditory word perception: Insights from the phonemic restoration illusion. J. Exp. Psychol. Hum. Percept. Perform. 12 (1986) 70-79
81. Schreiner C. Encoding of alternating acoustical signals in the medial geniculate body of guinea pigs. Hear. Res. 3 (1980) 265-278
82. Schroeder C.E., and Lakatos P. Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci. 32 (2008) 9-18
83. Schroeder C.E., and Lakatos P. The gamma oscillation: master or slave?. Brain Topogr. 22 (2009) 24-26
84. Shahin A.J., Bishop C.W., and Miller L.M. Neural mechanisms for illusory filling-in of degraded speech. Neuroimage 44 (2009) 1133-1143
85. Shamma S. On the role of space and time in auditory processing. Trends Cogn. Sci. 5 (2001) 340-348
86. Sivonen P., Maess B., Lattner S., and Friederici A.D. Phonemic restoration in a sentence context: Evidence from early and later ERP effects. Brain Res. 1121 (2006) 177-189
87. Sugita Y. Neuronal correlates of auditory induction in the cat cortex. Neuroreport 8 (1997) 1155-1159
88. Tallon-Baudry C., and Bertrand O. Oscillatory gamma activity in humans and its role in object representation. Trends Cogn. Sci. 3 (1999) 151-162
89. Ulanovsky N., Las L., and Nelken I. Processing of low-probability sounds by cortical neurons. Nat. Neurosci. 6 (2003) 391-398
90. Vanhatalo S., Voipio J., and Kaila K. Electroencephalography: Basic Principles, Clinical Applications, and Related Fields. In: Niedermeyer E., and Lopes da Silva F. (Eds) (2005), Lippincott Williams and Wilkins, Philadelphia, PA 489-493
91. Von Stein A., and Sarnthein J. Different frequencies for different scales of cortical integration: from local gamma to long range alpha/theta synchronization. Int. J. Psychophysiol. 38 (2000) 301-313
92. Von Stein A., Chiang C., and Koenig P. Top-down processing mediated by interareal synchronization. Proc. Natl. Acad. Sci. USA 97 (2000) 14748-14753
93. Warren R.M. Auditory Perception: A new Analysis and Synthesis (1999), Cambridge University Press, Cambridge, UK
94. Warren R.M., Obusek C.J., and Ackroff J.M. Auditory induction: Perceptual synthesis of absent sounds. Science 176 (1972) 1149-1151
95. Warren R.M., Bashford J.A., Healy E.W., and Brubaker B.S. Auditory induction: Reciprocal changes in alternating sounds. Percept. Psychophys. 55 (1994) 313-322
96. Wrightson J.M., and Warren R.M. Incomplete auditory induction of tones alternated with noise: Effects occurring below the pulsation threshold. J. Acoust. Soc. Am. 69 (1981) S105-S106
97. Yordanova J., and Kolev V. Single-sweep analysis of the theta frequency band during an auditory oddball task. Psychophysiology 35 (1998) 116-126
98. Zatorre R.J., Belin P., and Penhune V.B. Structure and function of auditory cortex: Music and speech. Trends Cogn. Sci. 6 (2002) 37-46