Tracking the speech signal - Time-locked MEG signals during perception of ultra-fast and moderately fast speech in blind and in sighted listeners

Brain and Language

Volumn 124, Issue 1, 2013, Pages 9-21

  Hertrich, Ingo ^a,b   Dietrich, Susanne ^a   Ackermann, Hermann ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Auditory processing; Blindness; Magnetoencephalography; Phase locking; Speech perception; Speech rate

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; AUDITORY CORTEX; BLINDNESS; CHILD; CLINICAL ARTICLE; COMPREHENSION; CONTROLLED STUDY; HEMISPHERIC DOMINANCE; HUMAN; INFERIOR FRONTAL GYRUS; MAGNETOENCEPHALOGRAPHY; NEUROLOGICAL EQUIPMENT; PITCH; RIGHT HEMISPHERE; SCHOOL CHILD; SIGNAL PROCESSING; SPEECH ANALYSIS; SPEECH DISCRIMINATION; SPEECH PERCEPTION; SPEECH RATE; VISUAL CORTEX;

ACOUSTIC STIMULATION; ADULT; AUDITORY CORTEX; BLINDNESS; BRAIN MAPPING; EVOKED POTENTIALS, AUDITORY; FEMALE; FRONTAL LOBE; FUNCTIONAL LATERALITY; HUMANS; MAGNETOENCEPHALOGRAPHY; MALE; MODELS, THEORETICAL; NEURONAL PLASTICITY; PITCH PERCEPTION; PSYCHOLINGUISTICS; REACTION TIME; SPEECH; SPEECH PERCEPTION; TIME FACTORS; VISUAL CORTEX;

EID: 84869876080     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2012.10.006     Document Type: Article

References (73)

1. Abrams D.A., Nicol T., Zecker S., Kraus N. Right-hemisphere auditory cortex is dominant for coding syllable patterns in speech. Journal of Neuroscience 2008, 28:3958-3965.
2. Abrams D.A., Nicol T., Zecker S., Kraus N. Abnormal cortical processing of the syllable rate of speech in poor readers. Journal of Neuroscience 2009, 29:7686-7693.
3. Ackermann H., Lutzenberger W., Hertrich I. Hemisphere lateralization of the neural encoding of temporal speech features: A whole-head magnetencephalography study. Cognitive Brain Research 1999, 7:511-518.
4. Ahissar E., Nagarajan S., Ahissar M., Protopapas A., Mahncke H., Merzenich M.M. Speech comprehension is correlated with temporal response patterns recorded from auditory cortex. Proceedings of the National Academy of Sciences of the United States of America 2001, 98:13367-13372.
5. Aiken S.J., Picton T.W. Human cortical responses to the speech envelope. Ear and Hearing 2008, 29:139-157.
6. Amedi A., Floel A., Knecht S., Zohary E., Cohen L.G. Transcranial magnetic stimulation of the occipital pole interferes with verbal processing in blind subjects. Nature Neuroscience 2004, 7:1266-1270.
7. Arvaniti A., Ladd D.R., Mennen I. Stability of tonal alignment: The case of Greek prenuclear accents. Journal of Phonetics 1998, 26:3-25.
8. Balaguer-Ballester E., Clark N.R., Coath M., Krumbholz K., Denham S.L. Understanding pitch perception as a hierarchical process with top-down modulation. PLoS Computational Biology 2009, 5:e1000301.
9. Bavelier D., Hirshorn E.A. I see where you're hearing: How cross-modal plasticity may exploit homologous brain structures. Nature Neuroscience 2010, 13:1309-1311.
10. Boersma, P., & Weenink, D. (2009). Praat: Doing phonetics by computer. <>. http://www.praat.org.
11. Bolognini N., Senna I., Maravita A., Pascual-Leone A., Merabet L.B. Auditory enhancement of visual phosphene perception: The effect of temporal and spatial factors and of stimulus intensity. Neuroscience Letters 2010, 477:109-114.
12. Boutros N.N., Belger A. Midlatency evoked potentials attenuation and augmentation reflect different aspects of sensory gating. Biological Psychiatry 1999, 45:917-922.
13. Brugge J.F., Nourski K.V., Oya H., Reale R.A., Kawasaki H., Steinschneider M., et al. Coding of repetitive transients by auditory cortex on Heschl's gyrus. Journal of Neurophysiology 2009, 102:2358-2374.
14. Büchel C. Cortical hierarchy turned on its head. Nature Neuroscience 2003, 6:657-658.
15. Büchel C., Price C., Frackowiak R.S.J., Friston K. Different activation patterns in the visual cortex of late and congenitally blind subjects. Brain 1998, 121:409-419.
16. Bueti D., Macaluso E. Auditory temporal expectations modulate activity in visual cortex. NeuroImage 2010, 51:1168-1183.
17. Bull R., Rathborn H., Clifford B.R. The voice-recognition accuracy of blind listeners. Perception 1983, 12:223-226.
18. Cate A.D., Herron T.J., Yund E.W., Stecker G.C., Rinne T., Kang X., et al. Auditory attention activates peripheral visual cortex. PLoS One 2009, 4:e4645.
19. Crouzet O. On segments and syllables in the sound structure of language: Curve-based approaches to phonology and the auditory representation of speech. Mathematics and Social Sciences/Mathématiques et sciences humaines 2007, 180:57-71.
20. Deng S., Srinivasan R. Semantic and acoustic analysis of speech by functional networks with distinct time scales. Brain Research 2010, 1346:132-144.
21. Dietrich, S., Hertrich, I., & Ackermann, H. (2011). Why do blind listeners use visual cortex for understanding ultra-fast speech? Journal of the Acoustical Society, 129, 2494. <>. http://www.aip.org/asa_laypapers2011/Dietrich.html.
22. Drullman R., Festen J.M., Plomp R. Effect of reducing slow temporal modulations on speech reception. Journal of the Acoustical Society of America 1994, 95:2670-2680.
23. Elbert T., Sterr A., Rockstroh B., Pantev C., Müller M.M., Taub E. Expansion of the tonotopic area in the auditory cortex of the blind. Journal of Neuroscience 2002, 22:9941-9944.
24. Elliott T.M., Theunissen F.E. The modulation transfer function for speech intelligibility. PLoS Computational Biology 2009, 5:e1000302.
25. Foxe J.J., Schroeder C.E. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 2005, 16:419-423.
26. Garcia-Rill E., Moran K., Garcia J., Findley W.M., Walton K., Strotman B., et al. Magnetic sources of the M50 response are localized to frontal cortex. Clinical Neurophysiology 2008, 119:388-398.
27. Gick B., Campbell F., Oh S., Tamburri-Watt L. Toward universals in the gestural organization of syllables: A cross-linguistic study of liquids. Journal of Phonetics 2006, 34:49-72.
28. Gollisch T. Time-warp invariant pattern detection with bursting neurons. New Journal of Physics 2008, 10:015012.
29. Gougoux F., Lepore F., Lassonde M., Voss P., Zatorre R.J., Belin P. Pitch discrimination in the early blind. Nature 2004, 430:309.
30. Greenberg S., Carvey H., Hitchcock L., Chang S. Temporal properties of spontaneous speech - a syllable-centric perspective. Journal of Phonetics 2003, 31:465-485.
31. Hertrich I., Dietrich S., Ackermann H. Cross-modal interactions during perception of audiovisual speech and nonspeech signals: An fMRI study. Journal of Cognitive Neuroscience 2010, 23:221-237.
32. Hertrich I., Dietrich S., Moos A., Trouvain J., Ackermann H. Enhanced speech perception capabilities in a blind listener are associated with activation of fusiform gyrus and primary visual cortex. Neurocase 2009, 15:163-170.
33. Hertrich I., Dietrich S., Trouvain J., Moos A., Ackermann H. Magnetic brain activity phase-locked to the envelope, the syllable onsets, and the fundamental frequency of a perceived speech signal. Psychophysiology 2012, 49:322-334. 10.1111/j.1469-8986.2011.01314.x.
34. Hertrich I., Mathiak K., Lutzenberger W., Ackermann H. Hemispheric lateralization of the processing of consonant-vowel syllables (formant transitions): Effects of stimulus characteristics and attentional demands on evoked magnetic fields. Neuropsychologia 2002, 40:1902-1917.
35. Hertrich I., Mathiak K., Lutzenberger W., Ackermann H. Transient and phase-locked evoked magnetic fields in response to periodic acoustic signals. Neuroreport 2004, 15:1687-1690.
36. Hertrich I., Mathiak K., Lutzenberger W., Ackermann H. Time course of early audiovisual interactions during speech and nonspeech central auditory processing: A magnetoencephalography study. Journal of Cognitive Neuroscience 2009, 21:259-274.
37. Hyde K.L., Peretz I., Zatorre R.J. Evidence for the role of the right auditory cortex in fine pitch resolution. Neuropsychologia 2008, 46:632-639. 10.1016/j.neuropsychologia.2007.09.004.
38. Kaukoranta E., Hari R., Lounasmaa O.V. Responses of the human auditory cortex to vowel onset after fricative consonants. Experimental Brain Research 1987, 69:19-23.
39. Kerlin J.R., Shahin A.J., Miller L.M. Attentional gain control of ongoing cortical speech representations in a " Cocktail Party" . Journal of Neuroscience 2010, 30:620-628.
40. Korzyukov O., Pflieger M.E., Wagner M., Bowyer S.M., Rosburg T., Sundaresan K., et al. Generators of the intracranial P50 response in auditory sensory gating. NeuroImage 2007, 35:814-826.
41. Ladd D.R., Dan F., Hanneke F., Astrid S. Constant " segmental anchoring" of F0 movements under changes in speech rate. Journal of the Acoustical Society of America 1999, 106:1543-1554.
42. Lattner S., Meyer M.E., Friederici A.D. Voice perception: Sex, pitch, and the right hemisphere. Human Brain Mapping 2005, 24(1):11-20. 10.1002/hbm.20065.
43. Leena M., Yegnanarayana B. Extraction and representation of prosodic features for language and speaker recognition. Speech Communication 2008, 50:782-796.
44. Luo H., Poeppel D. Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron 2007, 54:1001-1010.
45. Macaluso E., Driver J. Multisensory spatial interactions: A window onto functional integration in the human brain. Trends in Neurosciences 2005, 28:264-271.
46. Moos, A., Trouvain, J., & Barry, W. J. (2007). Comprehension of ultra-fast speech - blind vs. " normally hearing" persons. In Proc. 16th international congress of phonetic sciences (677-680). Saarbrücken: University of Saarbrücken.
47. Nabatiyan A., Poulet J.F.A., de Polavieja G.G., Hedwig B. Temporal pattern recognition based on instantaneous spike rate coding in a simple auditory system. Journal of Neurophysiology 2003, 90:2484-2493.
48. Niemeyer W., Starlinger I. Do blind hear better? Investigations on auditory processing in congenital early acquired blindness. Audiology 1981, 20:510-515.
49. Noordhoek I.M., Drullman R. Effect of reducing temporal intensity modulations on sentence intelligibility. Journal of the Acoustical Society of America 1997, 101:498-502.
50. Noppeney U. The effects of visual deprivation on functional and structural organization of the human brain. Neuroscience & Biobehavioral Reviews 2007, 31(8):1169-1180.
51. Nourski K.V., Reale R.A., Oya H., Kawasaki H., Kovach C.K., Chen H., et al. Temporal envelope of time-compressed speech represented in the human auditory cortex. Journal of Neuroscience 2009, 29:15564-15574.
52. Obleser J., Lahiri A., Eulitz C. Auditory-evoked magnetic field codes place of articulation in timing and topography around 100 milliseconds post syllable onset. Neuroimage 2003, 20:1839-1847.
53. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
54. Onitsuka T., Ninomiya H., Sato E., Yamamoto T., Tashiro N. The effect of interstimulus intervals and between-block rests on the auditory evoked potential and magnetic field: Is the auditory P50 in humans an overlapping potential?. Clinical Neurophysiology 2000, 111:237-245.
55. Patel A.D., Balaban E. Human pitch perception is reflected in the timing of stimulus-related cortical activity. Nature Neuroscience 2001, 4:839-844.
56. Poeppel D. The analysis of speech in different temporal integration windows: Cerebral lateralization as 'asymmetric sampling in time'. Speech Communication 2003, 41:245-255.
57. Poldrack R.A., Temple E., Protopapas A., Nagarajan S., Tallal P., Merzenich M., et al. Relations between the neural bases of dynamic auditory processing and phonological processing: Evidence from fMRI. Journal of Cognitive Neuroscience 2001, 13:687-697.
58. Prieto P., Torreira F. The segmental anchoring hypothesis revisited: Syllable structure and speech rate effects on peak timing in Spanish. Journal of Phonetics 2007, 35:473-500.
59. Röder B., Rösler F., Hennighausen E., Näcker F. Event-related potentials during auditory and somatosensory discrimination in sighted and blind human subjects. Cognitive Brain Research 1996, 4:77-93.
60. Röder B., Stock O., Bien S., Neville H., Rösler F. Speech processing activates visual cortex in congenitally blind humans. European Journal of Neuroscience 2002, 16:930-936.
61. Röder B., Teder-Salejarvi W., Sterr A., Rösler F., Hillyard S.A., Neville H.J. Improved auditory spatial tuning in blind humans. Nature 1999, 400:162-166.
62. Schoonhoven R., Boden C.J.R., Verbunt J.P.A., de Munck J.C. A whole head MEG study of the amplitude-modulation-following response: Phase coherence, group delay and dipole source analysis. Clinical Neurophysiology 2003, 114:2096-2106.
63. Schroeder C.E., Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Current Opinion in Neurobiology 2005, 15:454-458.
64. Schroeder C.E., Smiley J., Fu K.G., McGinnis T., O'Connell M.N., Hackett T.A. Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. International Journal of Psychophysiology 2003, 50:5-17.
65. Smiley J.F., Falchier A. Multisensory connections of monkey auditory cerebral cortex. Hearing Research 2009, 258:37-46.
66. Steinschneider M., Fishman Y.I., Arezzo J.C. Representation of the voice onset time (VOT) speech parameter in population responses within primary auditory cortex of the awake monkey. Journal of the Acoustical Society of America 2003, 114:307-321.
67. Steinschneider M., Reser D.H., Fishman Y.I., Schroeder C.E., Arezzo J.C. Click train encoding in primary auditory cortex of the awake monkey: Evidence for two mechanims subserving pitch perception. Journal of the Acoustical Society of America 1998, 104:2935-2955.
68. Stevens A.A., Snodgrass M., Schwartz D., Weaver K. Preparatory activity in occipital cortex in early blind humans predicts auditory perceptual performance. Journal of Neuroscience 2007, 27:10734-10741.
69. Stevens A.A., Weaver K. Auditory perceptual consolidation in early-onset blindness. Neuropsychologia 2005, 43:1901-1910.
70. Stevens A.A., Weaver K.E. Functional characteristics of auditory cortex in the blind. Behavioural and Brain Research 2009, 196:134-138.
71. Trouvain J. On the comprehension of extremely fast synthetic speech. Saarland Working Papers in Linguistics 2007, 1:5-13.
72. Vihman M.M., Nakai S., DePaolis R.A., Hallé P. The role of accentual pattern in early lexical representation. Journal of Memory and Language 2004, 50:336-353.
73. Wan C.Y., Wood A.G., Reutens D.C., Wilson S.J. Early but not late-blindness leads to enhanced auditory perception. Neuropsychologia 2010, 48:344-348.