Dynamic encoding of speech sequence probability in human temporal cortex

Journal of Neuroscience

Volumn 35, Issue 18, 2015, Pages 7203-7214

  Leonard, Matthew K ^a   Bouchard, Kristofer E ^a,b,c   Tang, Claire ^b   Chang, Edward F ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

Auditory; Electrocorticography; Sequences; Speech

Indexed keywords

ARTICLE; AUDITORY DISCRIMINATION; AUDITORY SYSTEM FUNCTION; CONTROLLED STUDY; CORTICAL ELECTRODE; ELECTROCORTICOGRAPHY; FEMALE; FREQUENCY ANALYSIS; HUMAN; HUMAN EXPERIMENT; MALE; NERVE POTENTIAL; NEUROMODULATION; NUCLEAR MAGNETIC RESONANCE IMAGING; PHONOTACTICS; PRIORITY JOURNAL; PROBABILITY; SENSORY STIMULATION; SPEECH PERCEPTION; STIMULUS RESPONSE; SUPERIOR TEMPORAL GYRUS; TASK PERFORMANCE; TEMPORAL CORTEX; TEMPORAL LOBE; TRANSITION PROBABILITY; AUDITORY EVOKED POTENTIAL; AUDITORY STIMULATION; ELECTRODE IMPLANT; HEARING; PHYSIOLOGY; PROCEDURES; RANDOMIZED CONTROLLED TRIAL; RETROSPECTIVE STUDY; SPEECH;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; ELECTRODES, IMPLANTED; EVOKED POTENTIALS, AUDITORY; FEMALE; HUMANS; MALE; RETROSPECTIVE STUDIES; SPEECH; SPEECH PERCEPTION; TEMPORAL LOBE;

EID: 84929347063     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4100-14.2015     Document Type: Article

References (72)

1. Ahrens MB, Linden JF, Sahani M (2008) Nonlinearities and contextual influences in auditory cortical responses modeled with multilinear spectro-temporal methods. J Neurosci 28:1929-1942. CrossRef Medline
2. Bastos AM, Usrey WM, Adams RA, Mangun GR, Fries P, Friston KJ (2012) Canonical microcircuits for predictive coding. Neuron 76:695-711. CrossRef Medline
3. Bouchard KE, Brainard MS (2013) Neural encoding and integration of learned probabilistic sequences in avian sensory-motor circuitry. J Neurosci 33:17710-17723. CrossRef Medline
4. Bouchard KE, Mesgarani N, Johnson K, Chang EF (2013) Functional organization of human sensorimotor cortex for speech articulation. Nature 495:327-332. CrossRef Medline
5. Brosch M, Schreiner CE (1997) Time course of forward masking tuning curves in cat primary auditory cortex. J Neurophysiol 77:923-943. Medline
6. Brosch M, Schreiner CE (2000) Sequence sensitivity of neurons in cat primary auditory cortex. Cereb Cortex 10:1155-1167. CrossRef Medline
7. Chang EF, Rieger JW, Johnson K, Berger MS, Barbaro NM, Knight RT (2010) Categorical speech representation in human superior temporal gyrus. Nat Neurosci 13:1428-1432. CrossRef Medline
8. Chechik G, Nelken I (2012) Auditory abstraction from spectro-temporal features to coding auditory entities. Proc Natl Acad Sci U S A 109:18968-18973. CrossRef Medline
9. Chechik G, Anderson MJ, Bar-Yosef O, Young ED, Tishby N, Nelken I (2006) Reduction of information redundancy in the ascending auditory pathway. Neuron 51:359-368. CrossRef Medline
10. Crone NE, Miglioretti DL, Gordon B, Lesser RP (1998) Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis: II. Event-related synchronization in the gamma band. Brain 121: 2301-2315. CrossRef Medline
11. Dahan D, Magnuson JS, Tanenhaus MK (2001) Time course of frequency effects in spoken-word recognition: evidence from eye movements. Cogn Psychol 42:317-367. CrossRef Medline
12. Dale AM, Fischl B, Sereno MI (1999) Cortical surface-based analysis: I. Segmentation and surface reconstruction. Neuroimage 9:179-194. CrossRef Medline
13. Dan Y, Poo MM (2004) Spike timing-dependent plasticity of neural circuits. Neuron 44:23-30. CrossRef Medline
14. David SV, Shamma SA (2013) Integration over multiple timescales in primary auditory cortex. J Neurosci 33:19154-19166. CrossRef Medline
15. Davis MH, Gaskell MG (2009) A complementary systems account of word learning: neural and behavioural evidence. Philos Trans R Soc B Biol Sci 364:3773-3800. CrossRef Medline
16. DeWitt I, Rauschecker JP (2012) Phoneme and word recognition in the auditory ventral stream. Proc Natl Acad Sci USA 109:E505-E514. CrossRef Medline
17. Dykstra AR, Chan AM, Quinn BT, Zepeda R, Keller CJ, Cormier J, Madsen JR, Eskandar EN, Cash SS (2012) Individualized localization and cortical surface-based registration of intracranial electrodes. Neuroimage 59: 3563-3570. CrossRef Medline
18. Elman JL (2009) On the meaning of words and dinosaur bones: lexical knowledge without a lexicon. Cogn Sci 33:547-582. CrossRef Medline
19. Fischl B, Sereno MI, Dale AM (1999) Cortical surface-based analysis: II. Inflation, flattening, and a surface-based coordinate system. Neuroimage 9:195-207. CrossRef Medline
20. Formisano E, De Martino F, Bonte M, Goebel R (2008) "Who" is saying "what?" Brain-based decoding of human voice and speech. Science 322: 970-973. CrossRef Medline
21. Friston K (2005) A theory of cortical responses. Philos Trans R Soc B Biol Sci 360:815-836. CrossRef Medline
22. Furl N, Kumar S, Alter K, Durrant S, Shawe-Taylor J, Griffiths TD (2011) Neural prediction of higher-order auditory sequence statistics. Neuroimage 54:2267-2277. CrossRef Medline
23. Garofolo JS, Lamel LF, Fisher WM, Fiscus JG, Pallett DS (1993) DARPA TIMIT acoustic-phonetic continous speech corpus CD-ROM. NIST speech disc 1-1.1. NASA STIRecon Tech Rep N 93:27403.
24. Garrido MI, Kilner JM, Stephan KE, Friston KJ (2009) The mismatch negativity: a review of underlying mechanisms. Clin Neurophysiol 120:453-463. CrossRef Medline
25. Gaskell MG, Marslen-Wilson WD (1997) Integrating form and meaning: a distributed model of speech perception. Lang Cogn Process 12:613-656. CrossRef
26. Gelfand JR, Bookheimer SY (2003) Dissociating neural mechanisms of temporal sequencing and processing phonemes. Neuron 38:831-842. CrossRef Medline
27. Gentner TQ, Margoliash D (2003) Neuronal populations and single cells representing learned auditory objects. Nature 424:669-674. CrossRef Medline
28. Grossberg S (1987) The adaptive self-organization of serial order in behavior: speech, language, and motor control. Adv Psychol 43:313-400. CrossRef
29. Hardcastle WJ, Hewlett N (1999) Coarticulation: theory, data and techniques. Cambridge UP.
30. Hebb DO (1949) The organization of behavior. New York: Wiley.
31. Hickok G, Poeppel D (2007) The cortical organization of speech processing. Nat Rev Neurosci 8:393-402. CrossRef Medline
32. Jerbi K, Ossandón T, Hamamé CM, Senova S, Dalai SS, Jung J, Minotti L, Bertrand O, Berthoz A, Kahane P, Lachaux JP (2009) Task-related gamma-band dynamics from an intracerebral perspective: review and implications for surface EEG and MEG. Hum Brain Mapp 30:1758-1771. CrossRef Medline
33. Johnson EK, Jusczyk PW (2001) Word segmentation by 8-month-olds: when speech cues count more than statistics. J Mem Lang 44:548-567. CrossRef
34. Kiebel SJ, von Kriegstein K, Daunizeau J, Friston KJ (2009) Recognizing sequences of sequences. PLoS Comput Biol 5:e 1000464. CrossRef Medline
35. Kikuchi Y, Horwitz B, Mishkin M (2010) Hierarchical auditory processing directed rostrally along the monkey's supratemporal plane. J Neurosci 30:13021-13030. CrossRef Medline
36. Kurumada C, Meylan SC, Frank MC (2013) Zipfian frequency distributions facilitate word segmentation in context. Cognition 127:439-453. CrossRef Medline
37. Leaver AM, Rauschecker JP (2010) Cortical representation of natural complex sounds: effects of acoustic features and auditory object category. J Neurosci 30:7604-7612. CrossRef Medline
38. Leonard MK, Chang EF (2014) Dynamic speech representations in the human temporal lobe. Trends Cogn Sci 18:472-479. CrossRef Medline
39. Lipinski J, Gupta P (2005) Does neighborhood density influence repetition latency for nonwords? Separating the effects of density and duration. J Mem Lang 52:171-192. CrossRef
40. Machens CK, Wehr MS, Zador AM (2004) Linearity of cortical receptive fields measured with natural sounds. J Neurosci 24:1089-1100. CrossRef Medline
41. Margoliash D, Fortune ES (1992) Temporal and harmonic combination-sensitive neurons in the zebra finch's HVc. J Neurosci 12:4309-4326. Medline
42. Marslen-Wilson WD (1987) Functional parallelism in spoken word-recognition. Cognition 25:71-102. CrossRef Medline
43. McQueen JM (1998) Segmentation of continuous speech using phonotac-tics. J Mem Lang 39:21-46. CrossRef
44. Mesgarani N, Chang EF (2012) Selective cortical representation of attended speaker in multi-talker speech perception. Nature 485:233-236. CrossRef Medline
45. Mesgarani N, Cheung C, Johnson K, Chang EF (2014) Phonetic feature encoding in human superior temporal gyrus. Science 343:1006-1010. CrossRef Medline
46. Newman RS, Sawusch JR, Wunnenberg T (2011) Cues and cue interactions in segmenting words in fluent speech. J Mem Lang 64:460-476. CrossRef
47. Obleser J, Zimmermann J, Van Meter J, Rauschecker JP (2007) Multiple stages of auditory speech perception reflected in event-related FMRI. Cereb Cortex 17:2251-2257. CrossRef Medline
48. Pasley BN, David SV, Mesgarani N, Flinker A, Shamma SA, Crone NE, Knight RT, Chang EF (2012) Reconstructing speech from human auditory cortex. PLoS Biol 10:el001251. CrossRef Medline
49. Pelucchi B, Hay JF, Saffran JR (2009) Learning in reverse: eight-month-old infants track backward transitional probabilities. Cognition 113:244-247. CrossRef Medline
50. Perruchet P, Desaulty S (2008) A role for backward transitional probabilities in word segmentation? Mem Cognit 36:1299-1305. CrossRef Medline
51. Pitt MA, McQueen JM (1998) Is compensation for coarticulation mediated by the lexicon? J Mem Lang 39:347-370. CrossRef
52. Pitt MA, Samuel AG (1995) Lexical and sub lexical feedback in auditory word recognition. Cogn Psychol 29:149-188. CrossRef Medline
53. Poeppel D, Idsardi WJ, van Wassenhove V (2008) Speech perception at the interface of neurobiology and linguistics. Philos Trans R Soc B Biol Sci 363:1071-1086. CrossRef Medline
54. Prabhakaran R, Blumstein SE, Myers EB, Hutchison E, Britton B (2006) An event-related fMRI investigation of phonological-lexical competition. Neuropsychologia 44:2209-2221. CrossRef Medline
55. Sadagopan S, Wang X (2009) Nonlinear spectrotemporal interactions underlying selectivity for complex sounds in auditory cortex. J Neurosci 29:11192-11202. CrossRef Medline
56. Saffran JR, Aslin RN, Newport EL (1996) Statistical learning by 8-month-old infants. Science 274:1926-1928. CrossRef Medline
57. Steinschneider M (2013) Phonemic representations and categories. In: Neural correlates of auditory cognition, pp 151-191. New York: Springer.
58. Steinschneider M, Fishman YI (2011) Enhanced physiologic discriminabil-ity of stop consonants with prolonged formant transitions in awake monkeys based on the tonotopic organization of primary auditory cortex. Hear Res 271:103-114. CrossRef Medline
59. Steinschneider M, Nourski KV, Kawasaki H, Oya H, Brugge JF, Howard MA 3rd (2011) Intracranial study of speech-elicited activity on the human posterolateral superior temporal gyrus. Cereb Cortex 21:2332-2347. CrossRef Medline
60. Theunissen FE, David SV, Singh NC, Hsu A, Vinje WE, Gallant JL (2001) Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli. Netw Comput Neural Syst 12:289-316. CrossRef Medline
61. Travis KE, Leonard MK, Chan AM, Torres C, Sizemore ML, Qu Z, Eskandar E, Dale AM, Elman JL, Cash SS, Halgren E (2013) Independence of early speech processing from word meaning. Cereb Cortex 23:2370-2379. CrossRef Medline
62. Tremblay P, Baroni M, Hasson U (2013) Processing of speech and nonspeech sounds in the supratemporal plane: auditory input preference does not predict sensitivity to statistical structure. Neuroimage 66:318-332. CrossRef Medline
63. Turkeltaub PE, Coslett HB (2010) Localization of sub lexical speech perception components. Brain Lang 114:1-15. CrossRef Medline
64. Ulanovsky N, Las L, Nelken I (2003) Processing of low-probability sounds by cortical neurons. Nat Neurosci 6:391-398. CrossRef Medline
65. Vaden K, Halpin H, Hickok G (2009) Irvine phonotactic online dictionary, version 2.0 [Data file].
66. Vitevitch MS, Luce PA (1999) Probabilistic phonotactics and neighborhood activation in spoken word recognition. J Mem Lang 40:374-408. CrossRef
67. Vitevitch MS, Luce PA (2005) Increases in phonotactic probability facilitate spoken nonword repetition. J Mem Lang 52:193-204. CrossRef
68. Vitevitch MS, Luce PA, Pisoni DB, Auer ET (1999) Phonotactics, neighborhood activation, and lexical access for spoken words. Brain Lang 68:306-311. CrossRef Medline
69. Winkler I, Denham SL, Nelken I (2009) Modeling the auditory scene: predictive regularity representations and perceptual objects. Trends Cogn Sci 13:532-540. CrossRef Medline
70. Yang T, Shadlen MN (2007) Probabilistic reasoning by neurons. Nature 447:1075-1080. CrossRef Medline
71. Yaron A, Hershenhoren I, Nelken I (2012) Sensitivity to complex statistical regularities in rat auditory cortex. Neuron 76:603-615. CrossRef Medline
72. Yildiz IB, von Kriegstein K, Kiebel SJ (2013) From birdsong to human speech recognition: Bayesian inference on a hierarchy of nonlinear dynamical systems. PLoS Comput Biol 9:el003219. CrossRef Medline