The auditory representation of speech sounds in human motor cortex

eLife

Volumn 5, Issue MARCH2016, 2016, Pages

  Cheung, Connie ^a,b   Hamiton, Liberty S ^a,b   Johnson, Keith ^c   Chang, Edward F ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITORY CORTEX; HUMAN; HUMAN EXPERIMENT; MOTOR CORTEX; SOUND; SPEECH; ANATOMY AND HISTOLOGY; AUDITORY STIMULATION; BRAIN MAPPING; HEARING; PHONETICS; PHYSIOLOGY;

ACOUSTIC STIMULATION; AUDITORY CORTEX; AUDITORY PERCEPTION; BRAIN MAPPING; HUMANS; MOTOR CORTEX; PHONETICS;

EID: 84962316932     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.12577     Document Type: Article

References (53)

1. Aertsen A, Johannesma P. 1981. The spectro-temporal receptive field. Biological Cybernetics 42:133–143. Available at http://www.springerlink.com/index/N1J6Q78Q6N7843H4.pdf. Accessed July 29, 2011. doi: 10.1007/BF00336731.
2. Alho J, Sato M, Sams M, Schwartz J. 2012. Enhanced early-latency electromagnetic activity in the left premotor cortex is associated with successful phonetic categorization. NeuroImage 60:1937–1946. doi: 10.1016/j.neuroimage.2012.02.011.
3. Benjamini Y, Hochberg Y. 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B 57:289–300. Available at: http://www.jstor.org/stable/2346101.
4. Boatman D, Lesser RP, Gordon B. 1995. Auditory speech processing in the left temporal lobe: an electrical interference study. Brain and Language 51:269–290. doi: 10.1006/brln.1995.1061.
5. Bouchard KE, Mesgarani N, Johnson K, Chang EF. 2013. Functional organization of human sensorimotor cortex for speech articulation. Nature 495:327–332. Available at: http://www.ncbi.nlm.nih.gov/pubmed/23426266. [Accessed September 19, 2013]. doi: 10.1038/nature11911.
6. Brown S, Ngan E, Liotti M. 2008. A larynx area in the human motor cortex. Cerebral Cortex 18:837–845. doi: 10.1093/cercor/bhm131.
7. Chang EF, Edwards E, Nagarajan SS, Fogelson N, Dalal SS, Canolty RT, Kirsch HE, Barbaro NM, Knight RT. 2011. Cortical spatio-temporal dynamics underlying phonological target detection in humans. Journal of Cognitive Neuroscience 23:1437–1446. doi: 10.1162/jocn.2010.21466.
8. Chang EF. 2015. Towards large-scale, human-based, mesoscopic neurotechnologies. Neuron 86:68–78. Available at: http://linkinghub.elsevier.com/retrieve/pii/S0896627315002615. doi: 10.1016/j.neuron.2015.03.037.
9. Chevillet M, Jiang X, Rauschecker JP, Riesenhuber M. 2013. Automatic phoneme category selectivity in the dorsal auditory stream. Journal of Neuroscience 33:5208–5215. doi: 10.1523/JNEUROSCI.1870-12.2013.
10. Cogan GB, Thesen T, Carlson C, Doyle W, Devinsky O, Pesaran B. 2014. Sensory–motor transformations for speech occur bilaterally. Nature 507:94–98. Available at: http://www.nature.com/nature/journal/vaop/ncurrent/pdf/nature12935.pdf. [Accessed March 23, 2014]. doi: 10.1038/nature12935.
11. Crone NE, Miglioretti DL, Gordon B, Lesser RP. 1998. Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. event-related synchronization in the gamma band. Brain 121:2301–2315. doi: 10.1093/brain/121.12.2301
12. di Pellegrino G, Fadiga L, Fogassi L, Gallese V, Rizzolatti G. 1992. Understanding motor events: a neurophysiological study. Experimental Brain Research 91:176–180. doi: 10.1007/BF00230027.
13. Du Y, Buchsbaum BR, Grady CL, Alain C. 2014. Noise differentially impacts phoneme representations in the auditory and speech motor systems. Proceedings of the National Academy of Sciences of the United States of America 111:7126–7131. doi: 10.1073/pnas.1318738111.
14. Edwards E, Nagarajan SS, Dalal SS, Canolty RT, Kirsch HE, Barbaro NM, Knight RT. 2010. Spatiotemporal imaging of cortical activation during verb generation and picture naming. NeuroImage 50:291–301. doi: 10.1016/j.neuroimage.2009.12.035.
15. Edwards E, Soltani M, Kim W, Dalal SS, Nagarajan SS, Berger MS, Knight RT. 2009. Comparison of time- frequency responses and the event-related potential to auditory speech stimuli in human cortex. Journal of Neurophysiology 102:377–386. Available at http://jn.physiology.org/content/102/1/377. [Accessed November 21, 2014]. doi: 10.1152/jn.90954.2008.
16. Formisano E, De MF, Bonte M, Goebel R. 2008. "Who" is saying "what"? brain-based decoding of human voice and speech. Science 322:970–973. doi: 10.1126/science.1164318.
17. Gallese V, Fadiga L, Fogassi L, Rizzolatti G. 1996. Action recognition in the premotor cortex. Brain 119:593–609. doi: 10.1093/brain/119.2.593.
18. Garofolo JS, Lamel LF, Fisher WF, Fiscus JG, Pallett DS, Dahlgren NL, Zue V. 1993. TIMIT Acoustic-Phonetic Continuous Speech Corpus. Philadelphia: Linguist Data Consortium.
19. Guenther FH, Ghosh SS, Tourville JA. 2006. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain and Language 96:280–301. doi: 10.1016/j.bandl.2005.06.001.
20. Hartigan J, Hartigan PM. 1985. The dip test of unimodality. Annals of Statistics 13:70–84.
21. Henschke JU, Noesselt T, Scheich H, Budinger E. 2015. Possible anatomical pathways for short-latency multisensory integration processes in primary sensory cortices. Brain Structure & Function 220. doi: 10.1007/s00429-013-0694-4.
22. Hickok G, Houde J, Rong F. 2011. Sensorimotor integration in speech processing: computational basis and neural organization. Neuron 69:407–422. doi: 10.1016/j.neuron.2011.01.019.
23. Hickok G, Poeppel D. 2007. The cortical organization of speech processing. Nature Reviews Neuroscience 8: 393–402. doi: 10.1038/nrn2113.
24. Houde JF, Nagarajan SS. 2011. Speech production as state feedback control. Frontiers in Human Neuroscience 5:82. doi: 10.3389/fnhum.2011.00082.
25. Hubert L, Arabie P. 1985. Comparing partitions. Journal of Classification 2:193–218. doi: 10.1007/BF01908075.
26. Kalogeratos A, Likas A. 2012. Dip-means: an incremental clustering method for estimating the number of clusters. Advances in Neural Information Processing Systems:2402–2410.
27. Klein DJ, Simon JZ, Shamma S. 2000. Robust spectrotemporal reverse correlation for the auditory system: optimizing stimulus design. Journal of Computational Neuroscience 9:85–111. Available at: http://www.ncbi.nlm.nih.gov/pubmed/10946994. doi: 10.1023/A:1008990412183.
28. Ladefoged P, Johnson K. 2010. A Course in Phonetics. Boston, MA: Cengage Learning.
29. Liberman AM, Cooper FS, Shankweiler DP, Studdert-Kennedy M. 1967. Perception of the speech code. Psychological Review 74:431–461. doi: 10.1037/h0020279.
30. Liberman AM, Mattingly IG. 1985. The motor theory of speech perception revised. Cognition 21:1–36. doi: 10.1016/0010-0277(85)90021-6.
31. Lindblom B. 1996. Role of articulation in speech perception: clues from production. The Journal of the Acoustical Society of America 99:1683–1692. doi: 10.1121/1.414691.
32. Lotto AJ, Hickok GS, Holt LL. 2009. Reflections on mirror neurons and speech perception. Trends in Cognitive Sciences 13:110–114. doi: 10.1016/j.tics.2008.11.008.
33. Mesgarani N, Cheung C, Johnson K, Chang EF. 2014. Phonetic feature encoding in human superior temporal gyrus. Science 343:1006–1010. Available at: http://www.ncbi.nlm.nih.gov/pubmed/24482117. doi: 10.1126/science.1245994.
34. Nelson A, Schneider DM, Takatoh J, Sakurai K, Wang F, Mooney R. 2013. A circuit for motor cortical modulation of auditory cortical activity. Journal of Neuroscience 33:14342–14353. doi: 10.1523/JNEUROSCI.2275-13.2013.
35. Ojemann G, Ojemann J, Lettich E, Berger M. 1989. Cortical language localization in left, dominant hemisphere. Journal of Neurosurgery 71:316–326. doi: 10.3171/jns.1989.71.3.0316.
36. Penfield W, Boldrey E. 1937. Somatic motor and sensory representation in the cerebral cortex of man studied by electrical stimulation. Brain 60:389–443. doi: 10.1093/brain/60.4.389.
37. Pulvermüller F, Fadiga L. 2010. Active perception: sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience 11:351–360. doi: 10.1038/nrn2811.
38. Pulvermüller F, Huss M, Kherif F, Moscoso del Prado Martin F, Hauk O, Shtyrov Y. 2006. Motor cortex maps articulatory features of speech sounds. Proceedings of the National Academy of Sciences of the United States of America 103:7865–7870. doi: 10.1073/pnas.0509989103.
39. Rand W. 1971. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association 66:846–850. doi: 10.1080/01621459.1971.10482356.
40. Rauschecker JP, Scott SK. 2009. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nature Neuroscience 12:718–724. doi: 10.1038/nn.2331.
41. Ray S, Maunsell JHR. 2011. Different origins of gamma rhythm and high-gamma activity in macaque visual cortex. PLoS Biology 9:e1000610. Available at: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3075230&tool=pmcentrez&rendertype=abstract. [Accessed September 26, 2013]. doi: 10.1371/journal.pbio.1000610.
42. Rizzolatti G, Craighero L. 2004. The mirror-neuron system. Annual Review of Neuroscience 27:169–192. doi: 10.1146/annurev.neuro.27.070203.144230.
43. Schneider DM, Nelson A, Mooney R. 2014. A synaptic and circuit basis for corollary discharge in the auditory cortex. Nature 513:189–194. doi: 10.1038/nature13724.
44. Scott SK, Mcgettigan C, Eisner F. 2009. A little more conversation, a little less action — candidate roles for the motor cortex in speech perception. Nature Reviews Neuroscience 10:295–302. doi: 10.1038/nrn2603.
45. Steinschneider M, Fishman Y, Arezzo J. 2008. Spectrotemporal analysis of evoked and induced electroencephalographic responses in primary auditory cortex (a1) of the awake monkey. Cerebral Cortex 18: 610–625. doi: 10.1093/cercor/bhm094.
46. Steinschneider M, Nourski KV, Kawasaki H, Oya H, Brugge JF, Howard MA. 2011. Intracranial study of speech- elicited activity on the human posterolateral superior temporal gyrus. Cerebral Cortex 21:2332–2347. doi: 10.1093/cercor/bhr014.
47. Theunissen FE, David SV, Singh NC, Hsu A, Vinje WE, Gallant JL. 2001. Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli. Network: Computation in Neural Systems 12:289–316. Available at: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db= PubMed&dopt=Citation&list_uids=11563531. doi: 10.1080/net.12.3.289.316.
48. Tkach D, Reimer J, Hatsopoulos NG. 2007. Congruent activity during action and action observation in motor cortex. Journal of Neuroscience 27:13241–13250. doi: 10.1523/JNEUROSCI.2895-07.2007.
49. Wang K, Shamma S. 1994. Self-normalization and noise-robustness in early auditory representations. IEEE Transactions on Speech and Audio Processing 2:421–435. doi: 10.1109/89.294356.
50. Wild CJ, Yusuf A, Wilson DE, Peelle JE, Davis MH, Johnsrude IS. 2012. Effortful listening: the processing of degraded speech depends critically on attention. Journal of Neuroscience 32:14010–14021. doi: 10.1523/JNEUROSCI.1528-12.2012.
51. Wilson SM, Saygin AP, Sereno MI, Iacoboni M. 2004. Listening to speech activates motor areas involved in speech production. Nature Neuroscience 7:701–702. doi: 10.1038/nn1263.
52. Woolley SMN, Gill PR, Theunissen FE. 2006. Stimulus-dependent auditory tuning results in synchronous population coding of vocalizations in the songbird midbrain. Journal of Neuroscience 26:2499–2512. Available at: http://www.ncbi.nlm.nih.gov/pubmed/16510728. [Accessed September 29, 2013]. doi: 10.1523/NEUROSCI.3731-05.2006.
53. Zatorre RJ, Chen JL, Penhune VB. 2007. When the brain plays music: auditory–motor interactions in music perception and production. Nature Reviews Neuroscience 8:547–558. doi: 10.1038/nrn2152