Structured neuronal encoding and decoding of human speech features

Nature Communications

Volumn 3, Issue , 2012, Pages

  Tankus, Ariel ^a,b   Fried, Itzhak ^a,c,d   Shoham, Shy ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^c TEL AVIV SOURASKY MEDICAL CENTER   (Israel)

^d TEL AVIV UNIVERSITY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN COMPUTER INTERFACE; CELL POPULATION; CLINICAL ARTICLE; CONSONANT; FEMALE; HUMAN; MALE; MOTOR CORTEX; NERVE CELL NETWORK; PARALYSIS; PHONETICS; SPEECH; SPEECH ARTICULATION; SUPERIOR TEMPORAL GYRUS; TASK PERFORMANCE; VOWEL;

EID: 84866128107     PISSN: None     EISSN: 20411723     Source Type: Journal    
DOI: 10.1038/ncomms1995     Document Type: Article

References (35)

1. International Phonetic Association. Handbook of the International Phonetic Association (Cambridge University Press, 1999).
2. Sahin, N. T., Pinker, S., Cash, S. S., Schomer, D. & Halgren, E. Sequential processing of lexical, grammatical, and phonological information within Broca's area. Science 326, 445-449 (2009).
3. Hickok, G., Houde, J. & Rong, F. Sensorimotor integration in speech processing: computational basis and neural organization. Neuron 69, 407-422 (2011).
4. Ghosh, S. S., Tourville, J. A. & Guenther, F. H. A neuroimaging study of premotor lateralization and cerebellar involvement in the production of phonemes and syllables. J. Speech Lang. Hear. Res. 51, 1183-1202 (2008).
5. Halgren, E. et al. Spatiotemporal stages in face and word-processing. 2. Depth- recorded potentials in the human frontal and rolandic cortices. J. Physiol. Paris 88, 51-80 (1994). (Pubitemid 24120247)
6. Paus, T., Petrides, M., Evans, A. C. & Meyer, E. Role of the human anterior cingulate cortex in the control of oculomotor, manual, and speech responses: a positron emission tomography study. J. Neurophysiol. 70, 453-469 (1993). (Pubitemid 23239179)
7. Sabri, M. et al. Attentional and linguistic interactions in speech perception. Neuroimage 39, 1444-1456 (2008).
8. Buchsbaum, B. R., Hickok, G. & Humphries, C. Role of left posterior superior temporal gyrus in phonological processing for speech perception and production. Cognitive Sci. 25, 663-678 (2001). (Pubitemid 33692685)
9. Ojemann, G. A., Creutzfeldt, O., Lettich, E. & Haglund, M. M. Neuronal activity in human lateral temporal cortex related to short-term verbal memory, naming and reading. Brain 111 (Pt 6), 1383-1403 (1988). (Pubitemid 19028459)
10. Georgopoulos, A. P., Kalaska, J. F., Caminiti, R. & Massey, J. T. On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J. Neurosci. 2, 1527-1537 (1982). (Pubitemid 13178240)
11. Georgopoulos, A. P., Schwartz, A. B. & Kettner, R. E. Neuronal population coding of movement direction. Science 233, 1416-1419 (1986). (Pubitemid 17169374)
12. Hahnloser, R. H. R., Kozhevnikov, A. A. & Fee, M. S. An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature 419, 65-70 (2002). (Pubitemid 34987870)
13. Quian-Quiroga, R., Reddy, L., Kreiman, G., Koch, C. & Fried, I. Invariant visual representation by single neurons in the human brain. Nature 435, 1102-1107 (2005). (Pubitemid 40910517)
14. Tankus, A. & Fried, I. Visuomotor coordination and motor representation by human temporal lobe neurons. J. Cogn. Neurosci. 24, 600-610 (2011).
15. Hayden, B. Y., Heilbronner, S. R., Pearson, J. M. & Platt, M. L. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J. Neurosci. 31, 4178-4187 (2011).
16. Wallis, J. D. Cross-species studies of orbitofrontal cortex and value-based decision-making. Nat. Neurosci. 15, 13-19 (2012).
17. Hickok, G. & Poeppel, D. The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393-402 (2007). (Pubitemid 46652465)
18. Hickok, G. Computational neuroanatomy of speech production. Nat. Rev. Neurosci. 13, 135-145 (2012).
19. Guenther, F. H. & Vladusich, T. A neural theory of speech acquisition and production. J. Neurolinguistics 25, 408-422 (2012).
20. Cavada, C., Company, T., Tejedor, J., Cruz-Rizzolo, R. J. & Reinoso-Suarez, F. The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb. Cortex 10, 220-242 (2000). (Pubitemid 30159290)
21. Carmichael, S. T. & Price, J. L. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 363, 642-664 (1995). (Pubitemid 26028726)
22. Brumberg, J. S., Wright, E. J., Andreasen, D. S., Guenther, F. H. & Kennedy, P. R. Classification of intended phoneme production from chronic intracortical microelectrode recordings in speech-motor cortex. Front Neurosci. 5, 65 (2011).
23. Guenther, F. H. et al. A wireless brain-machine interface for real-time speech synthesis. PLoS ONE 4, e8218 (2009).
24. Brumberg, J. S., Nieto-Castanon, A., Kennedy, P. R. & Guenther, F. H. Brain-computer interfaces for speech communication. Speech Commun. 52, 367-379 (2010).
25. Pasley, B. N. et al. Reconstructing speech from human auditory cortex. PLoS Biol. 10, e1001251 (2012).
26. Pei, X., Barbour, D. L., Leuthardt, E. C. & Schalk, G. Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans. J. Neural Eng. 8, 046028 (2011).
27. Leuthardt, E. C. et al. Using the electrocorticographic speech network to control a brain-computer interface in humans. J. Neural Eng. 8, 036004 (2011).
28. Formisano, E., De Martino, F., Bonte, M. & Goebel, R. 'Who' is saying 'what'? Brain-based decoding of human voice and speech. Science 322, 970-973 (2008).
29. Fried, I. et al. Cerebral microdialysis combined with single-neuron and electroencephalographic recording in neurosurgical patients. J. Neurosurg. 91, 697-705 (1999). (Pubitemid 30133472)
30. Quian-Quiroga, R., Nadasdy, Z. & Ben-Shaul, Y. Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering. Neural Comput. 16, 1661-1687 (2004). (Pubitemid 38835137)
31. Tankus, A., Yeshurun, Y. & Fried, I. An automatic measure for classifying clusters of suspected spikes into single cells versus multiunits. J. Neural Eng. 6, 056001 (2009).
32. McCormick, L. M. et al. Anterior cingulate cortex: an MRI-based parcellation method. NeuroImage 32, 1167-1175 (2006). (Pubitemid 44278678)
33. Benjamini, Y. & Hochberg, Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B Methodological 57, 289-300 (1995).
34. van den Berg, E. & Friedlander, M. P. Probing the pareto frontier for basis pursuit solutions. SIAM J. Sci. Comput. 31, 890-912 (2008).
35. Tankus, A., Fried, I. & Shoham, S. Sparse decoding of multiple spike trains for brain-machine interfaces. J. Neural Eng. 9 (in press) (2012).