From speech to thought: The neuronal basis of cognitive units in non-experimental, real-life communication investigated using ECoG

Frontiers in Human Neuroscience

Volumn 8, Issue JUNE, 2014, Pages

  Derix, Johanna ^a,b   Iljina, Olga ^a,b   Weiske, Johanna ^a,b   Schulze Bonhage, Andreas ^a,b   Aertsen, Ad ^b   Ball, Tonio ^a,b  

^a UNIVERSITY OF FREIBURG   (Germany)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Autobiographical memory; Electrocorticography; High gamma mapping; Idea unit; Natural behavior; Parietal cortex; Prefrontal cortex; Speech production

Indexed keywords

ALPHA FREQUENCY; ARTICLE; BRAIN MAPPING; BRAIN REGION; CASE REPORT; COGNITION; ELECTROCORTICOGRAPHY; FEMALE; HUMAN; MALE; RADIOFREQUENCY; STIMULUS RESPONSE; THETA FREQUENCY; VERBAL COMMUNICATION;

EID: 84902595261     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00383     Document Type: Article

References (90)

1. Auer, P. (2010). "Zum Segmentierungsproblem in der Gesprochenen Sprache," in InLiSt - Interaction and Linguistic Structures 49, 1-19. Available online at: http://www.inlist.uni-bayreuth.de/issues/49/InList49.pdf
2. Baddeley, A. (2000). The episodic buffer: a new component of working memory? Trends Cogn. Sci. 4, 417-423. doi: 10.1016/S1364-6613(00)01538-2
3. Ball, T., Demandt, E., Mutschler, I., Neitzel, E., Mehring, C., Vogt, K., et al. (2008). Movement related activity in the high gamma range of the human EEG. Neuroimage 41, 302-310. doi: 10.1016/j.neuroimage.2008.02.032
4. Ball, T., Kern, M., Mutschler, I., Aertsen, A., and Schulze-Bonhage, A. (2009). Signal quality of simultaneously recorded invasive and non-invasive EEG. Neuroimage 46, 708-716. doi: 10.1016/j.neuroimage.2009.02.028
5. Bangerter, A. (2000). Identifying individual and collective acts of remembering in task-related communication. Disc. Process. 30, 237-264. doi: 10.1207/S15326950dp3003_2
6. Bauer, P. R., Vansteensel, M. J., Bleichner, M. G., Hermes, D., Ferrier, C. H., Aarnoutse, E. J., et al. (2013). Mismatch between electrocortical stimulation and electrocorticography frequency mapping of language. Brain Stimul. 6, 524-531. doi: 10.1016/j.brs.2013.01.001
7. Benjamini, Y., and Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Stat. 29, 1165-1188. Available online at: http://www.jstor.org/stable/2674075
8. Boersma, P., and Weenink, D. (2014). Praat: Doing Phonetics by Computer [Computer program]. Version 5.3.77. Available online at: http://www.praat.org
9. Bonnici, H. M., Chadwick, M. J., Lutti, A., Hassabis, D., Weiskopf, N., and Maguire, E. A. (2012). Detecting representations of recent and remote autobiographical memories in vmPFC and hippocampus. J. Neurosci. 32, 16982-16991. doi: 10.1523/JNEUROSCI.2475-12.2012
10. Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., and Babiloni, F. (2012). Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. doi: 10.1016/j.neubiorev.2012.10.003. [Epub ahead of print].
11. Bouchard, K. E., Mesgarani, N., Johnson, K., and Chang, E. F. (2013). Functional organization of human sensorimotor cortex for speech articulation. Nature 495, 327-332. doi: 10.1038/nature11911
12. Braun, A. R., Guillemin, A., Hosey, L., and Varga, M. (2001). The neural organization of discourse: an H2 15O-PET study of narrative production in English and American sign language. Brain 124, 2028-2044. doi: 10.1093/brain/124.10.2028
13. Brunel, N. (2000). Dynamics of networks of randomly connected excitatory and inhibitory spiking neurons. J. Physiol. Paris. 94, 445-463. doi: 10.1016/S0928-4257(00)01084-6
14. Brunel, N., and Hakim, V. (1999). Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Comput. 11, 1621-1671. doi: 10.1162/089976699300016179
15. Burke, J. F., Long, N. M., Zaghloul, K. A., Sharan, A. D., Sperling, M. R., and Kahana, M. J. (2013). Human intracranial high-frequency activity maps episodic memory formation in space and time. Neuroimage 85, 834-843. doi: 10.1016/j.neuroimage.2013.06.067
16. Cabeza, R., and St Jacques, P. (2007). Functional neuroimaging of autobiographical memory. Trends Cogn. Sci. 11, 219-227. doi: 10.1016/j.tics.2007.02.005
17. Canolty, R. T., Soltani, M., Dalal, S. S., Edwards, E., Dronkers, N. F., Nagarajan, S. S., et al. (2007). Spatiotemporal dynamics of word processing in the human brain. Front. Neurosci. 1, 185-196. doi: 10.3389/neuro.01.1.1. 014.2007
18. Caruana, F., Cantalupo, G., Russo, G. L., Mai, R., Sartori, I., and Avanzini, P. (2013). Human cortical activity evoked by gaze shift observation: an intracranial EEG study. Hum. Brain Mapp. 35, 1515-1528. doi: 10.1002/hbm. 22270
19. Caspers, S., Geyer, S., Schleicher, A., Mohlberg, H., Amunts, K., and Zilles, K. (2006). The human inferior parietal cortex: cytoarchitectonic parcellation and interindividual variability. Neuroimage 33, 430-448. doi: 10.1016/j.neuroimage.2006.06.054
20. Chafe, W. L. (1980). "The deployment of consciousness in the construction of narrative," in The Pear Stories: Cognitive, Cultural, and Linguistic Aspects of Narrative Production, ed W. Chafe (New York, NY: Ablex), 353-387.
21. Chafe, W. (1984). How people use adverbial clauses Proc. Annu. Meet. Berkeley Linguist. Soc. 10, 437-449.
22. Chafe, W. L. (1985). "Linguistic differences produced by differences between speaking and writing," in Literacy, Language, and Learning, eds D. R. Olson, N. Torrance, and A. Hildyard (Camebridge: CUP), 9-50.
23. Chafe, W. (1994). Discourse, Consciousness, and Time: the Flow and Displacement of Conscious Experience in Speaking and Writing. Chicago: University of Chicago Press.
24. Chafe, W. (2000). A linguist's perspective on William James and "the stream of thought". Conscious. Cogn. 9, 618-628. doi: 10.1006/ccog.2000.0490
25. Chafe, W. (2012). "From thoughts to sounds," in Routledge Handbook of Discourse Analysis, eds P. Gee and M. Handford (London; New York: Routledge), 357-365.
26. Cheyne, D., Bells, S., Ferrari, P., Gaetz, W., and Bostan, A. C. (2008). Self-paced movements induce high-frequency gamma oscillations in primary motor cortex. Neuroimage 42, 332-342. doi: 10.1016/j.neuroimage.2008.04.178
27. Cristofori, I., Moretti, L., Harquel, S., Posada, A., Deiana, G., Isnard, J., et al. (2012). Theta signal as the neural signature of social exclusion. Cereb. Cortex 23, 2437-2447. doi: 10.1093/cercor/bhs236
28. Crone, N. E., Boatman, D., Gordon, B., and Hao, L. (2001a). Induced electro-corticographic gamma activity during auditory perception. Brazier Award-winning article, 2001. Clin. Neurophysiol. 112, 565-582. doi: 10.1016/S1388-2457(00)00545-9
29. Crone, N. E., Hao, L., Hart, J. Jr., Boatman, D., Lesser, R. P., Irizarry, R., et al. (2001b). Electrocorticographic gamma activity during word production in spoken and sign language. Neurology 57, 2045-2053. doi: 10.1212/WNL.57.11.2045
30. Crone, N. E., Korzeniewska, A., and Franaszczuk, P. J. (2011). Cortical γ responses: searching high and low. Int. J. Psychophysiol. 79, 9-15. doi: 10.1016/j.ijpsycho.2010.10.013
31. Crone, N. E., Miglioretti, D. L., Gordon, B., and Lesser, R. P. (1998). Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. Brain J. Neurol. 121(pt 12), 2301-2315. doi: 10.1093/brain/121.12.2301
32. Cuc, A., Ozuru, Y., Manier, D., and Hirst, W. (2006). On the formation of collective memories: the role of a dominant narrator. Mem. Cognit. 34, 752-762. doi: 10.3758/BF03193423
33. Derix, J., Iljina, O., Schulze-Bonhage, A., Aertsen, A., and Ball, T. (2012). "Doctor" or "darling"? Decoding the communication partner from ECoG of the anterior temporal lobe during non-experimental, real-life social interaction. Front. Hum. Neurosci. 6:251. doi: 10.3389/fnhum.2012.00251
34. Dritschel, B. (1991). Autobiographical memory in natural discourse - a methodological note. Appl. Cogn. Psychol. 5, 319-330. doi: 10.1002/acp.2350050403
35. Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., et al. (2005). A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage 25, 1325-1335. doi: 10.1016/j.neuroimage.2004.12.034
36. Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychol. Bull. 76, 378-382. doi: 10.1037/h0031619
37. Fogassi, L., Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., and Rizzolatti, G. (2005). Parietal lobe: from action organization to intention understanding. Science 308, 662-667. doi: 10.1126/science.1106138
38. Friston, K. J., Jezzard, P., and Turner, R. (1994). Analysis of functional MRI time-series. Hum. Brain Mapp. 1, 153-171. doi: 10.1002/hbm.460010207
39. Gibbons, J. D. (2003). Nonparametric Statistical Inference. New York, NY: Marcel Dekker.
40. Gierthmuehlen, M., Ball, T., Henle, C., Wang, X., Rickert, J., Raab, M., et al. (2011). Evaluation of μECoG electrode arrays in the minipig: experimental procedure and neurosurgical approach. J. Neurosci. Methods 202, 77-86. doi: 10.1016/j.jneumeth.2011.08.021
41. Helias, M., Tetzlaff, T., and Diesmann, M. (2013). Echoes in correlated neural systems. New J. Phys. 15:023002. doi: 10.1088/1367-2630/15/2/023002
42. Heusinger, K. (1999). Intonation and Information Structure. Konstanz: Habilitation University of Konstanz.
43. Jensen, O., Kaiser, J., and Lachaux, J.-P. (2007). Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci. 30, 317-324. doi: 10.1016/j.tins.2007.05.001
44. Johnson, S. C., Baxter, L. C., Wilder, L. S., Pipe, J. G., Heiserman, J. E., and Prigatano, G. P. (2002). Neural correlates of self-reflection. Brain J. Neurol. 125, 1808-1814. doi: 10.1093/brain/awf181
45. Kingstone, A., Smilek, D., Ristic, J., Friesen, C. K., and Eastwood, J. D. (2003) Attention researchers! It's time to take a look at the real world. Curr. Dir. Psychol. 12, 176-184. doi: 10.1111/1467-8721.01255
46. Konvalinka, I., and Roepstorff, A. (2012). The two-brain approach: how can mutually interacting brains teach us something about social interaction? Front. Hum. Neurosci. 6:215. doi: 10.3389/fnhum.2012.00215
47. Landis, J. R., and Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159-174. doi: 10.2307/2529310
48. Leuthardt, E. C., Miller, K., Anderson, N. R., Schalk, G., Dowling, J., Miller, J., et al. (2007). Electrocorticographic frequency alteration mapping: a clinical technique for mapping the motor cortex. Neurosurgery 60, 260-270. discussion: 270-271. doi: 10.1227/01.NEU.0000255413.70807.6E
49. Maguire, E. A. (2012). Studying the freely-behaving brain with fMRI. Neuroimage 62, 1170-1176. doi: 10.1016/j.neuroimage.2012.01.009
50. Maguire, E. A., Frith, C. D., and Morris, R. G. M. (1999). The functional neuroanatomy of comprehension and memory: the importance of prior knowledge. Brain 122, 1839-1850. doi: 10.1093/brain/122.10.1839
51. Manning, J. R., Jacobs, J., Fried, I., and Kahana, M. J. (2009). Broadband shifts in LFP power spectra are correlated with single-neuron spiking in humans. J. Neurosci. 29, 13613-13620. doi: 10.1523/JNEUROSCI.2041-09.2009
52. Mar, R. A. (2011). The neural bases of social cognition and story comprehension. Annu. Rev. Psychol. 62, 103-134. doi: 10.1146/annurev-psych-120709-145406
53. Mesgarani, N., and Chang, E. F. (2012). Selective cortical representation of attended speaker in multi-talker speech perception. Nature 485, 233-236. doi: 10.1038/nature11020
54. Mitchell, J. P., Banaji, M. R., and Macrae, C. N. (2005). The link between social cognition and self-referential thought in the medial prefrontal cortex. J. Cogn. Neurosci. 17, 1306-1315. doi: 10.1162/0898929055002418
55. Muller, F., and Hirst, W. (2010). Resistance to the influences of others: limits to the formation of a collective memory through conversational remembering. Appl. Cogn. Psychol. 24, 608-625. doi: 10.1002/acp.1572
56. Neisser, U. (1978). "Memory: what are the important questions?," in Practical Aspects of Memory, eds M. M. Gruneberg, P. Morris, and R. Sykes (London: Academic Press), 3-24.
57. Ojemann, G. A., and Whitaker, H. A. (1978). Language localization and variability. Brain Lang. 6, 239-260. doi: 10.1016/0093-934X(78)90061-5
58. Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., et al. (2012). Reconstructing speech from human auditory cortex. PLoS Biol. 10:e1001251. doi: 10.1371/journal.pbio.1001251
59. Pawley, A., and Syder, F. H. (1983). "Two puzzles for linguistic theory: native-like selection and nativelike fluency," in Language and Communication, eds J. Richards and J. Schmidt (London: Longman), 191-226.
60. Pei, X., Barbour, D. L., Leuthardt, E. C., and Schalk, G. (2011). Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans. J. Neural Eng. 8:046028. doi: 10.1088/1741-2560/8/4/046028
61. Percival, D. B., and Walden, A. T. (2010). Wavelet Methods for Time Series Analysis. New Edn. Camebridge: Cambridge University Press.
62. Perrone-Bertolotti, M., Kujala, J., Vidal, J. R., Hamame, C. M., Ossandon, T., Bertrand, O., et al. (2012). How silent is silent reading? Intracerebral evidence for top-down activation of temporal voice areas during reading. J. Neurosci. Off. J. Soc. Neurosci. 32, 17554-17562. doi: 10.1523/JNEUROSCI.2982-12.2012
63. Pistohl, T., Schulze-Bonhage, A., Aertsen, A., Mehring, C., and Ball, T. (2012). Decoding natural grasp types from human ECoG. Neuroimage 59, 248-260. doi: 10.1016/j.neuroimage.2011.06.084
64. Price, C. J. (2012). A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage 62, 816-847. doi: 10.1016/j.neuroimage.2012.04.062
65. Przyrembel, M., Smallwood, J., Pauen, M., and Singer, T. (2012). Illuminating the dark matter of social neuroscience: Considering the problem of social interaction from philosophical, psychological, and neuroscientific perspectives. Front. Hum. Neurosci. 6:190. doi: 10.3389/fnhum.2012.00190
66. Pulvermüller, F., and Fadiga, L. (2010). Active perception: sensorimotor circuits as a cortical basis for language. Nat. Rev. Neurosci. 11, 351-360. doi: 10.1038/nrn2811
67. Ray, S., Crone, N. E., Niebur, E., Franaszczuk, P. J., and Hsiao, S.S. (2008). Neural correlates of high-gamma oscillations (60-200 Hz) in macaque local field potentials and their potential implications in electrocorticography. J. Neurosci. 28, 11526-11536. doi: 10.1523/JNEUROSCI.2848-08.2008
68. Ruescher, J., Iljina, O., Altenmüller, D.-M., Aertsen, A., Schulze-Bonhage, A., and Ball, T. (2013). Somatotopic mapping of natural upper-and lower-extremity movements and speech production with high gamma electrocorticography. Neuroimage 81, 164-177. doi: 10.1016/j.neuroimage.2013.04.102
69. Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., et al. (2013). Toward a second-person neuroscience. Behav. Brain Sci. 36, 393-414. doi: 10.1017/S0140525X12000660
70. Sederberg, P. B., Schulze-Bonhage, A., Madsen, J. R., Bromfield, E. B., Litt, B., Brandt, A., et al. (2007). Gamma oscillations distinguish true from false memories. Psychol. Sci. 18, 927-932. doi: 10.1111/j.1467-9280.2007.02003.x
71. Sheskin, D. J. (2007). Handbook of Parametric and Nonparametric Statistical Procedures, 4th Edn. Boca Raton: Chapman and Hall.
72. Sinai, A., Bowers, C. W., Crainiceanu, C. M., Boatman, D., Gordon, B., Lesser, R. P., et al. (2005). Electrocorticographic high gamma activity versus electrical cortical stimulation mapping of naming. Brain 128, 1556-1570. doi: 10.1093/brain/awh491
73. Spiers, H. J., and Maguire, E. A. (2006a). Spontaneous mentalizing during an interactive real world task: an fMRI study. Neuropsychologia 44, 1674-1682. doi: 10.1016/j.neuropsychologia.2006.03.028
74. Spiers, H. J., and Maguire, E. A. (2006b). Thoughts, behaviour, and brain dynamics during navigation in the real world. Neuroimage 31, 1826-1840. doi: 10.1016/j.neuroimage.2006.01.037
75. Spiers, H. J., and Maguire, E. A. (2007). Decoding human brain activity during real-world experiences. Trends Cogn. Sci. 11, 356-365. doi: 10.1016/j.tics.2007.06.002
76. Spiers, H. J., and Maguire, E. A. (2008). The dynamic nature of cognition during wayfinding. J. Environ. Psychol. 28, 232-249. doi: 10.1016/j.jenvp. 2008.02.006
77. Stafford, L., Burggraf, C. S., and Sharkey, W. F. (1987). Conversational memory the effects of time, recall, mode, and memory expectancies on remembrances of natural conversations. Hum. Commun. Res. 14, 203-229. doi: 10.1111/j.1468-2958.1987.tb00127.x
78. Stafford, L., and Daly, J. A. (1984). Conversational memory. Hum. Commun. Res. 10, 379-402. doi: 10.1111/j.1468-2958.1984.tb00024.x
79. Stanley, D. A., and Adolphs, R. (2013). Toward a neural basis for social behavior. Neuron 80, 816-826. doi: 10.1016/j.neuron.2013.10.038
80. Steinvorth, S., Wang, C., Ulbert, I., Schomer, D., and Halgren, E. (2010). Human entorhinal gamma and theta oscillations selective for remote autobiographical memory. Hippocampus 20, 166-173. doi: 10.1002/hipo.20597
81. Svoboda, E., McKinnon, M. C., and Levine, B. (2006). The functional neuroanatomy of autobiographical memory: a meta-analysis. Neuropsychologia 44, 2189-2208. doi: 10.1016/j.neuropsychologia.2006.05.023
82. Szmrecsanyi, B. (2004). "On operationalizing syntactic complexity," in Le Poids des Mots. Proceedings of the 7th International Conference on Textual Data Statistical Analysis (Louvain-la-Neuve: University of de Louvain Press), 1032-1039.
83. Thinnes-Elker, F., Iljina, O., Apostolides, J. K., Kraemer, F., Schulze-Bonhage, A., Aertsen, A., et al. (2012). Intention concepts and brain-machine interfacing. Front. Psychology 3:455. doi: 10.3389/fpsyg.2012.00455
84. Towle, V. L., Yoon, H.-A., Castelle, M., Edgar, J. C., Biassou, N. M., Frim, D. M., et al. (2008). ECoG gamma activity during a language task: differentiating expressive and receptive speech areas. Brain 131, 2013-2027. doi: 10.1093/brain/awn147
85. Toyoda, G., Brown, E. C., Matsuzaki, N., Kojima, K., Nishida, M., and Asano, E. (2014). Electrocorticographic correlates of overt articulation of 44 English phonemes: intracranial recording in children with focal epilepsy. Clin. Neurophysiol. 125, 1129-1137. doi: 10.1016/j.clinph.2013.11.008
86. van Vugt, M. K., Schulze-Bonhage, A., Litt, B., Brandt, A., and Kahana, M. J. (2010). Hippocampal gamma oscillations increase with memory load. J. Neurosci. 30, 2694-2699. doi: 10.1523/JNEUROSCI.0567-09.2010
87. Vilberg, K. L., and Rugg, M. D. (2008). Memory retrieval and the parietal cortex: a review of evidence from a dual-process perspective. Neuropsychologia 46, 1787-1799. doi: 10.1016/j.neuropsychologia.2008.01.004
88. Wagner, A. D., Shannon, B. J., Kahn, I., and Buckner, R. L. (2005). Parietal lobe contributions to episodic memory retrieval. Trends Cogn. Sci. 9, 445-453. doi: 10.1016/j.tics.2005.07.001
89. Wu, M., Wisneski, K., Schalk, G., Sharma, M., Roland, J., Breshears, J., et al. (2010). Electrocorticographic frequency alteration mapping for extra-operative localization of speech cortex. Neurosurgery 66, E407-E409. doi: 10.1227/01.NEU.0000345352.13696.6F
90. Zaki, J., and Ochsner, K. (2009). The need for a cognitive neuroscience of naturalistic social cognition. Ann. N.Y. Acad. Sci. 1167, 16-30. doi: 10.1111/j.1749-6632.2009.04601.x