Composition of brain oscillations and their functions in the maintenance of auditory, visual and audio-visual speech percepts: An exploratory study

Cognitive Processing

Volumn 8, Issue 3, 2007, Pages 183-199

  Fingelkurts, Alexander A ^a   Fingelkurts, Andrew A ^a   Krause, Christina M ^b  

^a BM Science   (Finland)

^b UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Adaptive classification; Audio visual percept maintenance; Brain functions; McGurk effect; MEG; Short term spectral patterns; Theta, alpha, beta oscillations

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; CONTROLLED STUDY; ELECTROENCEPHALOGRAPHY; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; MAGNETOENCEPHALOGRAPHY; MALE; PRIORITY JOURNAL; SPEECH; VISION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BRAIN; CEREBRAL CORTEX; DATA INTERPRETATION, STATISTICAL; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MAGNETOENCEPHALOGRAPHY; MALE; NEURAL PATHWAYS; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 34547849436     PISSN: 16124782     EISSN: 16124790     Source Type: Journal    
DOI: 10.1007/s10339-007-0175-x     Document Type: Article

References (93)

1. Alsius A, Navarra J, Campbell R, Soto-Faraco S (2005) Audiovisual integration of speech falters under high attention demands. Curr Biol 15(9):839-843
2. Arroyo S, Lesser RP, Gordon B, Uematus S, Jackson D, Webber R (1993) Functional significance of the mu rhythm of human cortex: an electrophysiological study with subdural electrodes. Electroencephalogr Clin Neurophysiol 87:76-87
3. Basar E (1999) Brain function and oscillations. Vol. II. Integrative brain function. Neurophysiology and cognitive processes. Springer, Berlin
4. Basar E, Basar-Eroglu C, Karakas S, Schurmann M (2001a) Gamma, alpha, delta, and theta oscillations govern cognitive processes. Int J Psychophysiol 39:241-248
5. Basar E, Schurmann M, Sakowitz O (2001b) The selectively distributed theta system: functions. Int J Psychophysiol 39:197-212
6. Basar E, Schurmann M, Demiralp T, Basar-Eroglu C, Ademoglu A (2001c) Event-related oscillations are 'real brain responses'-wavelet analysis and new strategies. Int J Psychophysiol 39:91-127
7. Basar E, Özgören M, Karakas S, Basar-Eroglu C (2004) Super-synergy in the brain: the grandmother percept is manifested by multiple oscillations. Int J Bifurcat Chaos 14:453-491
8. Barry RJ, Rushby JA, Janette L, Smith JL, Clarke AR, Rodney J, Croft RJ (2006) Dynamics of narrow-band EEG phase effects in the passive auditory oddball task. Eur J Neurosci 24:291
9. Bullock TH (1997) Signals and signs in the nervous system: the dynamic anatomy of electrical activity. Proc Natl Acad Sci U S A 94:1-6
10. Calvert GA (2001) Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 11:1110-1123
11. Calvert GA, Thesen T (2004) Multisensory integration: methodological approaches and emerging principles in the human brain. J Physiol (Paris) 98:191-205
12. Colin C, Radeau M, Soquet A, Demolin D, Colin F, Deltenre P (2002) Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory. Clin Neurophysiol 113:495-506
13. Courtney SM, Ungerleider LG, Keil K, Haxby JV (1997) Transient and sustained activity in a distributed neural system for human working memory. Nature 386:608-611
14. Doppelmayr M, Klimesch W, Schwaiger J, Auinger P, Winkler T (1998) Theta synchronization in the human EEG and episodic retrieval. Neurosci Lett 257:41-44
15. Duffy F, Hughes JR, Miranda F, Bernard P, Cook P (1994) Status of quantitative EEG (QEEG) in clinical practice. Clin Electroencephalogr 25:VI-XXII
16. Ernst MO, Bulthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162-169
17. Felleman DJ, Van Essen DC (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1:1-47
18. Fingelkurts AnA, Fingelkurts AlA (2004) Making complexity simpler: multivariability and metastability in the brain. Int J Neurosci 114:843-862
19. Fingelkurts AnA, Fingelkurts AlA (2005) Mapping of the brain operational architectonics. In: Chen FJ (ed) Focus on brain mapping research. Nova Science Publ, New York, pp 59-98
20. Fingelkurts AnA, Fingelkurts AlA (2006) Timing in cognition and EEG brain dynamics: discreteness versus continuity. Cogn Process 7:135-162
21. Fingelkurts AlA, Fingelkurts AnA, Krause CM, Sams M (2002) Probability interrelations between pre-/post-stimulus intervals and ERD/ERS during a memory task. Clin Neurophysiol 113:826-843
22. Fingelkurts AlA, Fingelkurts AnA, Kaplan AYa (2003a) The regularities of the discrete nature of multi-variability of EEG spectral patterns. Int J Psychophysiol 47:23-41
23. Fingelkurts AlA, Fingelkurts AnA, Krause CM, Kaplan AYa (2003b) Systematic rules underlying spectral pattern variability: experimental results and a review of the evidences. Int J Neurosci 113:1455-1481
24. Fingelkurts AnA, Fingelkurts AlA, Krause CM, Möttönen R, Sams M (2003c) Cortical operational synchrony during audio-visual speech integration. Brain Lang 85:297-312
25. Fingelkurts AlA, Fingelkurts AnA, Kaplan AYa (2006a) Stability, reliability and consistency of the compositions of brain oscillations. Int J Psychophysiol 59(2):116-126
26. Fingelkurts AlA, Fingelkurts AnA, Kaplan AYa (2006b) Interictal EEG as a physiological adaptation. Part I: composition of brain oscillations in interictal EEG. Clin Neurophysiol 117:208-222
27. Fingelkurts AA, Fingelkurts AA, Kivisaari R, Autti T, Borisov S, Puuskari V, Jokela O, Kähkönen S (2006c) Reorganization of the composition of brain oscillations and their temporal characteristics in opioid dependent patients. Prog Neuropsychopharmacol Biol Psychiatry 30(8):1453-1465
28. Friederici AD (2002) Towards a neural basis of auditory sentence processing. Trends Cogn Sci 6:78-84
29. Funahashi S, Bruce CJ, Goldman-Rakic PS (1989) Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61:331-349
30. Fuster JM, Alexander GE (1973) Firing changes in cells of the nucleus medialis dorsalis associated with delayed response behavior. Brain Res 61:79-91
31. Gazzaley A, Rissman J, D'Esposito M (2004) Functional connectivity during working memory maintenance. Cogn Affect Behav Neurosci 4(4):580-599
32. Grossberg S (2000) The complementary brain: unifying brain dynamics and modularity. Trends Cogn Sci 4:233-246
33. Gundel A, Wilson GF (1992) Topographical changes in the ongoing EEG related to the difficulty of mental tasks. Brain Topogr 5:17-25
34. Hari R, Salenius S (1999) Rhythmical corticomotor communication. Neuroreport 10:R1-R10
35. Kanwisher N, Wojciulik E (2000) Visual attention: insights from brain imaging. Nat Rev Neurosci 1:91-100
36. Kaplan AYa (1998) Nonstationary EEG: methodological and experimental analysis. Uspehi Physiologicheskih Nayk (Success Physiol Sci) 29(3):35-55 (in Russian)
37. Kaplan AYa, Fingelkurts AlA, Fingelkurts AnA, Grin' EU, Ermolaev VA (1999) Adaptive classification of dynamic spectral patterns of human EEG. J VND (J High Nerve Act) 49:416-426 (In Russian)
38. Karakas S, Erzengin O, Basar E (2000) A new strategy involving multiple cognitive paradigms demonstrates that ERP components are determined by the superposition of oscillatory responses. Clin Neurophysiol 111:1719-1732
39. King AJ, Calvert GA (2001) Multisensory integration: perceptual grouping by eye and ear. Curr Biol 11:R322-R325
40. Klimesch W (1996) Memory processes, brain oscillations and EEG synchronization. Int J Psychophysiol 24:61-100
41. Klimesch W (1999) Event-related band power changes and memory performance. Event-related desynchronization and related oscillatory phenomena of the brain. In: Pfurtscheller G, Lopez da Silva FH (eds) Handbook of electroencephalography and clinical neurophysiology, revised edn, vol 6. Elsevier, Amsterdam, pp 151-178
42. Knudsen EI, Brainard MS (1995) Creating a unified representation of visual and auditory space in the brain. Annu Rev Neurosci 18:19-43
43. Krause CM, Möttönen R, Jensen O, Lampinen J, Sams M (2001) Brain oscillations during audiovisual speech perception-a MEG study. Paper was presented at the Human Brain Mapping Conference, June 10-14, England
44. Kutas M, Hillyard SA (1980) Reading senseless sentences: brain potentials reflect semantic incongruity. Science 207:203-205
45. Large M-E, Aldcroft A, Vilis T (2005) Perceptual continuity and the emergence of perceptual persistence in the ventral visual pathway. J Neurophysiol 93:3453-3462
46. Laskaris NA, Ioannides AA (2001) Exploratory data analysis of evoked response single trials based on minimal spanning tree. Clin Neurophysiol 112:698-712
47. Lebib R, Papo D, Douiri A, de Bode S, Gillon Dowens M, Baudonnière P-M (2004) Modulations of 'late' event-related brain potentials in humans by dynamic audiovisual speech stimuli. Neurosci Lett 372(1-2):74-79
48. Lehmann D (1989) From mapping to the analysis and interpretation of the EEG/EP maps. In: Maurer K (eds) Topographic brain mapping of EEG and evoked potentials. Springer, Heidelberg, pp 53-75
49. Levy WJ (1987) Effect of epoch length on power spectrum analysis of the EEG. Anesthesiology 66(4):489-495
50. Libet B (1993) The neural time factor in conscious and unconscious events. Experimental and theoretical studies of consciousness (CIBA Foundation Symposium 174). Wiley, Chichester, pp 123-146
51. Logan GD (1992) Attention and preattention in theories of automaticity. Am J Psychol 105:317-339
52. Lopes da Silva FH (1991) Neural mechanisms underlying brain waves: from neural membranes to networks. Electroencephalogr Clin Neurophysiol 79:81-93
53. Lopes da Silva FH, Vos JE, Mooibroek J, Van Rotterdam A (1980) Relative contributions of intracortical and thalamo-cortical processes in the generation of alpha rhythms, revealed by partial coherence analysis. Electroencephalogr Clin Neurophysiol 50:449-456
54. McCollough AW, Machizawa MG, Vogel EK (2007) Electrophysiological measures of maintaining representations in visual working memory. Cortex 43:77-94
55. McEvoy LK, Smith ME, Gevins A (2000) Test-retest reliability of cognitive EEG. Clin Neurophysiol 111:457-463
56. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748
57. Mesulam M (1998) From sensation to cognition. Brain 121:1013-1052
58. Möttönen R, Krause CM, Tiipana K, Sams M (2002) Processing of changes in visual speech in the human auditory cortex. Brain Res Cogn Brain Res 13:417-425
59. Mukamel R, Harel M, Hendler T, Malach R (2004) Enhanced temporal non-linearities in human object-related occipito-temporal cortex. Cerebr Cortex 14:575-585
60. Muller UA (1993) Statistics of variables observed over overlapping intervals. Working paper from Olsen and Associates No 1993-06-18. November 30, p 10. File URL: http://www.olsen.ch/research/403_intervalOverlap.pdf
61. Näätänen R, Winkler I (1999) The concept of auditory stimulus representation in cognitive neuroscience. Psychol Bull 125:826-859
62. Neuper C, Pfurtscheller G (1999) Motor imagery and ERD. Event-related desynchronization and related oscillatory phenomena of the brain. In: Pfurtscheller G, Lopes da Silva FH (eds). Handbook of electroencephalography and clinical neurophysiology, Vol. 6, revised ed. Elsevier, Amsterdam, pp 303-326
63. Nuwer MR, Comi C, Emerson R, Fuglsang-Frederiksen A, Guerit JM, Hinrichs H, Ikeda A, Luccas FJ, Rappelsberger P (1998) IFCN standards for digital recording of clinical EEG. Electroencephalogr Clin Neurophysiol 106:259-261
64. O'Hare JJ (1991) Perceptual integration. J Wash Acad Sci 81:44-59
65. Perneger TV (1998) What is wrong with Bonferroni adjustments. Br Med J 136:1236-1238
66. Pfurtscheller G, Klimesch W (1990) Topographical display and interpretation of event-related desynchronization during visual-verbal task. Brain Topogr 3:85-93
67. Pfurtscheller G, Stancak JrA, Neuper C (1996) Post-movement beta synchronization: a correlate of an idling motor area? Electroencephalogr Clin Neurophysiol 98:281-293
68. Pöppel E (1994) Temporal mechanisms in perception. Int Rev Neurobiol 37:185-202
69. Pöppel E (2004) Lost in time: historical foundations and the 3-second-window of temporal integration. Acta Neurobiol Exp 64:295-301
70. Pulvermuller F, Keil A, Thomas E (1999) High-frequency brain activity: perception or active memory? Trends Cogn Sci 3:250-252
71. Raij T (1999) Patterns of brain activity during visual imagery of letters. J Cogn Neurosci 11:282-299
72. Riley WJ (2003) Techniques for frequency stability analysis. IEEE International Frequency Control Symposium, Tampa, FL, 4 May
73. Rosenblum LD, Saldana HM (1996) An audiovisual test of kinematic primitives for visual speech perception. J Exp Psychol Hum Percept Perform 22:318-331
74. Rothman KJ (1990) No adjustments are needed for multiple comparisons. Epidemiology 1:43-46
75. Sakowitz O, Schurmann M, Basar E (2000) Oscillatory frontal theta responses are increased upon bisensory stimulation. Clin Neurophysiol 111:884-893
76. Sakowitz O, Quiroga R, Schurmann M, Basar E (2001) Bisensory stimulation increases gamma-responses over multiple cortical regions. Brain Res Cogn Brain Res 11:267-279
77. Salmelin R, Hämälinen M, Kajola M, Hari R (1995) Functional segregation of movement-related rhythmic activity in the human brain. Neuroimage 2:237-243
78. Sams M, Aulanko R, Hämäläinen M, Hari R, Lounasmaa OV, Lu ST, Simola J (1991) Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci Lett 127:141-145
79. Schacter DL (1977) EEG theta waves and psychological phenomena: a review and analysis. Biol Psychol 5:47-82
80. Singer W (1994) Putative functions of temporal correlations in neocortical processing. In: Koch C, Davis JL (eds). Large-scale neuronal theories of the brain, MIT Press, Cambridge, pp 201-237
81. Soto-Faraco S, Navarra J, Alsius A (2004) Assessing automaticity in audiovisual speech integration: evidence from the speeded classification task. Cognition 92:B13-B23
82. Stampfer HG, Basar E (1985) Does frequency analysis lead to better understanding of human event related potentials? Int J Neurosci 26:181-196
83. Steriade M, Gloor P, Llinas RR, Lopes da Silva FH, Mesulam MM (1990) Basic mechanisms of cerebral rhythmic activities. Electroencephalogr Clin Neurophysiol 76:481-508
84. Taylor JL, McCloskey DI (1990) Triggering of preprogrammed movements as reactions to masked stimuli. J Neurophysiol 63:439-446
85. Teder-Sälejårvi WA, McDonald JJ, Russo FDi, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn Brain Res 14:106-114
86. Thatcher RW (2001) Normative EEG databases and EEG biofeedback. J Neurother 2:8-39
87. Tiippana K, Andersen TS, Sams M (2004) Visual attention modulates audiovisual speech perception. Eur J Cogn Psychol 16:457-472
88. Treisman AM, Sato S (1990) Conjunction search revisited. J Exp Psychol Hum Percept Perform 16:459-478
89. Tononi G, Edelman GM, Sporns O (1998) Complexity and coherency: integrating information in the brain. Trends Cogn Sci 2:474-484
90. Zarahn E, Aguirre GK, D'Esposito M (1999) Temporal isolation of the neural correlates of spatial mnemonic processing with fMRI. Cogn Brain Res 7:255-268
91. Yordanova J, Kolev V, Rosso OA, Schurmann M, Sakowitz OW, Özgören M, Basar E (2002) Wavelet entropy analysis of event-related potentials indicates modality-independent theta dominance. J Neurosci Methods 117:99-109
92. Usher M, Niebur E (1997) Active neural representations: neurophysiological data and conceptual implications. In: Peschl M, Riegler A (eds) New trends in cognitive science. University of Vienna, Austria
93. Varela F (1995) Resonant cell assemblies: a new approach to cognitive functions and neuronal synchrony. Biol Res 28:81-95