Encoding of event timing in the phase of neural oscillations

NeuroImage

Volumn 92, Issue , 2014, Pages 274-284

  Kösem, Anne ^a,b,c   Gramfort, Alexandre ^b,d   Van Wassenhove, Virginie ^a,b,c  

^a INSERM   (France)

^b DIF   (France)

^c UNIVERSITÉ PARIS SACLAY   (France)

^d CEA SACLAY   (France)

Author keywords

Internal clock; MEG; Oscillatory entrainment; Simultaneity; Temporal order

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; BRAIN FUNCTION; CONTROLLED STUDY; EVOKED AUDITORY RESPONSE; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; MAGNETOENCEPHALOGRAPHY; MALE; PRIORITY JOURNAL; TASK PERFORMANCE; TIME PERCEPTION; VISUAL CORTEX; VISUAL STIMULATION; BIOLOGICAL RHYTHM; BRAIN CORTEX; FEEDBACK SYSTEM; HEARING; NERVE CELL NETWORK; NERVE CELL PLASTICITY; PHYSIOLOGY; PROCEDURES; REACTION TIME; STIMULATION; VISION;

ADULT; AUDITORY PERCEPTION; BIOLOGICAL CLOCKS; CEREBRAL CORTEX; FEEDBACK, PHYSIOLOGICAL; FEMALE; HUMANS; MALE; NERVE NET; NEURONAL PLASTICITY; PHYSICAL STIMULATION; REACTION TIME; TIME PERCEPTION; VISUAL PERCEPTION;

EID: 84895834108     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.02.010     Document Type: Article

References (113)

1. Alais D., Burr D. The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 2004, 14:257-262.
2. Arnal L.H., Wyart V., Giraud A.-L. Transitions in neural oscillations reflect prediction errors generated in audiovisual speech. Nat. Neurosci. 2011, 14:797-801.
3. Besle J., Schevon C.A., Mehta A.D., Lakatos P., Goodman R.R., McKhann G.M., Emerson R.G., Schroeder C.E. Tuning of the human neocortex to the temporal dynamics of attended events. J. Neurosci. 2011, 31:3176-3185.
4. Brainard D.H. The Psychophysics toolbox. Spat. Vis. 1997, 10:433-436.
5. Buhusi C.V., Meck W.H. What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 2005, 6:755-765.
6. Buhusi C.V., Meck W.H. Relativity theory and time perception: single or multiple clocks?. PLoS One 2009, 4:e6268.
7. Burr D., Alais D. Combining visual and auditory information. Prog. Brain Res. 2006, 155:243-258.
8. Busch N.A., Dubois J., VanRullen R. The phase of ongoing EEG oscillations predicts visual perception. J. Neurosci. 2009, 29:7869-7876.
9. Buzsáki G. Theta oscillations in the hippocampus. Neuron 2002, 33:325-340.
10. Buzsáki G. Neural syntax: cell assemblies, synapsembles, and readers. Neuron 2010, 68:362-385.
11. Buzsáki G., Draguhn A. Neuronal oscillations in cortical networks. Science 2004, 304:1926-1929.
12. Cai M., Stetson C., Eagleman D.M. A neural model for temporal order judgments and their active recalibration: a common mechanism for space and time?. Front. Psychol. 2012, 3:470.
13. Canolty R.T., Edwards E., Dalal S.S., Soltani M., Nagarajan S.S., Berger M.S., Barbaro N.M., Knight R.T. High gamma power is phase-locked to theta oscillations in human neocortex. Science 2006, 313:1626-1628.
14. Capilla A., Pazo-Alvarez P., Darriba A., Campo P., Gross J. Steady-state visual evoked potentials can be explained by temporal superposition of transient event-related responses. PLoS One 2011, 6.
15. Chakravarthi R., Vanrullen R. Conscious updating is a rhythmic process. Proc. Natl. Acad. Sci. U. S. A. 2012, 109:10599-10604.
16. Chopin A., Mamassian P. Predictive properties of visual adaptation. Curr. Biol. 2012, 22:622-626.
17. Church R.M. Properties of the internal clock. Ann. N. Y. Acad. Sci. 1984, 423:566-582.
18. Coles M., Rugg M. Event-Related Brain Potentials: An Introduction. Electrophysiology of Mind: Event-Related Brain Potentials and Cognition 1995, 1-26. Oxford University Press, London. M. Coles, M. Rugg (Eds.).
19. Colonius H., Diederich A. The optimal time window of visual-auditory integration: a reaction time analysis. Front. Integr. Neurosci. 2010, 4:11.
20. Costa-Faidella J., Baldeweg T., Grimm S., Escera C. Interactions between "what" and "when" in the auditory system: temporal predictability enhances repetition suppression. J. Neurosci. 2011, 31:18590-18597.
21. Coull J.T., Vidal F., Nazarian B., Macar F. Functional anatomy of the attentional modulation of time estimation. Science 2004, 303:1506-1508.
22. Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis. I. Segmentation and surface reconstruction. NeuroImage 1999, 9:179-194.
23. Engel A.K., Singer W. Temporal binding and the neural correlates of sensory awareness. Trends Cogn. Sci. 2001, 5:16-25.
24. Engel A.K., König P., Singer W. Direct physiological evidence for scene segmentation by temporal coding. Proc. Natl. Acad. Sci. U. S. A. 1991, 88:9136-9140.
25. Ernst M.O., Bülthoff H.H. Merging the senses into a robust percept. Trends Cogn. Sci. 2004, 8:162-169.
26. Fiebelkorn I.C., Foxe J.J., Butler J.S., Mercier M.R., Snyder A.C., Molholm S. Ready, set, reset: stimulus-locked periodicity in behavioral performance demonstrates the consequences of cross-sensory phase reset. J. Neurosci. 2011, 31:9971-9981.
27. Fiebelkorn I.C., Snyder A.C., Mercier M.R., Butler J.S., Molholm S., Foxe J.J. Cortical cross-frequency coupling predicts perceptual outcomes. NeuroImage 2013, 69:126-137.
28. Fischl B., Dale A.M. Measuring the thickness of the human cerebral cortex from magnetic resonance images. Proc. Natl. Acad. Sci. U. S. A. 2000, 97:11050-11055.
29. Fisher N.I. Statistical Analysis of Circular Data 1995, Cambridge University Press, Cambridge.
30. Fujisaki W., Shimojo S., Kashino M., Nishida S. Recalibration of audiovisual simultaneity. Nat. Neurosci. 2004, 7:773-778.
31. Gazzaley A., Cooney J.W., Rissman J., D'Esposito M. Top-down suppression deficit underlies working memory impairment in normal aging. Nat. Neurosci. 2005, 8:1298-1300.
32. Gho M., Varela F.J. A quantitative assessment of the dependency of the visual temporal frame upon the cortical rhythm. J. Physiol. Paris 1988, 83:95-101.
33. Giraud A.-L., Poeppel D. Cortical oscillations and speech processing: emerging computational principles and operations. Nat. Neurosci. 2012, 15:511-517.
34. Gomez-Ramirez M., Kelly S.P., Molholm S., Sehatpour P., Schwartz T.H., Foxe J.J. Oscillatory sensory selection mechanisms during intersensory attention to rhythmic auditory and visual inputs: a human electrocorticographic investigation. J. Neurosci. 2011, 31:18556-18567.
35. Gramfort A., Luessi M., Larson E., Engemann D.A., Strohmeier D., Brodbeck C., Goj R., Jas M., Brooks T., Parkkonen L., Hämäläinen M. MEG and EEG data analysis with MNE-python. Front. Neurosci. 2013, 7.
36. Gramfort A., Luessi M., Larson E., Engemann D.A., Strohmeier D., Brodbeck C., Parkkonen L., Hämäläinen M.S. MNE software for processing MEG and EEG data. NeuroImage 2014, 86:446-460.
37. Grill-Spector K., Henson R., Martin A. Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn. Sci. 2006, 10:14-23.
38. Gross J., Baillet S., Barnes G.R., Henson R.N., Hillebrand A., Jensen O., Jerbi K., Litvak V., Maess B., Oostenveld R., Parkkonen L., Taylor J.R., van Wassenhove V., Wibral M., Schoffelen J.-M. Good practice for conducting and reporting MEG research. NeuroImage 2013, 65:349-363.
39. Hämäläinen M.S., Sarvas J. Realistic conductivity geometry model of the human head for interpretation of neuromagnetic data. IEEE Trans. Biomed. Eng. 1989, 36:165-171.
40. Harrington D.L., Haaland K.Y., Knight R.T. Cortical networks underlying mechanisms of time perception. J. Neurosci. 1998, 18:1085-1095.
41. Henry M.J., Obleser J. Frequency modulation entrains slow neural oscillations and optimizes human listening behavior. Proc. Natl. Acad. Sci. U. S. A. 2012, 109:20095-20100.
42. Heron J., Roach N.W., Whitaker D., Hanson J.V.M. Attention regulates the plasticity of multisensory timing. Eur. J. Neurosci. 2010, 31:1755-1762.
43. Ivry R.B., Schlerf J.E. Dedicated and intrinsic models of time perception. Trends Cogn. Sci. 2008, 12:273-280.
44. Jensen O., Bonnefond M., VanRullen R. An oscillatory mechanism for prioritizing salient unattended stimuli. Trends Cogn. Sci. 2012, 16:200-206.
45. Johnston A., Nishida S. Time perception: brain time or event time?. Curr. Biol. 2001, 11:R427-R430.
46. Karmarkar U.R., Buonomano D.V. Timing in the absence of clocks: encoding time in neural network states. Neuron 2007, 53:427-438.
47. Keil A., Debener S., Gratton G., Junghöfer M., Kappenman E.S., Luck S.J., Luu P., Miller G.A., Yee C.M. Committee report: publication guidelines and recommendations for studies using electroencephalography and magnetoencephalography. Psychophysiology 2013, 51:1-21.
48. Knudsen E., Brainard M. Visual instruction of the neural map of auditory space in the developing optic tectum. Science 1991, 253:85-87.
49. Kösem A., van Wassenhove V. Temporal structure in audiovisual sensory selection. PLoS One 2012, 7:e40936.
50. Lachaux J.P., Rodriguez E., Martinerie J., Varela F.J. Measuring phase synchrony in brain signals. Hum. Brain Mapp. 1999, 8:194-208.
51. Lakatos P., Karmos G., Mehta A.D., Ulbert I., Schroeder C.E. Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 2008, 320:110-113.
52. Lewald J., Guski R. Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cogn. Brain Res. 2003, 16:468-478.
53. Lin F.-H., Belliveau J.W., Dale A.M., Hämäläinen M.S. Distributed current estimates using cortical orientation constraints. Hum. Brain Mapp. 2006, 27:1-13.
54. Lisman J. The theta/gamma discrete phase code occurring during the hippocampal phase precession may be a more general brain coding scheme. Hippocampus 2005, 15:913-922.
55. Lisman J.E., Jensen O. The theta-gamma neural code. Neuron 2013, 77:1002-1016.
56. Love S.A., Petrini K., Cheng A., Pollick F.E. A psychophysical investigation of differences between synchrony and temporal order judgments. PLoS One 2013, 8:e54798.
57. Luo H., Liu Z., Poeppel D. Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation. PLoS Biol. 2010, 8:e1000445.
58. Madl T., Baars B.J., Franklin S. The timing of the cognitive cycle. PLoS One 2011, 6:e14803.
59. Maris E., Oostenveld R. Nonparametric statistical testing of EEG- and MEG-data. J. Neurosci. Methods 2007, 164:177-190.
60. McDonald J.J., Teder-Sälejärvi W.A., Di Russo F., Hillyard S.A. Neural basis of auditory-induced shifts in visual time-order perception. Nat. Neurosci. 2005, 8:1197-1202.
61. Meredith M., Nemitz J., Stein B. Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J. Neurosci. 1987, 7:3215-3229.
62. Mishra J., Martinez A., Sejnowski T.J., Hillyard S.A. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 2007, 27:4120-4131.
63. Miyazaki M., Yamamoto S., Uchida S., Kitazawa S. Bayesian calibration of simultaneity in tactile temporal order judgment. Nat. Neurosci. 2006, 9:875-877.
64. Monto S., Palva S., Voipio J., Palva J.M. Very slow EEG fluctuations predict the dynamics of stimulus detection and oscillation amplitudes in humans. J. Neurosci. 2008, 28:8268-8272.
65. Morillon B., Kell C.A., Giraud A.-L. Three stages and four neural systems in time estimation. J. Neurosci. 2009, 29:14803-14811.
66. Moutoussis K., Zeki S. A direct demonstration of perceptual asynchrony in vision. Proc. Biol. Sci. 1997, 264:393-399.
67. Nadasdy Z. Binding by asynchrony: the neuronal phase code. Front. Neurosci. 2010, 4.
68. Navarra J., Hartcher-O'Brien J., Piazza E., Spence C. Adaptation to audiovisual asynchrony modulates the speeded detection of sound. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:9169-9173.
69. Neuling T., Rach S., Wagner S., Wolters C.H., Herrmann C.S. Good vibrations: oscillatory phase shapes perception. NeuroImage 2012, 63:771-778.
70. Nozaradan S., Peretz I., Missal M., Mouraux A. Tagging the neuronal entrainment to beat and meter. J. Neurosci. 2011, 31:10234-10240.
71. Panzeri S., Brunel N., Logothetis N.K., Kayser C. Sensory neural codes using multiplexed temporal scales. Trends Neurosci. 2010, 33:111-120.
72. Pöppel E. A hierarchical model of temporal perception. Trends Cogn. Sci. 1997, 1:56-61.
73. Rees A., Green G.G.R., Kay R.H. Steady-state evoked responses to sinusoidally amplitude-modulated sounds recorded in man. Hear. Res. 1986, 23:123-133.
74. Regan D. Some characteristics of average steady-state and transient responses evoked by modulated light. Electroencephalogr. Clin. Neurophysiol. 1966, 20:238-248.
75. Roelfsema P., Engel A., Konig P., Singer W. Visuomotor integration is associated with zero time-lag synchronization among cortical areas. Nature 1997, 385:157-161.
76. Romei V., Gross J., Thut G. Sounds reset rhythms of visual cortex and corresponding human visual perception. Curr. Biol. 2012, 22:807-813.
77. Roopun A.K., Kramer M.A., Carracedo L.M., Kaiser M., Davies C.H., Traub R.D., Kopell N.J., Whittington M.A. Temporal interactions between cortical rhythms. Front. Neurosci. 2008, 2:145-154.
78. Scharnowski F., Rees G., Walsh V. Time and the brain: neurorelativity: the chronoarchitecture of the brain from the neuronal rather than the observer's perspective. Trends Cogn. Sci. 2013, 17:51-52.
79. Schroeder C.E., Lakatos P. Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci. 2009, 32:9-18.
80. Senkowski D., Schneider T.R., Foxe J.J., Engel A.K. Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci. 2008, 31:401-409.
81. Shaw M.E., Hämäläinen M.S., Gutschalk A. How anatomical asymmetry of human auditory cortex can lead to a rightward bias in auditory evoked fields. NeuroImage 2013, 74:22-29.
82. Skaggs W.E., Knierim J.J., Kudrimoti H.S., McNaughton B.L. A model of the neural basis of the rat's sense of direction. Adv. Neural Inf. Process. Syst. 1995, 7:173-180.
83. Slutsky D.A., Recanzone G.H. Temporal and spatial dependency of the ventriloquism effect. Neuroreport 2001, 12:7-10.
84. Stefanics G., Hangya B., Hernádi I., Winkler I., Lakatos P., Ulbert I. Phase entrainment of human delta oscillations can mediate the effects of expectation on reaction speed. J. Neurosci. 2010, 30:13578-13585.
85. Stone J.V., Hunkin N.M., Porrill J., Wood R., Keeler V., Beanland M., Port M., Porter N.R. When is now? Perception of simultaneity. Proc. Biol. Sci. 2001, 268:31-38.
86. Sugita Y., Suzuki Y. Implicit estimation of sound-arrival time. Nature 2003, 421.
87. Summerfield C., Trittschuh E.H., Monti J.M., Mesulam M.M., Egner T. Neural repetition suppression reflects fulfilled perceptual expectations. Nat. Neurosci. 2008, 11:1004-1006.
88. Summerfield C., Wyart V., Johnen V.M., de Gardelle V. Human Scalp electroencephalography reveals that repetition suppression varies with expectation. Front. Hum. Neurosci. 2011, 5:67.
89. Tallon-Baudry C., Bertrand O. Oscillatory gamma activity in humans and its role in object representation. Trends Cogn. Sci. 1999, 3:151-162.
90. Taulu S., Kajola M., Simola J. Suppression of interference and artifacts by the signal space separation method. Brain Topogr. 2003, 16:269-275.
91. Thorne J.D., De Vos M., Viola F.C., Debener S. Cross-modal phase reset predicts auditory task performance in humans. J. Neurosci. 2011, 31:3853-3861.
92. Todorovic A., de Lange F.P. Repetition suppression and expectation suppression are dissociable in time in early auditory evoked fields. J. Neurosci. 2012, 32:13389-13395.
93. Treisman M. Temporal discrimination and the indifference interval: Implications for a model of the "internal clock". Psychol. Monogr. Gen. Appl. 1963, 77:1.
94. Treisman M. Temporal rhythms and cerebral rhythms. Ann. N. Y. Acad. Sci. 1984, 423:542-565.
95. Treisman A. The binding problem. Curr. Opin. Neurobiol. 1996, 6:171-178.
96. Treisman M., Faulkner A., Naish P.L., Brogan D. The internal clock: evidence for a temporal oscillator underlying time perception with some estimates of its characteristic frequency. Perception 1990, 19:705-743.
97. Treisman M., Faulkner A., Naish P.L.N. On the relation between time perception and the timing of motor action: evidence for a temporal oscillator controlling the timing of movement. Q. J. Exp. Psychol. A 1992, 45:235-263.
98. Uusitalo M.A., Ilmoniemi R.J. Signal-space projection method for separating MEG or EEG into components. Med. Biol. Eng. Comput. 1997, 35:135-140.
99. Van Eijk R.L.J., Kolhlrausch A., Juola J.F., Van de Par S. Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type. Percept. Psychophys. 2008, 70:955-968.
100. Van Wassenhove V. Minding time in an amodal representational space. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:1815-1830.
101. VanRullen R., Koch C. Is perception discrete or continuous?. Trends Cogn. Sci. 2003, 7:207-213.
102. VanRullen R., Reddy L., Koch C. The continuous wagon wheel illusion is associated with changes in electroencephalogram power at approximately 13Hz. J. Neurosci. 2006, 26:502-507.
103. Varela F., Toro A., John E.R., Schwartz E. Perceptual framing and cortical alpha rhythm. Neuropsychologia 1981, 19:675-686.
104. Vibell J., Klinge C., Zampini M., Spence C., Nobre A.C. Temporal order is coded temporally in the brain: early event-related potential latency shifts underlying prior entry in a cross-modal temporal order judgment task. J. Cogn. Neurosci. 2007, 19:109-120.
105. Vroomen J., Keetels M. Perception of intersensory synchrony: a tutorial review. Atten. Percept. Psychophys. 2010, 72:871-884.
106. Vroomen J., Keetels M., de Gelder B., Bertelson P. Recalibration of temporal order perception by exposure to audio-visual asynchrony. Brain Res. Cogn. Brain Res. 2004, 22:32-35.
107. Wang X. Neurophysiological and computational principles of cortical rhythms in cognition. Phys. Rev. 2010, 90:1195-1268.
108. Watkins S., Shams L., Tanaka S., Haynes J.-D., Rees G. Sound alters activity in human V1 in association with illusory visual perception. NeuroImage 2006, 31:1247-1256.
109. Witten I.B., Knudsen E.I. Why seeing is believing: merging auditory and visual worlds. Neuron 2005, 48:489-496.
110. Wittmann M. The inner experience of time. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:1955-1967.
111. Wittmann M. The inner sense of time: how the brain creates a representation of duration. Nat. Rev. Neurosci. 2013, 14:217-223.
112. Yamamoto S., Miyazaki M., Iwano T., Kitazawa S. Bayesian calibration of simultaneity in audiovisual temporal order judgments. PLoS One 2012, 7:e40379.
113. Zeki S., Bartels A. The asynchrony of consciousness. Proc. Biol. Sci. 1998, 265:1583-1585.