Combining spatial and temporal expectations to improve visual perception

Journal of Vision

Volumn 14, Issue 4, 2014, Pages

  Rohenkohl, Gustavo ^a,b   Gould, Ian Christina ^a,b   Pessoa, Jéssica ^a   Nobre, Anna C ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Spatial expectation; Synergistic effect; Temporal expectation; Timing; Visual attention

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; ATTENTION; CONTRAST SENSITIVITY; DEPTH PERCEPTION; FEMALE; HUMAN; MALE; PERCEPTIVE THRESHOLD; PHYSIOLOGY; PSYCHOPHYSICS; SPATIAL EXPECTATION; SYNERGISTIC EFFECT; TEMPORAL EXPECTATION; TIMING; VISION; VISUAL ATTENTION; YOUNG ADULT;

SPATIAL EXPECTATION; SYNERGISTIC EFFECT; TEMPORAL EXPECTATION; TIMING; VISUAL ATTENTION;

ADULT; ATTENTION; CONTRAST SENSITIVITY; CUES; FEMALE; HUMANS; MALE; PSYCHOPHYSICS; SENSORY THRESHOLDS; SPACE PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84899091085     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/14.4.8     Document Type: Article

References (109)

1. Anderson, B., & Sheinberg, D. L. (2008). Effects of temporal context and temporal expectancy on neural activity in inferior temporal cortex. Neuropsychologia, 46(4), 947-957.
2. Bausenhart, K. M., Rolke, B., & Ulrich, R. (2007). Knowing when to hear aids what to hear. Quarterly Journal of Experimental Psychology, 60(12), 1610-1615.
3. Besle, J., Schevon, C. A., Mehta, A. D., Lakatos, P., Goodman, R. R., McKhann, G. M., Schroeder, C. E. (2011). Tuning of the human neocortex to the temporal dynamics of attended events. Journal of Neuroscience, 31(9), 3176-3185.
4. Breitmeyer, B. G. (1984). Visual masking: An integrative approach. Oxford, UK: Clarendon Press.
5. Breska, A., & Deouell, L. Y. (2014). Automatic bias of temporal expectations following temporally regular input independently of high-level temporal expectation. Journal of Cognitive Neuroscience, doi:10. 1162/jocn_a_00564.
6. Chambers, C. D., Stokes, M. G., & Mattingley, J. B. (2004). Modality-specific control of strategic spatial attention in parietal cortex. Neuron, 44(6), 925-930.
7. Correa, A., Lupiáñez, J., & Tudela, P. (2005). Attentional preparation based on temporal expectancy modulates processing at the perceptual level. Psychonomic Bulletin & Review, 12(2), 328-334.
8. Correa, A., & Nobre, A. (2008). Neural modulation by regularity and passage of time. Journal of Neurophysiology, 100(3), 1649-1655.
9. Costa-Faidella, J., Baldeweg, T., Grimm, S., & Escera, C. (2011). Interactions between "what" and "when" in the auditory system: Temporal predictability enhances repetition suppression. Journal of Neuroscience, 31(50), 18590-18597.
10. Cotti, J., Rohenkohl, G., Stokes, M., Nobre, A. C.,& Coull, J. T. (2011). Functionally dissociating temporal and motor components of response preparation in left intraparietal sulcus. Neuro-Image, 54(2), 1221-1230.
11. Coull, J. T., Davranche, K., Nazarian, B., & Vidal, F. (2013). Functional anatomy of timing differs for production versus prediction of time intervals. Neuropsychologia, 51(2), 309-319.
12. Coull, J. T., & Nobre, A. C. (1998). Where and when to pay attention: The neural systems for directing attention to spatial locations and to time intervals as revealed by both PET and fMRI. Journal of Neuroscience, 18(18), 7426-7435.
13. Coull, J. T., & Nobre, A. C. (2008). Dissociating explicit timing from temporal expectation with fMRI. Current Opinion in Neurobiology, 18(2), 137-144.
14. Coull, J. T., Nobre, A. C., & Frith, C. D. (2001). The noradrenergic alpha2 agonist clonidine modulates behavioural and neuroanatomical correlates of human attentional orienting and alerting. Cerebral Cortex, 11(1), 73-84.
15. Cravo, A. M., Rohenkohl, G., Wyart, V., & Nobre, A. C. (2011). Endogenous modulation of low fre-quency oscillations by temporal expectations. Journal of Neurophysiology, 106(6), 2964-2972.
16. Cravo, A. M., Rohenkohl, G., Wyart, V., & Nobre, A. C. (2013). Temporal expectation enhances contrast sensitivity by phase entrainment of low-frequency oscillations in visual cortex. Journal of Neuroscience, 33(9), 4002-4010.
17. Cui, X., Stetson, C., Montague, P. R., & Eagleman, D. M. (2009). Ready.go: Amplitude of the FMRI signal encodes expectation of cue arrival time. PLoS Biology, 7(8), e1000167.
18. Davranche, K., Nazarian, B., Vidal, F., & Coull, J. (2011). Orienting attention in time activates left intraparietal sulcus for both perceptual and motor task goals. Journal of Cognitive Neuroscience, 23(11), 3318-3330.
19. de Graaf, T. A., Gross, J., Paterson, G., Rusch, T., Sack, A. T., & Thut, G. (2013). Alpha-band rhythms in visual task performance: Phase-locking by rhythmic sensory stimulation. PLoS One, 8(3), e60035.
20. de Hemptinne, C., Nozaradan, S., Duvivier, Q., Lefevre, P., & Missal, M. (2007). How do primates anticipate uncertain future events?. Journal of Neuroscience, 27(16), 4334-4341.
21. Doherty, J. R., Rao, A., Mesulam, M. M., & Nobre, A. C. (2005). Synergistic effect of combined temporal and spatial expectations on visual attention. Journal of Neuroscience, 25(36), 8259-8266.
22. Eimer, M. (1994). "Sensory gating" as a mechanism for visuospatial orienting: Electrophysiological evidence from trial-by-trial cuing experiments. Perception & Psychophysics, 55(6), 667-675.
23. Engbert, R., & Mergenthaler, K. (2006). Microsaccades are triggered by low retinal image slip. Proceedings of the National Academy of Sciences, USA, 103(18), 7192-7197.
24. Ernst, M. D. (2004). Permutation methods: A basis for exact inference. Statistical Science, 19(4), 676-685.
25. Ghose, G. M., & Bearl, D. W. (2010). Attention directed by expectations enhances receptive fields in cortical area MT. Vision Research, 50(4), 441-451.
26. Ghose, G. M., & Maunsell, J. H. (2002). Attentional modulation in visual cortex depends on task timing. Nature, 419(6907), 616-620.
27. Gomez-Ramirez, M., Kelly, S. P., Molholm, S., Sehatpour, P., Schwartz, T. H., & Foxe, J. J. (2011). Oscillatory sensory selection mechanisms during intersensory attention to rhythmic auditory and visual inputs: A human electrocorticographic investigation. Journal of Neuroscience, 31(50), 18556-18567.
28. Gould, I. C., Wolfgang, B. J., & Smith, P. L. (2007). Spatial uncertainty explains exogenous and endogenous attentional cuing effects in visual signal detection. Journal of Vision, 7(13):4, 1-17, http://www.journalofvision.org/content/7/13/4, doi: 10.1167/7.13.4.
29. Green, J. J., & McDonald, J. J. (2010). The role of temporal predictability in the anticipatory biasing of sensory cortex during visuospatial shifts of attention. Psychophysiology, 47(6), 1057-1065.
30. Harter, M. R., Aine, C., & Schroeder, C. (1982). Hemispheric differences in the neural processing of stimulus location and type: Effects of selective attention on visual evoked potentials. Neuropsychologia, 20(4), 421-438.
31. Henry, M. J., & Obleser, J. (2012). Frequency modulation entrains slow neural oscillations and optimizes human listening behavior. Proceedings of the National Academy of Sciences, USA, 109(49), 20095-20100.
32. Hillyard, S. A., & Münte, T. F. (1984). Selective attention to color and location: An analysis with event-related brain potentials. Perception & Psychophysics, 36(2), 185-198.
33. Hogendoorn, H., Carlson, T. A., VanRullen, R., & Verstraten, F. A. (2010). Timing divided attention. Attention, Perception, & Psychophysics, 72(8), 2059-2068.
34. Hubert, M., & Van der Veeken, S. (2008). Outlier detection for skewed data. Journal of Chemometrics, 22, 235-246.
35. Itthipuripat, S., Garcia, J. O., & Serences, J. T. (2013). Temporal dynamics of divided spatial attention. Journal of Neurophysiology, 109(9), 2364-2373.
36. Janssen, P., & Shadlen, M. (2005). A representation of the hazard rate of elapsed time in macaque area LIP. Nature Neuroscience, 8(2), 234-241.
37. Jaramillo, S., & Zador, A. M. (2011). The auditory cortex mediates the perceptual effects of acoustic temporal expectation. Nature Neuroscience, 14(2), 246-251.
38. Jepma, M., Wagenmakers, E. J., & Nieuwenhuis, S. (2012). Temporal expectation and information processing: A model-based analysis. Cognition, 122(3), 426-441.
39. Jones, M. R. (1976). Time, our lost dimension: Toward a new theory of perception, attention, and memory. Psychological Review, 83(5), 323-355.
40. Jones, M. R. (2010). Attending to sound patterns and the role of entrainment. In A. C. Nobre & J. T. Coull (Eds.), Attention and time (pp. 137-330). Oxford, UK: Oxford University Press.
41. Jones, M. R., Moynihan, H., MacKenzie, N.,& Puente, J. (2002). Temporal aspects of stimulusdriven attending in dynamic arrays. Psychological Science, 13(4), 313-319.
42. Kaernbach, C. (1991). Simple adaptive testing with the weighted up-down method. Perception & Psychophysics, 49(3), 227-229.
43. King, A. J., & Nelken, I. (2009). Unraveling the principles of auditory cortical processing: Can we learn from the visual system? Nature Neuroscience, 12(6), 698-701.
44. Kingstone, A. (1992). Combining expectancies. Quarterly Journal of Experimental Psychology A, 44(1), 69-104.
45. Kleiner, M., Brainard, D. H., & Pelli, D. G. (2007). What's new in Psychtoolbox-3? Perception, 36(ECVP Abstract Supplement).
46. Lakatos, P., Karmos, G., Mehta, A., Ulbert, I., & Schroeder, C. (2008). Entrainment of neuronal oscillations as a mechanism of attentional selection. Science, 320(5872), 110-113.
47. Lange, K. (2012). The N1 effect of temporal attention is independent of sound location and intensity: Implications for possible mechanisms of temporal attention. Psychophysiology, 49(11), 1468-1480.
48. Lange, K. (2013). The ups and downs of temporal orienting: A review of auditory temporal orienting studies and a model associating the heterogeneous findings on the auditory N1 with opposite effects of attention and prediction. Frontiers in Human Neuroscience, 7, 263.
49. Lange, K., & Roder, B. (2006). Orienting attention to points in time improves stimulus processing both within and across modalities. Journal of Cognitive Neuroscience, 18(5), 715-729.
50. Lange, K., & Roder, B. (2010). Temporal orienting in audition, touch, and across modalities. In A. C. Nobre & J. T. Coull (Eds.). Attention and time (pp. 393-406). Oxford, UK: Oxford University Press.
51. Lange, K., Rosler, F., & Roder, B. (2003). Early processing stages are modulated when auditory stimuli are presented at an attended moment in time: An event-related potential study. Psychophysiology, 40(5), 806-817.
52. Large, E. W., & Jones, M. R. (1999). The dynamics of attending: How people track time-varying events. Psychological Review, 106(1), 119-159.
53. Lasley, D. J., & Cohn, T. (1981). Detection of a luminance increment: Effect of temporal uncertainty. Journal of the Optical Society of America, 71(7), 845-850.
54. Lima, B., Singer, W., & Neuenschwander, S. (2011). Gamma responses correlate with temporal expectation in monkey primary visual cortex. Journal of Neuroscience, 31(44), 15919-15931.
55. Los, S. A., & Agter, F. (2005). Reweighting sequential effects across different distributions of foreperiods: Segregating elementary contributions to nonspecific preparation. Perception & Psychophysics, 67(7), 1161-1170.
56. Los, S. A., Knol, D. L., & Boers, R. M. (2001). The foreperiod effect revisited: Conditioning as a basis for nonspecific preparation. Acta Psychologica, 106(1-2), 121-145.
57. Lucchetti, C., & Bon, L. (2001). Time-modulated neuronal activity in the premotor cortex of macaque monkeys. Experimental Brain Research, 141(2), 254-260.
58. Luck, S. J., Chelazzi, L., Hillyard, S. A., & Desimone, R. (1997). Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. Journal of Neurophysiology, 77(1), 24-42.
59. Mangun, G. R., & Hillyard, S. (1987). The spatial allocation of visual attention as indexed by eventrelated brain potentials. Human Factors Cognitive Psychophysiology, 29, 195-211.
60. Marchant, J. L., Ruff, C. C., & Driver, J. (2012). Audiovisual synchrony enhances BOLD responses in a brain network including multisensory STS while also enhancing target-detection performance for both modalities. Human Brain Mapping, 33(5), 1212-1224.
61. Maris, E., Schoffelen, J. M., & Fries, P. (2007). Nonparametric statistical testing of coherence differences. Journal of Neuroscience Methods, 163(1), 161-175.
62. Mathewson, K. E., Fabiani, M., Gratton, G., Beck, D. M., & Lleras, A. (2010). Rescuing stimuli from invisibility: Inducing a momentary release from visual masking with pre-target entrainment. Cognition, 115(1), 186-191.
63. Naccache, L., Blandin, E., & Dehaene, S. (2002). Unconscious masked priming depends on temporal attention. Psychological Science, 13(5), 416-424.
64. Nobre, A. C. (2010). How can temporal expectations bias perception and action? In A. C. Nobre & J. T. Coull (Eds.). Attention and time (pp. 371-392). Oxford, UK: Oxford University Press.
65. Nobre, A. C., & Rohenkohl, G. (2014). Time for the fourth dimension in attention. In A. C. Nobre & S. Kastner (Eds.). The Oxford handbook of attention (pp. 676-721). Oxford, UK: Oxford University Press.
66. nd ed, pp. 159-186). New York: Guilford Press.
67. Poeppel, D. (2003). The analysis of speech in different temporal integration windows: Cerebral lateralization as "asymmetric sampling in time." Speech Communication, 41, 245-255.
68. Posner, M. I., & Boies, S. J. (1971). Components of attention. Psychological Review, 78(5), 391-408.
69. Posner, M. I., & Petersen, S. E. (1990). The attention system of the human brain. Annual Review of Neuroscience, 13, 25-42.
70. Praamstra, P., Kourtis, D., Kwok, H. F., & Oostenveld, R. (2006). Neurophysiology of implicit timing in serial choice reaction-time performance. Journal of Neuroscience, 26(20), 5448-5455.
71. Praamstra, P., & Pope, P. (2007). Slow brain potential and oscillatory EEG manifestations of impaired temporal preparation in Parkinson's disease. Journal of Neurophysiology, 98(5), 2848-2857.
72. Riehle, A., Grun, S., Diesmann, M., & Aertsen, A. (1997). Spike synchronization and rate modulation differentially involved in motor cortical function. Science, 278(5345), 1950-1953.
73. Rimmele, J., Jolsvai, H., & Sussman, E. (2011). Auditory target detection is affected by implicit temporal and spatial expectations. Journal of Cognitive Neuroscience, 23(5), 1136-1147.
74. Rohenkohl, G., Coull, J. T., & Nobre, A. C. (2011). Behavioural dissociation between exogenous and endogenous temporal orienting of attention. PLoS ONE, 6(1), e14620.
75. Rohenkohl, G., Cravo, A. M., Wyart, V., & Nobre, A. C. (2012). Temporal expectation improves the quality of sensory information. Journal of Neuroscience, 32(24), 8424-8428.
76. Rohenkohl, G., & Nobre, A. C. (2011). Alpha oscillations related to anticipatory attention follow temporal expectations. Journal of Neuroscience, 31(40), 14076-14084.
77. Romei, V., Driver, J., Schyns, P. G., & Thut, G. (2011). Rhythmic TMS over parietal cortex links distinct brain frequencies to global versus local visual processing. Current Biology, 21(4), 334-337.
78. Rousseeuw, P. J., Ruts, I., & Tukey, J. W. (1999). The bagplot: a bivariate boxplot. The American Statistician, 53(4), 382-387.
79. Roux, S., Mackay, W. A., & Riehle, A. (2006). The premovement component of motor cortical local field potentials reflects the level of expectancy. Behavioural Brain Research, 169(2), 335-351.
80. Schnuerch, R., Kreitz, C., & Lange, K. (2013). Independent effects of temporal expectation and stimulus intensity in audition. Attention, Perception, & Psychophysics, 75(7), 1520-1532.
81. Schoffelen, J. M., Oostenveld, R., & Fries, P. (2005). Neuronal coherence as a mechanism of effective corticospinal interaction. Science, 308(5718), 111-113.
82. Shen, D., & Alain, C. (2011). Temporal attention facilitates short-term consolidation during a rapid serial auditory presentation task. Experimental Brain Research, 215(3-4), 285-292.
83. Shen, D., & Alain, C. (2012). Implicit temporal expectation attenuates auditory attentional blink. PLoS ONE, 7(4), e36031.
84. Shuler, M. G., & Bear, M. F. (2006). Reward timing in the primary visual cortex. Science, 311(5767), 1606-1609.
85. Smith, P. L. (2000). Attention and luminance detection: Effects of cues, masks, and pedestals. Journal of Experimental Psychology: Human Perception & Performance, 26(4), 1401-1420.
86. Smith, P. L., & Ratcliff, R. (2009). An integrated theory of attention and decision making in visual signal detection. Psychological Review, 116(2), 283-317.
87. Smith, P. L., Ratcliff, R., & Wolfgang, B. J. (2004). Attention orienting and the time course of perceptual decisions: Response time distributions with masked and unmasked displays. Vision Research, 44(12), 1297-1320.
88. Smith, P. L., & Wolfgang, B. J. (2004). The attentional dynamics of masked detection. Journal of Experimental Psychology: Human Perception & Performance, 30(1), 119-136.
89. Smith, P. L., Wolfgang, B. J., & Sinclair, A. J. (2004). Mask-dependent attentional cuing effects in visual signal detection: The psychometric function for contrast. Perception & Psychophysics, 66(6), 1056-1075.
90. Smithson, H., & Mollon, J. (2006). Do masks terminate the icon? Quarterly Journal of Experimental Psychology, 59(1), 150-160.
91. Snyder, J. S., & Large, E. W. (2005). Gamma-band activity reflects the metric structure of rhythmic tone sequences. Cognitive Brain Research, 24(1), 117-126.
92. Stefanics, G., Hangya, B., Hernadi, I., Winkler, I., Lakatos, P., & Ulbert, I. (2010). Phase entrainment of human delta oscillations can mediate the effects of expectation on reaction speed. Journal of Neuroscience, 30(41), 13578-13585.
93. Theunissen, F. E. (2003). From synchrony to sparseness. Trends in Neurosciences, 26(2), 61-64.
94. Theunissen, F. E., Sen, K., & Doupe, A. J. (2000). Spectral-temporal receptive fields of nonlinear auditory neurons obtained using natural sounds. Journal of Neuroscience, 20(6), 2315-2331.
95. Townsend, J. T., & Ashby, F. G. (1983). Stochastic modelling of elementary psychological processes. London: Cambridge University Press.
96. Trivino, M., Arnedo, M., Lupianez, J., Chirivella, J.,& Correa, A. (2011). Rhythms can overcome temporal orienting deficit after right frontal damage. Neuropsychologia, 49(14), 3917-3930.
97. Trivino, M., Correa, A., Arnedo, M., & Lupianez, J. (2010). Temporal orienting deficit after prefrontal damage. Brain, 133(Pt 4), 1173-1185.
98. Turvey, M. T. (1973). On peripheral and central processes in vision: Inferences from an informationprocessing analysis of masking with patterned stimuli. Psychological Review, 80(1), 1-52.
99. Vallesi, A., Shallice, T., & Walsh, V. (2007). Role of the prefrontal cortex in the foreperiod effect: TMS evidence for dual mechanisms in temporal preparation. Cerebral Cortex, 17(2), 466-474.
100. van Ede, F., de Lange, F., Jensen, O., & Maris, E. (2011). Orienting attention to an upcoming tactile event involves a spatially and temporally specific modulation of sensorimotor alpha-and beta-band oscillations. Journal of Neuroscience, 31(6), 2016-2024.
101. Vangkilde, S., Coull, J. T., & Bundesen, C. (2012). Great expectations: Temporal expectation modulates perceptual processing speed. Journal of Experimental Psychology: Human Perception& Performance, 38(5), 1183-1191.
102. Vangkilde, S., Petersen, A., & Bundesen, C. (2013). Temporal expectancy in the context of a theory of visual attention. Philosophical Transactions of the Royal Society of London, B: Biological Sciences, 368(1628), 20130054.
103. Verboven, S., & Hubert, M. (2005). LIBRA: A MATLAB library for robust analysis. Chemometrics & Intelligent Laboratory Systems, 75, 127-136.
104. Viemeister, N. F., & Plack, C. J. (1993). Time analysis. In W. Yost, A. Popper & R. Fay (Eds.). Human psychophysics (pp. 116-154). New York: Springer-Verlag.
105. Weinbach, N., & Henik, A. (2012). Temporal orienting and alerting-The same or different? Frontiers in Psychology, 3, 236.
106. Westheimer, G., & Ley, E. (1996). Temporal uncertainty effects on orientation discrimination and stereoscopic thresholds. Journal of the Optical Society of America, 13(4), 884-886.
107. Zanto, T. P., Pan, P., Liu, H., Bollinger, J., Nobre, A. C., & Gazzaley, A. (2011). Age-related changes in orienting attention in time. Journal of Neuroscience, 31(35), 12461-12470.
108. Zanto, T. P., Snyder, J. S., & Large, E. (2006). Neural correlates of rhythmic expectancy. Advances in Cognitive Psychology, 2(2-3), 221-231.
109. Zion Golumbic, E. M., Ding, N., Bickel, S., Lakatos, P., Schevon, C. A., McKhann, G. M., Schroeder, C. E. (2013). Mechanisms underlying selective neuronal tracking of attended speech at a "cocktail party." Neuron, 77(5), 980-991.