Temporal structure in audiovisual sensory selection

PLoS ONE

Volumn 7, Issue 7, 2012, Pages

  Kösem, Anne ^a,b,c   van Wassenhove, Virginie ^a,b,c  

^a INSERM   (France)

^b SERVICE HOSPITALIER FRÉDÉRIC JOLIOT   (France)

^c UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL SENSORY SELECTION; AUDITORY STIMULATION; COGNITION; COLOR; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NEUROPHYSIOLOGY; NORMAL HUMAN; PERIODICITY; SENSORY SYSTEM PARAMETERS; SOUND DETECTION; STIMULUS RESPONSE; TASK PERFORMANCE; TEMPORAL STRUCTURE; VISION; VISUAL SEARCHING; VISUAL STIMULATION;

AUDITORY PERCEPTION; HUMANS; NEUROPHYSIOLOGY; VISUAL PERCEPTION;

EID: 84864034737     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0040936     Document Type: Article

References (58)

1. Lewicki MS, (2002) Efficient coding of natural sounds. Nat Neurosci 5: 356-363.
2. Simoncelli EP, Olshausen BA, (2001) Natural image statistics and neural representation. Ann Rev Neurosci 24: 1193-1216.
3. Schroeder CE, Lakatos P, Kajikawa Y, Partan S, Puce A, (2008) Neuronal oscillations and visual amplification of speech. Trends Cogn Sci 12: 106-113.
4. Winfree AT, (2000) The geometry of biological time. New York: Springer. 777 p.
5. Jones MR, Johnston HM, Puente J, (2006) Effects of auditory pattern structure on anticipatory and reactive attending. Cogn Psychol 53: 59-96.
6. Mathewson KE, Fabiani M, Gratton G, Beck DM, Lleras A, (2010) Rescuing stimuli from invisibility: Inducing a momentary release from visual masking with pre-target entrainment. Cognition 115: 186-191.
7. Large EW, Jones MR, (1999) The dynamics of attending: How people track time-varying events. Psychol Rev 106: 119-159.
8. Jones MR, (1976) Time, our lost dimension: toward a new theory of perception, attention, and memory. Psychol Rev 83: 323-355.
9. Barnes R, Jones MR, (2000) Expectancy, attention, and time. Cogn Psychol 41: 254-311.
10. Treisman AM, Gelade G, (1980) A feature-integration theory of attention. Cogn Psychol 12: 97-136.
11. Yantis S, (1992) Multielement visual tracking: Attention and perceptual organization. Cogn Psychol 24: 295-340.
12. Guttman SE, Gilroy LA, Blake R, (2005) Hearing what the eyes see: auditory encoding of visual temporal sequences. Psychol Sci 16: 228-235.
13. Fujisaki W, Nishida S, (2005) Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals. Exp Brain Res166: 455-464.
14. Fujisaki W, Nishida S, (2007) Feature-based processing of audio-visual synchrony perception revealed by random pulse trains. Vis Res 47: 1075-1093.
15. Fujisaki W, Nishida S, (2010) A common perceptual temporal limit of binding synchronous inputs across different sensory attributes and modalities. Proc Biol Sci 277: 2281-2290.
16. Benjamins JS, van der Smagt MJ, Verstraten FA, (2008) Matching auditory and visual signals: is sensory modality just another feature? Perception 37: 848-858.
17. Shipley T, (1964) Auditory Flutter-Driving of Visual Flicker. Science 145: 1328-1330.
18. Welch RB, DuttonHurt LD, Warren DH, (1986) Contributions of audition and vision to temporal rate perception. Percept Psychophys 39: 294-300.
19. Gebhard JW, Mowbray GH, (1959) On discriminating the rate of visual flicker and auditory flutter. Am J Psychol 72: 521-529.
20. van der Burg E, Olivers CNL, Bronkhorst AW, Theeuwes J, (2008) Pip and pop: Nonspatial auditory signals improve spatial visual search. J Exp Psychol Hum Percept Perform 34: 1053-1065.
21. van der Burg E, Cass J, Olivers CN, Theeuwes J, Alais D, (2010) Efficient visual search from synchronized auditory signals requires transient audiovisual events. PloS One 5: e10664.
22. Fujisaki W, Koene A, Arnold D, Johnston A, Nishida S, (2006) Visual search for a target changing in synchrony with an auditory signal. Proc Biol Sci 273: 865-874.
23. Gomez-Ramirez M, Kelly SP, Molholm S, Sehatpour P, Schwartz TH, et al. (2011) Oscillatory Sensory Selection Mechanisms during Intersensory Attention to Rhythmic Auditory and Visual Inputs: A Human Electrocorticographic Investigation. J Neurosci 31: 18556-18567.
24. Lakatos P, Karmos G, Mehta AD, Ulbert I, Schroeder CE, (2008) Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 320: 110-113.
25. Besle J, Schevon CA, Mehta AD, Lakatos P, Goodman RR, et al. (2011) Tuning of the human neocortex to the temporal dynamics of attended events. J Neurosci 31: 3176-3185.
26. Galambos R, Makeig S, Talmachoff PJ, (1981) A 40-Hz potential recorded from the human scalp. Proc Natl Acad Sci U S A 78: 2343-2347.
27. Regan D, (1966) Some characteristics of average steady-state and transient responses evoked by modulated light. Electroencephalogr Clin Neurophysiol 20: 238-248.
28. Schroeder CE, Lakatos P, (2009) Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci 32: 9-18.
29. Chen YC, Yeh SL, (2009) Catch the moment: multisensory enhancement of rapid visual events by sound. Exp Brain Res 198: 209-219.
30. Chen YC, Yeh SL, (2008) Visual events modulated by sound in repetition blindness. Psychon Bull Rev 15: 404-408.
31. Shams L, Kamitani Y, Shimojo S, (2000) What you see is what you hear. Nature 408: 788.
32. Baayen RH, Davidson DJ, Bates DM, (2008) Mixed-effects modeling with crossed random effects for subjects and items. J Mem Lang 59: 390-412.
33. Jaeger TF, (2008) Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. J Mem Lang 59: 434-446.
34. Santee JL, Egeth HE, (1982) Do reaction time and accuracy measure the same aspects of letter recognition? J Exp Psychol Hum Percept Perform 8: 489-501.
35. McDonald JJ, Teder-Salejarvi WA, Hillyard SA, (2000) Involuntary orienting to sound improves visual perception. Nature 407: 906-908.
36. Yantis S, Jonides J, (1984) Abrupt visual onsets and selective attention: evidence from visual search. J Exp Psychol Hum Percept Perform 10: 601-621.
37. Verstraten FA, Cavanagh P, Labianca AT, (2000) Limits of attentive tracking reveal temporal properties of attention. Vis Res 40: 3651-3664.
38. Posner MI, Boies SJ, (1971) Components of Attention. Psychol Rev 78: 391.
39. Alsius A, Soto-Faraco S, (2011) Searching for audiovisual correspondance in multiple speaker scenarios. Exp Brain Res 213: 175-183.
40. Blake R, Lee SH, (2005) The role of temporal structure in human vision. Behav Cogn Neurosci Rev 4: 21-42.
41. Lee SH, Blake R, (1999) Visual form created solely from temporal structure. Science 284: 1165-1168.
42. Kandil FI, Fahle M, (2001) Purely temporal figure-ground segregation. Eur J Neurosci 13: 2004-2008.
43. French-St George M, Bregman AS, (1989) Role of predictability of sequence in auditory stream segregation. Percept Psychophys 46: 384-386.
44. Turgeon M, Bregman AS, (2001) Ambiguous musical figures. Sequential grouping by common pitch and sound-source location versus simultaneous grouping by temporal synchrony. Ann N Y Acad Sci 930: 375-381.
45. Huang L, Pashler H, (2005) Expectation and repetition effects in searching for featural singletons in very brief displays. Percept Psychophys 67: 150-157.
46. Keele SW, Nicoletti R, Ivry RI, Porkony RA, (1989) Mechanisms of perceptual timing: beat-based of interval-based judgements? Psychol Res 50: 251-256.
47. Drake C, Botte MC, (1993) Tempo sensitivity in auditory sequences: evidence for a multiple look model. Atten Percep Psychophys 54: 277-286.
48. Busch NA, Dubois J, VanRullen R, (2009) The phase of ongoing EEG oscillations predicts visual perception. J Neurosci 29: 7869-7876.
49. Luo H, Liu Z, Poeppel D, (2010) Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation. PLoS Biol 8: e1000445.
50. Stefanics G, Hangya B, Hernadi I, Winkler I, Lakatos P, et al. (2010) Phase entrainment of human delta oscillations can mediate the effects of expectation on reaction speed. J Neurosci 30: 13578-13585.
51. Luo H, Poeppel D, (2007) Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron 54: 1001-1010.
52. VanRullen R, Reddy L, Koch C, (2006) The continuous wagon wheel illusion is associated with changes in electroencephalogram power at approximately 13 Hz. J Neurosci 26: 502-507.
53. Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG, (2010) The multifaceted interplay between attention and multisensory integration. Trends Cogn Sci 14: 400-410.
54. Zou H, Müller HJ, Shi Z, (2012) Non-spatial sounds regulate eye movements and enhance visual search. J Vis 12: 2.
55. Vroomen J, deGelder B, (2000) Sound enhances visual perception: Cross-modal effects of auditory organization on vision. J Exp Psychol Hum Percept Perform 26: 1583-1590.
56. Fiebelkorn IC, Foxe JJ, Butler JS, Mercier MR, Snyder AC, et al. (2011) Ready, set, reset: stimulus-locked periodicity in behavioral performance demonstrates the consequences of cross-sensory phase reset. J Neurosci 31: 9971-9981.
57. R Development Core Team (2007) R: a language and environment for statistical computing. Vienna: R Foundation for statistical computing. Available: http://www.R-project.org. Accessed 2012 Jun 28.
58. Bates DM, Sarkar D, (2007) lme4: Linear mixed-effects models using S4 classes. R package version 0.99875-6.