Multisensory Integration Affects Visuo-Spatial Working Memory

Journal of Experimental Psychology: Human Perception and Performance

Volumn 37, Issue 4, 2011, Pages 1099-1109

  Botta, Fabiano ^a,b   Santangelo, Valerio ^c,d   Raffone, Antonino ^a,e   Sanabria, Daniel ^b   Lupiáñez, Juan ^b   Belardinelli, Marta Olivetti ^a,e,f  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b UNIVERSITY OF GRANADA   (Spain)

^c IRCCS FONDAZIONE SANTA LUCIA   (Italy)

^d UNIVERSITY OF PERUGIA   (Italy)

^e RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^f ECONA   (Italy)

Author keywords

Attentional capture; Crossmodal attention; Exogenous orienting; Multisensory integration; Visuo spatial working memory

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDITORY STIMULATION; DEPTH PERCEPTION; FEMALE; HEARING; HUMAN; MALE; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; REFERENCE VALUE; SHORT TERM MEMORY; VISUAL FIELD;

ACOUSTIC STIMULATION; ADULT; ATTENTION; AUDITORY PERCEPTION; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; MALE; MEMORY, SHORT-TERM; PHOTIC STIMULATION; REFERENCE VALUES; SPACE PERCEPTION; VISUAL FIELDS; YOUNG ADULT;

EID: 79961130225     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0023513     Document Type: Article

References (69)

1. Alais D., Burr D. The ventriloquist effect results from near-optimal bimodal integration. Current Biology 2004, 14:257-262.
2. Awh E., Jonides J. Overlapping mechanism of attention and spatial working memory. Trends in Cognitive Sciences 2001, 5:119-126.
3. Awh E., Jonides J., Smith E.E., Buxton R.B., Frank L.R., Love T., Wong E.C. Rehearsal in spatial working memory: Evidence from neuroimaging. Psychological Science 1999, 10:443-447.
4. Awh E., Smith E.E., Jonides Human rehearsal processes and the frontal lobes: PET evidence. Annals of the New York Academy of Sciences, Vol. 769. Structure and functions of the human prefrontal cortex 1995, 97-119. New York Academy of Sciences, New York. J. Grafman, K. Holyoak, F. Boiler (Eds.).
5. Awh E., Vogel E., Oh S.H. Interactions between attention and working memory. Neuroscience 2006, 139:201-208.
6. Baddeley A., Hitch G. Working memory. The Psychology of Learning and Motivation 1974, 47-89. Academic Press, New York. G. Bower (Ed.).
7. Battaglia P.W., Jacobs R.A., Aslin R.N. Bayesian integration of visual and auditory signals for spatial localization. Journal of the Optical Society A 2003, 20:1391-1397.
8. Belopolsky A.V., Zwaan L., Theeuwes J., Kramer A.F. The size of an attentional window modulates attentional capture by color singletons. Psychonomic Bulletin & Review 2007, 14:934-938.
9. Botta F., Santangelo V., Raffone A., Lupiáñez J., Olivetti Belardinelli M. Exogenous and endogenous spatial attention effects on visuo-spatial working memory. Quarterly Journal of Experimental Psychology 2010, 27:1-13.
10. Bundesen C. A theory of visual attention. Psychological Review 1990, 97:523-547.
11. Burr D., Alais D. Combining visual and auditory information. Progress in Brain Research 2006, 155:243-258.
12. Calvert G.A., Spence C., Stein B.E. The handbook of multisensory processes 2004, MIT Press, Cambridge, MA.
13. Castiello U., Umiltà C. Splitting focal attention. Journal of Experimental Psychology: Human Perception & Performance 1992, 18:837-848.
14. Corsi, P. M. (1972). Human memory and the medial temporal region of the brain. (Unpublished doctoral dissertation). McGill University, Montreal, Canada.
15. Dalton P., Spence C. Attentional capture in serial audiovisual search tasks. Perception & Psychophysics 2007, 69:422-438.
16. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annual Review of Neuroscience 1995, 18:193-222.
17. Driver J. A selective review of selective attention research from the past century. British Journal of Psychology 2001, 92:53-78.
18. Driver J., Spence C. Crossmodal links in spatial attention. Proceedings of the Royal Society of London Series B 1998, 353:1-13.
19. Eimer M. Electrophysiology of human crossmodal spatial attention. Crossmodal space and crossmodal attention 2004, 221-245. Oxford University Press, Oxford, UK. C. Spence, J. Driver (Eds.).
20. Eimer M., Schröger E. ERP effects of intermodal attention and cross-modal links in spatial attention. Psychophysiology 1998, 35:313-327.
21. Eriksen C.W., St.James J.D. Visual attention within and around the field of focal attention: A zoom lens model. Perception & Psychophysics 1986, 40:225-240.
22. Ernst M.O., Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 2002, 415:429-433.
23. Graziano M.S., Gross C.G. The representation of extrapersonal space: A possible role for bimodal, visuo-tactile neurons. The Cognitive Neurosciences 1995, 1021-1034. MIT Press, Cambridge, MA. M.S. Gazzaniga (Ed.).
24. Griffin I.C., Nobre A.C. Orienting attention to locations in internal representations. Journal of Cognitive Neuroscience 2003, 15:1176-1194.
25. Handy T., Kingstone A., Mangun G.R. Spatial distribution of visual attention: Perceptual sensitivity and response latency. Perception & Psychophysics 1996, 58:613-627.
26. Heron J., Whitaker D., McGraw P.V. Sensory uncertainty governs the extent of audiovisual interaction. Vision Research 2004, 44:2875-2884.
27. Herrero J.L., Nikolaev A.R., Raffone A., van Leeuwen C. Selective attention in visual short-term memory consolidation. Neuroreport 2009, 20:652-656.
28. Ho C., Santangelo V., Spence C. Multisensory warning signals: When spatial correspondence matters. Experimental Brain Research 2009, 195:261-272.
29. Hollingworth A., Rasmussen I.P. Binding objects to locations: The relationship between object files and visual working memory. Journal of Experimental Psychology: Human Perception & Performance 2010, 36:543-564.
30. Holmes N.P., Spence C. Multisensory integration: Space, time and superadditivity. Current Biology 2005, 15:762-764.
31. James W. The principles of psychology 1890, Harvard University Press, Cambridge, MA.
32. Jonides J. Voluntary vs. automatic control over the mind's eye's movement. Attention and performance IX 1981, 187-203. Erlbaum, Hillsdale, NJ. J.B. Long, A.D. Baddeley (Eds.).
33. Kahneman D., Treisman A., Gibbs B.J. The reviewing of object files: Object-specific integration of information. Cognitive Psychology 1992, 24:175-219.
34. Koelewijn T., Bronkhorst A., Theeuwes J. Competition between auditory and visual spatial cues during visual task performance. Experimental Brain Research 2009, 195:593-602.
35. Lavie N. Distracted and confused?: Selective attention under load. Trends in Cognitive Sciences 2005, 9:76-82.
36. Lu Z.L., Dosher B. External noise distinguishes attention mechanisms. Vision Research 1998, 38:1183-1198.
37. Luck S.J., Vogel E.K. The capacity of visual working memory for features and conjunctions. Nature 1997, 390:279-281.
38. Lupiáñez J., Ruz M., Funes M.J., Milliken B. The manifestation of attentional capture: Facilitation or IOR depending on task demands. Psychological Research 2007, 71:77-91.
39. Macaluso E., Driver J. Multisensory spatial interactions: A window onto functional integration in the human brain. Trends in Neurosciences 2005, 28:264-271.
40. Macaluso E., Frith C.D., Driver J. Crossmodal spatial influences of touch on extrastriate visual areas take current gaze-direction into account. Neuron 2002, 34:647-658.
41. Mastroberardino S., Santangelo V., Botta F., Marucci F.S., Olivetti Belardinelli M. How the bimodal format of presentation affects working memory: An overview. Cognitive Processing 2008, 9:69-76.
42. Posner M.I. Orienting of attention. Quarterly Journal of Experimental Psychology 1980, 32:3-25.
43. Posner M.I., Snyder C.R.R. Attention and cognitive control. Information processing and cognition: The Loyola Symposium 1975, 55-85. Erlbaum, Hillsdale, NJ. R. Solso (Ed.).
44. Postle B.R., Awh E., Jonides J., Smith E.E., D'Esposito M. The where and how of attention-based rehearsal in spatial working memory. Cognitive Brain Research 2004, 20:194-205.
45. Prinzmetal W., Amiri H., Allen K., Edwards T. The phenomenology of attention: I. Color, location, orientation, and " clarity." Journal of Experimental Psychology: Human Perception and Performance 1998, 24:261-282.
46. Prinzmetal W., McCool C., Park S. Attention: Reaction time and accuracy reveal different mechanisms. Journal of Experimental Psychology: General 2005, 134:73-92.
47. Prinzmetal W., Park S., Garrett R. Involuntary attention and identification accuracy. Perception & Psychophysics 2005, 67:1344-1353.
48. Prinzmetal W., Presti D.E., Posner M.I. Does attention affect visual feature integration?. Journal of Experimental Psychology: Human Perception & Performance 1986, 12:361-369.
49. Sanabria D., Soto-Faraco S., Spence C. Spatiotemporal interactions between audition and touch depend on hand posture. Experimental Brain Research 2005, 165:505-514.
50. Santangelo V., Ho C., Spence C. Capturing spatial attention with multisensory cues. Psychonomic Bulletin & Review 2008, 15:398-403.
51. Santangelo V., Spence C. Multisensory cues capture spatial attention regardless of perceptual load. Journal of Experimental Psychology 2007, 33:1311-1321.
52. Santangelo V., Spence C. Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies. Consciousness and Cognition 2008, 17:989-1015.
53. Schmidt B.K., Vogel E.K., Woodman G.F., Luck S.J. Voluntary and automatic attentional control of visual working memory. Perception & Psychophysics 2002, 64:754-763.
54. Smyth M.M., Scholey K.A. Interference in immediate spatial memory. Memory & Cognition 1994, 22:1-13.
55. Spence C. Crossmodal spatial attention. Annals of New York Academy of Sciences 2010, 1191:182-200.
56. Spence C., Driver J. Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics 1997, 59:1-22.
57. Spence C., Driver J. A new approach to the design of multimodal warning signals. Engineering psychology and cognitive ergonomics, Vol. 4: Job design, product design and human-computer interaction 1999, 455-461. Ashgate Publishing, Hampshire. D. Harris (Ed.).
58. Spence C., Driver J. Crossmodal space and crossmodal attention 2004, Oxford University Press, Oxford.
59. Spence C., Santangelo V. Capturing spatial attention with multisensory cues: A review. Hearing Research 2009, 258:134-142.
60. Stein B.E., Meredith M.A. The merging of the senses 1993, MIT Press, Cambridge, MA.
61. Stein B.E., Meredith M.A., Wallace M.T. The visually responsive neuron and beyond: Multisensory integration in cat and monkey. Progress in Brain Research 1993, 95:79-90.
62. Treisman A.M. Features and objects: The fourteenth Bartlett memorial lecture. Quarterly Journal of Experimental Psychology 1988, 40A:201-237.
63. Turatto M., Benso F., Facoetti A., Galfano G., Mascetti G.G., Umiltà C. Automatic and voluntary focusing of attention. Perception & Psychophysics 2000, 62:935-952.
64. Van der Burg E., Olivers C.N.L., Bronkhorst A.W., Theeuwes J. Audiovisual events capture attention: Evidence from temporal order judgements. Journal of Vision 2008, 8:1-10.
65. Vogel E.K., Woodman G.F., Luck S.J. Storage of features, conjunctions, and objects in visual working memory. Journal of Experimental Psychology: Human Perception & Performance 2001, 27:92-114.
66. Vroomen J., de Gelder B. Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception and Performance 2000, 26:1583-1590.
67. Wallace M.T., Meredith M.A., Stein B.E. Multisensory integration in the superior colliculus of the alert cat. Journal of Neurophysiology 1998, 80:1006-1010.
68. Woods T.M., Recanzone G.H. Multimodal interactions evidenced by the ventriloquism effect in humans and monkeys. Handbook of multisensory processes 2004, 35-48. MIT Press, Cambridge, MA. C. Spence, G. Calvert, B.E. Stein (Eds.).
69. Zimmer U., Macaluso E. Processing of multisensory spatial congruency can be dissociated form working memory and visuo-spatial attention. European Journal of Neuroscience 2007, 26:1681-1691.