Crossmodal semantic congruence can affect visuo-spatial processing and activity of the fronto-parietal attention networks

Frontiers in Integrative Neuroscience

Volumn 9, Issue JULY, 2015, Pages

  Mastroberardino, Serena ^a   Santangelo, Valerio ^a,b   Macaluso, Emiliano ^a  

^a IRCCS FONDAZIONE SANTA LUCIA   (Italy)

^b UNIVERSITY OF PERUGIA   (Italy)

Author keywords

Attention; Fronto parietal networks; Multisensory; Semantics; Space

Indexed keywords

ANGULAR GYRUS; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; ATTENTION; AUDITORY STIMULATION; CAT; CONTROLLED STUDY; DEPTH PERCEPTION; DOG; EYE MOVEMENT; EYE TRACKING; FEMALE; FRONTOPARIETAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; INFERIOR PARIETAL LOBULE; MALE; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; OCCIPITAL CORTEX; SEMANTIC MEMORY; SEMANTICS; SENSORY STIMULATION; SIGNAL PROCESSING; SUPPLEMENTARY MOTOR AREA; TASK PERFORMANCE; VISUAL FEEDBACK; VISUAL FIELD; VISUAL ORIENTATION; VISUAL STIMULATION;

EID: 84941274415     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2015.00045     Document Type: Article

References (70)

1. Alsius, A., Navarra, J., Campbell, R., and Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Curr. Biol. 15, 839-843. doi: 10.1016/j.cub.2005.03.046
2. Arrington, C., Carr, T., Mayer, A., and Rao, S. (2000). Neural mechanisms of visual attention: object-based selection of a region in space. J. Cogn. Neurosci. 12, 106-117. doi: 10.1162/089892900563975
3. Awh, E., Belopolsky, A. V., and Theeuwes, J. (2012). Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends Cogn. Sci. 16, 437-443. doi: 10.1016/j.tics.2012.06.010
4. Bogler, C., Bode, S., and Haynes, J. D. (2011). Decoding successive computational stages of saliency processing. Curr. Biol. 21, 1667-1671. doi: 10.1016/j.cub.2011.08.039
5. Brown, J. M., and Denney, H. I. (2007). Shifting attention into and out of objects: evaluating the processes underlying the object advantage. Percept. Psychophys. 69, 606-618. doi: 10.3758/BF03193918
6. Bruyer, R., and Brysbaert, M. (2011). Combining speed and accuracy in cognitive psychology: is the Inverse Efficiency Score (IES) a better dependent variable than the mean Reaction Time (RT) and the Percentage of Errors (PE)? Psychol. Belg. 51, 5-13. doi: 10.5334/pb-51-1-5
7. Calvert, G. A. (2001). Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb. Cortex 11, 1110-1123. doi: 10.1093/cercor/11.12.1110
8. Chen, Z. (2012). Object-based attention: a tutorial review. Atten. Percept. Psychophys.74, 784-802. doi: 10.3758/s13414-012-0322-z
9. Constantinidis, C., and Steinmetz, M. A. (2001). Neuronal responses in area 7a to multiple-stimulus displays: I. Neurons encode the location of the salient stimulus.Cereb. Cortex 11, 581-591. doi: 10.1093/cercor/11.7.581
10. Corbetta, M., Kincade, J. M., Ollinger, J. M., McAvoy, M. P., and Shulman, G. L. (2000). Voluntary orienting is dissociated from target detection in human posterior parietal cortex. Nat. Neurosci. 3, 292-297. doi: 10.1038/73009
11. Corbetta, M., Patel, G., and Shulman, G. L. (2008). The reorienting system of the human brain: from environment to theory of mind. Neuron 58, 306-324. doi: 10.1016/j.neuron.2008.04.017
12. Corbetta, M., and Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201-215. doi: 10.1038/nrn755
13. De Lucia, M., Clarke, S., and Murray, M. M. (2010). A temporal hierarchy for conspecific vocalization discrimination in humans. J. Neurosci. 30, 11210-11221. doi: 10.1523/JNEUROSCI.2239-10.2010
14. Doehrmann, O., and Naumer, M. J. (2008). Semantics and the multisensory brain: how meaning modulates processes of audio-visual integration. Brain Res. 1242, 136-150. doi: 10.1016/j.brainres.2008.03.071
15. Downar, J., Crawley, A. P., Mikulis, D. J., and Davis, K. D. (2000). A multimodal cortical network for the detection of changes in the sensory environment. Nat. Neurosci. 3, 277-283. doi: 10.1038/72991
16. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature 381, 66-68. doi: 10.1038/381066a0
17. Eimer, M., and Kiss, M. (2008). Involuntary attentional capture is determined by task set: evidence from event-related brain potentials. J. Cogn. Neurosci. 20, 1423-1433. doi: 10.1162/jocn.2008.20099
18. Fiebelkorn, I. C., Foxe, J. J., Schwartz, T. H., and Molholm, S. (2010). Staying within the lines: the formation of visuospatial boundaries influences multisensory feature integration. Eur. J. Neurosci. 31, 1737-1743. doi: 10.1111/j.1460-9568.2010.07196.x
19. Folk, C. L., Remington, R., and Johnson, J. C. (1992). Involuntary covert orienting is contingent on attentional control settings. J. Exp. Psychol. Hum. Percept. Perform. 19, 676-681. doi: 10.1037//0096-1523.18.4.1030
20. Friston, K. J., Glaser, D. E., Henson, R. N., Kiebel, S., Phillips, C., and Ashburner, J. (2002). Classical and Bayesian inference in neuroimaging: applications. Neuroimage16, 484-512. doi: 10.1006/nimg.2002.1091
21. Geng, J. J., and Vossel, S. (2013). Re-evaluating the role of TPJ in attentional control: contextual updating? Neurosci. Biobehav. Rev. 37, 2608-2620. doi: 10.1016/j.neubiorev.2013.08.010
22. Gottlieb, J. P., Kusunoki, M., and Goldberg, M. E. (1998). The representation of visual salience in monkey parietal cortex. Nature 391, 481-484. doi: 10.1038/35135
23. Greicius, M. D., Krasnow, B., Reiss, A. L., and Menon, V. (2003). Functional connectivity in the resting brain: a network analysis of the default mode hypothesis.Proc. Natl. Acad. Sci. U.S.A. 100, 253-258. doi: 10.1073/pnas.0135058100
24. Hill, K. T., and Miller, L. M. (2010). Auditory attentional control and selection during cocktail party listening. Cereb. Cortex 20, 583-590. doi: 10.1093/cercor/bhp124
25. Indovina, I., and Macaluso, E. (2007). Dissociation of stimulus relevance and saliency factors during shifts of visuospatial attention. Cereb. Cortex 17, 1701-1711. doi: 10.1093/cercor/bhl081
26. Iordanescu, L., Grabowecky, M., Franconeri, S., Theeuwes, J., and Suzuki, S. (2010). Characteristic sounds make you look at target objects more quickly. Atten. Percept. Psychophys. 72, 1736-1741. doi: 10.3758/APP.72.7.1736
27. Iordanescu, L., Guzman-Martinez, E., Grabowecky, M., and Suzuki, S. (2008). Characteristic sounds facilitate visual search. Psychon. Bull. Rev. 15, 548-554. doi: 10.3758/PBR.15.3.548
28. Kastner, S., and Ungerleider, L. G. (2001). The neural basis of biased competition in human visual cortex. Neuropsychologia 39, 1263-1276. doi: 10.1016/S0028-3932(01)00116-6
29. Kincade, J. M., Abrams, R. A., Astafiev, S. V., Shulman, G. L., and Corbetta, M. (2005). An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention. J. Neurosci. 25, 4593-4604. doi: 10.1523/JNEUROSCI.0236-05.2005
30. Koelewijn, T., Bronkhorst, A., and Theeuwes, J. (2010). Attention and the multiple stages of multisensory integration: a review of audiovisual studies. Acta Psychol. 134, 372-384. doi: 10.1016/j.actpsy.2010.03.010
31. Krumbholz, K., Nobis, E. A., Weatheritt, R. J., and Fink, G. R. (2009). Executive control of spatial attention shifts in the auditory compared to the visual modality.Hum. Brain Mapp. 30, 1457-1469. doi: 10.1002/hbm.20615
32. Macaluso, E., and Doricchi, F. (2013). Attention and predictions: control of spatial attention beyond the endogenous-exogenous dichotomy. Front. Hum. Neurosci.7:685. doi: 10.3389/fnhum.2013.00685
33. Macaluso, E., Eimer, M., Frith, C. D., and Driver, J. (2003). Preparatory states in crossmodal spatial attention: spatial specificity and possible control mechanisms. Exp. Brain Res. 149, 62-74. doi: 10.1007/s00221-002-1335-y
34. Macaluso, E., Frith, C. D., and Driver, J. (2002). Supramodal effects of covert spatial orienting triggered by visual or tactile events. J. Cogn. Neurosci. 14, 389-401. doi: 10.1162/089892902317361912
35. Matusz, P. J., Broadbent, H., Ferrari, J., Forrest, B., Merkley, R., and Scerif, G. (2015). Multi-modal distraction: insights from children's limited attention. Cognition 136, 156-165. doi: 10.1016/j.cognition.2014.11.031
36. Matusz, P. J., and Eimer, M. (2011). Multisensory enhancement of attentional capture in visual search. Psychon. Bull. Rev. 18, 904-909. doi: 10.3758/s13423-011-0131-8
37. McDonald, J. J., Teder-Sälejärvi, W. A., and Hillyard, S. A. (2000). Involuntary orienting to sound improves visual perception. Nature 407, 906-908. doi: 10.1038/35038085
38. McDonald, J. J.,Teder-Sälejärvi, W. A., and Ward, L. M. (2001). Multisensory integration and crossmodal attention effects in the human brain. Science 292, 1791-1791. doi: 10.1126/science.292.5523.1791a
39. Nardo, D., Santangelo, V., and Macaluso, E. (2011). Stimulus-driven orienting of visuo-spatial attention in complex dynamic environments. Neuron 69, 1015-1028. doi: 10.1016/j.neuron.2011.02.020
40. Nardo, D., Santangelo, V., and Macaluso, E. (2014). Spatial orienting in complex audiovisual environments. Hum. Brain Mapp. 35, 1597-1614. doi: 10.1002/hbm.22276
41. Natale, E., Marzi, C. A., and Macaluso, E. (2009). FMRI correlates of visuo-spatial reorienting investigated with an attention shifting double-cue paradigm. Hum. Brain Mapp. 30, 2367-2381. doi: 10.1002/hbm.20675
42. Noppeney, U., Josephs, O., Hocking, J., Price, C. J., and Friston, K. J. (2007). The effect of prior visual information on recognition of speech and sounds. Cereb. Cortex18, 598-609. doi: 10.1093/cercor/bhm091
43. Penny, W. D., and Holmes, A. P. (2004). "Random effects analysis," in Human Brain Function, 2 Edn, eds R. S. J. Frackowiak, K. J. Friston, R. Frith, K. J. Dolan, C. J. Price, S. Zeki, et al. (San Diego, CA: Academic Press), 843-850.
44. Posner, M. I., and Cohen, Y. (1984). "Components of visual orienting," in Attention and Performance, eds H. Bouma and D. Bowhuis (Hillsdale, NJ: Lawrence Erlbaum), 531-556. doi: 10.1093/cercor/bhm091
45. Ptak, R. (2012). The frontoparietal attention network of the human brain action, saliency, and a priority map of the environment. Neuroscientist 18, 502-515. doi: 10.1177/1073858411409051
46. Raichle, M. E., MacLeod, A. M., Snyder, A. Z., Powers, W. J., Gusnard, D. A., and Shulman, G. L. (2001). A default mode of brain function. Proc. Natl. Acad. Sci. U.S.A.98, 676-682. doi: 10.1073/pnas.98.2.676
47. Rauschenberger, R. (2003). Attentional capture by auto-and allo-cues. Psychon. Bull. Rev. 10, 814-842. doi: 10.3758/BF03196545
48. Ruz, M., and Lupiáñez, J. (2002). A review of attentional capture: on its automaticity and sensitivity to endogenous control. Psicológica 23, 283-369.
49. Santangelo, V., Ho, C., and Spence, C. (2008a). Capturing spatial attention with multisensory cues. Psychon. Bull. Rev. 15, 398-403. doi: 10.3758/pbr.15.2.398
50. Santangelo, V., Van der Lubbe, R. H., Olivetti Belardinelli, M., and Postma, A. (2008b). Multisensory integration affects ERP components elicited by exogenous cues. Exp. Brain Res. 185, 269-277. doi: 10.1007/s00221-007-1151-5
51. Santangelo, V., and Macaluso, E. (2012). "Spatial attention and audiovisual processing," in The New Handbook of Multisensory Processes, ed. B. E. Stein (Cambridge, MA: The MIT Press), 359-370.
52. Santangelo, V., and Spence, C. (2007). Multisensory cues capture spatial attention regardless of perceptual load. J. Exp. Psychol. Hum. Percept. Perform. 33, 1311-1321. doi: 10.1037/0096-1523.33.6.1311
53. Santangelo, V., and Spence, C. (2008). Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies. Conscious. Cogn.17, 989-1015. doi: 10.1016/j.concog.2008.02.006
54. Santangelo, V., Van der Lubbe, R. H., Olivetti Belardinelli, M., and Postma, A. (2006). Spatial attention triggered by unimodal, crossmodal, and bimodal exogenous cues: a comparison of reflexive orienting mechanisms. Exp. Brain Res. 173, 40-48. doi: 10.1007/s00221-006-0361-6
55. Schall, J. D., and Hanes, D. P. (1993). Neural basis of saccade target selection in frontal eye field during visual search. Nature 366, 467-469. doi: 10.1038/366467a0
56. Shams, L., and Beierholm, U. R. (2010). Causal inference in perception. Trends Cogn. Sci. 14, 425-432. doi: 10.1016/j.tics.2010.07.001
57. Spence, C. (2010). Crossmodal spatial attention. Ann. N. Y. Acad. Sci. 1191, 182-200. doi: 10.1111/j.1749-6632.2010.05440.x
58. Spence, C., and Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Percept. Psychophys. 59, 1-22. doi: 10.3758/BF03206843
59. Spence, C., and Driver, J. (1998). Inhibition of return following an auditory cue: the role of central reorienting events. Exp. Brain Res. 118, 352-360. doi: 10.1007/s002210050289
60. Spence, C., and Santangelo, V. (2009). Capturing spatial attention with multisensory cues: a review. Hear. Res. 258, 134-142. doi: 10.1016/j.heares.2009.04.015
61. Stevenson, R. A., Wallace, M. T., and Altieri, N. (2014). The interaction between stimulus factors and cognitive factors during multisensory integration of audiovisual speech. Front. Psychol. 5:352. doi: 10.3389/fpsyg.2014.00352
62. Striemer, C. L., Chouinard, P. A., Goodale, M. A., and de Ribaupierre, S. (2015). Overlapping neural circuits for visual attention and eye movements in the human cerebellum. Neuropsychologia 69, 9-21. doi: 10.1016/j.neuropsychologia.2015.01.024
63. Talsma, D., Senkowski, D., Soto-Faraco, S., and Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. 14, 400-410. doi: 10.1016 /j.tics.2010.06.008
64. Taylor, K. I., Moss, H. E., Stamatakis, E. A., and Tyler, L. K. (2006). Binding crossmodal object features in perirhinal cortex. Proc. Natl. Acad. Sci. U.S.A. 103, 8239-8244. doi: 10.1073/pnas.0509704103
65. Townsend, J. T., and Ashby, F. G. (1983). Stochastic Modeling of Elementary Psychological Processes. Cambridge: Cambridge University Press.
66. van den Brink, R. L., Cohen, M. X., van der Burg, E., Talsma, D., Vissers, M. E., and Slagter, H. A. (2014). Subcortical, modality-specific pathways contribute to multisensory processing in humans. Cereb. Cortex 24, 2169-2177. doi: 10.1093/cercor/bht069
67. Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., and Theeuwes, J. (2008). Pip and pop: nonspatial auditory signals improve spatial visual search. J. Exp. Psychol. Hum. Percept. Perform. 34, 1053-1065. doi: 10.1037/0096-1523.34.5.1053
68. Van der Burg, E., Olivers, C., and Theeuwes, J. (2012). The attentional window modulates capture by audiovisual events. PLoS ONE 7:e39137. doi: 10.1371/journal.pone.0039137
69. Vecera, S. P., and Farah, M. J. (1994). Does visual attention select objects or locations? J. Exp. Psychol. Gen. 123, 146-160. doi: 10.1037/0096-3445.123.2.146
70. Yantis, S., Schwarzbach, J., Serences, J. T., Carlson, R. L., Steinmetz, M. A., Pekar, J. J., et al. (2002). Transient neural activity in human parietal cortex during spatial attention shifts. Nat. Neurosci. 5, 995-1002. doi: 10.1038/nn921