Modality-dependent "what" and "where" preparatory processes in auditory and visual systems

Journal of Cognitive Neuroscience

Volumn 23, Issue 7, 2011, Pages 1609-1623

  Diaconescu, Andreea Oliviana ^a,b   Alain, Claude ^a,b   McIntosh, Anthony Randal ^a,b  

^a BAYCREST CENTRE FOR GERIATRIC CARE   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; AUDITORY SYSTEM; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PARTIAL LEAST SQUARES REGRESSION; PERCEPTIVE DISCRIMINATION; PRIORITY JOURNAL; SPATIAL ORIENTATION; VISUAL STIMULATION; VISUAL SYSTEM;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ANTICIPATION, PSYCHOLOGICAL; CUES; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; MALE; MENTAL PROCESSES; PHOTIC STIMULATION; SOUND LOCALIZATION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 79955847786     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2010.21465     Document Type: Article

References (51)

1. Alain, C., Arnott, S. R., Hevenor, S., Graham, S., & Grady, C. L. (2001). "What" and "where" in the human auditory system. Proceedings of the National Academy of Sciences, U.S.A., 98, 12301-12306.
2. Alain, C., McDonald, K. L., Kovacevic, N., & McIntosh, A. R. (2009). Spatiotemporal analysis of auditory "what" and "where" working memory. Cerebral Cortex, 19, 305-314.
3. Allison, T., Puce, A., & McCarthy, G. (2000). Social perception from visual cues: Role of the STS region. Trends in Cognitive Sciences, 4, 267-278.
4. Altmann, C. F., Bledowski, C., Wibral, M., & Kaiser, J. (2007). Processing of location and pattern changes of natural sounds in the human auditory cortex. Neuroimage, 35, 1192-1200.
5. Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M. S., & Naumer, M. J. (2005). Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research, 166, 559-571.
6. Andersen, R. A., Snyder, L. H., Bradley, D. C., & Xing, J. (1997). Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annual Review of Neuroscience, 20, 303-330.
7. Arnott, S. R., Binns, M. A., Grady, C. L., & Alain, C. (2004). Assessing the auditory dual-pathway model in humans. Neuroimage, 22, 401-408.
8. Arnott, S. R., Grady, C. L., Hevenor, S. J., Graham, S., & Alain, C. (2005). The functional organization of auditory working memory as revealed by fMRI. Journal of Cognitive Neuroscience, 17, 819-831.
9. Bushara, K. O., Weeks, R. A., Ishii, K., Catalan, M. J., Tian, B., Rauschecker, J. P., et al. (1999). Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans. Nature Neuroscience, 2, 759-766.
10. Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657.
11. Chawla, D., Rees, G., & Friston, K. J. (1999). The physiological basis of attentional modulation in extrastriate visual areas. Nature Neuroscience, 2, 671-676.
12. Cohen, Y. E., Russ, B. E., & Gifford, G. W., III (2005). Auditory processing in the posterior parietal cortex. Behavioural and Cognitive Neuroscience Reviews, 4, 218-231.
13. Colby, C. L., & Goldberg, M. E. (1999). Space and attention in parietal cortex. Annual Review of Neuroscience, 22, 319-349.
14. Courtney, S. M., Ungerleider, L. G., Keil, K., & Haxby, J. V. (1996). Object and spatial visual working memory activate separate neural systems in human cortex. Cerebral Cortex, 6, 39-49.
15. Dale, C. L., Simpson, G. V., Foxe, J. J., Luks, T. L., & Worden, M. S. (2008). ERP correlates of anticipatory attention: Spatial and non-spatial specificity and relation to subsequent selective attention. Experimental Brain Research, 188, 45-62.
16. Damasio, A. R., Damasio, H., & Van Hoesen, G. W. (1982). Prosopagnosia: Anatomic basis and behavioral mechanisms. Neurology, 32, 331-341.
17. Diaconescu, A. O., Kovacevic, N., & McIntosh, A. R. (2008). Modality-independent processes in cued motor preparation revealed by cortical potentials. Neuroimage, 42, 1255-1265.
18. Efron, B., & Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals and other measures of statistical accuracy. Statistical Science, 1, 54-77.
19. Eimer, M., van Velzen, J., & Driver, J. (2002). Cross-modal interactions between audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations. Journal of Cognitive Neuroscience, 14, 254-271.
20. Foxe, J. J., Simpson, G. V., Ahlfors, S. P., & Saron, C. D. (2005). Biasing the brain's attentional set: I. Cue driven deployments of intersensory selective attention. Experimental Brain Research, 166, 370-392.
21. Goodale, M. A., & Milner, A. D. (1992). Separate visual pathways for perception and action. Trends in Neurosciences, 15, 20-25.
22. Green, J. J., Teder-Salejarvi, W. A., & McDonald, J. J. (2005). Control mechanisms mediating shifts of attention in auditory and visual space: A spatio-temporal ERP analysis. Experimental Brain Research, 166, 358-369.
23. Haxby, J. V., Grady, C. L., Horwitz, B., Ungerleider, L. G., Mishkin, M., Carson, R. E., et al. (1991). Dissociation of object and spatial visual processing pathways in human extrastriate cortex. Proceedings of the National Academy of Sciences, U.S.A., 88, 1621-1625.
24. Heinze, H. J., Mangun, G. R., Burchert, W., Hinrichs, H., Scholz, M., Munte, T. F., et al. (1994). Combined spatial and temporal imaging of brain activity during visual selective attention in humans. Nature, 372, 543-546.
25. Hill, K. T., & Miller, L. M. (2010). Auditory attentional control and selection during cocktail party listening. Cerebral Cortex, 20, 583-590.
26. Hillyard, S. A., & Anllo-Vento, L. (1998). Event-related brain potentials in the study of visual selective attention. Proceedings of the National Academy of Sciences, U.S.A., 95, 781-787.
27. Hopf, J. M., & Mangun, G. R. (2000). Shifting visual attention in space: An electrophysiological analysis using high spatial resolution mapping. Clinical Neurophysiology, 111, 1241-1257.
28. Iacoboni, M., Woods, R. P., & Mazziotta, J. C. (1998). Bimodal (auditory and visual) left frontoparietal circuitry for sensorimotor integration and sensorimotor learning. Brain, 121, 2135-2143.
29. Kubovy, M., & Van Valkenburg, D. (2001). Auditory and visual objects. Cognition, 80, 97-126.
30. Livingstone, M., & Hubel, D. (1988). Segregation of form, color, movement, and depth: Anatomy, physiology, and perception. Science, 240, 740-749.
31. Lobaugh, N. J., West, R., & McIntosh, A. R. (2001). Spatiotemporal analysis of experimental differences in event-related potential data with partial least squares. Psychophysiology, 38, 517-530.
32. Maeder, P. P., Meuli, R. A., Adriani, M., Bellmann, A., Fornari, E., Thiran, J. P., et al. (2001). Distinct pathways involved in sound recognition and localization: A human fMRI study. Neuroimage, 14, 802-816.
33. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
34. McIntosh, A. R., Bookstein, F. L., Haxby, J. V., & Grady, C. L. (1996). Spatial pattern analysis of functional brain images using Partial Least Squares. Neuroimage, 3, 143-157.
35. McIntosh, A. R., & Lobaugh, N. J. (2004). Partial least squares analysis of neuroimaging data: Applications and advances. Neuroimage, 23(Suppl. 1), S250-S263.
36. Mishkin, M., & Ungerleider, L. G. (1982). Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys. Behavioural Brain Research, 6, 57-77.
37. Molholm, S., Ritter, W., Javitt, D. C., & Foxe, J. J. (2004). Multisensory visual-auditory object recognition in humans: A high-density electrical mapping study. Cerebral Cortex, 14, 452-465.
38. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Brain Research, Cognitive Brain Research, 14, 115-128.
39. Molholm, S., Sehatpour, P., Mehta, A. D., Shpaner, M., Gomez-Ramirez, M., Ortigue, S., et al. (2006). Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. Journal of Neurophysiology, 96, 721-729.
40. Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Gonzalez Andino, S., et al. (2004). Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage, 21, 125-135.
41. Poremba, A., Saunders, R. C., Crane, A. M., Cook, M., Sokoloff, L., & Mishkin, M. (2003). Functional mapping of the primate auditory system. Science, 299, 568-572.
42. Proctor, R. W., Dutta, A., Kelly, P. L., & Weeks, D. J. (1994). Cross-modal compatibility effects with visual-spatial and auditory-verbal stimulus and response sets. Perception & Psychophysics, 55, 42-47.
43. Puce, A., Allison, T., Bentin, S., Gore, J. C., & McCarthy, G. (1998). Temporal cortex activation in humans viewing eye and mouth movements. Journal of Neuroscience, 18, 2188-2199.
44. Salmi, J., Rinne, T., Degerman, A., Salonen, O., & Alho, K. (2007). Orienting and maintenance of spatial attention in audition and vision: Multimodal and modality-specific brain activations. Brain Structure and Function, 212, 181-194.
45. Shen, L., Hu, X., Yacoub, E., & Ugurbil, K. (1999). Neural correlates of visual form and visual spatial processing. Human Brain Mapping, 8, 60-71.
46. Shomstein, S., & Yantis, S. (2006). Parietal cortex mediates voluntary control of spatial and nonspatial auditory attention. Journal of Neuroscience, 26, 435-439.
47. Smith, D. V., Davis, B., Niu, K., Healy, E. W., Bonilha, L., Fridriksson, J., et al. (2010). Spatial attention evokes similar activation patterns for visual and auditory stimuli. Journal of Cognitive Neuroscience, 22, 347-361.
48. Spence, C., & Driver, J. (1994). Covert spatial orienting in audition: Exogenous and endogenous mechanisms. Journal of Experimental Psychology: Human Perception and Performance, 20, 555-574.
49. Spence, C., & Driver, J. (1997). On measuring selective attention to an expected sensory modality. Perception & Psychophysics, 59, 389-403.
50. Weeks, R. A., Aziz-Sultan, A., Bushara, K. O., Tian, B., Wessinger, C. M., Dang, N., et al. (1999). A PET study of human auditory spatial processing. Neuroscience Letters, 262, 155-158.
51. Wu, C. T., Weissman, D. H., Roberts, K. C., & Woldorff, M. G. (2007). The neural circuitry underlying the executive control of auditory spatial attention. Brain Research, 1134, 187-198.