The costs of crossing paths and switching tasks between audition and vision

Brain and Cognition

Volumn 69, Issue 1, 2009, Pages 47-55

  Murray, Micah M ^a,b   Santis, Laura De ^a   Thut, Gregor ^c,d   Wylie, Glenn R ^e,f  

^a LAUSANNE UNIVERSITY HOSPITAL   (Switzerland)

^b University of Lausanne   (Switzerland)

^c GENEVA UNIVERSITY HOSPITALS   (Switzerland)

^d UNIVERSITY OF GLASGOW   (United Kingdom)

^e KESSLER FOUNDATION   (United States)

^f RUTGERS NEW JERSEY MEDICAL SCHOOL   (United States)

Author keywords

'What' and 'where' pathways; Auditory; Crossmodal; Executive functions; Multisensory; Object recognition; Spatial localization; Switch cost; Task switching; Visual

Indexed keywords

ADULT; ARTICLE; AUDITORY DISCRIMINATION; AUDITORY STIMULATION; CONTROLLED STUDY; FEMALE; HEARING; HUMAN; MALE; NERVE CELL; NORMAL HUMAN; PRIORITY JOURNAL; SENSORY EVALUATION; SPATIAL DISCRIMINATION; TASK PERFORMANCE; VISION; VISUAL DISCRIMINATION; VISUAL STIMULATION;

ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; CUES; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; MALE; REACTION TIME; SPACE PERCEPTION; TASK PERFORMANCE AND ANALYSIS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 58749098625     PISSN: 02782626     EISSN: 10902147     Source Type: Journal    
DOI: 10.1016/j.bandc.2008.05.004     Document Type: Article

References (55)

1. Alain C., Arnott S.R., Hevenor S., Graham S., and Grady C.L. "What" and "Where" in the human auditory system. Proceedings of the National Academy of Sciences of the United States of America 98 (2001) 12301-12306
2. Allport D.A., Styles E.A., and Hsieh S. Shifting intentional set: Exploring the dynamic control of tasks. In: Umilta C., and Moscovitch (Eds). Attention and performance XI (1994), MIT Press, Cambridge, MA 107-132
3. Allport D.A., and Wylie G.R. Task-switching: Positive and negative priming of task-set. In: Humphreys G.W., Duncan J., and Treisman A.M. (Eds). Attention space and action: Studies in cognitive neuroscience (1999), Oxford University Press, Oxford 273-296
4. Allport D.A., and Wylie G.R. Task-switching, stimulus-response bindings, and negative priming. In: Monsell S., and Driver J.S. (Eds). Control of cognitive processes: Attention and performance XVIII (2001), MIT Press, Cambridge, MA 35-70
5. Brass M., and von Cramon D.Y. The role of the frontal cortex in task preparation. Cerebral Cortex 12 (2002) 908-914
6. Brass M., and von Cramon D.Y. Decomposing components of task preparation with functional magnetic resonance imaging. Journal of Cognitive Neuroscience 16 (2004) 609-620
7. Cappe C., and Barone P. Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. European Journal of Neuroscience 22 (2005) 2886-2902
8. Chan J.S., and Newell F.N. Behavioral evidence for task-dependent "what" versus "where" processing within and across modalities. Perception & Psychophysics 70 (2008) 36-49
9. De Santis L., Clarke S., and Murray M.M. Automatic and intrinsic auditory "what" and "where" processing in humans revealed by electrical neuroimaging. Cerebral Cortex 17 (2007) 9-17
10. De Santis L., Spierer L., Clarke S., and Murray M.M. Getting in touch: Segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging. Neuroimage 37 (2007) 890-903
11. Duncan J., Martens S., and Ward R. Restricted attentional capacity within but not between sensory modalities. Nature 387 (1997) 808-810
12. Falchier A., Clavagnier S., Barone P., and Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. Journal of Neuroscience 22 (2002) 5749-5759
13. Gade M., and Koch I. Cue-task associations in task switching. The Quarterly Journal of Experimental Psychology (Colchester) 60 (2007) 762-769
14. Ghazanfar A.A., and Schroeder C.E. Is neocortex essentially multisensory?. Trends in Cognitive Sciences 10 (2006) 278-285
15. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 11 (1999) 473-490
16. Gondan M., Lange K., Rösler F., and Röder B. The redundant target effect is affected by modality switch costs. Psychonomic Bulletin & Review 11 (2004) 307-313
17. Haxby J.V., Horwitz B., Ungerleider L.G., Maisog J.M., Pietrini P., and Grady C.L. The functional organization of human extrastriate cortex: A PET-rCBF study of selective attention to faces and locations. Journal of Neuroscience 14 (1994) 6336-6353
18. Hunt A.R., and Kingstone A. Multisensory executive functioning. Brain and Cognition 55 (2004) 325-327
19. Jersild A.T. Mental set and shift. Archives of Psychology 89 (1927) 5-82
20. Jolicoeur P. Restricted attentional capacity between sensory modalities. Psychonomic Bulletin & Review 6 (1999) 87-92
21. Kaas J.H., and Hackett T.A. Subdivisions of auditory cortex and processing streams in primates. Proceedings of the National Academy of Sciences of the United States of America 97 (2000) 11793-11799
22. Kayser C., Petkov C.I., Augath M., and Logothetis N.K. Functional imaging reveals visual modulation of specific fields in auditory cortex. Journal of Neuroscience 27 (2007) 1824-1835
23. Koch I., and Allport A. Cue-based preparation and stimulus-based priming of tasks in task switching. Memory & Cognition 34 (2006) 433-444
24. Logan G.D., and Bundesen C. Clever Homunculus: Is there an endogenous act of control in the explicit task-cuing procedure. Journal of Experimental Psychology: Human Perception and Performance 29 (2003) 575-599
25. Maeder P.P., Meuli R.A., Adriani M., Bellmann A., Fornari E., Thiran J.P., et al. Distinct pathways involved in sound recognition and localization: A human fMRI study. Neuroimage 14 (2001) 802-816
26. Martuzzi R., Murray M.M., Michel C.M., Thiran J.P., Maeder P.P., Clarke S., et al. Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cerebral Cortex 17 (2007) 1672-1679
27. Meiran N. Reconfiguration of processing mode prior to task performance. Journal of Experimental Psychology Learning Memory & Cognition 22 (1996) 1423-1442
28. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory integration of coherent auditory and visual stimulation is a feedforward, pre-perceptual cortical process: A high density electrical mapping and behavioral study. Cognitive Brain Research 14 (2002) 115-128
29. Molholm S., Martinez A., Shpaner M., and Foxe J.J. Object-based attention is multisensory: Co-activation of an object's representations in ignored sensory modalities. European Journal of Neuroscience 26 (2007) 499-509
30. Monsell S. Control of mental processes. In: Bruce V. (Ed). Unsolved mysteries of the mind: Tutorial essays in cognition (1996), Erlbaum, Taylor, and Francis, Hove, UK 93-148
31. Murray M.M., Camen C., Gonzalez Andino S.L., Bovet P., and Clarke S. Rapid brain discrimination of sounds of objects. Journal of Neuroscience 26 (2006) 1293-1302
32. Nicholson R., Karayanidis F., Poboka D., Heathcote A., and Michie P. Electrophysiological correlates of anticipatory task-switching processes. Psychophysiology 42 (2005) 540-554
33. Norman D.A., and Shallice T. Attention to action: Willed and automatic control of behaviour. In: Davidson R.J., Schwartz G.E., and Shapiro D. (Eds). Consciousness and self-regulation: Advances in research and theory (1986), Plenum Press
34. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9 (1971) 97-113
35. Rivier F., and Clarke S. Cytochrome oxidase, acetylcholinesterase, and NADPH-diaphorase staining in human supratemporal and insular cortex: evidence for multiple auditory areas. Neuroimage 6 (1997) 288-304
36. Rockland K.S., and Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey. International Journal of Psychophysiology 50 (2003) 19-26
37. Rogers R.D., and Monsell S. Costs of a predictable switch between simple cognitive tasks. Journal of Experimental Psychology 124 (1995) 207-231
38. Romanski L.M., Tian B., Fritz J., Mishkin M., Goldman-Rakic P.S., and Rauschecker J.P. Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nature Neuroscience 2 (1999) 1131-1136
39. Romei V., Murray M.M., Merabet L.B., and Thut G. Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: Implications for multisensory interactions. Journal of Neuroscience 27 (2007) 11465-11472
40. Rubinstein J.S., Meyer D.E., and Evans J.E. Executive control of cognitive processes in task switching. Journal of Experimental Psychology: Human Perception and Performance 27 (2001) 763-797
41. Sestieri C., Di Matteo R., Ferretti A., Del Gratta C., Caulo M., Tartaro A., et al. "What" versus "where" in the audiovisual domain: An fMRI study. Neuroimage 33 (2006) 672-680
42. Snodgrass J.G., and Vanderwart M. A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology Human Learning 6 (1980) 174-215
43. Spector A., and Biederman I. Mental set and shift revisited. American Journal of Psychology 89 (1976) 669-679
44. Spence C., Nicholls M.E.R., and Driver J. The cost of expecting events in the wrong sensory modality. Perception & Psychophysics 63 (2001) 330-336
45. Tardif E., Spierer L., Clarke S., and Murray M.M. Interactions between auditory 'what' and 'where' pathways revealed by enhanced near-threshold discrimination of frequency and position. Neuropsychologia 46 (2008) 958-966
46. Tian B., Reser D., Durham A., Kustov A., and Rauschecker J.P. Functional specialization in rhesus monkey auditory cortex. Science 292 (2001) 290-293
47. Ungerleider L.G., and Mishkin M. Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys. Behavioural Brain Research 6 (1982) 57-77
48. Wylie G., and Allport A. Task switching and the measurement of switch costs. Psychological Research 63 (2000) 212-233
49. Wylie G.R., Javitt D.C., and Foxe J.J. Task switching: A high-density electrical mapping study. Neuroimage 20 (2003) 2322-2342
50. Wylie G.R., Javitt D.C., and Foxe J.J. Cognitive control processes during an anticipated switch of task. European Journal of Neuroscience 17 (2003) 667-672
51. Wylie G.R., Javitt D.C., and Foxe J.J. Don't think of a white bear: An fMRI investigation of the effects of sequential instructional sets on cortical activity in a task-switching paradigm. Human Brain Mapping 21 (2004) 279-297
52. Wylie G.R., Javitt D.C., and Foxe J.J. The role of response requirements in task switching: Dissolving the residue. Neuroreport 15 (2004) 1079-1087
53. Wylie G.R., Javitt D.C., and Foxe J.J. Jumping the gun: Is effective preparation contingent upon anticipatory activation in task-relevant neural circuitry. Cerebral Cortex 16 (2006) 394-404
54. Wylie G.R., Murray M.M., Javitt D.C., and Foxe J.J. Distinct neurophysiological mechanisms mediate mixing costs and switch costs. Journal of Cognition and Neurosciencem (2008) 10.1162/jocn.2009.21009
55. Yeung N., Nystrom L.E., Aronson J.A., and Cohen J.D. Between-task competition and cognitive control in task switching. Journal of Neuroscience 26 (2006) 1429-1438