Enhanced multisensory integration and motor reactivation after active motor learning of audiovisual associations

Journal of Cognitive Neuroscience

Volumn 23, Issue 11, 2011, Pages 3515-3528

  Butler, Andrew J ^a   James, Thomas W ^a   James, Karin Harman ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; BRAIN FUNCTION; BRAIN REGION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM GYRUS; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MEMORY; MOTOR ACTIVITY; MOTOR CORTEX; NERVE PROJECTION; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; RECOGNITION; REGULATORY MECHANISM; RESPONSE TIME; SENSORIMOTOR INTEGRATION; TASK PERFORMANCE; VISUAL CORTEX; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MOVEMENT; OXYGEN; PHOTIC STIMULATION; PROBLEM-BASED LEARNING; RECOGNITION (PSYCHOLOGY); STATISTICS AS TOPIC; VISUAL PERCEPTION; YOUNG ADULT;

EID: 80053517786     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00015     Document Type: Article

References (52)

1. Amedi, A., von Kriegstein, K., Atteveldt, N. M., Beauchamp, M. S., & Naumer, M. J. (2005). Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research, 166, 559-571.
2. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-609.
3. Beauchamp, M. S. (2005). Statistical criteria in fMRI studies of multisensory integration. Neuroinformatics, 3, 93-113.
4. Chao, L. L., & Martin, A. (2000). Representation of manipulable man-made objects in the dorsal stream. Neuroimage, 12, 478-484.
5. Cohen, R. L. (1989). Memory for action events: The power of enactment. Educational Psychological Reviews, 1, 57-80.
6. Culham, J. C., & Valyear, K. F. (2006). Human parietal cortex in action. Current Opinion in Neurobiology, 16, 205-212.
7. Damasio, A. R. (1989). Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition. Cognition, 33, 37-43.
8. De Lucia, M., Camen, C., Clarke, S., & Murray, M. M. (2009). The role of actions in auditory object discrimination. Neuroimage, 48, 475-485.
9. Dinstein, I., Thomas, C., Behrmann, M., & Heeger, D. J. (2008). A mirror up to nature. Current Biology, 18, 13-18.
10. Engelkamp, J., & Zimmer, H. D. (1994). The human memory. A multimodal approach. Seattle: Hogrefe and Huber.
11. Engelkamp, J., & Zimmer, H. D. (1997). Sensory factors in memory for subject-performed tasks. Acta Psychologica, 96, 43-60.
12. Engelkamp, J., Zimmer, H. D., & Biegelmann, U. E. (1993). Bizarreness effects in verbal tasks and subject-performed tasks. European Journal of Cognitive Psychology, 5, 393-415.
13. Etzel, J. A., Gazzola, V., & Keysers, C. (2008). Testing simulation theory with cross-modal multivariate classification of fMRI data. Public Library of Science One, 3, 1-6.
14. Fredembach, B., de Boisferon, A., & Gentaz, E. (2009). Learning of arbitrary association between visual and auditory stimuli in adults: The "bond effect" of haptic exploration. Public Library of Science One, 4.
15. Fuster, J. M. (2009). Cortex and memory: Emergence of a new paradigm. Journal of Cognitive Neuroscience, 21, 2047-2072.
16. Gibson, J. J. (1977). The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing. New York: John Wiley and Sons.
17. Goodale, M. A., & Milner, A. D. (1992). Separate visual pathways for perception and action. Trends in Neuroscience, 15, 20-25.
18. Grezes, J. & Decety, J. (2002). Does visual perception of object afford action? Evidence from a neuroimaging study. Neuropsychologia, 40, 212-222.
19. Grill-Spector, K., Kushnir, T., Hendler, T., & Malach, R. (2000). The dynamics of object-selective activation correlate with recognition performance in humans. Nature Neuroscience, 3, 837-843.
20. Harman, K. L., Humphrey, G. K., & Goodale, M. A. (1999). Active manual control of object views facilitates visual recognition. Current Biology, 9, 1315-1318.
21. Imamizu, H., Kuroda, T., Miyauchi, S., Yoshioka, T., & Kawato, M. (2003). Modular organization of internal models of tools in the human cerebellum. Proceedings of the National Academy of Sciences, U.S.A., 100, 5461-5466.
22. James, K. H., & Atwood, T. P. (2009). The role of sensorimotor learning in the perception of letter-like forms: Tracking the causes of neural specialization for letters. Cognitive Neuropsychology, 26, 91-110.
23. James, K. H., & Gauthier, I. (2006). Letter processing automatically recruits a sensory-motor brain network. Neuropsychologia, 44, 2937-2949.
24. James, K. H., Humphrey, G. K., & Goodale, M. A. (2001). Manipulating and recognizing virtual objects: Where the action is. Canadian Journal of Experimental Psychology, 55, 111-120.
25. James, K. H., Humphrey, G. K., Vilis, T., Baddour, R., Corrie, B., & Goodale, M. A. (2002). Learning three-dimensional object structure: A virtual reality study. Behavioral Research Methods, Instruments and Computers, 34, 383-390.
26. James, K. H., & Maouene, J. (2009). Auditory verb perception recruits motor systems in the developing brain: An fMRI investigation. Developmental Science, 12, F26-F34.
27. James, T. W., & Gauthier, I. (2003). Auditory and action semantic features activate sensory-specific perceptual brain regions. Current Biology, 13, 1792-1796.
28. James, T. W., Humphrey, G. K., Gati, J. S., Menon, R. S., & Goodale, M. A. (2002). Differential effects of viewing on object-driven activation in dorsal and ventral streams. Neuron, 35, 793-801.
29. James, T. W., VanDerKlok, R. M., Stevenson, R. A., & James, K. H. (2011). Multisensory perception of action in temporal and parietal cortices. Neuropsychologia, 49, 108-114.
30. Johnson, J. D., McDuff, S. G. R., Rugg, M. D., & Norman, K. A. (2009). Recollection, familiarity, and cortical reinstatement: A multivoxel pattern analysis. Neuron, 63, 697-708.
31. Laurienti, P. J., Perrault, T. J., Stanford, T. R., Wallace, M. T., & Stein, B. E. (2009). On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Experimental Brain Research, 166, 289-297.
32. Longcamp, M., Anton, J.-L., Roth, M., & Velay, J.-L. (2005). Premotor activations in response to visually presented single letters depend on the hand used to write: A study on left-handers. Neuropsychologia, 43, 1801-1809.
33. Malfait, N., Valyear, K. F., Culham, J. C., Anton, J.-L., Brown, L. E., & Gribble, P. L. (2010). fMRI activation during observation of others reach errors. Journal of Cognitive Neuroscience, 22, 1493-1503.
34. Masumoto, K., Yamaguchi, M., Sutani, K., Tsunetoa, S., Fujita, A., & Tonoike, M. (2006). Reactivation of physical motor information in the memory of action events. Brain Research, 1101, 102-109.
35. Mattar, A. A. G., & Gribble, P. L. (2005). Motor learning by observing. Neuron, 46, 153-160.
36. Mutschler, I., Schulze-Bonhage, A., Glauche, V., Demandt, E., Speck, O., & Ball, T. (2007). A rapid sound-action association effect in human insular cortex. Public Library of Science One, 2, 1-9.
37. Nilsson, L.-G., Nyberg, L., Klingberg, T., Aberg, C., Persson, J., & Roland, P. E. (2000). Activity in motor areas while remembering action events. NeuroReport, 11, 2199-2201.
38. Nyberg, L., Petersson, K. M., Nilsson, L.-G., Sandblom, J., Aberg, C., & Ingvar, M. (2001). Reactivation of motor brain areas during explicit memory for actions. Neuroimage, 14, 521-528.
39. Pulvermuller, F., Harle, M., & Hummel, F. (2001). Walking or talking: Behavioral and neurophysiological correlates of action verb processing. Brain and Language, 78, 143-168.
40. Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 3, 131-141.
41. Rugg, M. D., Johnson, J. D., Park, H., & Uncapher, M. R. (2008). Encoding-retrieval overlap in human episodic memory: A functional neuroimaging perspective. Progress in Brain Research, 169, 339-352.
42. Senkfor, A. J., Petten, C. V., & Kutas, M. (2002). Episodic action memory for real objects: An ERP investigation with perform, watch, and imagine action encoding tasks versus a non-action encoding task. Journal of Cognitive Neuroscience, 14, 402-419.
43. Shmuelof, L., & Zohary, E. (2008). Mirror-image representation of action in the anterior parietal cortex. Nature Neuroscience, 11, 1267-1269.
44. Slotnick, S. D. (2004). Visual memory and visual perception recruit common neural substrates. Behavioral and Cognitive Neuroscience Reviews, 3, 207-221.
45. Stevenson, R. A., Geoghegan, M. L., & James, T. W. (2007). Superadditive BOLD response in superior temporal sulcus with threshold non-speech objects. Experimental Brain Research, 179, 85-95.
46. Stevenson, R. A., Kim, S., & James, T. W. (2009). An additive-factors design to disambiguate neuronal and areal convergence: Measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI. Experimental Brain Research, 198, 183-194.
47. Stock, O., Roder, B., Burke, M., Bien, S., & Rosler, F. (2009). Corticle activation patterns during long-term memory retrieval of visually or hapitcally encoded objects and locations. Journal of Cognitive Neuroscience, 21, 58-82.
48. Talairach, J., & Tournoux, P. (1988). A co-planar stereotactic atlas of the human brain: 3-Dimensional proportional system: An approach to cerebral mapping (M. Rayport, Trans.). New York: Thieme.
49. Tanabe, H. C., Honda, M., & Sadato, N. (2005). Functionally segregated neural substrates for arbitrary audiovisual paired-association learning. The Journal of Neuroscience, 25, 6409-6418.
50. von Essen, J. D., & Nilsson, L.-G. (2003). Memory effects of motor activation in subject-performed tasks and sign language. Psychonomic Bulletin & Review, 10, 445-449.
51. Weisberg, J., van Turennout, M., & Martin, A. (2007). A neural system for learning about object function. Cerebral Cortex, 17, 513-521.
52. Wheeler, M. E., Peterson, S. E., & Buckner, R. L. (2000). Memory's echo: Vivid remembering reactivates sensory-specific cortex. Proceedings of the National Academy of Sciences, U.S.A., 97, 11125-11129.