Active learning of novel sound-producing objects: Motor reactivation and enhancement of visuo-motor connectivity

Journal of Cognitive Neuroscience

Volumn 25, Issue 2, 2013, Pages 203-218

  Butler, Andrew J ^a,b   James, Karin Harman ^a  

^a INDIANA UNIVERSITY   (United States)

^b BUTLER UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; ADULT; ARTICLE; ASSOCIATION; BOLD SIGNAL; CEREBELLUM; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LEARNING; MALE; MOTOR CORTEX; MOTOR PERFORMANCE; MOTOR REACTIVATION; PASSIVE LEARNING; PRIORITY JOURNAL; RECOGNITION; SOMATOSENSORY CORTEX; VISUOMOTOR COORDINATION;

EID: 84871793270     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00284     Document Type: Article

References (55)

1. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-609.
2. Bolognini, N., Frassinetti, F., Serino, A., & Ladavas, E. (2005). "Acoustical vision" of below threshold stimuli: Interaction among spatially converging audiovisual inputs. Experimental Brain Research, 160, 273-282.
3. Buccino, G., Vogt, S., Ritzl, A., Fink, G. R., Zilles, K., Freund, H. J., et al. (2004). Neural circuits underlying imitation learning of hand actions: An event-related fMRI study. Neuron, 42, 323-334.
4. Butler, A. J., James, T. W., & Harman James, K. (2011). Enhanced multisensory integration and motor reactivation after active motor learning of audiovisual associations. Journal of Cognitive Neuroscience, 23, 3515-3528.
5. Caspers, S., Zilles, K., Laird, A. R., & Eickhoff, S. B. (2010). ALE meta-analysis of action observation and imitation in the human brain. Neuroimage, 50, 1148-1167.
6. Chao, L. L., & Martin, A. (2000). Representation of manipulable man-made objects in the dorsal stream. Neuroimage, 12, 478-484.
7. Damasio, A. R. (1989). Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition. Cognition, 33, 37-43.
8. De Lucia, M., Camen, C., Clarke, S., & Murray, M. M. (2009). The role of actions in auditory object discrimination. Neuroimage, 48, 475-485.
9. Dinstein, I., Thomas, C., Behrmann, M., & Heeger, D. J. (2008). A mirror up to nature. Current Biology, 18, 13-18.
10. Dushanova, J., & Donoghue, J. (2010). Neurons in primary motor cortex engaged during action observation. European Journal of Neuroscience, 31, 386-398.
11. Etzel, J. A., Gazzola, V., & Keysers, C. (2008). Testing simulation theory with cross-modal multivariate classification of Fmri data. PLoS, 3, 1-6.
12. Fredembach, B., de Boisferon, A., & Gentaz, E. (2009). Learning of arbitrary association between visual and auditory stimuli in adults: The "bond effect" of haptic exploration. PLoS, 4, e4844.
13. Fuster, J. M. (2009). Cortex and memory: Emergence of a new paradigm. Journal of Cognitive Neuroscience, 21, 2047-2072.
14. Gibson, J. J. (1977). The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing (pp. 67-82). Hillsdale, NJ: Erlbaum.
15. Gottfried, J. A., Smith, A. P. R., Rugg, M. D., & Dolan, R. J. (2004). Remembrance of odors past: Human olfactory cortex in cross-modal recognition memory. Neuron, 42, 687-695.
16. Grezes, J., & Decety, J. (2002). Does visual perception of object afford action? Evidence from a neuroimaging study. Neuropsychologia, 40, 212-222.
17. Grezes, J., Tucker, M., Armony, J., Ellis, R., & Passingham, R. E. (2003). Objects automatically potentiate action: An fMRI study of implicit processing. European Journal of Neuroscience, 17, 2735-2740.
18. Harman, K. L., Humphrey, G. K., & Goodale, M. A. (1999). Active manual control of object views facilitates visual recognition. Current Biology, 9, 1315-1318.
19. Hornberger, M., Rugg, M. D., & Henson, R. N. A. (2006). fMRI correlates of retrieval orientation. Neuropsychologia, 44, 1425-1436.
20. Imamizu, H., Kuroda, T., Miyauchi, S., Yoshioka, T., & Kawato, M. (2003). Modular organization of internal models of tools in the human cerebellum. Proceedings of the National Academy of Sciences, U.S.A., 100, 5461-5466.
21. James, K. H., & Atwood, T. P. (2009). The role of sensorimotor learning in the perception of letter-like forms: Tracking the causes of neural specialization for letters. Cognitive Neuropsychology, 26, 91-110.
22. James, K. H., & Gauthier, I. (2006). Letter processing automatically recruits a sensory-motor brain network. Neuropsychologia, 44, 2937-2949.
23. James, K. H., Humphrey, G. K., & Goodale, M. A. (2001). Manipulating and recognizing virtual objects: Where the action is. Canadian Journal of Experimental Psychology, 55, 111-120.
24. James, K. H., Humphrey, G. K., Vilis, T., Baddour, R., Corrie, B., & Goodale, M. A. (2002). Learning three-dimensional object structure: A virtual reality study. Behavioral Research Methods, Instruments and Computers, 34, 383-390.
25. James, K. H., & Mauoene, J. (2009). Auditory verb perception recruits motor systems in the developing brain: An fMRI investigation. Developmental Science, 12, F26-F34.
26. James, K. H., & Swain, S. N. (2011). Only self-generated actions create sensori-motor systems in the developing brain. Developmental Science, 13, 279-288.
27. James, T. W., Culham, J., Humphrey, G. K., Milner, D. A., & Goodale, M. A. (2003). Ventral occipital lesions impair object recognition but not object-directed grasping: A fMRI study. Brain, 126, 2463-2475.
28. James, T. W., & Gauthier, I. (2003). Auditory and action semantic features activate sensory-specific perceptual brain regions. Current Biology, 13, 1792-1796.
29. Kahn, I., Davachi, L., & Wagner, A. D. (2004). Functional-neuroanatomic correlates of recollection: Implications for models of recognition memory. The Journal of Neuroscience, 24, 4172-4180.
30. Longcamp, M., Anton, J.-L., Roth, M., & Velay, J.-L. (2005). Premotor activations in response to visually presented single letters depend on the hand used to write: A study on left-handers. Neuropsychologia, 43, 1801-1809.
31. Masumoto, K., Yamaguchi, M., Sutani, K., Tsunetoa, S., Fujita, A., & Tonoike, M. (2006). Reactivation of physical motor information in the memory of action events. Brain Research, 1101, 102-109.
32. Murray, M. M., Foxe, J. J., & Wylie, G. R. (2005). The brain uses single-trial multisensory memories to discriminate without awareness. Neuroimage, 27, 473-478.
33. Murray, M. M., & Sperdin, H. F. (2010). Single-trial multisensory learning and memory retrieval. In M. J. Naumer & J. Kaiser (Eds.), Multisensory object perception in the primate brain (pp. 191-208). New York: Springer Science + Business Media, LLC.
34. Mutschler, I., Schulze-Bonhage, A., Glauche, V., Demandt, E., Speck, O., & Ball, T. (2007). A rapid sound-action association effect in human insular cortex. PLoS, 2, 1-9.
35. Nilsson, L.-G., Nyberg, L., Klingberg, T., Aberg, C., Persson, J., & Roland, P. E. (2000). Activity in motor areas while remembering action events. NeuroReport, 11, 2199-2201.
36. Nyberg, L., Habib, R., McIntosh, A. R., & Tulving, E. (2000). Reactivation of encoding-related brain activity during memory retrieval. Proceedings of the National Academy of Sciences, 9, 11120-11124.
37. Nyberg, L., Petersson, K. M., Nilsson, L.-G., Sandblom, J., Aberg, C., & Ingvar, M. (2001). Reactivation of motor brain areas during explicit memory for actions. Neuroimage, 14, 521-528.
38. Pulvermuller, F., Harle, M., & Hummel, F. (2001). Walking or talking: Behavioral and neurophysiological correlates of action verb processing. Brain and Language, 78, 143-168.
39. Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 3, 131-141.
40. Rizzolatti, G., Fogassi, L., & Gallese, V. (2001). Neurophysiological mechanisms underlying the understanding of imitation of action. Nature Reviews Neuroscience, 2, 661-670.
41. Sasaoka, T., Asakura, N., & Kawahara, T. (2010). Effect of active exploration of 3-D object views on the view-matching process in object recognition. Perception, 39, 289-308.
42. Saxe, R., Brett, M., & Kanwisher, N. (2006). Divide and conquer: A defense of functional localizers. Neuroimage, 30, 1088-1096.
43. Senkfor, A. J., Petten, C. V., & Kutas, M. (2002). Episodic action memory for real objects: An ERP investigation with perform, watch, and imagine action encoding tasks versus a non-action encoding task. Journal of Cognitive Neuroscience, 14, 402-419.
44. Slotnick, S. D., & Schacter, D. L. (2006). The nature of memory related activity in early visual areas. Neuropsychologia, 44, 2874-2886.
45. Stevenson, R. A., Altieri, N. A., Kim, S., Pisoni, D. B., & James, T. W. (2010). Neural processing of asynchronous audiovisual speech perception. Neuroimage, 49, 3308-3318.
46. Stevenson, R. A., Geoghegan, M. L., & James, T. W. (2007). Superadditive BOLD response in superior temporal sulcus with threshold non-speech objects. Experimental Brain Research, 179, 85-95.
47. Stevenson, R. A., & James, T. W. (2009). Neuronal convergence and inverse effectiveness with audiovisual integration of speech and tools in human superior temporal sulcus: Evidence from BOLD fMRI. Neuroimage, 44, 1210-1223.
48. Stock, O., Roder, B., Burke, M., Bien, S., & Rosler, F. (2009). Cortical activation patterns during long-term memory retrieval of visually or haptically encoded objects and locations. Journal of Cognitive Neuroscience, 21, 58-82.
49. Talairach, J., & Tournoux, P. (1988). A co-planar stereotactic atlas of the human brain: 3-Dimensional proportional system: An approach to cerebral mapping (M. Rayport, Trans.). New York: Thieme.
50. Vaidya, C. J., Zhao, M., Desmond, J. E., & Gabrieli, J. D. E. (2002). Evidence for cortical encoding specificity in episodic memory: Memory-induced re-activation of picture processing areas. Neuropsychologia, 40, 2136-2143.
51. Vilberg, K. L., & Rugg, M. D. (2007). Dissociation of the neural correlates of recognition memory according to familiarity, recollection, and amount of recollected information. Neuropsychologia, 45, 2216-2225.
52. Vogt, S., Buccino, G., Wohlschlager, A. M., Canessa, N., Shah, N. J., Zilles, K., et al. (2008). Prefrontal involvement in imitation learning of hand actions: Effects of practice and expertise. Neuroimage, 37, 1371-1383.
53. Weisberg, J., van Turennout, M., & Martin, A. (2007). A neural system for learning about object function. Cerebral Cortex, 17, 513-521.
54. Wheeler, M. E., Peterson, S. E., & Buckner, R. L. (2000). Memory's echo: Vivid remembering reactivates sensory-specific cortex. Proceedings of the National Academy of Sciences, 97, 11125-11129.
55. Wheeler, M. E., Shulman, G. L., Buckner, R. L., Miezin, F. M., Velanova, K., & Peterson, S. E. (2006). Evidence for separate perceptual reactivation and search processes during remembering. Cerebral Cortex, 16, 949-959.