Memory effects of speech and gesture binding: Cortical and hippocampal activation in relation to subsequent memory performance

Journal of Cognitive Neuroscience

Volumn 21, Issue 4, 2009, Pages 821-836

  Straube, Benjamin ^a   Green, Antonia ^a   Weis, Susanne ^a   Chatterjee, Anjan ^b   Kircher, Tilo ^a  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; COMPREHENSION; CONTROLLED STUDY; GESTURE; HIPPOCAMPUS; HUMAN; HUMAN EXPERIMENT; INTERPERSONAL COMMUNICATION; MALE; MEMORY; NORMAL HUMAN; PREMOTOR CORTEX; PRIORITY JOURNAL; RECOGNITION; SEMANTICS; SPEECH; VISUAL INFORMATION; ANALYSIS OF VARIANCE; AUDITORY STIMULATION; BLOOD; BRAIN; BRAIN CORTEX; BRAIN MAPPING; FEMALE; HAND; HEMISPHERIC DOMINANCE; IMAGE PROCESSING; METHODOLOGY; MOVEMENT (PHYSIOLOGY); NUCLEAR MAGNETIC RESONANCE IMAGING; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; VASCULARIZATION;

OXYGEN;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; CEREBRAL CORTEX; DISCRIMINATION (PSYCHOLOGY); FEMALE; FUNCTIONAL LATERALITY; GESTURES; HAND; HIPPOCAMPUS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY; MOVEMENT; OXYGEN; PHOTIC STIMULATION; REACTION TIME; SPEECH; YOUNG ADULT;

EID: 65449153632     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2009.21053     Document Type: Article

References (65)

1. Alvarez, P., & Squire, L. R. (1994). Memory consolidation and the medial temporal lobe - A simple network model. Proceedings of the National Academy of Sciences, U.S.A., 91, 7041-7045.
2. Amunts, K., Kedo, O., Kindler, M., Pieperhoff, P., Mohlberg, H., Shah, N. J., et al. (2005). Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: Intersubject variability and probability maps. Anatomy and Embryology (Berlin), 210, 343-352.
3. Baker, J. T., Sanders, A. L., Maccotta, L., & Buckner, R. L. (2001). Neural correlates of verbal memory encoding during semantic and structural processing tasks. NeuroReport, 12, 1251-1256.
4. Beattie, G., & Shovelton, H. (1999). Mapping the range of information contained in the iconic hand gestures that accompany spontaneous speech. Journal of Language and Social Psychology, 184, 438-462.
5. Beattie, G., & Shovelton, H. (2002). What properties of talk are associated with the generation of spontaneous iconic hand gestures? British Journal of Social Psychology, 41, 403-417.
6. Brewer, J. B., Zhao, Z., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. (1998). Making memories: Brain activity that predicts how well visual experience will be remembered. Science, 281, 1185-1187.
7. Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., et al. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: An fMRI study. European Journal of Neuroscience, 13, 400-404. (Pubitemid 32142485)
8. Calvo-Merino, B., Glaser, D. E., & Grezes, J. (2005). Action observation and acquired motor skills: An fMRI study with expert dancers. Cerebral Cortex, 15, 1243-1249.
9. Casasanto, D. J., Killgore, W. D. S., Maldjian, J. A., Glosser, G., Alsop, D. C., Cooke, A. M., et al. (2002). Neural correlates of successful and unsuccessful verbal memory encoding. Brain and Language, 80, 287-295.
10. Cohen, N. J., & Eichenbaum, H. (1993). Memory, amnesia, and the hippocampal system. Cambridge: MIT Press.
11. Daselaar, S. M., Rombouts, S. A., Veltman, D. J., Raaijmakers, J. G., Lazeron, R. H., & Jonker, C. (2001). Parahippocampal activation during successful recognition of words: A self-paced event-related fMRI study. Neuroimage, 13, 1113-1120.
12. Davachi, L., Maril, A., & Wagner, A. D. (2001). When keeping in mind supports later bringing to mind: Neural markers of phonological rehearsal predict subsequent remembering. Journal of Cognitive Neuroscience, 13, 1059-1070. (Pubitemid 33141143)
13. Davachi, L., Mitchell, J. P., & Wagner, A. D. (2003). Multiple routes to memory: Distinct medial temporal lobe processes build item and source memories. Proceedings of the National Academy of Sciences, U.S.A., 100, 2157-2162.
14. Davachi, L., & Wagner, A. D. (2002). Hippocampal contributions to episodic encoding: Insights from relational and item-based learning. Journal of Neuroscience, 88, 982-990.
15. Donaldson, D. I., Petersen, S. E., & Buckner, R. L. (2001). Dissociating memory retrieval processes using fMRI: Evidence that priming does not support recognition memory. Neuron, 31, 1047-1059.
16. Eichenbaum, H. (2004). Hippocampus: Cognitive processes and neural representations that underlie declarative memory. Neuron, 44, 109-120.
17. Eichenbaum, H., & Cohen, N. J. (2001). From conditioning to conscious recollection: Memory systems of the brain. Oxford: Oxford University Press.
18. Eichenbaum, H., Otto, T., & Cohen, N. J. (1992). The hippocampus - What does it do? Behavioral and Neural Biology, 57, 2-36.
19. Eldridge, L. L., Knowlton, B. J., Furmanski, C. S., Bookheimer, S. Y., & Engel, S. A. (2000). Remembering episodes: A selective role for the hippocampus during retrieval. Nature Neuroscience, 3, 1149-1152.
20. Fletcher, P. C., Stephenson, C. M., Carpenter, T. A., Donovan, T., & Bullmorel, E. T. (2003). Regional brain activations predicting subsequent memory success: An event-related fMRI study of the influence of encoding tasks. Cortex, 39, 1009-1026.
21. Fliessbach, K., Trautner, P., Quesada, C. M., Elger, C. E., & Weber, B. (2007). Cerebellar contributions to episodic memory encoding as revealed by fMRI. Neuroimage, 35, 1330-1337.
22. Friston, K. J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M. D., & Turner, R. (1998). Event-related fMRI: Characterizing differential responses. Neuroimage, 7, 30-40.
23. Gauger, P. W. (1952). The effect of gesture and the presence or absence of the speaker on the listening comprehension of eleventh and twelfth grade high school pupils. Speech Monographs, 19, 116-117.
24. Gold, J. J., Smith, C. N., Bayley, P. J., Shrager, Y., Brewer, J. B., Stark, C. E. L., et al. (2006). Item memory, source memory, and the medial temporal lobe: Concordant findings from fMRI and memory-impaired patients. Proceedings of the National Academy of Sciences, U.S.A., 103, 9351-9356.
25. Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3, 419-429.
26. Graham, J. A., & Argyle, M. (1975). A cross-cultural study of the communication of extra-verbal meaning by gestures. International Journal of Psychology, 10, 57-67.
27. Hanlon, R., Brown, J., & Gerstman, L. (1990). Enhancement of naming in nonfluent aphasia through gesture. Brain and Language, 38, 298-314.
28. Hari, R., Forss, N., Avikainen, S., Kirveskari, E., Salenius, S., & Rizzolatti, G. (1998). Activation of human primary motor cortex during action observation: A neuromagnetic study. Proceedings of the National Academy of Sciences, U.S.A., 95, 15061-15065.
29. Henson, R. A., Rugg, M. D., Shallice, T., Josephs, O., & Dolan, R. J. (1999). Recollection and familiarity in recognition memory: An event-related functional magnetic resonance imaging study. Journal of Neuroscience, 19, 3962-3972. (Pubitemid 29222270)
30. Henson, R. N., Hornberger, M., & Rugg, M. D. (2005). Further dissociating the processes involved in recognition memory: An fMRI study. Journal of Cognitive Neuroscience, 17, 1058-1073. (Pubitemid 41045578)
31. Holle, H., Gunter, T. C., Rüschemeyer, S.-A., Hennenlotter, A., & Iacoboni, M. (2008). Neural correlates of the processing of co-speech gestures. Neuroimage, 39, 2010-2024.
32. Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40, 577-592.
33. Kirchhoff, B. A., & Buckner, R. L. (2006). Functional-anatomic correlates of individual differences in memory. Neuron, 51, 263-274.
34. Kirchhoff, B. A., Wagner, A. D., Maril, A., & Stern, C. E. (2000). Prefrontal-temporal circuitry for episodic encoding and subsequent memory. Journal of Neurosciences, 20, 6173-6180. (Pubitemid 30658411)
35. Macmillan, N. A., & Creelman, C. D. (1991). Detection theory: A user's guide. New York: Cambridge University Press.
36. Marr, D. (1971). Simple memory: A theory for archicortex. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 262, 23-81.
37. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.
38. McNeill, D. (1999). Action, thought and language. In P. Llyod & C. Fernyhough (Eds.), Lev Vygotsky: Critical assessments: Thought and language (Vol. II, pp. 23-30). Florence, KY: Taylor & Francis/Routledge.
39. Morcom, A. M., Good, C. D., Frackowiak, R. S., & Rugg, M. D. (2003). Age effects on the neural correlates of successful memory encoding. Brain, 126, 213-229.
40. Norman, K. A., & O'Reilly, R. C. (2003). Modeling hippocampal and neocortical contributions to recognition memory: A complementary learning-systems approach. Psychological Review, 110, 611-646.
41. Nyberg, L., Mcintosh, A. R., Houle, S., Nilsson, L. G., & Tulving, E. (1996). Activation of medial temporal structures during episodic memory retrieval. Nature, 380, 715-717.
42. Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9, 97-113.
43. Otten, L. J., Henson, R. N., & Rugg, M. D. (2001). Depth of processing effects on neural correlates of memory encoding: Relationship between findings from across- and within-task comparisons. Brain, 124, 399-412.
44. Otten, L. J., & Rugg, M. D. (2001). Task-dependency of the neural correlates of episodic encoding as measured by fMRI. Cerebral Cortex, 11, 1150-1160.
45. Ozyurek, A., Willems, R. M., Kita, S., & Hagoort, P. (2007). On-line integration of semantic information from speech and gesture: Insights from event-related brain potentials. Journal of Cognitive Neuroscience, 19, 605-616. (Pubitemid 46495292)
46. Paller, K. A., & Wagner, A. D. (2002). Observing the transformation of experience into memory. Trends in Cognitive Sciences, 6, 93-102.
47. Prince, S. E., Daselaar, S. M., & Cabeza, R. (2005). Neural correlates of relational memory: Successful encoding and retrieval of semantic and perceptual associations. Journal of Neurosciences, 25, 1203-1210. (Pubitemid 40268962)
48. Prince, S. E., Tsukiura, T., & Cabeza, R. (2007). Distinguishing the neural correlates of episodic memory encoding and semantic memory retrieval. Psychological Science, 18, 144-151.
49. Ranganath, C., & Rainer, G. (2003). Neural mechanisms for detecting and remembering novel events. Nature Reviews Neuroscience, 4, 193-202.
50. Rolls, E. T. (2000). Memory systems in the brain. Annual Review of Psychology, 51, 599-630.
51. Rose, M., & Douglas, J. (2001). The differential facilitatory effects of gesture and visualisation processes on object naming in aphasia. Aphasiology, 15, 977-990.
52. Shastri, L. (2002). Episodic memory and cortico-hippocampal interactions. Trends in Cognitive Neurosciences, 6, 162-168.
53. Slotnick, S. D., Moo, L. R., Segal, J. B., & Hart, J., Jr. (2003). Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. Brain Research, Cognitive Brain Research, 17, 75-82.
54. Strange, B. A., Otten, L. J., Josephs, O., Rugg, M. D., & Dolan, R. J. (2002). Dissociable human perirhinal, hippocampal, and parahippocampal roles during verbal encoding. Journal of Neuroscience, 22, 523-528. (Pubitemid 34049091)
55. Talairach, J., & Tournoux, P. (1988). Co-planar stereotaxic atlas of the human brain. New York: Thieme.
56. Uncapher, M. R., & Rugg, M. D. (2005). Effects of divided attention on fMRI correlates of memory encoding. Journal of Cognitive Neuroscience, 17, 1923-1935.
57. Valenzeno, L., Alibali, M. W., & Klatzkya, R. (2003). Teacher's gestures facilitate students learning: A lesson in symmetry. Contemporary Educational Psychology, 28, 187-204.
58. Wagner, A. D., Schacter, D. L., Rotte, M., Koutstaal, W., Maril, A., Dale, A. M., et al. (1998). Building memories: Remembering and forgetting of verbal experiences as predicted by brain activity. Science, 281, 1188-1191.
59. Wallenstein, G. V., Eichenbaum, H., & Hasselmo, M. E. (1998). The hippocampus as an associator of discontiguous events. Trends in Neurosciences, 21, 317-323.
60. Weis, S., Klaver, P., Reul, J., Elger, C. E., & Fernandez, G. (2004). Temporal and cerebellar brain regions that support both declarative memory formation and retrieval. Cerebral Cortex, 14, 256-267.
61. Wheeler, M. E., & Buckner, R. L. (2004). Functional-anatomic correlates of remembering and knowing. Neuroimage, 21, 1337-1349.
62. Willems, R. M., & Hagoort, P. (2007). Neural evidence for the interplay between language, gesture, and action: A review. Brain and Language, 101, 278-289. (Pubitemid 46802720)
63. Willems, R. M., Ozyurek, A., & Hagoort, P. (2007). When language meets action: The neural integration of gesture and speech. Cerebral Cortex, 17, 2322-2333.
64. Witter, M. P., & Amaral, D. G. (1991). Entorhinal cortex of the monkey: V. Projections to the dentate gyrus, hippocampus, and subicular complex. Journal of Comparative Neurology, 307, 437-459.
65. Woodruff, C. C., Johnson, J. D., Uncapher, M. R., & Rugg, M. D. (2005). Content-specificity of the neural correlates of recollection. Neuropsychologia, 43, 1022-1032.