The differentiation of iconic and metaphoric gestures: Common and unique integration processes

Human Brain Mapping

Volumn 32, Issue 4, 2011, Pages 520-533

  Straube, Benjamin ^a,b   Green, Antonia ^b,c   Bromberger, Bianca ^a   Kircher, Tilo ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b PHILIPPS UNIVERSITY MARBURG   (Germany)

^c RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

Coverbal gestures; Iconic gestures; Integration; Metaphoric gestures; Unification

Indexed keywords

ADULT; ARTICLE; CLINICAL ARTICLE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GESTURE; HUMAN; INFERIOR FRONTAL GYRUS; MALE; PRIORITY JOURNAL; RIGHT HEMISPHERE; SPEECH; TEMPORAL GYRUS; TEMPORAL LOBE;

ADULT; FRONTAL LOBE; GESTURES; HUMANS; LANGUAGE; LANGUAGE TESTS; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; SPEECH PERCEPTION; SYMBOLISM; TEMPORAL LOBE; VISUAL PERCEPTION; YOUNG ADULT;

EID: 79952400274     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.21041     Document Type: Article

References (62)

1. Ahrens K, Liu HL, Lee CY, Gong SP, Fang, SY, Hsu YY (2007): Functional MRI of conventional and anomalous metaphors in Mandarin Chinese. Brain Lang 100: 163-171.
2. Amedi A, von Kriegstein K, van Atteveldt NM, Beauchamp MS, Naumer MJ (2005): Functional imaging of human crossmodal identification and object recognition. Exp Brain Res 166: 559-571.
3. Badre D (2008): Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends Cogn Sci 12: 193-200.
4. Badre D, D'Esposito M (2009): Is the rostro-caudal axis of the frontal lobe hierarchical? Nat Rev Neurosci 10: 659-669.
5. Badre D, Poldrack RA, Pare-Blagoev EJ, Insler RZ, Wagner AD (2005): Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex. Neuron 47: 907-918.
6. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A (2004a): Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nat Neurosci 7: 1190-1192.
7. Beauchamp MS, Lee KE, Argall BD, Martin A (2004b): Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41: 809-823.
8. Bookheimer S (2002): Functional MRI of language: New approaches to understanding the cortical organization of semantic processing. Ann Rev Neurosci 25: 151-188.
9. Bunge SA, Wendelken C, Badre D, Wagner AD (2005): Analogical reasoning and prefrontal cortex: Evidence for separable retrieval and integration mechanisms. Cereb Cortex 15: 239-249
10. Bunge SA, Helskog EH, Wendelken C (2009): Left, but not right, rostrolateral prefrontal cortex meets a stringent test of the relational integration hypothesis. Neuroimage 46: 338-342.
11. Callan DE, Jones JA, Munhall K, Kroos C, Callan AM, Vatikiotis-Bateson E (2004): Multisensory integration sites identified by perception of spatial wavelet filtered visual speech gesture information. J Cogn Neurosci 16: 805-816.
12. Calvert GA (2001): Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cereb Cortex 11: 1110-1123.
13. Calvert GA, Thesen T (2004): Multisensory integration: Methodological approaches and emerging principles in the human brain. J Physiol Paris 98: 191-205.
14. Dick AS, Goldin-Meadow S, Hasson U, Skipper JI, Small SL (2009): Co-speech gestures influence neural activity in brain regions associated with processing semantic information. Hum Brain Mapp 30: 3509-3526.
15. Eickhoff SB, Stephan KE, Mohlberg H, Grefkes C, Fink GR, Amunts K, Zilles K (2005): A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage 25: 1325-1335.
16. Eviatar Z, Just MA (2006): Brain correlates of discourse processing: An fMRI investigation of irony and conventional metaphor comprehension. Neuropsychologia 44: 2348-2359.
17. Feyereisen P, Van de Wiele M, Dubois F (1988): The meaning of gestures: What can be understood without speech? Curr Psychol Cogn 8: 3-25.
18. Friederici AD, Ruschemeyer SA, Hahne A, Fiebach CJ (2003): The role of left inferior frontal and superior temporal cortex in sentence comprehension: Localizing syntactic and semantic processes. Cereb Cortex 13: 170-177.
19. Friston KJ, Fletcher P, Josephs O, Holmes A, Rugg MD, Turner R (1998): Event-related fMRI: Characterizing differential responses. Neuroimage 7: 30-40.
20. Gold BT, Balota DA, Kirchhoff BA, Buckner RL (2005): Common and dissociable activation patterns associated with controlled semantic and phonological processing: Evidence from FMRI adaptation. Cereb Cortex 15: 1438-1450.
21. Green AE, Fugelsang JA, Kraemer DJ, Shamosh NA, Dunbar KN (2006): Frontopolar cortex mediates abstract integration in analogy. Brain Res 1096: 125-137.
22. Green A, Straube B, Weis S, Jansen A, Willmes K, Konrad K, Kircher T (2009): Neural integration of iconic and unrelated coverbal gestures: A functional MRI study. Human Brain Mapp 30: 3309-3324.
23. Hagoort P, Baggio G, Willems RM (2009): Semantic unification. In: Gazzaniga MS, editor. The Cognitive Neurosciences IV. Cambridge: MIT Press pp 819-836.
24. Hein G, Knight RT (2008). Superior temporal sulcus-It's my area: Or is it? J Cogn Neurosci 20: 2125-2136.
25. Hein G, Doehrmann O, Muller NG, Kaiser J, Muckli L, Naumer MJ (2007): Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. J Neurosci 27: 7881-7887.
26. Hocking J, Price CJ (2008): The role of the posterior superior temporal sulcus in audiovisual processing. Cereb Cortex 18: 2439-2449.
27. Hoenig K, Scheef L (2009): Neural correlates of semantic ambiguity processing during context verification. Neuroimage 45: 1009-1019.
28. Holle H, Gunter TC, Ruschemeyer SA, Hennenlotter A, Iacoboni M (2008): Neural correlates of the processing of co-speech gestures. Neuroimage 39: 2010-2024.
29. Hubbard AL, Wilson SM, Calla DE, Dapretto M (2009): Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception. Human Brain Mapp 30: 1028-1037.
30. January D, Trueswell JC, Thompson-Schill SL (2009): Co-localization of stroop and syntactic ambiguity resolution in Broca's area: Implications for the neural basis of sentence processing. J Cogn Neurosci 21: 2434-2444.
31. Kable JW, Chatterjee A (2006): Specificity of action representations in the lateral occipitotemporal cortex. J Cogn Neurosci 18: 1498-1517.
32. Kable JW, Kan IP, Wilson A, Thompson-Schill SL, Chatterjee A (2005): Conceptual representations of action in the lateral temporal cortex. J Cogn Neurosci 17: 1855-1870.
33. Kemmotsu N, Villalobos ME, Gaffrey MS, Courchesne E, Muller RA (2005): Activity and functional connectivity of inferior frontal cortex associated with response conflict. Brain Res Cogn Brain Res 24: 335-342.
34. Kircher T, Straube B, Leube D, Weis S, Sachs O, Willmes K, Konrad K, Green A (2009): Neural interaction of speech and gesture: Differential activations of metaphoric co-verbal gestures. Neuropsychologia 47: 169-179.
35. Kuperberg GR, Holcomb PJ, Sitnikova T, Greve D, Dale AM, Caplan D (2003): Distinct patterns of neural modulation during the processing of conceptual and syntactic anomalies. J Cogn Neurosci 15: 272-293.
36. Kuperberg GR, Sitnikova T, Lakshmanan BM (2008): Neuroanatomical distinctions within the semantic system during sentence comprehension: Evidence from functional magnetic resonance imaging. Neuroimage 40: 367-388.
37. Lee SS, Dapretto M (2006): Metaphorical vs. literal word meanings: fMRI evidence against a selective role of the right hemisphere. Neuroimage 29: 536-544.
38. Lewis JW, Brefczynski JA, Phinney RE, Janik JJ, DeYoe EA (2005): Distinct cortical pathways for processing tool versus animal sounds. J Neurosci 25: 5148-5158.
39. Lewis JW (2006): Cortical networks related to human use of tools. Neuroscientist 12: 211-231.
40. Luo Q, Perry C, Peng D, Xu D, Ding G, Xu S (2003): The neural substrate of analogical reasoning: An fMRI study. Brain Res Cogn Brain Res 17: 527-534.
41. Macmillan NA, Creelman CD. 1991: Detection Theory: A User's Guide. New York: Cambridge University Press.
42. McNeill D. 1992. Hand and Mind: What Gestures Reveal About Thought. Chicago: University of Chicago Press.
43. McNeill D. 2005. Gesture and Thought. Chicago: University of Chicago Press.
44. Moss HE, Abdallah S, Fletcher P, Bright P, Pilgrim L, Acres K, Tyler LK (2005): Selecting among competing alternatives: Selection and retrieval in the left inferior frontal gyrus. Cereb Cortex 15: 1723-1735.
45. Naumer MJ, Doehrmann O, Muller NG, Muckli L, Kaiser J, Hein G (2008). Cortical plasticity of audio-visual object representations. Cereb Cortex 19: 1641-1653.
46. Novick JM, Trueswell JC, Thompson-Schill SL (2005): Cognitive control and parsing: Re-examining the role of Broca's area in sentence comprehension. Cogn Affect Behav Neurosci 5: 263-281.
47. Nichols T, Brett M, Andersson J, Wager T, Poline J (2005): Valid conjunction inference with the minimum statistic. Neuroimage 25: 653-660.
48. Oldfield RC (1971): The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9: 97-113.
49. Rapp AM, Leube DT, Erb M, Grodd W, Kircher TTJ (2004): Neural correlates of metaphor processing. Brain Res Cogn Brain Res 20: 395-402.
50. Rapp AM, Leube DT, Erb M, Grodd W, Kircher TT (2007): Laterality in metaphor processing: Lack of evidence from functional magnetic resonance imaging for the right hemisphere theory. Brain Lang 100: 142-149.
51. Sætrevik B, Specht K (2009): Cognitive conflict and inhibition in primed dichotic listening. Brain Cogn 71: 20-25.
52. Shalom DB, Poeppel D (2008): Functional anatomic models of language: Assembling the pieces. Neuroscientist 14: 119-127.
53. Slotnick SD, Moo LR, Segal JB, Hart J (2003): Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. Cogn Brain Res 17: 75-82.
54. Slotnick SD, Schacter DL (2004): A sensory signature that distinguishes true from false memories. Nat Neurosci 7: 664-672.
55. Straube B, Green A, Weis S, Chatterjee A, Kircher T (2009): Memory effects of speech and gesture binding: Cortical and hippocampal activation in relation to subsequent memory performance. J Cogn Neurosci 21: 821-836.
56. Straube B, Green A, Jansen A, Chatterjee A, Kircher T (2010). Social cues, mentalizing and the neural processing of speech accompanied by gestures. Neuropsychologia 48: 382-393.
57. Stringaris AK, Medford NC, Giampietro V, Brammer MJ, David AS (2007): Deriving meaning: Distinct neural mechanisms for metaphoric, literal, and nonmeaningful sentences. Brain Lang 100: 150-162.
58. Thompson-Schill SL, Bedny M, Goldberg RF (2005): The frontal lobes and the regulation of mental activity. Curr Opin Neurobiol 15: 219-224.
59. Wendelken C, Nakhabenko D, Donohue SE, Carter CS, Bunge SA (2008): "Brain is to thought as stomach is to ??": Investigating the role of rostrolateral prefrontal cortex in relational reasoning. J Cogn Neurosci 20: 682-693.
60. Willems RM, Hagoort P (2007): Neural evidence for the interplay between language, gesture, and action: A review. Brain Lang 101: 278-289.
61. Willems RM, Ozyurek A, Hagoort P (2007): When language meets action: The neural integration of gesture and speech. Cereb Cortex 17: 2322-2333.
62. Willems RM, Ozyürek A, Hagoort P (2009): Differential roles for left inferior frontal and superior temporal cortex in multimodal integration of action and language. Neuroimage 47: 1992-2004.