Semantic processing of mathematical gestures

Brain and Cognition

Volumn 71, Issue 3, 2009, Pages 306-312

  Lim, Vanessa K ^a   Wilson, Anna J ^a   Hamm, Jeff P ^a   Phillips, Nicola ^a   Iwabuchi, Sarina J ^a   Corballis, Michael C ^a   Arzarello, Ferdinando ^b   Thomas, Michael O J ^a  

^a UNIVERSITY OF AUCKLAND   (New Zealand)

^b UNIVERSITY OF TURIN   (Italy)

Author keywords

EEG; Gestures; Language; Mathematics; N400; Semantics

Indexed keywords

ADULT; ARTICLE; COMPREHENSION; FEMALE; GESTURE; HUMAN; HUMAN EXPERIMENT; LANGUAGE ABILITY; LANGUAGE PROCESSING; MALE; MATHEMATICAL ANALYSIS; MATHEMATICS; NONVERBAL COMMUNICATION; NORMAL HUMAN; PRIORITY JOURNAL; SEMANTICS; SENSORY STIMULATION; UNIVERSITY STUDENT; VISUAL DISCRIMINATION;

ACOUSTIC STIMULATION; ANALYSIS OF VARIANCE; BRAIN; CHI-SQUARE DISTRIBUTION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; GESTURES; HUMANS; MALE; MATHEMATICS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPEECH PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 70350257618     PISSN: 02782626     EISSN: 10902147     Source Type: Journal    
DOI: 10.1016/j.bandc.2009.07.004     Document Type: Article

References (46)

1. Alarcon G., Guy C.N., and Binnie C.D. A simple algorithm for digital three-pole Butterworth filter of arbitrary cut-off frequency: Application to digital electroencephalography. Journal of Neuroscience Methods 104 (2000) 35-44
2. Anderson J.R., Qin Y., Sohn M.-H., Stenger V.A., and Carter C.S. An information-processing model of the BOLD response in symbol manipulation tasks. Psychonomic Bulletin & Review 10 2 (2003) 241
3. Arbib M.A. From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics. Behavioral and Brain Sciences 28 (2005) 105-124
4. Arzarello F., Paola D., Robutti O., and Sabena C. Gestures as semiotic resources in the mathematical classroom. Educational Studies in Mathematics 70 2 (2009)
5. Arzarello F., and Robutti O. Framing the embodied mind approach within a multimodal paradigm. In: English L. (Ed). Handbook of international research in mathematics education (2008), Routledge, New York 720-749
6. Barrett A.M., Foundas A.L., and Heilman K.M. Speech and gesture are mediated by independent systems. Behavioral and Brain Sciences 28 2 (2005) 125
7. Barrett S., and Rugg M. Event-related potentials and the semantic matching of pictures. Brain and Cognition 14 (1990) 201-212
8. Bedny M., Caramazza A., Grossman E., Pascual-Leone A., and Saxe R. Concepts are more than percepts: The case of action verbs. Journal of Neuroscience 28 44 (2008) 11347-11353
9. Besson M., Kutas M., and Vanpetten C. An event-related potential (Erp) analysis of semantic congruity and repetition effects in sentences. Journal of Cognitive Neuroscience 4 2 (1992) 132-149
10. Byrne J.M., Dywan C.A., and Connolly J.F. Assessment of children's receptive vocabulary using event-related brain potentials: Development of a clinically valid test. Child Neuropsychology 1 3 (1995) 211-223
11. Connolly J.F., and Phillips N.A. Event-related potential components reflect phonological and semantic processing of the terminal word of spoken sentences. Journal of Cognitive Neuroscience 6 3 (1994) 256-266
12. Corballis M.C. From hand to mouth. The origins of language (2002), Princeton University Press
13. Danker J.F., and Anderson J.R. The roles of prefrontal and posterior parietal cortex in algebra problem solving: A case of using cognitive modeling to inform neuroimaging data. Neuroimage 35 3 (2007) 1365
14. Dehaene S., Molko N., Cohen L., and Wilson A.J. Arithmetic and the brain. Current Opinion in Neurobiology 14 2 (2004) 218-224
15. Dehaene S., Piazza M., Pinel P., and Cohen L. Three parietal circuits for number processing. Cognitive Neuropsychology 20 (2003) 487-506
16. Edwards L., Radford L., and Arzarello F. Introduction: Beyond words. Educational Studies in Mathematics 70 2 (2009)
17. Gelman R., and Butterworth B. Number and language: How are they related?. Trends in Cognitive Sciences 9 1 (2005) 6
18. Gentilucci M., and Volta R.D. Spoken language and arm gestures are controlled by the same motor control system. Quarterly Journal of Experimental Psychology 61 6 (2008) 944-957
19. Goldin-Meadow S. Hearing gesture. How our hands help us think (2003), The Belknap Press of Harvard University Press, Cambridge
20. Hadar U.D., Wenkert-Olenik R.K., and Soroker N. Gesture and the processing of speech: Neuropsychological evidence. Brain and Language 62 (1998) 107-126
21. Hamm J.P., Johnson B.W., and Corballis M.C. One good turn deserves another: An event-related brain potential study of rotated mirror-normal letter discriminations. Neuropsychologia 42 6 (2004) 810-820
22. Hamm J.P., Johnson B.W., and Kirk I.J. Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts. Clinical Neurophysiology 113 8 (2002) 1339-1350
23. Hamzei F., Rijntjes M., Dettmers C., Glauche V., Weiller C., and Buchel C. The human action recognition system and its relationship to Broca's area: An fMRI study. Neuroimage 19 3 (2003) 637-644
24. Holle H., and Gunter T.C. The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience 19 7 (2007) 1175-1192
25. Holle H., Gunter T.C., Rueschemeyer S.A., Hennenlotter A., and Iacoboni M. Neural correlates of the processing of co-speech gestures. Neuroimage 39 4 (2008) 2010-2024
26. Johnson B.W., and Hamm J.P. High-density mapping in an N400 paradigm: Evidence for bilateral temporal lobe generators. Clinical Neurophysiology 111 3 (2000) 532-545
27. Kelly S.D., Ward S., Creigh P., and Bartolotti J. An intentional stance modulates the integration of gesture and speech during comprehension. Brain and Language 101 3 (2007) 222-233
28. Kučera H., and Francis W.N. Computational analysis of present-day American English (1967), Brown University Press, Providence: R.I.
29. Kutas M., and Hillyard S.A. Reading senseless sentences: Brain potentials reflect semantic incongruity. Science 207 (1980) 203-205
30. Kutas M., and Hillyard S.A. Brain potentials during reading reflect word expectancy and semantic association. Nature 307 5947 (1984) 161-163
31. Lehmann D., and Skrandies W. Reference-free identification of components of checkerboard-evoked multichannel potential fields. Electroencephalography and Clinical Neurophysiology 48 (1980) 609-621
32. Levelt W.J., Richardson G., and La Heij W. Pointing and voicing in deictic expressions. Journal of Memory and Language 24 (1985) 133-164
33. McCarthy G., and Wood C.C. Scalp distributions of event-related potentials: An ambiguity associated with analysis of variance models. Electroencephalography and Clinical Neurophysiology 62 (1985) 203-208
34. McNeill D. Hand and mind: What gestures reveal about thought (1992), University of Chicago Press, Chicago
35. McPherson W.B., and Holcomb P.J. An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology 38 (1999) 53-65
36. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9 (1971) 77-113
37. Ozyurek A., Willems R.M., Kita S., and Hagoort P. Online integration of semantic information from speech and gesture: Insights from event-related brain potentials. Journal of Cognitive Neuroscience 19 (2007) 605-616
38. Pascual-Marqui R.D., Michel C.M., and Lehmann D. Low resolution electromagnetic tomography: A new method for localizing electrical activity in the brain. International Journal of Psychophysiology 18 (1994) 49-65
39. Pekkola J., Ojanen V., Autti T., Jaaskelainen I.P., Mottonen R., Tarkiainen A., et al. Primary auditory cortex activation by visual speech: An fMRI study at 3 T. Neuroreport 16 2 (2005) 125-128
40. Polich J. N400s from sentences, semantic categories, number and letter strings?. Bulletin of the Psychonomic Society 23 4 (1985) 361-364
41. Sarfarazi M., Cave B., Richardson A., Behan J., and Sedgwick E.M. Visual event related potentials modulated by contextually relevant and irrelevant olfactory primes. Chemical Senses 24 2 (1999) 145-154
42. Stocco A., and Anderson J.R. Endogenous control and task representation: An fMRI study in algebraic problem-solving. Journal of Cognitive Neuroscience 20 7 (2008) 1300-1314
43. Tucker D.M. Spatial sampling of head electrical fields: The geodesic sensor net. Electroencephalography and Clinical Neurophysiology 87 (1993) 154-163
44. Willems R.M., Ozyurek A., and Hagoort P. When language meets action: The neural integration of gesture and speech. Cerebral Cortex 17 10 (2007) 2322-2333
45. Wu Y.C., and Coulson S. Meaningful gestures: Electrophysiological indices of iconic gesture comprehension. Psychophysiology 42 6 (2005) 654-667
46. Wu Y.C., and Coulson S. How iconic gestures enhance communication: An ERP study. Brain and Language 101 3 (2007) 234-245