Watching corresponding gestures facilitates learning with animations by activating human mirror-neurons: An fNIRS study

Learning and Instruction

Volumn 36, Issue , 2015, Pages 27-37

  Brucker, Birgit ^a   Ehlis, Ann Christine ^b   Häußinger, Florian B ^b   Fallgatter, Andreas J ^b   Gerjets, Peter ^a  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

^b UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

Author keywords

Dynamic visualizations; Functional near infrared spectroscopy (fNIRS); Gestures; Human mirror neuron system; Learning from animation

Indexed keywords

EID: 84912140787     PISSN: 09594752     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.learninstruc.2014.11.003     Document Type: Article

References (44)

1. Aiken L.S., West S.G. Multiple regression: Testing and interpreting interactions 1991, Sage, Newbury Park.
2. Allison T., Puce A., McCarthy G. Social perception from visual cues: role of the STS region. Trends in Cognitive Sciences 2000, 4:267-278.
3. Ayres P., Marcus N., Chan C., Qian N. Learning hand manipulative tasks: when instructional animations are superior to equivalent static representations. Computers in Human Behavior 2009, 25:348-353.
4. Blazhenkova O., Kozhevnikov M. The new object-spatial-verbal cognitive style model: theory and measurement. Applied Cognitive Psychology 2009, 23:638-663.
5. Chu M., Kita S. The nature of gestures' beneficial role in spatial problem solving. Journal of Experimental Psychology: General 2011, 140:102-116.
6. Cohen J. Statistical power analysis for the behavioral sciences 1988, Lawrence Erlbaum Associates. 2nd ed.
7. Cook S.M., Goldin-Meadow S. The role of gesture in learning: do children use their hands to change their minds?. Journal of Cognition and Development 2006, 7:211-232.
8. Cutini S., Scarpa F., Scatturin P., Dell'acqua R., Zorzi M. Number-space interactions in the human parietal cortex: enlightening the SNARC effect with functional near-infrared spectroscopy. Cerebral Cortex 2012, 24:444-451.
9. De Koning B.B., Tabbers H.K. Facilitating understanding of movements in dynamic visualizations: an embodied perspective. Educational Psychology Review 2011, 23:501-521.
10. De Koning B.B., Tabbers H.K. Gestures in instructional animations: a helping hand to understanding non-human movements?. Applied Cognitive Psychology 2013, 27:683-689.
11. Ehlis A.-C., Herrmann M.J., Pichta M.M., Fallgatter A.J. Cortical activation during two verbal fluency tasks in schizophrenic patients and healthy controls as assessed by multi-channel near-infrared spectroscopy. Psychiatry Research 2007, 156:1-13.
12. Ehlis A.-C., Schneider S., Dresler T., Fallgatter A.J. Application of functional near-infrared spectroscopy in psychiatry. NeuroImage 2014, 85:478-488.
13. Ekstrom R., French J., Harman H., Dermen D. Manual for kit of factor-referenced cognitive tests 1976, Educational Testing Service, Princeton.
14. Engel A., Burke M., Fiehler K., Bien S., Rösler F. What activates the human mirror neuron system during observation of artificial movements: bottom-up visual features or top-down intentions?. Neuropsychologia 2008, 46:2033-2042.
15. Fogassi L., Ferrari P.F. Mirror systems. Wiley Interdisciplinary Reviews: Cognitive Science 2011, 2:22-38.
16. Gerjets P., Imhof B., Kühl T., Pfeiffer V., Scheiter K., Gemballa S. Using static and dynamic visualizations to support the comprehension of complex dynamic phenomena in the natural sciences. Use of external representations in reasoning and problem solving: Analysis and improvement 2010, 153-168. Routledge, London. L. Verschaffel, E. de Corte, T. de Jong, J. Elen (Eds.).
17. Hays T.A. Spatial abilities and the effects of computer animation on short-term and long-term comprehension. Journal of Educational Computing Research 1996, 14:139-155.
18. Hegarty M. Mental animation: inferring motion from static diagrams of mechanical systems. Journal of Experimental Psychology: Learning, Memory and Cognition 1992, 18:1084-1102.
19. Hegarty M., Kriz S. Effects of knowledge and visuospatial ability on learning from animation. Learning with animation: Research implications for design 2008, 3-29. Cambridge University Press, Cambridge, England. R. Lowe, W. Schnotz (Eds.).
20. Hegarty M., Mayer S., Kriz S., Keehner M. The role of gestures in mental animation. Spatial Cognition and Computation 2005, 5:333-356.
21. Hegarty M., Waller D. Individual differences in visuospatial ability. Handbook of visuospatial thinking 2005, Cambridge University Press. P. Shah, A. Miyake (Eds.).
22. Hoeren M., Kaller C.P., Glauche V., Vry M.S., Rijntjes M., Hamzei F., et al. Action semantics and movement characteristics engage distinct processing streams during the observation of tool use. Experimental Brain Research 2013, 229:243-260.
23. Höffler T.N. Visuospatial ability: its influence on learning with visualizations-a meta-analytic review. Educational Psychological Review 2010, 22:245-269.
24. Höffler T.N., Leutner D. Instructional animation versus static pictures: a meta-analysis. Learning and Instruction 2007, 17:722-738.
25. Höffler T.N., Sumfleth E., Leutner D. The role of visuospatial ability when learning from an instructional animation or a series of static pictures. Proceedings of the NYU Symposium on Technology and Learning, April 2006 2006, New York University, New York. J. Plass (Ed.).
26. Imhof B., Scheiter K., Edelmann J., Gerjets P. How temporal and spatial aspects of presenting visualizations affect learning about locomotion patterns. Learning and Instruction 2012, 22:193-205.
27. Imhof B., Scheiter K., Gerjets P. Learning about locomotion patterns from visualizations: effects of presentation format and realism. Computers & Education 2011, 57:1961-1970.
28. Jarodzka H., Scheiter K., Gerjets P., van Gog T. In the eyes of the beholder: how experts and novices interpret dynamic stimuli. Learning and Instruction 2010, 20:146-154.
29. Jasper H. Report of committee on methods of clinical exam in EEG. Electroencephalography and Clinical Neurophysiology 1958, 10:370-375.
30. Kühl T., Scheiter K., Gerjets P., Gemballa S. Can differences in learning strategies explain the benefits of learning from static and dynamic visualizations?. Computers & Education 2011, 56:176-187.
31. Lindsey C.C. Form, function, and locomotory habits in fish. Fish physiology 1978, Vol. 2:1-100. Academic Press, New York.
32. Lowe R.K., Schnotz W., Rasch T. Aligning affordances of graphics with learning task requirements. Applied Cognitive Psychology 2011, 25:452-459.
33. Marcus N., Cleary B., Wong A., Ayres P. Should hand actions be observed when learning hand motor skills from instructional animations?. Computers in Human Behavior 2013, 29:2172-2178.
34. Nedelko V., Hassa T., Hamzei F., Schoenfeld M.A., Dettmers C. Action imagery combined with action observation activates more corticomotor regions than action observation alone. Journal of Neurologic Physical Therapy 2012, 36:182-188.
35. Newman-Norlund R., van Schie H.T., van Hoek M.E., Cuijpers R.H., Bekkering H. The role of inferior frontal and parietal areas in differentiating meaningful and meaningless object-directed actions. Brain Research 2010, 1315:63-74.
36. Obrig H., Villringer A. Beyond the visible - imaging the human brain with light. Journal of Cerebral Blood Flow & Metabolism 2003, 23:1-18.
37. Okamoto M., Dan H., Sakamoto K., Takeo K., Shimizu K., Kohno S., et al. Three-dimensional probabilistic anatomical cranio-cerebral correlation via the international 10-20 system oriented for transcranial functional brain mapping. NeuroImage 2004, 21:99-111.
38. Pine K.J., Reeves L., Howlett N., Fletcher B. Giving cognition a helping hand: the effect of congruent gestures on object name retrieval. British Journal of Psychology 2013, 104:57-68.
39. Rizzolatti G., Craighero L. The mirror-neuron system. Annual Review of Neuroscience 2004, 27:169-192.
40. Scheiter K., Arndt J., Imhof B., Ainsworth S. Move like a fish: do gestures aid learning from photographs and videos?. Proceedings EARLI Special Interest Group Text and Graphics: Staging knowledge and experience: How to take advantage of representational technologies in education and training? 2012, 184-186. Université Pierre-Mendès-France, Grenoble, France. E. de Vries, K. Scheiter (Eds.).
41. Schneider S., Christensen A., Häußinger F.B., Fallgatter A.J., Giese M.A., Ehlis A.-C. Show me how you walk and I tell you how you feel - a functional near-infrared spectroscopy study on emotion perception based on human gait. NeuroImage 2014, 85:380-390.
42. Tupak S.V., Reif A., Pauli P., Dresler T., Herrmann M.J., Domschke K., et al. Neuropeptide S receptor gene: fear-specific modulations of prefrontal activation. NeuroImage 2012, 66C:353-360.
43. Tversky B., Morrison J., Bétrancourt M. Animation: can it facilitate?. International Journal of Human-Computer Studies 2002, 57:247-262.
44. Van Gog T., Paas F., Marcus N., Ayres P., Sweller J. The mirror-neuron system and observational learning: implications for the effectiveness of dynamic visualizations. Educational Psychology Review 2009, 21:21-30.