From gestures to gaming: Visible embodiment of remote actions

Quarterly Journal of Experimental Psychology

Volumn 67, Issue 3, 2014, Pages 609-624

  Chisholm, Joseph D ^a   Risko, Evan F ^b   Kingstone, Alan ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b University of Memphis   (United States)

Author keywords

Action; Cognitive demand; Embodied cognition; Natural behaviour; Teleoperation

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; COGNITION; FEMALE; GESTURE; HUMAN; MALE; MOTOR ACTIVITY; PHYSIOLOGY; RECREATION; YOUNG ADULT;

ADOLESCENT; ADULT; COGNITION; FEMALE; GESTURES; HUMANS; MALE; MOTOR ACTIVITY; VIDEO GAMES; YOUNG ADULT;

EID: 84894237647     PISSN: 17470218     EISSN: 17470226     Source Type: Journal    
DOI: 10.1080/17470218.2013.823454     Document Type: Article

References (61)

1. Alibali, M. W., Spencer, R. C., Knox, L., & Kita, S. (2011). Spontaneous gestures influence strategy choices in problem solving. Psychological Science, 22, 1138-1144. doi: 10.1177/0956797611417722
2. Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997). Deictic codes for the embodiment of cognition. Behavioral & Brain Sciences, 20, 723-767.
3. Barsalou, L. W. (2010). Grounded cognition: Past, present, and future. Topics in Cognitive Science, 2, 716-724. doi: 10.1111/j.1756-8765.2010.01115.x
4. Brown, E., & Cairns, P. (2004). A grounded investigation of game immersion. In E. Dykstra-Erickson & M. Tscheligi (Eds.), Proceedings of the Conference on Human Factors in Computing Systems (CHI 2004), (pp. 1297-1300). New York, NY: ACM Press.
5. Chandrasekharan, S., Athreya, D., & Srinivasan, N. (2010). Investigating prospective control: When and how actions supporting cognition are generated. International Journal of Mind, Brain, & Cognition, 1, 93-114.
6. Chisholm, J. D., Risko, E. F., & Kingstone, A. (2013). The embodiment of focus: Investigating the impact of leaning behavior on our cognitive state and other's perception of our cognitive state. Journal of Experimental Psychology: Human Perception and Performance, 39, 100-110.
7. Chu, M., & Kita, S. (2008). Spontaneous gestures during mental rotation tasks: Insights into the microdevelopment of the motor strategy. Journal of Experimental Psychology: General, 137, 706-723. doi: 10.1037/a0013157
8. Chu, M., & Kita, S. (2011). The nature of gestures' beneficial role in spatial problem solving. Journal of Experimental Psychology: General, 140, 102-116. doi: 10.1037/a0021790
9. Clark, A. (2010). Supersizing the mind, Oxford, UK: Oxford University Press.
10. Eerland, A., Guadalupe, T. M., & Zwaan, R. A. (2011). Leaning to the left makes the Eiffel Tower seem smaller-Posture-modulated estimation. Psychological Science, 22(12), 1511-1514. doi: 10.1177/0956797611420731
11. van Elk, M., van Schie, H. T., & Bekkering, H. (2008). Conceptual knowledge for understanding other's actions is organized primarily around action goals. Experimental Brain Research, 189, 99-107.
12. Farnè, A., Bonifazi, S., & Làdavas, E. (2005). The role played by tool-use and tool-length on the plastic elongation of peri-hand space: A single case study. Cognitive Neuropsychology, 22, 408-418. doi: 10.1080/02643290442000112
13. Farnè, A., Serino, A., & Làdavas, E. (2007). Dynamic size-change of perihand space following tool-use: Determinants and spatial characteristics revealed through cross-modal extinction. Cortex, 43, 436-443. doi: 10.1016/S0010-9452(08)70468-4
14. Freeman, J., Avons, S. E., Meddis, R., Pearson, D. E., & Ijsselsteijn, W. (2000). Using behavioral realism to estimate presence: A study of the utility of postural responses to motion stimuli. Presence, 9(2), 149-164. doi: 10.1162/105474600566691
15. Glenberg, A. M. (2010). Embodiment as a unifying perspective for psychology. WIREs Cognitive Science, 1, 586-596.
16. Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Science, 13, 419-429. doi: 10.1016/S1364-6613(99)01397-2
17. Goldin-Meadow, S. (2005). Hearing gesture: How our hands help us think, Cambridge, MA: Harvard University Press.
18. Goldin-Meadow, S., Cook, S. W., & Mitchell, Z. A. (2009). Gesturing gives children new ideas about math. Psychological Science, 20(3), 267-272. doi: 10.1111/j.1467-9280.2009.02297.x
19. Goldin-Meadow, S., Nusbaum, H., Kelly, S. D., & Wagner, S. (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12, 516-522. doi: 10.1111/1467-9280.00395
20. Grafton, S. T., & Hamilton, A. F. D. C. (2007). Evidence for a distributed hierarchy of action representation in the brain. Human Movement Science, 26(4), 590-616. doi: 10.1016/j.humov.2007.05.009
21. Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload, (pp. 139-178). Amsterdam: North Holland Press.
22. Heyes, C. (2001). Causes and consequences of imitation. Trends in Cognitive Sciences, 5(6), 253-261. doi: 10.1016/S1364-6613(00)01661-2
23. Hollan, J., Hutchins, E., & Kirsh, D. (2000). Distributed cognition: Toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction, 7(2), 174-196. doi: 10.1145/353485.353487
24. Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24, 849-937. doi: 10.1017/S0140525X01000103
25. Hoshino, M., Takashi, M., Oyamada, K., Ohmi, M., & Yoshizawa, T. (1997). Body sway induced by 3D images. In S. S. Fisher, J. O. Merritt, & M. T. Bolas (Eds.), Proceedings of SPIE-Stereoscopic Displays and Virtual Reality Systems IV (Vol. 3012, pp. 400-407.San Jose, CA: International Society for Optics and Photonics
26. Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15(3), 495-514. doi: 10.3758/PBR.15.3.495
27. Hostetter, A. B., Alibali, M. W., & Kita, S. (2007). I see it in my hands' eye: Representational gestures reflect conceptual demands. Language & Cognitive Processes, 22, 313-336. doi: 10.1080/01690960600632812
28. Hutchins, E. (1995). Cognition in the wild, Cambridge, MA: MIT Press.
29. James, W. (1890). The principles of psychology, New York, NY: Holt.
30. Jeannerod, M. (1994). The representing brain: Neural correlates of motor intention and imagery. Behavioral and Brain Sciences, 17(2), 187-202. doi: 10.1017/S0140525X00034026
31. Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., & Walton, A. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66, 641-661. doi: 10.1016/j.ijhcs.2008.04.004
32. Killeen, P. R., & Glenberg, A. M. (2010). Resituating cognition. Comparative Cognition & Behavior Reviews, 5, 59-77. doi: 10.3819/ccbr.2010.50003
33. Kingstone, A., Smilek, D., & Eastwood, J. D. (2008). Cognitive ethology: A new approach for studying human cognition. British Journal of Psychology, 99, 317-340. doi: 10.1348/000712607X251243
34. Kirsh, D. (1995). Complementary strategies: Why we use our hands when we think. In J. D. Moore & J. F. Lehman (Eds.), Proceedings of 17th Annual Conference on the Cognitive Science Society, (pp. 212-217). Mahwah, NJ: Lawrence Erlbaum Associates.
35. Kirsh, D. (1996). Adapting the environment instead of oneself. Adaptive Behavior, 4, 415-452. doi: 10.1177/105971239600400307
36. Kirsh, D. (2010). Thinking with external representations. AI & Society, 25, 441-454. doi: 10.1007/s00146-010-0272-8
37. Kornblum, S., Hasbroucq, T., & Osman, A. (1990). Dimensional overlap: Cognitive basis for stimulus-response compatibility-A model and taxonomy. Psychological Review, 97(2), 253 doi: 10.1037/0033-295X.97.2.253
38. Lopez, C., Bachofner, C., Mercier, M., & Blanke, O. (2009). Gravity and observer's body orientation influence the visual perception of human body postures. Journal of Vision, 9(5), 1-14. doi: 10.1167/9.5.1
39. Majdandžić, J., Grol, M. J., van Schie, H. T., Verhagen, L., Toni, I., & Bekkering, H. (2007). The role of immediate and final goals in action planning: An fMRI study. NeuroImage, 37(2), 589-598. doi: 10.1016/j.neuroimage.2007.04.071
40. Maravita, A., & Iriki, A. (2004). Tools for the body schema. Trends in Cognitive Science, 8, 79-86. doi: 10.1016/j.tics.2003.12.008
41. Melinger, A., & Kita, S. (2007). Conceptualisation load triggers gesture production. Language & Cognitive Processes, 22, 473-500. doi: 10.1080/01690960600696916
42. Newman-Norlund, R. D., van Schie, H., van Zuijlen, A. M. J., & Bekkering, H. (2007). The mirror neuron system is more active during complementary compared with imitative action. Nature Neuroscience, 10(7), 817-818. doi: 10.1038/nn1911
43. Niedenthal, P. M. (2007). Embodying emotion. Science, 316(5827), 1002-1005. doi: 10.1126/science.1136930
44. Pfiefer, R., & Bongard, J. C. (2006). How the body shapes the way we think: A new view of intelligence, Cambridge, MA: MIT Press.
45. Prinz, W. (1992). Why don't we perceive our brain states?. European Journal of Cognitive Psychology, 4(1), 1-20. doi: 10.1080/09541449208406240
46. Prinz, W. (1997). Perception and action planning. European Journal of Cognitive Psychology, 9(2), 129-154. doi: 10.1080/713752551
47. Proffitt, D. R. (2006). Embodied perception and the economy of action. Perspectives on Psychological Science, 1(2), 110-122. doi: 10.1111/j.1745-6916.2006.00008.x
48. Proffitt, D. R., Stefanucci, J., Banton, T., & Epstein, W. (2003). The role of effort in perceiving distance. Psychological Science, 14(2), 106-112. doi: 10.1111/1467-9280.t01-1-01427
49. Risko, E. F., Medimorec, S., Chisholm, J. D., & Kingstone, A. (in press). Cognitive offloading in the identification of rotated objects: A natural behavior approach. Cognitive Science,
50. Risko, E. F., & Kingstone, A. (2011). Eyes wide shut: Implied social presence, eye tracking and attention. Attention, Perception, & Psychophysics, 73(2), 291-296. doi: 10.3758/s13414-010-0042-1
51. Riva, G., & Mantovani, F. (2012). From the body to the tools and back: A general framework for presence in mediated interactions. Interacting with Computers, 24(4), 203-210. doi: 10.1016/j.intcom.2012.04.007
52. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16(2), 225-237. doi: 10.3758/PBR.16.2.225
53. van Schie, H. T., & Bekkering, H. (2007). Neural mechanisms underlying immediate and final action goals in object use reflected by slow wave brain potentials. Brain Research, 1148, 183-197.
54. Schwartz, D. L., & Black, J. B. (1996). Shuttling between depictive models and abstract rules: Induction and fallback. Cognitive Science, 20, 457-497. doi: 10.1207/s15516709cog2004_1
55. Tinbergen, N. (1963). On aims and method of ethology. Zeitschrift für Tierpsychologie, 20, 410-433. doi: 10.1111/j.1439-0310.1963.tb01161.x
56. Umiltà, M. A., Escola, L., Intskirveli, I., Grammont, F., Rochat, M., Caruana, F., Rizzolatti, G. (2008). When pliers become fingers in the monkey motor system. Proceedings of the National Academy of Sciences USA, 105(6), 2209-2213. doi: 10.1073/pnas.0705985105
57. Vallee-Tourangeau, T., & Wrightman, M. (2010). Interactive skills and individual differences in a word production task. AI & Society, 25, 433-439. doi: 10.1007/s00146-010-0270-x
58. Vogeley, K., & Fink, G. R. (2003). Neural correlates of the first-person-perspective. Trends in Cognitive Sciences, 7, 38-42. doi: 10.1016/S1364-6613(02)00003-7
59. Wagenmakers, E. J., Wetzels, R., Borsboom, D., & van der Maas, H. L. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100(3), 426-432. doi: 10.1037/a0022790
60. Williams, L. E., & Bargh, J. A. (2009). Experiencing physical warmth promotes interpersonal warmth. Science, 322, 606-607. doi: 10.1126/science.1162548
61. Wilson, M. (2002). Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4), 625-636. doi: 10.3758/BF03196322