Embodied cognition and the magical future of interaction design

ACM Transactions on Computer-Human Interaction

Volumn 20, Issue 1, 2013, Pages

  Kirsh, David ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Distributed cognition; Embodied cognition; Human computer interaction; Interaction design; Mental simulation; Physical computation; Situated cognition; Tangible interfaces

Indexed keywords

DISTRIBUTED COGNITION; EMBODIED COGNITION; INTERACTION DESIGN; MENTAL SIMULATION; SITUATED COGNITION; TANGIBLE INTERFACES;

VISUAL COMMUNICATION;

HUMAN COMPUTER INTERACTION;

EID: 84877899548     PISSN: 10730516     EISSN: 15577325     Source Type: Journal    
DOI: 10.1145/2442106.2442109     Document Type: Article

References (80)

1. AGLIOTI, S. M., CESARI, P., ROMANI, M., AND URGESI, C. 2008. Action anticipation and motor resonance in elite basketball players. Nature Neurosci. 11, 9, 1109-1116.
2. AGNEW, Z. K., BHAKOO, K. K., AND PURI, B. K. 2007. The human mirror system: A theory of mind reading. Brain Res. Rev. 54, 2, 286-293.
3. BARSALOU, L. 1983. Ad hoc categories. Memory Cogn. 11, 211-227.
4. BARSALOU, L. W. 1999. Perceptual symbol systems. Behav. Brain Sci. 22, 577-660.
5. BARSALOU, L. W. 2008. Grounded cognition. Annu. Rev. Psychol. 59, 617-645.
6. BISIACH, E., PERANI, D.,VALLAR, G., AND BEERTI, A. 1986. Unilateral neglect: Personal and extrapersonal. Neuropsychologia 24, 759-767.
7. BLAKESLEE, S. 2004. When the brain says, "don't get too close". The New York Times, July 13.
8. BRAIN, W. R. 1941. Visual disorientation with special reference to lesions of the right hemisphere. Brain 64, 224-272.
9. BUCCINO, G.,BINKOFSKI, F., AND RIGGIO, L. 2004. The mirror neuron system and action recognition. Brain Lang. 89, 370-376.
10. BUXTON, B. 2007. Sketching User Experience. Sketching User Experiences: Getting The Design Right And The Right Design (Interactive Technologies). Morgan Kaufmann.
11. CARLSON, R. A., AVRAAMIDES, M. N., CARY, M., AND STRASBERG, S. 2007. What do the hands externalize in simple arithmetic? J. Exp. Psychol. Learn. Mem. Cogn. 33, 4, 747-756.
12. CLARK, A. 1997. Being There Putting Brain, Body, and World Together Again. MIT Press, Cambridge, M.A.
13. CLARK, A. 2008. Supersizing the Mind: Embodiment, Action, and Cognitive Extension. Oxford University Press.
14. COLBY, C. L. 1998. Action oriented spatial reference frames in cortex. Neuron 20, 15-24.
15. COSLETT, H. B. 1998. Evidence for a disturbance of the body schema in neglect. Brain Cogn. 37, 529-544.
16. CROSS, E., KRAEMER, D. J. M.,HAMILTON, A. F. DE C., KELLEY, W. M., AND GRAFTON, S. T. 2009. Sensitivity of the action observation network to physical and observational learning. Cereb. Cortex 19, 315-326.
17. ECK, D., GASSER, M., AND PORT, R. 2000. Dynamics and embodiment in beat induction. In Rhythm Perception and Production, P. Desain and L. Windsor, Eds., Swets and Zeitlinger, Exton, PA.
18. ENDSLEY, M. 1995. Toward a theory of situation awareness in dynamic systems. Hum. Factors J. Hum. Factors Ergon. Soc. 37, 1, 32-64.
19. FODOR, J. A. 1975. The Language of Thought. Harvard University Press, Cambridge, M.A.
20. FRANK, M. AND BARNER, D. 2012. Representing exact number visually using mental abacus. J. Exp. Psychol. General. 141, 1, 134-149.
21. GIBSON, J. J. 1966. The Senses Considered as Perceptual Systems. Houghton Mifflin, Boston.
22. GIBSON, J. J. AND CROOKS, L. E. 1938. A theoretical field-analysis of automobile-driving. Amer. J. Psychol. 51, 453-471.
23. GOLDIN-MEADOW, S. 2005. Hearing Gestures: How Our Hands Help Us to Think. Harvard University Press.
24. GOLDIN-MEADOW, S. AND BEILOCK, S. L. 2010. Action's influence on thought: The case of gesture. Persepct. Psychol. Sci. 5, 664-674.
25. GOODWIN, C. 1994. Professional vision. Amer. Anthropol. 96, 3, 606-633.
26. GRAZIANO, M. S. A. AND GROSS, C. G. 1995. The representation of extrapersonal space: A possible role for bimodal, visuo-tactile neurons. In The Cognitive Neurosciences, M. S. Gazzaniga, Ed., MIT Press, 1021-1034.
27. HARMAN, G. 1986. Change in View: Principles of Reasoning. MIT Press.
28. HATANO, G.,MIYAKE, Y., AND BINKS, M. G. 1977. Performance of expert abacus operators. Cogn. 5, 47-55.
29. HINZ, B. 2008. Practice exaggeration for large intervals and leaps. http://www.creativekeyboard.com/oct08/hinz.html
30. IRIKI, A. 2009. Using tools: The moment when mind, language, and humanity emerged. Frontlines Riken Res. 4, 5.
31. IRIKI, A., TANAKA, M., AND IWAMURA, Y. 1996. Coding of modified body schema during tool use by macaque postcentral neurones. Neurorep. 7, 2325-2330.
32. JEANNEROD, M. 1994. The representing brain: Neural correlates of motor intension and imagery. Behav. Brain Sci. 17, 187-245.
33. JEANNEROD, M. 2001. Neural simulation of action: A unifying mechanism for motor cognition. NeuroImage 14, S103-S109.
34. JOHNSON-LAIRD, P. 1989. Mental models. In The Foundations of Cognitive Science, M. Posner, Ed., MIT Press, Cambridge, MA, Chapter 8.
35. JONES, K. 2003. What is an affordance? Ecol. Psychol. 15, 2, 107-114.
36. KASCHAK, M. P., ZWAAN, R. A., AVEYARD, M., AND YAXLEY, R. H. 2006. Perception of auditory motion affects language processing. Cogn. Sci. 30, 733-744.
37. KIRSH, D. 1992. When is information explicitly represented? In The Vancouver Studies in Cognitive Science. Oxford University Press, 340-365.
38. KIRSH, D. 1995. Complementary strategies: Why we use our hands when we think. In Proceedings of the 17th Annual Conference of the Cognitive Science Society, J. D. Moore and J. F. Lehman, Eds., 212-217.
39. KIRSH, D. 2005. Multi-Tasking and cost structure: Implications for design. In Proceedings of the 27th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum, Mahwah, NJ.
40. KIRSH, D. 2009a. Problem solving and situated cognition. In The Cambridge Handbook of Situated Cognition, P. Robbins and M. Aydede, Eds., Cambridge University Press.
41. KIRSH, D. 2009b. Projection, problem space and anchoring. In Proceedings of the 31st Annual Conference of the Cognitive Science Society, N. A. Taatgen and H. van Rijn, Eds., Cognitive Science Society, 2310-2315.
42. KIRSH, D. 2009c. Interaction, external representations and sense making. In Proceedings of the 31st Annual Conference of the Cognitive Science Society, N. A. Taatgen and H. van Rijn, Eds., Cognitive Science Society, 1103-1108.
43. KIRSH, D. 2009d. Knowledge, implicit versus explicit. In Oxford Companion to Consciousness. Oxford University Press, Cambridge, UK.
44. KIRSH, D. 2010. Explaining artifact evolution. In The Cognitive Life of Things: Recasting the Boundaries of the Mind, L. Malafouris, and C. Renfrew, Eds., McDonald Institute for Archaeological Research.
45. KIRSH,D. 2012a. How marking in dance constitutes thinking with the body. In The External Mind: Perspectives on Mediation, Distribution and Situation in Cognition and Semiosis, R. Fusaroli, T. Granelli, and C. Paolucci, Eds., 112-113.
46. KIRSH, D. 2012b. Running it through the body. In Proceedings of the 34th Annual Cognitive Science Society. Lawrence Erlbaum.
47. KIRSH, D., CABALLERO R., AND CUYKENDALL, S. 2012. When doing the wrong thing is right. In Proceedings of the 34th Annual Cognitive Science Society. Lawrence Erlbaum.
48. KIRSH, D. AND MAGLIO, P. 1995. On distinguishing epistemic from pragmatic actions. Cogn. Sci. 18, 513-549.
49. KIRSH, D. MUNTANYOLA, D., JAO, J., LEW, A., AND SUGIHARA, M. 2009. Choreographic methods for creating novel, high quality dance. In Proceedings of the 5th International Workshop on Design and Semantics and Form (DESFORM). Kluwer.
50. KOSSYLN, H. AND MOULTON, S. T. 2009. Mental imagery and implicit memory. In Handbook of Imagination and Mental Imagery, K. D. Markman, W. M. P. Klein, and J. A. Suhr, Eds., Psychology Press, New York.
51. KNOBLICH, G. AND FLACH, R. 2001. Predicting the effects of actions: Interactions of perception and action. Psychol. Sci. 12, 467-472.
52. LÀDAVAS, E. 2002. Functional and dynamic properties of visual peripersonal space. Trends Cogn. Sci. 6, 1.
53. LADAVAS, E., DI PELLEGRINO, G., FARNE, A., AND ZELONI, G. 1998. Neuropsychological evidence of an integrated visuotactile representation of peripersonal space in humans. J. Cogn. Neurosci. 10, 581-589.
54. MAKIN, T. R., HOLMES N. P., AND ZOHARY, E. 2007. Is that near my hand? Multisensory representation of peripersonal space in human intraparietal sulcus. J. Neurosci. 27, 731-740.
55. MALAFOURIS, L. 2008. At the potter's wheel: An argument for material agency. In Material Agency, C. Knappett, and L. Malafouris, Eds., Springer, 19-36.
56. MARAVITA, A. AND IRIKI, A. 2004. Tools for the body (schema). Trends Cogn. Sci. 8, 2, 79-86.
57. MARAVITA, A., SPENCE, C., KENNETT, S., AND DRIVER, J. 2002. Tool-Use changes multimodal spatial interactions between vision and touch in normal humans. Cogn. 83, B25-B34.
58. MCLUHAN, M. 1964. Understanding Media: The Extensions of Man 1st Ed. McGraw Hill, New York.
59. MYIN, E. AND O'REGAN, J. K. 2008. Situated perception and sensation in vision and other modalities: Form an active to a sensorimotor account. In Cambridge Handbook of Situated Cognition, P. Robbins and A. Aydede, Eds., Cambridge University Press, 185-200.
60. NÖE, A. 2005. Action in Perception. MIT Press.
61. O'CONNOR, E. 2006. Glassblowing tools: Extending the body towards practical knowledge and informing a social world. Qual. Sociol. 29, 2, 177-193.
62. O'REGAN, J. K. AND NOE, A. 2001. A sensorimotor account of vision and visual consciousness. Behav. Brain Sci. 24, 939-1031.
63. POTTER, L. 1980. The Art of Cello Playing: A Complete Textbook Method for Private or Class Instruction. Alfred Music Publishing.
64. PREVIC, F. H. 1998. The neuropsychology of 3-D space. Psychol. Bull. 124, 123-163.
65. PRINZ, W. 1997. Perception and action planning. Euro. J. Cogn. Psychol. 9, 129-154.
66. PROFFITT, D. 2006. Embodied perception and the economy of action. Perspect. Psychol. Sci. 1, 110.
67. RENSINK, R. A. 2002. Change detection. Annu. Rev. Psychol. 53, 245-277.
68. RIZZOLATTI, G. AND CRAIGHERO, L. 2004. The mirror-neuron system. Annu. Rev. Neurosci. 27, 169-192.
69. RIZZOLATTI, G. AND SINIGAGLIA, C. 2007. Mirrors in the Brain: How Our Minds Share Actions and Emotions. Oxford University Press.
70. SCAIFE, M., AND ROGERS, Y. 1996. External cognition: How do graphical representations work? Int. J. Hum.-Comput. Stud. 45, 185-213.
71. SEBANZ, N. AND SHIFFRAR, M. 2007. Bodily bonds: Effects of social context on ideomotor movements. In Sensorimotor Foundations of Higher Cognition, P. Haggard, Y. Rosetti, and M. Kawato, Eds., Oxford University Press.
72. SHIN, Y. K., PROCTOR, R. W., AND CAPALDI, E. J. 2010. A review of contemporary ideomotor theory. Psychol. Bull. 136, 6, 943-974.
73. SIMONS, D. J. AND CHABRIS, C. F. 1999. Gorillas in our midst: Sustained inattentional blindness for dynamic events. Percept. 28, 9, 1059-1074.
74. VAISHNAVI, S., CALHOUN, J., AND CHATTERJEE, A. 1999. Crossmodal and sensorimotor integration in tactile awareness. Neurol. 53, 1596-1598.
75. VARELA, F., THOMPSON, E., AND ROSCH, E. 1991. The Embodied Mind: Cognitive Science and Human Experience. MIT Press.
76. VIVIANI, P. 2002. Motor competence in the perception of dynamic events: A tutorial. In Common Mechanisms in Perception and Action, W. Prinz and B. Hommel, Eds., Oxford University Press, 406-442.
77. WEXLER, M., KOSSLYN, S., AND BERTHOZ, A. 1998. Motor processes in mental rotation. Cogn. 68, 77-94.
78. WILLIAMS, A. AND GRIBBLE, P. L. 2012. Observed effector-independent motor learning by observing. J. Neurophysiol. 107, 1564-1570.
79. WILSON, M. AND KNOBLICH, G. 2005. The case for motor involvement in perceiving conspecifics. Psychol. Bull. 131, 460-473.
80. WINTER, B. AND BERGEN, B. 2012. Language comprehenders represent object distance both visually and auditorily. Lang. Cogn. 4, 1, 1-16.