Too good to be true? Ideomotor theory from a computational perspective

Frontiers in Psychology

Volumn 3, Issue NOV, 2012, Pages

  Herbort, Oliver ^a,b   Butz, Martin V ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b UNIVERSITY OF WÜRZBURG   (Germany)

Author keywords

Associative learning; Computational model; Consolidation; Ideomotor theory; Planning

Indexed keywords

EID: 84870944836     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00494     Document Type: Article

References (68)

1. Adams, J. A. (1971). A closed-loop theory of motor learning. J. Mot. Behav. 3, 111-149.
2. Bastian, A., Schöner, G., and Riehle, A. (2003). Preshaping and continuous evolution of motor cortical representations during movement preparation. Eur. J. Neurosci. 18, 2047-2058.
3. Bellman, R. E. (1957). Dynamic Programming. Princeton: Princeton University Press.
4. Brashers-Krug, T., Shadmehr, R., and Bizzi, E. (1996). Consolidation in human motor memory. Nature 382, 252-255.
5. Bullock, D., Grossberg, S., and Guenther, F. H. (1993). A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm. J. Cogn. Neurosci. 5, 408-435.
6. Butz, M. V., Herbort, O., and Hoffmann, J. (2007). Exploiting redundancy for flexible behavior:unsupervised learning in a modular sensorimotor control architecture. Psychol. Rev. 114, 1015-1046.
7. Butz, M. V., Herbort, O., and Pezzulo, G. (2008). "Anticipatory, goal-directed behavior," in The Challenge of Anticipation, eds G. Pezzulo, M. Butz, C. Castelfranchi, and R. Falcone (Berlin: Springer), 85-113.
8. Cruse, H. (2003). The evolution of cognition - a hypothesis. Cogn. Sci. 27, 135-155.
9. Desmurget, M., and Grafton, S. (2000). Forward modeling allows feedback control for fast reaching movements. Trends Cogn. Sci. (Regul. Ed.) 4, 423-431.
10. Doya, K. (1999). What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Netw. 12, 961-974.
11. Elsner, B., and Hommel, B. (2001). Effect anticipation and action control. J. Exp. Psychol. Hum. Percept. Perform. 27, 229-240.
12. Elsner,B.,and Hommel,B. (2004). Contiguity and contingency in actioneffect learning. Psychol. Res. 68, 138-154.
13. Elsner, B., Hommel, B., Mentschel, C., Drzezga, A., Prinz, W., Conrad, B., et al. (2002). Linking actions and their perceivable consequences in the human brain. Neuroimage 17, 364-372.
14. Eppler, M. A. (1995). Development of manipuiatory skills and the deployment of attention. Infant Behav. Dev. 18, 39-405.
15. Fagioli, S., Hommel, B., and Schubotz, R. (2007). Intentional control of attention: action planning primes action-related stimulus dimensions. Psychol. Res. 71, 22-29.
16. Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 74, 381-391.
17. Flanagan, J. R., Vetter, P., Johansson, R. S., and Wolpert, D. M. (2003). Prediction precedes control in motor learning. Curr. Biol. 13, 146-150.
18. Flash, T., and Hogan, N. (1985). The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5, 1688-1703.
19. Georgopoulos, A. P., Caminiti, R., Kalaska, J. F., and Massey, J. T. (1983). Spatial coding of movement: a hypothesis concerning the coding of movement direction by motor cortical populations. Exp. Brain Res. 49, 327-336.
20. Gottlieb, G. L. (1996). On the voluntary movement of compliant (inertialvisco-elastic) loads by parcellated control mechanisms. J. Neurophysiol. 76, 3207-3229.
21. Haering, C., and Kiesel, A. (2012). Time in action contexts: learning when an action effect occurs. Psychol. Res. 76, 336-344.
22. Herbart, J. F. (1825). Psychologie als Wissenschaft neu gegründet auf Erfahrung, Metaphysik und Mathematik. Zweiter analytischer Teil [Psychology as a Science Newly Founded on Experience, Metaphysics and Mathematics: Second, Analytical Part]. Königsberg: August Wilhelm Unzer.
23. Herbort, O., and Butz, M. V. (2007). Encoding complete body models enables task dependent optimal control. Proc. Int. Jt. Conf. Neural Netw. 20, 1639-1644.
24. Herbort, O., and Butz, M. V. (2011). Habitual and goal-directed factors in (everyday) object handling. Exp. Brain Res. 213, 371-382.
25. Herbort, O., Butz, M.V., and Hoffmann, J. (2005)."Towards the advantages of hierarchical anticipatory behavioral control," in Proceedings of KogWis05 the German Cognitive Science Conference, eds K. Opwis, and I.-K. Penner (Basel: Schwabe), 77-82.
26. Herbort, O., Butz, M. V., and Pedersen, G. (2010). "The SURE_REACH model for motor learning and control of a redundant arm: from modeling human behavior to applications in robotics," in From Motor Learning to Interaction Learning in Robots, eds O. Sigaud, and J. Peters (Berlin: Springer), 85-106.
27. Herwig, A., and Waszak, F. (2009). Intention and attention in ideomotor learning. Q. J. Exp. Psychol. 62, 219-227.
28. Hoffmann, J. (1993). Vorhersage und Erkenntnis: Die Funktion von Antizipationen in der menschlichen Verhaltenssteuerung und Wahrnehmung [Anticipation and Cognition: The Function of Anticipations in Human Behavioral Control and Perception]. Göttingen: Hogrefe.
29. Hoffmann, J. (2003). "Anticipatory behavior control," in Anticipatory Behavior in Adaptive Learning Systems: Foundations, Theories, and Systems, eds M. V. Butz, O. Sigaud, and P. Gérard (Berlin: Springer), 44-65.
30. Hommel, B., Müsseler, J., Aschersleben, G., and Prinz, W. (2001). The theory of event coding (TEC): a framework for perception and action planning. Behav. Brain Sci. 24, 849-878.
31. James, W. (1890). The Principles of Psychology, Vol. I, II. Cambridge, MA: Harvard University Press.
32. Jordan, M. I., and Rumelhart, D. E. (1992). Forward models: supervised learning with a distal teacher. Cogn. Sci. 16, 307-354.
33. Jordan,M. I.,andWolpert,D. M. (1999). "Computational motor control," in The Cognitive Neuroscience, ed. M. Gazzaniga (Cambridge: MIT Press), 601-620.
34. Karniel, A. (2002). Three creatures named forward model. Neural Netw. 15, 305-307.
35. Kawato, M. (1999). Internal models for motor control and trajectory planning. Curr. Opin. Neurobiol. 9, 718-727.
36. Kawato, M., Furukawa, K., and Suzuki, R. (1987). A hierarchical neuralnetwork model for control and learning of voluntary movement. Biol. Cybern. 57, 169-185.
37. Kawato, M., and Gomi, H. (1992). A computational model of four regions of the cerebellum based on feedback-error learning. Biol. Cybern. 68, 95-103.
38. Kawato, M., Maeda, M., Uno, Y., and Suzuki, R. (1990). Trajectory formation of arm movement by cascade neural-network model based on minimum torque change criterion. Biol. Cybern. 57, 169-185.
39. Kiesel, A., and Hoffmann, J. (2004). Variable action effects:response control by context-specific effect anticipations. Psychol. Res. 68, 155-162.
40. Konczak, J., and Dichgans, J. (1997). The development toward stereotypic arm kinematics during reaching in the first 3 years of life. Exp. Brain Res. 117, 346-354.
41. Korman, M., Doyon, J., Doljansky, J., Carrier, J., Dagan, Y., and Karni, A. (2007). Daytime sleep condenses the time course of motor memory consolidation. Nat. Neurosci. 10, 1206-1213.
42. Kunde, W. (2001). Response-effect compatibility in manual choice reaction tasks. J. Exp. Psychol. Hum. Percept. Perform. 27, 387-394.
43. Kunde, W., Koch, I., and Hoffmann, J. (2004). Anticipated action effects affect the selection, initiation, and execution of actions. Q. J. Exp. Psychol. A 57, 87-106.
44. Kunde, W., Lozo, L., and Neumann, R. (2011). Effect-based control of facial expressions: evidence from actioneffect compatibility. Psychon. Bull. Rev. 18, 820-826.
45. Kuperstein, M. (1988). Neural model of adaptive hand-eye coordination for single postures. Science 239, 1308-1311.
46. Laycock, T. (1845). On the reflex function of the brain. Br. Foreign Med. J. 19, 298-311.
47. Ma, W. J., Beck, J. M., Latham, P. E., and Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nat. Neurosci. 9, 1432-1438.
48. Melcher, T., Weidema, M., Eenshuistra, R. M., Hommel, B., and Gruber, O. (2008). The neural substrate of the ideomotor principle: an event-related fMRI analysis. Neuroimage 39, 1274-1288.
49. Munro, H., Plumb, M. S., Wilson, A. D., Williams, J. H. G., and MonWilliams, M. (2007). The effect of distance on reaction time in aiming movements. Exp. Brain Res. 183, 249-257.
50. Paulus, M. (2012). Action mirroring and action understanding: an ideomotor and attentional account. Psychol. Res. 76, 760-767.
51. Paulus, M., Hunnius, S., van Elk, M., and Bekkering, H. (2012). How learning to shake a rattle affects 8month-old infants'perception of the rattle's sound: electrophysiological evidence for action-effect binding in infancy. Dev. Cogn. Neurosci. 2, 90-96.
52. Pavlov,I. P. (1927). ConditionedReflexes. London: Oxford University Press.
53. Pfister, R., Kiesel, A., and Hoffmann, J. (2011). Learning at any rate: actioneffect learning for stimulus-based actions. Psychol. Res. 75, 61-65.
54. Rogoff, B. (1998). "Cognition as a collaborative process," in Handbook of Child Psychology, Volume 2: Cognition, Perception, and Language, eds W. Damon, D. Kuhn, and R. S. Siegler (New York: Wiley), 679-744.
55. Rosenbaum, D. A., Inhoff, A. W., and Gordon, A. M. (1984). Choosing between movement sequences: a hierarchical editor models. J. Exp. Psychol. Gen. 113, 372-393.
56. Rosenbaum, D. A., Loukopoulos, L. D., Meulenbroek, R. G. J., Vaughan, J., and Engelbrecht, S. E. (1995). Planning reaches by evaluating stored postures. Psychol. Rev. 102, 28-67.
57. Sailer,U.,Flanagan,J. R.,and Johansson, R. S. (2005). Eye-hand coordination during learning of a novel visuomotor task. J. Neurosci. 25, 8833-8842.
58. Schmidt, R. A. (1975). A schema theory of discrete motor skill-learning. Psychol. Rev. 82, 229-261.
59. Schmidt, R. A. (2003). Motor schema theory after 27 years: reflections and implications for a new theory. Res. Q. Exerc. Sport 74, 366-375.
60. Shin, Y. K., Proctor, R. W., and Capaldi, E. J. (2010). A review of contemporary ideomotor theory. Psychol. Bull. 136, 943-974.
61. Stock, A., and Hoffmann, J. (2002). Intentional fixation of behavioral learning or how R-E learning blocks S-R learning. Eur. J. Cogn. Psychol. 14, 127-153.
62. Stock, A., and Stock, C. (2004). A short history of ideo-motor action. Psychol. Res. 68, 176-188.
63. Todorov, E. (2004). Optimality principles in sensorimotor control. Nat. Rev. Neurosci. 7, 907-915.
64. Vygotsky, L. S. (1978). "Interaction between learning and development," in Mind in Society. The Development of Higher Psychological Processes, eds V. John-Steiner, S. Scribner, and E. Souberman (Cambridge: Harvard University Press), 79-91.
65. Waszak, F., Wascher, E., Keller, P., Koch, I., Aschersleben, G., Rosenbaum, D. A., et al. (2005). Intention-based and stimulus-based mechanisms in action selection. Exp. Brain Res. 162, 346-356.
66. Wolfensteller, U., and Ruge, H. (2011). On the timescale of stimulus-based action-effect learning. Q. J. Exp. Psychol. 64, 1273-1289.
67. Wolpert, D. M., Ghahramani, Z., and Flanagan, J. R. (2001). Perspectives and problems in motor learning. Trends Cogn. Sci. (Regul. Ed.) 5, 487-494.
68. Zukow-Goldring, P., and Arbib, M. A. (2007). Affordances, effectivities, and assisted imitation: caregivers and the directing of attention. Neurocomputing 70, 2181-2193.