Proactive action preparation: Seeing action preparation as a continuous and proactive process

Motor Control

Volumn 16, Issue 3, 2012, Pages 386-424

  Pezzulo, Giovanni ^a,b   Ognibene, Dimitri ^c  

^a CNR Consiglio Nazionale delle Ricerche   (Italy)

^b INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

^c IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Action execution; Action preparation; Internal model; Prediction; Proactivity; Prospection

Indexed keywords

DECISION MAKING; HUMAN; KNOWLEDGE; MENTAL FUNCTION; MOTOR CONTROL; PROACTIVE ACTION PREPARATION; REVIEW;

EID: 84865069584     PISSN: 10871640     EISSN: 15432696     Source Type: Journal    
DOI: 10.1123/mcj.16.3.386     Document Type: Review

References (203)

1. Allport, D. A. (1987). Selection for action: some behavioural and neurophysiological considerations of attention and action. In Hauer, H. and Sanders, A. F., editors, Perspectives on Perception and Action, pages 395-419. Hillsdale, NJ: Lawrence Erlbaum Associates.
2. Arbib, M.A. (1981). Perceptual structures and distributed motor control. In V.B. Brooks (Ed.), Handbook of Physiology - The Nervous System II. Motor Control (pp. 1449-1480). American Physiological Society.
3. Baldauf, D., Wolf, M., & Deubel, H. (2006). Deployment of visual attention before sequences of goal-directed hand movements. Vision Research, 46(26), 4355-4374. PubMed doi:10.1016/j.visres.2006.08.021
4. Ballard, D. (1991). Animate vision. Artificial Intelligence, 48(1), 1-27. doi:10.1016/0004-3702(91)90080-4
5. Bar, M. (2007). The proactive brain: using analogies and associations to generate predictions. Trends in Cognitive Sciences, 11(7), 280-289. PubMed doi:10.1016/j.tics.2007.05.005
6. Bargh, J.A., & Chartrand, T.L. (1999). The unbearable automaticity of being. The American Psychologist, 54, 462-479. doi:10.1037/0003-066X.54.7.462
7. Barkley, R.A. (2001). The executive functions and self-regulation: An evolutionary neuropsychological perspective. Neuropsychology Review, 11 (1), 1-29. PubMed doi:10.1023/A:1009085417776
8. Barsalou, L. (2008). Grounded cognition. Annual Review of Psychology, 59, 617-645. PubMed doi:10.1146/annurev.psych.59.103006.093639
9. Bastian, A., Schner, G., & Riehle, A. (2003). Preshaping and continuous evolution of motor cortical representations during movement preparation. The European Journal of Neuroscience, 18(7), 2047-2058. PubMed doi:10.1046/j.1460-9568.2003.02906.x
10. Bays, P.M., & Wolpert, D.M. (2007). Computational principles of sensorimotor control that minimize uncertainty and variability. The Journal of Physiology, 578(Pt 2), 387-396. PubMed doi:10.1113/jphysiol.2006.120121
11. Beer, R. (1997). The dynamics of adaptive behavior: A research program. Robotics and Autonomous Systems, 20, 257-289. doi:10.1016/S0921-8890(96)00063-2
12. Behrens, T.E.J., Woolrich, M.W., Walton, M.E., & Rushworth, M.F.S. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10(9), 1214-1221. PubMed doi:10.1038/nn1954
13. Bichot, N.P., Rao, S.C., & Schall, J.D. (2001). Continuous processing in macaque frontal cortex during visual search. Neuropsychologia, 39(9), 972-982. PubMed doi:10.1016/S0028-3932(01)00022-7
14. Botvinick, M. (2007). Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cognitive, Affective & Behavioral Neuroscience, 7(4), 356. PubMed doi:10.3758/CABN.7.4. 356
15. Botvinick, M.M. (2008). Hierarchical models of behavior and prefrontal function. Trends in Cognitive Sciences, 12(5), 201-208. PubMed doi:10.1016/j.tics.2008.02.009
16. Botvinick, M. M., Ibara, S., & Prabhakar, J. (submitted) Cognitive and neural foundations of goal-directed decision-making: An integrated framework.
17. Braver, T.S., Paxton, J.L., Locke, H.S., & Barch, D.M. (2009). Flexible neural mechanisms of cognitive control within human prefrontal cortex. Proceedings of the National Academy of Sciences of the United States of America, 106(18), 7351-7356. PubMed doi:10.1073/pnas.0808187106
18. Bubic, A., von Cramon, D., & Schubotz, R. (2010). Prediction, cognition and the brain. Frontiers in Human Neuroscience, 4.
19. Buckner, R.L., & Carroll, D.C. (2007). Self-projection and the brain. Trends in Cognitive Sciences, 11(2), 49-57. PubMed doi:10.1016/j.tics.2006.11. 004
20. Bullock, D., & Grossberg, S. (1988). Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. Psychological Review, 95, 49-90. PubMed doi:10.1037/0033-295X.95.1.49
21. Busemeyer, J.R., & Townsend, J.T. (1993). Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychological Review, 100(3), 432-459. PubMed doi:10.1037/0033-295X.100.3.432
22. Cassandra, A.R. (1998). Exact and Approximate Algorithms for Partially Observable Markov Decision Processes. PhD thesis, Brown University.
23. Chao, L.L., & Martin, A. (2000). Representation of manipulable man-made objects in the dorsal stream. NeuroImage, 12(4), 478-484. PubMed doi:10.1006/nimg.2000.0635
24. Churchland, A.K., Kiani, R., & Shadlen, M.N. (2008). Decision-making with multiple alternatives. Nature Neuroscience, 11(6), 693-702. PubMed doi:10.1038/nn.2123
25. Churchland, M.M., Yu, B.M., Ryu, S.I., Santhanam, G., & Shenoy, K.V. (2006). Neural variability in premotor cortex provides a signature of motor preparation. The Journal of Neuroscience, 26(14), 3697-3712. PubMed doi:10.1523/JNEUROSCI.3762-05.2006
26. Cisek, P. (2005). Neural representations of motor plans, desired trajectories, and controlled objects. Cognitive Processing, 6, 15-24. doi:10.1007/s10339-004-0046-7
27. Cisek, P. (2006). Integrated neural processes for defining potential actions and deciding between them: a computational model. The Journal of Neuroscience, 26(38), 9761-9770. PubMed doi:10.1523/JNEUROSCI.5605-05.2006
28. Cisek, P. (2007). Cortical mechanisms of action selection: the affordance competition hypothesis. Phil. Trans. R. Soc. B., 362, 1585-1599. PubMed doi:10.1098/rstb.2007.2054
29. Cisek, P., & Kalaska, J.F. (2004). Neural correlates of mental rehearsal in dorsal premotor cortex. Nature, 431(7011), 993-996. PubMed doi:10.1038/nature03005
30. Cisek, P., & Kalaska, J.F. (2005). Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron, 45(5), 801-814. PubMed doi:10.1016/j.neuron.2005.01.027
31. Cisek, P., & Kalaska, J.F. (2010). Neural mechanisms for interacting with a world full of action choices. Annual Review of Neuroscience. PubMed
32. Cisek, P., Puskas, G.A., & El-Murr, S. (2009). Decisions in changing conditions: the urgency-gating model. The Journal of Neuroscience, 29(37), 11560-11571. PubMed doi:10.1523/JNEUROSCI.1844-09.2009
33. Coello, Y., Bartolo, A., Amiri, B., Devanne, H., Houdayer, E., & Derambure, P. (2008). Perceiving what is reachable depends on motor representations: evidence from a transcranial magnetic stimulation study. PLoS ONE, 3(8), e2862. PubMed doi:10.1371/journal.pone.0002862
34. Coles, M., Smid, H., Scheffers, M., & Otten, L. (1995). Mental chronometry and the study of human information processing. In M. Rugg & M. Coles (Eds.), Electrophysiology of Mind: Event-Related Brain Potentials and Cognition. Oxford University Press.
35. Coles, M.G., Gratton, G., Bashore, T.R., Eriksen, C.W., & Donchin, E. (1985). A psychophysiological investigation of the continuous flow model of human information processing. Journal of Experimental Psychology. Human Perception and Performance, 11(5), 529-553. PubMed doi:10.1037/0096-1523.11.5. 529
36. Coull, J., & Nobre, A. (2008). Dissociating explicit timing from temporal expectation with fmri. Current Opinion in Neurobiology, 18(2), 137-144. PubMed doi:10.1016/j.conb.2008.07.011
37. Craighero, L., Bello, A., Fadiga, L., & Rizzolatti, G. (2002). Hand action preparation influences the responses to hand pictures. Neuropsychologia, 40(5), 492-502. PubMed doi:10.1016/S0028-3932(01)00134-8
38. Crammond, D.J., & Kalaska, J.F. (2000). Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. Journal of Neurophysiology, 84(2), 986-1005. PubMed
39. Cui, X., Stetson, C., Montague, P.R., & Eagleman, D.M. (2009). Ready...go: Amplitude of the fmri signal encodes expectation of cue arrival time. PLoS Biology, 7(8), e1000167. PubMed doi:10.1371/journal.pbio.1000167
40. Curtis, C.E., Rao, V.Y., & D'Esposito, M. (2004). Maintenance of spatial and motor codes during oculomotor delayed response tasks. The Journal of Neuroscience, 24(16), 3944-3952. PubMed doi:10.1523/JNEUROSCI.5640-03.2004
41. Daw, N.D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8(12), 1704-1711. PubMed doi:10.1038/nn1560
42. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B., & Dolan, R.J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441(7095), 876-879. PubMed doi:10.1038/nature04766
43. Dayan, P. (2009). Goal-directed control and its antipodes. Neural Networks, 22, 213-219. PubMed doi:10.1016/j.neunet.2009.03.004
44. Dayan, P., & Daw, N.D. (2008). Decision theory, reinforcement learning, and the brain. Cognitive, Affective & Behavioral Neuroscience, 8(4), 429-453. PubMed doi:10.3758/CABN.8.4.429
45. Dayan, P., Niv, Y., Seymour, B., & Daw, N.D. (2006). The misbehavior of value and the discipline of the will. Neural Networks, 19(8), 1153-1160. PubMed doi:10.1016/j.neunet.2006.03.002
46. Dayan, P., & Sejnowski, T.J. (1996). Exploration bonus and dual control. Machine Learning, 25(1), 5-22.
47. Dean, M., Wu, S-W., & Maloney, L.T. (2007). Trading off speed and accuracy in rapid, goal-directed movements. J. Vis., 7(5):1-12.
48. Dean, T. & Boddy, M. (1988). An analysis of time-dependent planning. In Proceedings of the seventh national conference on artificial intelligence, pages 49-54.
49. Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193-222. PubMed doi:10.1146/annurev.ne.18.030195.001205
50. Desmurget, M., & Grafton, S. (2000). Forward modeling allows feedback control for fast reaching movements. Trends in Cognitive Sciences, 4, 423-431. PubMed doi:10.1016/S1364-6613(00)01537-0
51. Dickinson, A. (1985). Actions and habits: the development of behavioural autonomy. Philosophical Transactions of the Royal Society of London. B, 308, 67-78. doi:10.1098/rstb.1985.0010
52. Dindo, H., Zambuto, D., & Pezzulo, G. (2011). Motor simulation via coupled internal models using sequential monte carlo. In Proceedings of IJCAI 2011, Barcelona, Spain.
53. Donders, F.C. (1969). On the speed of mental processes. Acta Psychologica, 30, 412-431. PubMed doi:10.1016/0001-6918(69)90065-1
54. Dornay, M., Uno, M., Kawato, M., & Suzuki, R. (1996). Minimum muscle-tension change trajectories predicted by using a 17-muscle model of the monkey's arm. Journal of Motor Behavior, 28(2), 83-100. PubMed doi:10.1080/00222895.1996.9941736
55. Doya, K., Ishii, S., Pouget, A., & Rao, R.P.N., editors. (2007). Bayesian Brain: Probabilistic Approaches to Neural Coding. The MIT Press, 1 edition.
56. Duhamel, J.R., Colby, C.L., & Goldberg, M.E. (1992). The updating of the representation of visual space in parietal cortex by intended eye movements. Science, 255(5040), 90-92. PubMed doi:10.1126/science.1553535
57. Erlhagen, W., & Schoener, G. (2002). Dynamic field theory of movement preparation. Psychological Review, 109(3), 545-572. PubMed doi:10.1037/0033- 295X.109.3.545
58. Faisal, A.A., Selen, L.P.J., & Wolpert, D.M. (2008). Noise in the nervous system. Nature Reviews. Neuroscience, 9(4), 292-303. PubMed doi:10.1038/nrn2258
59. Fiser, J., Berkes, P., Orbn, G., & Lengyel, M. (2010). Statistically optimal perception and learning: from behavior to neural representations. Trends in Cognitive Sciences, 14(3), 119-130. PubMed doi:10.1016/j.tics.2010.01.003
60. Fitts, P.M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47(6), 381-391. PubMed doi:10.1037/h0055392
61. Flanagan, J., & Johansson, R. (2003). Action plans used in action observation. Nature, 424, 769-771. PubMed doi:10.1038/nature01861
62. Flash, T., & Hochner, B. (2005). Motor primitives in vertebrates and invertebrates. Current Opinion in Neurobiology, 15(6), 660-666. PubMed doi:10.1016/j.conb.2005.10.011
63. Flash, T., & Hogan, N. (1985). The coordination of arm movements: an experimentally confirmed mathematical model. The Journal of Neuroscience, 5(7), 1688-1703. PubMed
64. Friston, K. (2005). A theory of cortical responses. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 360(1456), 815-836. PubMed doi:10.1098/rstb.2005.1622
65. Friston, K. (2008). Hierarchical models in the brain. PLoS Computational Biology, 4(11), e1000211. PubMed doi:10.1371/journal.pcbi.1000211
66. Friston, K., Mattout, J., & Kilner, J. (2011). Action understanding and active inference. Biological Cybernetics, 104(12), 137-160. PubMed doi:10.1007/s00422-011-0424-z
67. Friston, K.J., Daunizeau, J., Kilner, J., & Kiebel, S.J. (2010). Action and behavior: a free-energy formulation. Biological Cybernetics, 102(3), 227-260. PubMed doi:10.1007/s00422-010-0364-z
68. Frith, C. (2007).Making up the Mind. How the Brain Creates our Mental World. Blackwell.
69. Frith, C.D., & Frith, U. (2008). Implicit and explicit processes in social cognition. Neuron, 60(3), 503-510. PubMed doi:10.1016/j.neuron.2008.10. 032
70. Fuster, J.M. (1997). The prefrontal cortex: anatomy, physiology, and neuropsychology of the frontal lobe. Philadelphia, PA: Lippincott-Raven.
71. Glimcher, P.W., & Rustichini, A. (2004). Neuroeconomics: the consilience of brain and decision. Science, 306(5695), 447-452. PubMed doi:10.1126/science.1102566
72. Gold, J., & Shadlen, M. (2001). Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences, 5, 10-16. PubMed doi:10.1016/S1364-6613(00)01567-9
73. Gold, J.I., & Shadlen, M.N. (2003). The influence of behavioral context on the representation of a perceptual decision in developing oculomotor commands. The Journal of Neuroscience, 23(2), 632-651. PubMed
74. Gold, J.I., & Shadlen, M.N. (2007). The neural basis of decision making. Annual Review of Neuroscience, 30, 535-574. PubMed doi:10.1146/annurev. neuro.29.051605.113038
75. Gollwitzer, P. (1999). Implementation intentions: strong effects of simple plans. The American Psychologist, 54, 493-503. doi:10.1037/0003-066X.54. 7.493
76. Grant, E.R., & Spivey, M.J. (2003). Eye movements and problem solving: guiding attention guides thought. Psychological Science, 14(5), 462-466. PubMed doi:10.1111/1467-9280.02454
77. Gratton, G., Coles, M.G., & Donchin, E. (1992). Optimizing the use of information: strategic control of activation of responses. Journal of Experimental Psychology. General, 121(4), 480-506. PubMed doi:10.1037/0096-3445. 121.4.480
78. Haggard, P. (2005). Conscious intention and motor cognition. Trends in Cognitive Sciences, 9(6), 290-295. PubMed doi:10.1016/j.tics.2005.04.012
79. Hamilton, A.F.C., & Grafton, S.T. (2007). The motor hierarchy: from kinematics to goals and intentions. In P. Haggard, Y. Rossetti, & M. Kawato (Eds.), Sensorimotor Foundations of Higher Cognition. Oxford University Press.
80. Harris, C.M., & Wolpert, D.M. (1998). Signal-dependent noise determines motor planning. Nature, 394, 780-784. PubMed doi:10.1038/29528
81. Haruno, M., Wolpert, D., & Kawato, M. (2003). Hierarchical mosaic for movement generation. In T. Ono, G. Matsumoto, R. Llinas, A. Berthoz, H. Norgren, & R. Tamura (Eds.), Excepta Medica International Coungress Series (pp. 575-590). Amsterdam: Elsevier Science.
82. Hayhoe, M., & Ballard, D. (2005). Eye movements in natural behavior. Trends in Cognitive Sciences, 9(4), 188-194. PubMed doi:10.1016/j.tics.2005.02. 009
83. Hoffmann, J. (2003). Anticipatory behavioral control. In M.V. Butz, O. Sigaud, & P. Gerard (Eds.), Anticipatory Behavior in Adaptive Learning Systems: Foundations, Theories, and Systems (pp. 44-65). Berlin, Heidelberg: Springer-Verlag.
84. Hommel, B. (2000). The prepared reflex: Automaticity and control in stimulus-response translation. In S. Monsell & J. Driver (Eds.), Attention and performance XVIII: Control of cognitive processes (pp. 247-273). Cambridge, MA: MIT Press.
85. Hommel, B. (2003). Planning and representing intentional action. The Scientific World JOURNAL, 3:593-608.
86. Horvitz, E. (1990). Computation and action under bounded resources. PhD thesis, Stanford University.
87. Horvitz, E. (2001). Principles and applications of continual computation. Artificial Intelligence Journal, 126, 159-196. doi:10.1016/S0004-3702(00)00082- 5
88. Horwitz, G.D., Batista, A.P., & Newsome, W.T. (2004). Representation of an abstract perceptual decision in macaque superior colliculus. Journal of Neurophysiology, 91(5), 2281-2296. PubMed doi:10.1152/jn.00872.2003
89. Houk, J.C., Bastianen, C., Fansler, D., Fishbach, A., Fraser, D., Reber, P.J., . . . Simo, L.S. (2007). Action selection and refinement in subcortical loops through basal ganglia and cerebellum. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 362(1485), 1573-1583. PubMed doi:10.1098/rstb.2007.2063
90. Howard, R. (1966). Information value theory. IEEE Transactions on systems science and cybernetics, 2(1):22-26.
91. Hudson, T.E., Maloney, L.T., & Landy, M.S. (2008). Optimal compensation for temporal uncertainty in movement planning. PLoS Computational Biology, 4(7), e1000130. PubMed doi:10.1371/journal.pcbi.1000130
92. Hurley, S. (1998). Consciousness in Action. Cambridge, MA: Harvard University Press.
93. Huys, Q., & Dayan, P. (2009). A bayesian formulation of behavioral control. Cognition, 113(3), 314-328. PubMed doi:10.1016/j.cognition.2009.01.008
94. Imamizu, H., Kuroda, T., Miyauchi, S., Yoshioka, T., & Kawato, M. (2003). Modular organization of internal models of tools in the human cerebellum. Proceedings of the National Academy of Sciences of the United States of America, 100(9), 5461-5466. PubMed doi:10.1073/pnas.0835746100
95. Ivry, R., Spencer, R., Zelaznik, H., & Diedrichsen, J. (2002). The cerebellum and event timing. Annals of the New York Academy of Sciences, 978, 302-317. PubMed doi:10.1111/j.1749-6632.2002.tb07576.x
96. Jeannerod, M. (1997). The Cognitive Neuroscience of Action. Oxford: Blackwell.
97. Jeannerod, M. (2001). Neural simulation of action: A unifying mechanism for motor cognition. NeuroImage, 14, S103-S109. PubMed doi:10.1006/nimg.2001. 0832
98. Johansson, R.S., Westling, G., Bckstrm, A., & Flanagan, J.R. (2001). Eye-hand coordination in object manipulation. The Journal of Neuroscience, 21(17), 6917-6932. PubMed
99. Kaelbling, L.P., Littman, M., & Cassandra, A.R. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101, 99-134. doi:10.1016/S0004-3702(98)00023-X
100. Kalaska, J.F., Scott, S.H., Cisek, P., & Sergio, L.E. (1997). Cortical control of reaching movements. Current Opinion in Neurobiology, 7, 849-859. PubMed doi:10.1016/S0959-4388(97)80146-8
101. Kalman, R.E. (1960). A new approach to linear filtering and prediction problems. Journal of Basic Engineering, 82(1), 35-45. doi:10.1115/1.3662552
102. Kawato, M. (1999). Internal models for motor control and trajectory planning. Current Opinion in Neurobiology, 9, 718-727. PubMed doi:10.1016/S0959-4388(99)00028-8
103. Kilner, J., Vargas, C., Duval, S., Blakemore, S., & Sirigu, A. (2004). Motor activation prior to observation of a predicted movement. Nature Neuroscience, 7, 1299-1301. PubMed doi:10.1038/nn1355
104. Kilner, J.M., Friston, K.J., & Frith, C.D. (2007). Predictive coding: An account of the mirror neuron system. Cognitive Processing, 8(3), 159-166. PubMed doi:10.1007/s10339-007-0170-2
105. Kirsh, D., & Maglio, P. (1994). On distinguishing epistemic from pragmatic action. Cognitive Science, 18, 513-549. doi:10.1207/s15516709cog1804-1
106. Koechlin, E., & Summerfield, C. (2007). An information theoretical approach to prefrontal executive function. Trends in Cognitive Sciences, 11(6), 229-235. PubMed doi:10.1016/j.tics.2007.04.005
107. Kording, K., & Wolpert, D. (2006). Bayesian decision theory in sensorimotor control. Trends in Cognitive Sciences, 10, 319-326. PubMed doi:10.1016/j.tics.2006.05.003
108. Kouneiher, F., Charron, S., & Koechlin, E. (2009). Motivation and cognitive control in the human prefrontal cortex. Nature Neuroscience, 12(7), 939-945. PubMed doi:10.1038/nn.2321
109. Krieghoff, V., Brass, M., Prinz, W., & Waszak, F. (2009). Dissociating what and when of intentional actions. Frontiers in Human Neuroscience.
110. Krubitzer, L. (2007). The magnificent compromise: cortical field evolution in mammals. Neuron, 56(2), 201-208. PubMed doi:10.1016/j.neuron.2007. 10.002
111. Laird, J., Rosenbloom, P., & Newell, A. (1986). Chunking in SOAR: The anatomy of a general learning mechanism. Machine Learning, 1(1), 11-46.
112. Land, M., & Tatler, B. (2009). Looking and Acting: Vision and eye movements in natural behaviour. Oxford University Press.
113. Lungarella, M., & Sporns, O. (2006). Mapping information flow in sensorimotor networks. PLoS Computational Biology, 2(10), e144. PubMed doi:10.1371/journal.pcbi.0020144
114. Ma, W. J. & Huang, W. (2009). No capacity limit in attentional tracking: evidence for probabilistic inference under a resource constraint. J Vis, 9(11):3.1-330.
115. McKinstry, C., Dale, R., & Spivey, M.J. (2008). Action dynamics reveal parallel competition in decision making. Psychological Science, 19(1), 22-24. PubMed doi:10.1111/j.1467-9280.2008.02041.x
116. Melo, F.S., & Ribeiro, I.M. (2006). Transition entropy in partially observable markov decision processes. In Proceedings of the 9th International Conference on Intelligent Autonomous Systems, pages 282-289.
117. Michelet, T., Duncan, G.H., & Cisek, P. (2010). Response competition in the primary motor cortex: corticospinal excitability reflects response replacement during simple decisions. Journal of Neurophysiology, 104(1), 119-127. PubMed doi:10.1152/jn.00819.2009
118. Middleton, F.A., & Strick, P.L. (1994). Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function. Science, 266(5184), 458-461. PubMed doi:10.1126/science.7939688
119. Miller, E.K., & Cohen, J.D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167-202. PubMed doi:10.1146/annurev.neuro.24.1.167
120. Mushiake, H., Inase, M., & Tanji, J. (1991). Neuronal activity in the primate premotor, supplementary, and precentral motor cortex during visually guided and internally determined sequential movements. Journal of Neurophysiology, 66(3), 705-718. PubMed
121. Navalpakkam, V., Koch, C., Rangel, A., & Perona, P. (2010). Optimal reward harvesting in complex perceptual environments. Proceedings of the National Academy of Sciences of the United States of America, 107(11), 5232-5237. PubMed doi:10.1073/pnas.0911972107
122. Newell, A., & Simon, H.A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.
123. Niv, Y., Daw, N.D., Joel, D., & Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology, 191(3), 507-520. PubMed doi:10.1007/s00213-006-0502-4
124. Niv, Y., Joel, D., & Dayan, P. (2006). A normative perspective on motivation. Trends in Cognitive Sciences, 8, 375-381. PubMed doi:10.1016/j.tics.2006.06.010
125. Nobre, A., Correa, A., & Coull, J. (2007). The hazards of time. Current Opinion in Neurobiology, 17(4), 465-470. PubMed doi:10.1016/j.conb.2007. 07.006
126. Nolfi, S. (2005). Behaviour as a complex adaptive system: On the role of self-organization in the development of individual and collective behaviour. Complexus, 2, 195-203. doi:10.1159/000093690
127. Nolfi, S., & Floreano, D. (2000). Evolutionary Robotics. MIT Press.
128. O'Reilly, R.C. (2010). The what and how of prefrontal cortical organization. Trends in Neurosciences, 33(8), 355-361. PubMed doi:10.1016/j.tins.2010.05.002
129. Pacherie, E. (2008). The phenomenology of action: A conceptual framework. Cognition, 107, 179-217. PubMed doi:10.1016/j.cognition.2007.09.003
130. Padoa-Schioppa, C., & Assad, J.A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature, 441(7090), 223-226. PubMed doi:10.1038/nature04676
131. Pessiglione, M., Czernecki, V., Pillon, B., Dubois, B., Schpbach, M., Agid, Y., & Tremblay, L. (2005). An effect of dopamine depletion on decision-making: the temporal coupling of deliberation and execution. Journal of Cognitive Neuroscience, 17(12), 1886-1896. PubMed doi:10.1162/ 089892905775008661
132. Pezzulo, G. (2011). Grounding procedural and declarative knowledge in sensorimotor anticipation. Mind & Language, 26(1), 78-114. doi:10.1111/j.1468-0017.2010.01411.x
133. Pezzulo, G., & Calvi, G. (2007). Schema-based design and the akira schema language: An overview. In M. Butz, O. Sigaud, G. Pezzulo, & G. Baldassarre (Eds.), Anticipatory Behavior in Adaptive Learning Systems: Advances in Anticipatory Processing, LNAI 4520. Springer.
134. Pezzulo, G., & Castelfranchi, C. (2007). The symbol detachment problem. Cognitive Processing, 8(2), 115-131. PubMed doi:10.1007/s10339-007- 0164-0
135. Pezzulo, G., & Castelfranchi, C. (2009). Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychological Research, 73(4), 559-577. PubMed doi:10.1007/s00426-009-0237-z
136. Pezzulo, G., & Couyoumdjian, A. (2006). Ambiguity-reduction: a satisfying criterion for decision making. In Proceedings of the 28th Annual Meeting of Cognitive Science Society (CogSci 2006), pages 669-674, Vancouver, Canada.
137. Pezzulo, G. & Rigoli, F. (2011). The value of foresight: how prospection affects decision-making. Front. Neurosci., 5(79).
138. Platt, M.L., & Glimcher, P.W. (1999). Neural correlates of decision variables in parietal cortex. Nature, 400(6741), 233-238. PubMed doi:10.1038/22268
139. Praamstra, P., Kourtis, D., & Nazarpour, K. (2009). Simultaneous preparation of multiple potential movements: opposing effects of spatial proximity mediated by premotor and parietal cortex. Journal of Neurophysiology, 102(4), 2084-2095. PubMed doi:10.1152/jn.00413.2009
140. Praamstra, P., & Plat, F.M. (2001). Failed suppression of direct visuomotor activation in Parkinson's disease. Journal of Cognitive Neuroscience, 13(1), 31-43. PubMed doi:10.1162/089892901564153
141. Prinz, W. (1997). Perception and action planning. The European Journal of Cognitive Psychology, 9, 129-154. doi:10.1080/713752551
142. Pulvermuller, F. (1999). Words in the brain's languages. The Behavioral and Brain Sciences, 22, 253-336. PubMed doi:10.1017/S0140525X9900182X
143. Raby, C.R., Alexis, D.M., Dickinson, A., & Clayton, N.S. (2007). Planning for the future by western scrub-jays. Nature, 445(7130), 919-921. PubMed doi:10.1038/nature05575
144. Rao, R.P., & Ballard, D.H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2(1), 79-87. PubMed doi:10.1038/4580
145. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85, 59-108. PubMed doi:10.1037/0033-295X.85.2.59
146. Resulaj, A., Kiani, R., Wolpert, D.M., & Shadlen, M.N. (2009). Changes of mind in decision-making. Nature, 461(7261), 263-266. PubMed doi:10.1038/nature08275
147. Rick, S., & Loewenstein, G. (2008). Intangibility in intertemporal choice. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 363(1511), 3813-3824. PubMed doi:10.1098/rstb.2008.0150
148. Rizzolatti, G., Camarda, R., Fogassi, L., Gentilucci, M., Luppino, G., & Matelli, M. (1988). Functional organization of inferior area 6 in the macaque monkey. ii. area f5 and the control of distal movements. Experimental Brain Research, 71(3), 491-507. PubMed doi:10.1007/BF00248742
149. Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169-192. PubMed doi:10.1146/annurev.neuro.27. 070203.144230
150. Rizzolatti, G., Riggio, L., & Sheliga, B. (1994). Space and selective attention. In C. Umilta & M. Moscovitch (Eds.), Attention and Performance XV. Cambridge, Mass.: MIT Press. (pp. 231-265).
151. Rosenbaum, D. (1991). Human motor control. New York: Academic Press.
152. Rosenbaum, D., Marchak, F., Barnes, H., Vaughan, J., Slotta, J., & Jorgensen, M. (1990). Constraints for action selection: overhand versus underhand grips. In M. Jeannerod (Ed.), Attention and performance XIII. Motor representation and control (pp. 211-265). Hillsdale: Lawrence Erlbaum.
153. Rosenbaum, D.A., Meulenbroek, R.J., & Vaughan, J. (2001). Planning reaching and grasping movements: Theoretical premises and practical implications. Motor Control, 2, 99-115. PubMed
154. Rosenbloom, P.S., Laird, J.E., & Newell, A. (1992). The Soar Papers: Research on Integrated Intelligence (Vol. 1 and 2). Cambridge, MA: MIT Press.
155. Ross, S., Pineau, J., Paquet, S., & Chaib-Draa, B. (2008). Online planning algorithms for pomdps. Journal of Artificial Intelligence Research, 32(1), 663-704. PubMed
156. Roy, N., & Thrun, S. (2000). Coastal navigation with mobile robots. In Advances in Neural Information Processing Systems 12.
157. Russell, S., & Wefald, E. (1991). Principles of metareasoning. Artificial Intelligence, 49(1-3), 361-395. doi:10.1016/0004-3702(91)90015-C
158. Russell, S.J. (1997). Rationality and intelligence. Artificial Intelligence, 94(1-2), 57-77 Economic Principles of Multi-Agent Systems. doi:10.1016/S0004-3702(97)00026-X
159. Sabes, P. (2000). The planning and control of reaching movements. Current Opinion in Neurobiology, 10(6), 740-746. PubMed doi:10.1016/S0959-4388(00) 00149-5
160. Schaal, S., Mohajerian, P., & Ijspeert, A. (2007). Dynamics systems vs. optimal control - a unifying view. Progress in Brain Research, 165, 425-445. PubMed doi:10.1016/S0079-6123(06)65027-9
161. Schacter, D.L., Addis, D.R., & Buckner, R.L. (2007). Remembering the past to imagine the future: the prospective brain. Nature Reviews. Neuroscience, 8(9), 657-661. PubMed doi:10.1038/nrn2213
162. Schall, J.D. (2001). Neural basis of deciding, choosing and acting. Nature Reviews. Neuroscience, 2(1), 33-42. PubMed doi:10.1038/35049054
163. Schmidt, R.A. (1975). A schema theory of discrete motor skill learning. Psychological Review, 82, 225-260. doi:10.1037/h0076770
164. Schoener, G. (2008). Dynamical systems approaches to cognition. In P. Spencer, M. Thomas, & J. McClelland (Eds.), ward a Unified Theory of Development: Connectionism and Dynamic Systems Theory Re-Considered. ford University Press.
165. Schuetz-Bosbach, S., & Prinz, W. (2007). Prospective coding in event representation. Cognitive Processing, 8(2), 93-102. PubMed doi:10.1007/s10339- 007-0167-x
166. Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annual Review of Psychology, 57, 87-115. PubMed doi:10.1146/annurev. psych.56.091103.070229
167. Shadlen, M., Kiani, R., Hanks, T., & Churchland, A. (2008). Neurobiology of decision making: An intentional framework. In Engel, C. & Singer, W., editors, Better than conscious?: decision making, the human mind, and implications for institutions. The MIT Press.
168. Shadlen, M.N., & Newsome, W.T. (2001). Neural basis of a perceptual decision in the parietal cortex (area lip) of the rhesus monkey. Journal of Neurophysiology, 86(4), 1916-1936. PubMed
169. Shadmehr, R., & Krakauer, J.W. (2008). A computational neuroanatomy for motor control. Experimental Brain Research, 185(3), 359-381. PubMed doi:10.1007/s00221-008-1280-5
170. Simon, H. (1956). Rational choice and the structure of the environment. Psychological Review, 63(2), 129-138. PubMed doi:10.1037/h0042769
171. Smid, H.G., Lamain, W., Hogeboom, M.M., Mulder, G., & Mulder, L.J. (1991). Psychophysiological evidence for continuous information transmission between visual search and response processes. Journal of Experimental Psychology. Human Perception and Performance, 17(3), 696-714. PubMed doi:10.1037/0096-1523.17.3.696
172. Smid, H.G., Mulder, G., Mulder, L.J., & Brands, G.J. (1992). A psychophysiological study of the use of partial information in stimulus-response translation. Journal of Experimental Psychology. Human Perception and Performance, 18(4), 1101-1119. PubMed doi:10.1037/0096-1523.18.4.1101
173. Smith, P.L., & Vickers, D. (1988). The accumulator model of two-choice discrimination. Journal of Mathematical Psychology, 32(2), 135-168. doi:10.1016/0022-2496(88)90043-0
174. Song, J-H., & Nakayama, K. (2009). Hidden cognitive states revealed in choice reaching tasks. Trends in Cognitive Sciences, 13 (8), 360-366. PubMed doi:10.1016/j.tics.2009.04.009
175. Spivey, J. (2007). The continuity of mind. USA: Oxford University Press.
176. Spivey, M., Grosjean, M., & Knoblich, G. (2005). Continuous attraction toward phonological competitors. Proceedings of the National Academy of Sciences of the United States of America, 102, 10393-10398. PubMed doi:10.1073/pnas.0503903102
177. Sprague, N., Ballard, D., & Robinson, A. (2007). Modeling embodied visual behaviors. ACM Transactions on Applied Perception, 4(2), 11. doi:10.1145/1265957.1265960
178. Stanford, T.R., Shankar, S., Massoglia, D.P., Costello, M.G., & Salinas, E. (2010). Perceptual decision making in less than 30 milliseconds. Nature Neuroscience, 13(3), 379-385. PubMed doi:10.1038/nn.2485
179. Stewart, N., Chater, N., & Brown, G.D.A. (2006). Decision by
180. Suddendorf, T., & Corballis, M.C. (2007). The evolution of foresight: What is mental time travel and is it unique to humans? The Behavioral and Brain Sciences, 30(3), 299-313. PubMed
181. Sutton, R., & Barto, A. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
182. Tipper, S., Howard, L., & Houghton, G. (2000). Behavioural consequences of selection from population codes. In S. Monsell & J. Driver (Eds.), Attention and performance XVII. MIT Press, Boston (pp. 223-246). Cambridge, MA: MIT Press.
183. Tkach, D., Reimer, J., & Hatsopoulos, N.G. (2007). Congruent activity during action and action observation in motor cortex. The Journal of Neuroscience, 27(48), 13241-13250. PubMed doi:10.1523/JNEUROSCI.2895-07.2007
184. Todorov, E. (2004). Optimality principles in sensorimotor control. Nature Neuroscience, 7(9), 907-915. PubMed doi:10.1038/nn1309
185. Todorov, E., & Jordan, M.I. (2002). Optimal feedback control as a theory of motor coordination. Nature Neuroscience, 5(11), 1226-1235. PubMed doi:10.1038/nn963
186. Tucker, M., & Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychologica, 116, 185-203. PubMed doi:10.1016/j.actpsy.2004.01. 004
187. Uno, Y., Kawato, M., & Suzuki, R. (1989). Formation and control of optimal trajectory in human multijoint arm movement. Minimum torque-change model. Biological Cybernetics, 61(2), 89-101. PubMed doi:10.1007/BF00204593
188. Usher, M., & McClelland, J.L. (2001). On the time course of perceptual choice: The leaky, competing accumulator model. Psychological Review, 108(3), 550-592. PubMed doi:10.1037/0033-295X.108.3.550
189. Verschure, P., Krose, B., & Pfeifer, R. (1992). Distributed adaptive control: The self-organization of behavior. Robotics and Autonomous Systems, 9, 181-196. doi:10.1016/0921-8890(92)90054-3
190. Verschure, P.F.M.J., Voegtlin, T., & Douglas, R.J. (2003). Environmentally mediated synergy between perception and behaviour in mobile robots. Nature, 425 (6958), 620-624. PubMed doi:10.1038/nature02024
191. Voss, M., Ingram, J.N., Haggard, P., & Wolpert, D.M. (2005). Sensorimotor attenuation by central motor command signals in the absence of movement. Nature Neuroscience, 9, 26-27. PubMed doi:10.1038/nn1592
192. Warren, W.H. (2006). The dynamics of perception and action. Psychological Review, 113(2), 358-389. PubMed doi:10.1037/0033-295X.113.2.358
193. Welchman, A. E., Stanley, J., Schomers, M. R., Miall, R. C., & Blthoff, H. H. (2010). The quick and the dead: when reaction beats intention. Proc Biol Sci, 277(1688):1667-1674.
194. Weld, D. (1994). An introduction to least-commitment planning. AI Magazine, 15(4), 27-61.
195. Wolpert, D., Miall, C., & Kawato, M. (1998). Internal models in the cerebellum. Trends in Cognitive Sciences, 2, 338-347. PubMed doi:10.1016/S1364-6613(98)01221-2
196. Wolpert, D.M. (2007). Probabilistic models in human sensorimotor control. Human Movement Science, 26(4), 511-524. PubMed doi:10.1016/j.humov.2007.05.005
197. Wolpert, D.M., Doya, K., & Kawato, M. (2003). A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 358(1431), 593-602. PubMed doi:10.1098/rstb.2002.1238
198. Wolpert, D.M., & Ghahramani, Z. (2000). Computational principles of movement neuroscience. Nature Neuroscience, 3, 1212-1217. PubMed doi:10.1038/81497
199. Wolpert, D.M., & Ghahramani, Z. (2004). Computational motor control. In M. Gazzaniga (Ed.), The Cognitive Neurosciences III (pp. 485-494). MIT Press.
200. Wolpert, D.M., Gharamani, Z., & Jordan, M. (1995). An internal model for sensorimotor integration. Science, 269, 1179-1182. PubMed doi:10.1126/science.7569931
201. Wong, K-F., Huk, A.C., Shadlen, M.N., & Wang, X-J. (2007). Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Front Comput Neurosci, 1, 6. PubMed doi:10.3389/neuro.10.006.2007
202. Woodman, G.F., Kang, M-S., Thompson, K., & Schall, J.D. (2008). The effect of visual search efficiency on response preparation: neurophysiological evidence for discrete flow. Psychological Science, 19(2), 128-136. PubMed doi:10.1111/j.1467-9280.2008.02058.x
203. Wyss, R., Koenig, P., & Verschure, P.F.M.J. (2004). Involving the motor system in decision making. Proceedings. Biological Sciences, 271(Suppl. 3), S50-S52. PubMed doi:10.1098/rsbl.2003.0098