Hedging Your Bets: Intermediate Movements as Optimal Behavior in the Context of an Incomplete Decision

PLoS Computational Biology

Volumn 11, Issue 3, 2015, Pages

  Haith, Adrian M ^a   Huberdeau, David M ^b   Krakauer, John W ^a  

^a JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION THEORY;

DECISIONS MAKINGS; FEEDBACK CONTROL MODELS; HUMAN SUBJECTS; MOVEMENT PLANNING; MOVEMENT TRAJECTORIES; OPTIMAL FEEDBACK CONTROL; POTENTIAL TARGETS; SPATIAL SEPARATION; UNCERTAINTY; VIRTUAL BARRIER;

DECISION MAKING;

ADULT; ARTICLE; BEHAVIOR; BEHAVIOR CONTROL; CONTROLLED STUDY; DECISION MAKING; EXECUTIVE FUNCTION; FEEDBACK SYSTEM; FEMALE; HUMAN; HUMAN EXPERIMENT; INTERMEDIATE MOVEMENT; JUMPING; MALE; MENTAL TASK; MOTIVATION; MOVEMENT (PHYSIOLOGY); MOVEMENT PERCEPTION; NORMAL HUMAN; OPTIMAL BEHAVIOR; RESPONSE TIME; TASK PERFORMANCE; ADOLESCENT; PHYSIOLOGY; REACTION TIME; UNCERTAINTY; YOUNG ADULT;

ADOLESCENT; ADULT; DECISION MAKING; FEMALE; GOALS; HUMANS; MALE; MOVEMENT; REACTION TIME; UNCERTAINTY; YOUNG ADULT;

EID: 84926393247     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1004171     Document Type: Article

References (54)

1. Wong AL, Haith AM, Krakauer JW (2014) Motor planning. The Neuroscientist.doi: 10.1177/1073858414541484 24981338
2. Gold JI, Shadlen MN, (2001) Neural computations that underlie decisions about sensory stimuli. Trends Cogn Sci 5: 10–16. 11164731
3. Ratcliff R, McKoon G, (2008) The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput 20: 873–922. 18085991
4. Ghez C, Favilla M, Ghilardi MF, Gordon J, Bermejo R, Pullman S, (1997) Discrete and continuous planning of hand movements and isometric force trajectories. Exp Brain Res 115: 217–233. 9224851
5. Rosenbaum DA, (1980) Human movement initiation: specification of arm, direction, and extent. J Exp Psychol Gen 109: 444–474. 6449531
6. Henry FM, Rogers D.E., (1960) Increased response latency for complicated movements and a "memory drum" theory of neuromotor reaction. Research Quarterly of the American Association for Health, Physical Education, & Recreation 31: 448–458. 1800841
7. Thompson KG, Hanes DP, Bichot NP, Schall JD, (1996) Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. J Neurophysiol 76: 4040–4055. 8985899
8. Shankar S, Massoglia DP, Zhu D, Costello MG, Stanford TR, Salinas E, (2011) Tracking the temporal evolution of a perceptual judgment using a compelled-response task. J Neurosci 31: 8406–8421. doi: 10.1523/JNEUROSCI.1419-11.2011 21653845
9. Hening W, Favilla M, Ghez C, (1988) Trajectory control in targeted force impulses. V. Gradual specification of response amplitude. Exp Brain Res 71: 116–128. 3416946
10. Forgaard CJ, Maslovat D, Carlsen AN, Franks IM, (2011) Default motor preparation under conditions of response uncertainty. Exp Brain Res 215: 235–245. doi: 10.1007/s00221-011-2893-7 21997330
11. Georgopoulos AP, Kalaska JF, Massey JT, (1981) Spatial trajectories and reaction-times of aimed movements—effects of practice, uncertainty, and change in target location. Journal of Neurophysiology 46: 725–743. 7288461
12. van Sonderen JF, Denier van der Gon JJ, Gielen CC, (1988) Conditions determining early modification of motor programmes in response to changes in target location. Exp Brain Res 71: 320–328. 3169167
13. Henis EA, Flash T, (1995) Mechanisms underlying the generation of averaged modified trajectories. Biological Cybernetics 72: 407–419.
14. Pastor-Bernier A, Tremblay E, Cisek P, (2012) Dorsal premotor cortex is involved in switching motor plans. Front Neuroeng 5: 5. doi: 10.3389/fneng.2012.00005 22493577
15. Becker W, Jurgens R, (1979) An analysis of the saccadic system by means of double step stimuli. Vision Res 19: 967–983. 532123
16. Chapman CS, Gallivan JP, Wood DK, Milne JL, Culham JC, Goodale MA, (2010) Reaching for the unknown: multiple target encoding and real-time decision-making in a rapid reach task. Cognition 116: 168–176. doi: 10.1016/j.cognition.2010.04.008 20471007
17. Stewart BM, Baugh LA, Gallivan JP, Flanagan JR (2013) Simultaneous encoding of the direction and orientation of potential targets during reach planning: evidence of multiple competing reach plans. J Neurophysiol.
18. Walker R, Deubel H, Schneider WX, Findlay JM, (1997) Effect of remote distractors on saccade programming: evidence for an extended fixation zone. J Neurophysiol 78: 1108–1119. 9307138
19. Song JH, Nakayama K, (2009) Hidden cognitive states revealed in choice reaching tasks. Trends Cogn Sci 13: 360–366. doi: 10.1016/j.tics.2009.04.009 19647475
20. Todorov E, Jordan MI, (2002) Optimal feedback control as a theory of motor coordination. Nature Neuroscience 5: 1226–1235. 12404008
21. Izawa J, Shadmehr R, (2008) On-line processing of uncertain information in visuomotor control. J Neurosci 28: 11360–11368. doi: 10.1523/JNEUROSCI.3063-08.2008 18971478
22. Nashed JY, Crevecoeur F, Scott SH, (2014) Rapid online selection between multiple motor plans. J Neurosci 34: 1769–1780. doi: 10.1523/JNEUROSCI.3063-13.2014 24478359
23. Cisek P, (2012) Making decisions through a distributed consensus. Curr Opin Neurobiol 22: 927–936. doi: 10.1016/j.conb.2012.05.007 22683275
24. Hudson TE, Maloney LT, Landy MS, (2007) Movement planning with probabilistic target information. J Neurophysiol 98: 3034–3046. 17898140
25. Chou IH, Sommer MA, Schiller PH, (1999) Express averaging saccades in monkeys. Vision Res 39: 4200–4216. 10755158
26. Gold JI, Shadlen MN, (2007) The neural basis of decision making. Annu Rev Neurosci 30: 535–574. 17600525
27. Cisek P, (2006) Integrated neural processes for defining potential actions and deciding between them: a computational model. J Neurosci 26: 9761–9770. 16988047
28. Costello MG, Zhu D, Salinas E, Stanford TR, (2013) Perceptual modulation of motor—but not visual—responses in the frontal eye field during an urgent-decision task. J Neurosci 33: 16394–16408. doi: 10.1523/JNEUROSCI.1899-13.2013 24107969
29. Stanford TR, Shankar S, Massoglia DP, Costello MG, Salinas E, (2010) Perceptual decision making in less than 30 milliseconds. Nat Neurosci 13: 379–385. doi: 10.1038/nn.2485 20098418
30. Glimcher PW, Sparks DL, (1993) Representation of averaging saccades in the superior colliculus of the monkey. Exp Brain Res 95: 429–435. 8224068
31. Bhutani N, Sureshbabu R, Farooqui AA, Behari M, Goyal V, Murthy A, (2013) Queuing of concurrent movement plans by basal ganglia. J Neurosci 33: 9985–9997. doi: 10.1523/JNEUROSCI.4934-12.2013 23761894
32. Favilla M, Gordon J, Hening W, Ghez C, (1990) Trajectory control in targeted force impulses. VII. Independent setting of amplitude and direction in response preparation. Exp Brain Res 79: 530–538. 2340872
33. Schouten JF, Bekker JA, (1967) Reaction time and accuracy. Acta Psychol (Amst) 27: 143–153. 6062205
34. Resulaj A, Kiani R, Wolpert DM, Shadlen MN, (2009) Changes of mind in decision-making. Nature 461: 263–266. doi: 10.1038/nature08275 19693010
35. Todorov E, (2009) Efficient computation of optimal actions. Proceedings of the National Academy of Sciences of the United States of America 106: 11478–11483. doi: 10.1073/pnas.0710743106 19574462
36. Todorov E, . (2009). Compositionality of optimal control laws. Advances in Neural Information Processing Systems 22, 1856–1864.
37. Kappen HJ, (2005) Linear theory for control of nonlinear stochastic systems. Phys Rev Lett 95: 200201. 16384034
38. Schlicht EJ, Schrater PR, (2007) Impact of coordinate transformation uncertainty on human sensorimotor control. J Neurophysiol 97: 4203–4214. 17409174
39. Cisek P, Kalaska JF, (2005) Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron 45: 801–814. 15748854
40. Kakei S, Hoffman DS, Strick PL, (2001) Direction of action is represented in the ventral premotor cortex. Nat Neurosci 4: 1020–1025. 11547338
41. Kalaska JF, Caminiti R, Georgopoulos AP, (1983) Cortical mechanisms related to the direction of two-dimensional arm movements: relations in parietal area 5 and comparison with motor cortex. Exp Brain Res 51: 247–260. 6617794
42. Klaes C, Westendorff S, Chakrabarti S, Gail A, (2011) Choosing goals, not rules: deciding among rule-based action plans. Neuron 70: 536–548. doi: 10.1016/j.neuron.2011.02.053 21555078
43. Klaes C, Schneegans S, Schoner G, Gail A, (2012) Sensorimotor learning biases choice behavior: a learning neural field model for decision making. PLoS Comput Biol 8: e1002774. doi: 10.1371/journal.pcbi.1002774 23166483
44. Erlhagen W, Schoner G, (2002) Dynamic field theory of movement preparation. Psychol Rev 109: 545–572. 12088245
45. Churchland MM, Cunningham JP, Kaufman MT, Ryu SI, Shenoy KV, (2010) Cortical preparatory activity: representation of movement or first cog in a dynamical machine? Neuron 68: 387–400. doi: 10.1016/j.neuron.2010.09.015 21040842
46. Churchland MM, Cunningham JP, Kaufman MT, Foster JD, Nuyujukian P, et al. (2012) Neural population dynamics during reaching. Nature 487: 51–56. doi: 10.1038/nature11129 22722855
47. Churchland MM, Yu BM, Ryu SI, Santhanam G, Shenoy KV, (2006) Neural variability in premotor cortex provides a signature of motor preparation. J Neurosci 26: 3697–3712. 16597724
48. Georgopoulos AP, Lurito JT, Petrides M, Schwartz AB, Massey JT, (1989) Mental rotation of the neuronal population vector. Science 243: 234–236. 2911737
49. Gold JI, Shadlen MN, (2000) Representation of a perceptual decision in developing oculomotor commands. Nature 404: 390–394. 10746726
50. Selen LP, Shadlen MN, Wolpert DM, (2012) Deliberation in the motor system: reflex gains track evolving evidence leading to a decision. J Neurosci 32: 2276–2286. doi: 10.1523/JNEUROSCI.5273-11.2012 22396403
51. Bishop CM, (2006) Pattern recognition and machine learning. New York: Springer.
52. Jordan MI, Jacobs RA, (1994) Hierarchical mixtures of experts and the EM algorithm. Neural Computation 6: 181–214.
53. Haith AM, Krakauer J.W., (2013) Theoretical models of motor control and motor learning. Routledge handbook of motor control and motor learning pp. 7–28. London: Routledge
54. Bertsekas DP, (1995) Dynamic programming and optimal control. Belmont, NH: Athena Scientific.