Embodied Choice: How Action Influences Perceptual Decision Making

PLoS Computational Biology

Volumn 11, Issue 4, 2015, Pages

  Lepora, Nathan F ^a,b   Pezzulo, Giovanni ^c  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

^c INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION THEORY; DYNAMICS;

'CURRENT; ACTION MODELING; ACTION PERFORMANCE; CHOICE MODEL; DECISION-MAKING PROCESS; DECISIONS MAKINGS; DYNAMIC CHANGES; EMBODIED MODELS; FEED BACK; PERCEPTUAL DECISION MAKING;

DECISION MAKING;

ACCURACY; ARTICLE; COGNITION; CONTROLLED STUDY; DECISION MAKING; DYNAMICS; HUMAN; KINEMATICS; MOUSE; NONHUMAN; PERCEPTION; PSYCHOLOGICAL ASPECT; SENSORIMOTOR FUNCTION; TASK PERFORMANCE; ANIMAL; BIOLOGICAL MODEL; DECISION SUPPORT SYSTEM; ECOSYSTEM; MOTIVATION; PHYSIOLOGY;

ANIMALS; CHOICE BEHAVIOR; DECISION MAKING; DECISION SUPPORT TECHNIQUES; ECOSYSTEM; MICE; MODELS, NEUROLOGICAL; MOTIVATION; PERCEPTION; TASK PERFORMANCE AND ANALYSIS;

EID: 84928980578     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1004110     Document Type: Article

References (67)

1. Ratcliff R, (1978) A theory of memory retrieval. Psychological Review 85: 59–108. doi: 10.1037/0033-295X.85.2.59
2. Usher M, McClelland JL, (2001) On the time course of perceptual choice: The leaky, competing accumulator model. Psychological Review 108(3): 550–592. doi: 10.1037/0033-295X.108.3.550 11488378
3. Wang XJ, (2002) Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36: 955–968. doi: 10.1016/S0896-6273(02)01092-9 12467598
4. Gold J, Shadlen M, (2001) Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences 5: 10–16. doi: 10.1016/S1364-6613(00)01567-9 11164731
5. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD, (2006) The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol Rev 113: 700–765. doi: 10.1037/0033-295X.113.4.700 17014301
6. Bogacz R, Gurney K, (2007) The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput 19: 442–477. doi: 10.1162/neco.2007.19.2.442 17206871
7. Lepora NF, Gurney KN, (2012) The basal ganglia optimize decision making over general perceptual hypotheses. Neural Comput 24: 2924–2945. doi: 10.1162/NECO_a_00360 22920846
8. Lepora NF, Fox CW, Evans MH, Diamond ME, Gurney K, et al. (2012) Optimal decision-making in mammals: insights from a robot study of rodent texture discrimination. J R Soc Interface 9: 1517–1528. doi: 10.1098/rsif.2011.0750 22279155
9. Gold JI, Shadlen MN, (2007) The neural basis of decision making. Annu Rev Neurosci 30: 535–574. doi: 10.1146/annurev.neuro.29.051605.113038 17600525
10. Newell A, Simon HA, (1972) Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.
11. Gratton G, Coles MG, Sirevaag EJ, Eriksen CW, Donchin E, (1988) Pre- and poststimulus activation of response channels: a psychophysiological analysis. J Exp Psychol Hum Percept Perform 14: 331–344. doi: 10.1037/0096-1523.14.3.331 2971764
12. Cisek P, (2007) Cortical mechanisms of action selection: the affordance competition hypothesis. Phil Trans R Soc B 362: 1585–1599. doi: 10.1098/rstb.2007.2054 17428779
13. Cisek P, Kalaska JF, (2005) Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron 45: 801–814. doi: 10.1016/j.neuron.2005.01.027 15748854
14. Coles MG, Gratton G, Bashore TR, Eriksen CW, Donchin E, (1985) A psychophysiological investigation of the continuous flow model of human information processing. J Exp Psychol Hum Percept Perform 11: 529–553. doi: 10.1037/0096-1523.11.5.529 2932529
15. DeSoto MC, Fabiani M, Geary DC, Gratton G, (2001) When in doubt, do it both ways: brain evidence of the simultaneous activation of conflicting motor responses in a spatial stroop task. J Cogn Neurosci 13: 523–536. doi: 10.1162/08989290152001934 11388924
16. Barca L, Pezzulo G, (2012) Unfolding visual lexical decision in time. PLoS ONE 7: e35932. doi: 10.1371/journal.pone.0035932 22563419
17. Freeman JB, Ambady N, (2010) Mousetracker: software for studying real-time mental processing using a computer mouse-tracking method. Behav Res Methods 42: 226–241. doi: 10.3758/BRM.42.1.226 20160302
18. Freeman JB, Dale R, Farmer TA, (2011) Hand in motion reveals mind in motion. Front Psychol 2: 59. doi: 10.3389/fpsyg.2011.00059 21687437
19. Selen LPJ, Shadlen MN, Wolpert DM, (2012) Deliberation in the motor system: reflex gains track evolving evidence leading to a decision. J Neurosci 32: 2276–2286. doi: 10.1523/JNEUROSCI.5273-11.2012 22396403
20. Spivey MJ, Grosjean M, Knoblich G, (2005) Continuous attraction toward phonological competitors. Proc Natl Acad Sci U S A 102: 10393–10398. doi: 10.1073/pnas.0503903102 15985550
21. Song JH, Nakayama K, (2009) Hidden cognitive states revealed in choice reaching tasks. Trends Cogn Sci 13: 360–366. doi: 10.1016/j.tics.2009.04.009 19647475
22. Walsh MM, Anderson JR, (2009) The strategic nature of changing your mind. Cogn Psychol 58: 416–440. doi: 10.1016/j.cogpsych.2008.09.003 19013562
23. Resulaj A, Kiani R, Wolpert DM, Shadlen MN, (2009) Changes of mind in decision-making. Nature 461: 263–266. doi: 10.1038/nature08275 19693010
24. Pezzulo G, Ognibene D, (2012) Proactive action preparation: Seeing action preparation as a continuous and proactive process. Motor Control 16: 386–424. 22643383
25. Spivey MJ, Dale R, Knoblich G, Grosjean M, (2010) Do curved reaching movements emerge from competing perceptions? a reply to van der wel et al. (2009). J Exp Psychol Hum Percept Perform 36: 251–254. doi: 10.1037/a0017170 20121308
26. Gibson J, (1966) The Senses Considered as Perceptual Systems. Boston, MA: Houghton Mifflin.
27. Gibson J, (1979) The ecological approach to visual perception. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
28. Neisser U, (1976) Cognition and reality. San Francisco, CA: Freeman.
29. Chapman CS, Gallivan JP, Wood DK, Milne JL, Culham JC, et al. (2010) Reaching for the unknown: Multiple target encoding and real-time decision-making in a rapid reach task. Cognition 116: 168–176. doi: 10.1016/j.cognition.2010.04.008 20471007
30. Cos I, Blanger N, Cisek P, (2011) The influence of predicted arm biomechanics on decision making. J Neurophysiol 105: 3022–3033. doi: 10.1152/jn.00975.2010 21451055
31. Wikenheiser AM, Stephens DW, Redish AD, (2013) Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task. Proc Natl Acad Sci U S A 110: 8308–8313. doi: 10.1073/pnas.1220738110 23630289
32. Rigoux L, Guigon E, (2012) A model of reward- and effort-based optimal decision making and motor control. PLoS Comput Biol 8: e1002716. doi: 10.1371/journal.pcbi.1002716 23055916
33. Cisek P, Pastor-Bernier A, (2014) On the challenges and mechanisms of embodied decisions. Philosophical Transactions of the Royal Society B: Biological Sciences 369: 20130479. doi: 10.1098/rstb.2013.0479
34. Cisek P, (2006) Integrated neural processes for defining potential actions and deciding between them: a computational model. J Neurosci 26: 9761–9770. doi: 10.1523/JNEUROSCI.5605-05.2006 16988047
35. Shadlen M, Kiani R, Hanks T, Churchland A, Engel C, Singer W, (2008) Neurobiology of decision making: An intentional framework. In: Better than conscious?: decision making, the human mind, and implications for institutions, The MIT Press.
36. Shankar S, Massoglia DP, Zhu D, Costello MG, Stanford TR, et al. (2011) Tracking the temporal evolution of a perceptual judgment using a compelled-response task. J Neurosci 31: 8406–8421. doi: 10.1523/JNEUROSCI.1419-11.2011 21653845
37. Shah A, Barto AG, (2009) Effect on movement selection of an evolving sensory representation: A multiple controller model of skill acquisition. Brain research 1299: 55–73. doi: 10.1016/j.brainres.2009.07.006 19595991
38. Thura D, Cisek P, (2013) Deliberation and commitment in the premotor and primary motor cortex during dynamic decision-making. Neuron.
39. Barca L, Pezzulo G, (2015) Tracking second thoughts: continuous and discrete revision processes during visual lexical decision. PLoS ONE 10(2): e0116193. doi: 10.1371/journal.pone.0116193
40. Ratcliff R, McKoon G, (2008) The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput 20: 873–922. doi: 10.1162/neco.2008.12-06-420 18085991
41. Spivey M, (2007) The continuity of mind. Oxford University Press, USA.
42. Quinton JC, Catenacci Volpi N, Barca L, Pezzulo G (2013) The cat is on the mat. or is it a dog? dynamic competition in perceptual decision making. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems.
43. van der Wel RP, Eder JR, Mitchel AD, Walsh MM, Rosenbaum DA, (2009) Trajectories emerging from discrete versus continuous processing models in phonological competitor tasks: A commentary on Spivey, Grosjean, and Knoblich (2005). Journal of Experimental Psychology: Human Perception and Performance 35: 588–594. 19331511
44. Körding KP, Wolpert DM, (2004) Bayesian integration in sensorimotor learning. Nature 427: 244–247. doi: 10.1038/nature02169 14724638
45. Bruhn P, Huette S, Spivey M, (2014) Degree of certainty modulates anticipatory processes in real time. J Exp Psychol Hum Percept Perform 40: 525–538. doi: 10.1037/a0034365 24041331
46. Cisek P, Puskas GA, El-Murr S, (2009) Decisions in changing conditions: the urgency-gating model. J Neurosci 29: 11560–11571. doi: 10.1523/JNEUROSCI.1844-09.2009 19759303
47. Wald A, Wolfowitz J, (1948) Optimum character of the sequential probability ratio test. The Annals of Mathematical Statistics 19: 326–339. doi: 10.1214/aoms/1177730197
48. Cisek P, Kalaska JF, (2010) Neural mechanisms for interacting with a world full of action choices. Annu Rev Neurosci 33: 269–298. doi: 10.1146/annurev.neuro.051508.135409 20345247
49. Pezzulo G, Castelfranchi C, (2009) Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychological Research 73: 559–577. doi: 10.1007/s00426-009-0237-z 19347359
50. Friston K, Schwartenbeck P, FitzGerald T, Moutoussis M, Behrens T, et al. (2013) The anatomy of choice: active inference and agency. Frontiers in human neuroscience 7. doi: 10.3389/fnhum.2013.00598
51. Pezzulo G, Rigoli F, Chersi F, (2013) The mixed instrumental controller: using value of information to combine habitual choice and mental simulation. Front Psychol 4: 92. doi: 10.3389/fpsyg.2013.00092 23459512
52. Pezzulo G, van der Meer MA, Lansink CS, Pennartz CMA, (2014) Internally generated sequences in learning and executing goal-directed behavior. Trends in Cognitive Sciences. doi: 10.1016/j.tics.2014.06.011 25156191
53. Hudson TE, Maloney LT, Landy MS, (2007) Movement planning with probabilistic target information. Journal of neurophysiology 98: 3034. doi: 10.1152/jn.00858.2007 17898140
54. Tassinari H, Hudson TE, Landy MS, (2006) Combining priors and noisy visual cues in a rapid pointing task. The Journal of neuroscience 26: 10154–10163. doi: 10.1523/JNEUROSCI.2779-06.2006 17021171
55. Tsetsos K, Gao J, McClelland JL, Usher M, (2012) Using time-varying evidence to test models of decision dynamics: Bounded diffusion vs. the leaky competing accumulator model. Front Neurosci 6: 79. doi: 10.3389/fnins.2012.00079 22701399
56. Kirsh D, Robbins P, Aydede M, (2009) Problem solving and situated cognition. In: The Cambridge Handbook of Situated Cognition, Cambridge: Cambridge University Press. pp. 264–306.
57. Cos I, Duque J, Cisek P, (2014) Rapid prediction of biomechanical costs during action decisions. J Neurophysiol 112: 1256–1266. doi: 10.1152/jn.00147.2014 24899673
58. Marcos E, Cos I, Cisek P, Girard B, Verschure PF, (2013) Biomechanical costs of reaching movements bias perceptual decisions. BMC Neuroscience 14: P408. doi: 10.1186/1471-2202-14-S1-P408
59. Burk D, Ingram JN, Franklin DW, Shadlen MN, Wolpert DM, (2014) Motor effort alters changes of mind in sensorimotor decision making. PLoS One 9: e92681. doi: 10.1371/journal.pone.0092681 24651615
60. Todorov E, Jordan MI, (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226–1235. doi: 10.1038/nn963 12404008
61. Trommershuser J, Maloney LT, Landy MS, (2008) Decision making, movement planning and statistical decision theory. Trends Cogn Sci 12: 291–297. doi: 10.1016/j.tics.2008.04.010
62. Wolpert DM, Landy MS, (2012) Motor control is decision-making. Curr Opin Neurobiol 22: 996–1003. doi: 10.1016/j.conb.2012.05.003 22647641
63. Redish D, (2013) The Mind within the Brain: How we make decisions and how those decisions go wrong. Oxford University Press.
64. Cisek P, (2012) Making decisions through a distributed consensus. Curr Opin Neurobiol. doi: 10.1016/j.conb.2012.05.007 22683275
65. Pezzulo G, Barsalou L, Cangelosi A, Fischer M, McRae K, et al. (2011) The mechanics of embodiment: A dialogue on embodiment and computational modeling. Frontiers in Psychology 2: 1–21. doi: 10.3389/fpsyg.2011.00005
66. Pezzulo G, Verschure P, Balkenius C, Pennartz C, (2014) The principles of goal-directed decision-making: from neural mechanisms to computation and robotics. Philosophical Transactions of the Royal Society B: Biological Sciences 369: 20130470. doi: 10.1098/rstb.2013.0470
67. Verschure P, Pennartz C, Pezzulo G, (2014) The why, what, where, when and how of goal directed choice: neuronal and computational principles. Philosophical Transaction of the Royal Society of London: Series B, Biological Sciences 369: 20130483. doi: 10.1098/rstb.2013.0483