Local dynamics in decision making: The evolution of preference within and across decisions

Scientific Reports

Volumn 3, Issue , 2013, Pages

  O'Hora, Denis ^a   Dale, Rick ^b   Piiroinen, Petri T ^a   Connolly, Fionnuala ^c  

^a NATIONAL UNIVERSITY OF IRELAND   (Ireland)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; DECISION MAKING; FEMALE; HUMAN; LEARNING; MALE; MOUSE; PHYSIOLOGY; PSYCHOLOGICAL MODEL; REACTION TIME; REWARD; ARTICLE;

ALGORITHMS; ANIMALS; CHOICE BEHAVIOR; DECISION MAKING; FEMALE; HUMANS; LEARNING; MALE; MICE; MODELS, PSYCHOLOGICAL; REACTION TIME; REWARD;

EID: 84880359241     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep02210     Document Type: Article

References (59)

1. Luce, R. D. Response times: Their role in inferring elementarymental organization. (Oxford University Press, 1986).
2. Link, S. W. The wave theory of difference and similarity. (Psychology Press, 1992).
3. Gold, J. I. & Shadlen, M. N. The neural basis of decision making. Ann. Rev. Neurosci. 30, 535-574 (2007). (Pubitemid 47218767)
4. Bogacz, R., Usher, M., Zhang, J. & McClelland, J. L. Extending a biologically inspired model of choice: Multi-alternatives, nonlinearity and value-based multidimensional choice. Philos. Trans. R. Soc. Lond., Ser. B 362, 1655-70 (2007). (Pubitemid 47395856)
5. Stafford, T. & Gurney, K. N. Biologically constrained action selection improves cognitive control in a model of the Stroop task. Philos. Trans. R. Soc. Lond., Ser. B 362, 1671-84 (2007). (Pubitemid 47395857)
6. Usher, M., Elhalal, A. , McClelland, J. The neurodynamics of choice, value-based decisions, and preference reversal. In Chater, N. & Oaksford, M. (eds.) The Probabilistic Mind: Prospects for Bayesian cognitive science, 277-300 (Oxford University Press, Oxford, UK., 2008).
7. Herrnstein, R. Relative and absolute strength of response as a function of frequency of reinforcement. J. Exp. Anal. Behav. 4, 267-272 (1961).
8. Herrnstein, R. J. On the law of effect. J. Exp. Anal. Behav. 13, 243-266 (1970).
9. Tversky, A. Elimination by aspects: A theory of choice. Psychol. Rev. 79, 281-299 (1972).
10. Kahneman, D. & Tversky, A. Prospect theory: An analysis of decision under risk. Econometrica 47, 263-292 (1979).
11. Pierce, W. D. & Epling, W. F. Choice, matching, and human behavior: A review of the literature. Behav. Anal. 6, 57-76 (1983).
12. Koop, G. J. & Johnson, J. G. Response dynamics : A new window on the decision process. Judgm. Decis. Mak. 6, 750-758 (2011).
13. Vlaev, I., Chater, N., Stewart, N. & Brown, G. D. A. Does the brain calculate value? Trends Cogn Sci 15, 546-54 (2011).
14. Busemeyer, J. R. & Townsend, J. T. Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment. Psychol. Rev. 100, 432 (1993).
15. Townsend, J. T. & Busemeyer, J. R. Dynamic representation of decision-making. In Port, R. F., Van GelderT. (eds.) Mind as Motion: Explorations in theDynamics of Cognition, 101-120 (MIT Press, 1995).
16. Ratcliff, R., Van Zandt, T. & McKoon, G. Connectionist and diffusion models of reaction time. Psychol. Rev. 106, 261-300 (1999).
17. Kahneman, D. & Tversky, A. Choices, values, and frames. (Cambridge University Press, 2000).
18. Van Zandt, T. ROC curves and confidence judgments in recognition memory. J. Exp. Psychol.: Learn. Mem. Cogn. 26, 582-600 (2000).
19. Usher, M. , McClelland, J. L. Loss aversion and inhibition in dynamical models of multialternative choice. Psychol. Rev. 111, 757-69 (2004). (Pubitemid 38883579)
20. Stewart, N., Chater, N., Brown, G. D. A. Decision by sampling. Cogn. Psychol. 53, 1-26 (2006). (Pubitemid 43717507)
21. Wang, X.-J. Decision making in recurrent neuronal circuits. Neuron 60, 215-234 (2008).
22. Dickhaut, J., Rustichini, A. & Smith, V. A neuroeconomic theory of the decision process. Proc. Natl. Acad. Sci. USA 106, 22145-50 (2009).
23. Gigerenzer, G., Gaissmaier, W. Heuristic decision making. Ann. Rev. Psychol. 62, 451-82 (2011).
24. Albantakis, L. & Deco, G. Changes of mind in an attractor network of decisionmaking. PLoS Comput. Biol. 7, e1002086 (2011).
25. Spivey, M. J., Grosjean, M. & Knoblich, G. Continuous attraction toward phonological competitors. Proc. Natl. Acad. Sci. USA 102, 10393-10398 (2005). (Pubitemid 41023381)
26. Dale, R., Kehoe, C. & Spivey, M. J. Graded motor responses in the time course of categorizing atypical exemplars. Mem. Cogn. 35, 15-28 (2007). (Pubitemid 46685189)
27. Farmer, T. A., Anderson, S. E. & Spivey, M. J. Gradiency and visual context in syntactic garden-paths. J. Mem. Lang. 57, 570-595 (2007).
28. Farmer, T. A., Cargill, S. A., Hindy, N. C., Dale, R. & Spivey, M. J. Tracking the continuity of language comprehension: Computer mouse trajectories suggest parallel syntactic processing. Cogn. Sci. 31, 889-909 (2007).
29. Freeman, J. B., Ambady, N., Rule, N. O., Johnson, K. L. Will a category cue attract you? Motor output reveals dynamic competition across person construal. J. Exp. Psychol.: Gen. 137, 673 (2008).
30. Freeman, J. B. & Ambady, N. Motions of the hand expose the partial and parallel activation of stereotypes. Psychol. Sci. 20, 1183-1188 (2009).
31. Barca, L. & Pezzulo, G. Unfolding visual lexical decision in time. PLoS One 7, e35932 (2012).
32. Dale, R., Roche, J., Snyder, K. , McCall, R. Exploring action dynamics as an index of paired-associate learning. PLoS ONE 3, e1728 (2008).
33. Duran,N.D., Dale, R., McNamara, D. S. The action dynamics of overcoming the truth. Psychon. Bull. Rev. 17, 486-91 (2010).
34. Song, J.-H. & Nakayama, K. Numeric comparison in a visually-guided manual reaching task. Cogn. 106, 994-1003 (2008). (Pubitemid 350265850)
35. Spivey, M. J. & Dale, R. Continuous dynamics in real-time cognition. Curr. Dir. Psychol. Sci. 15, 207-211 (2006). (Pubitemid 44800061)
36. Song, J.-H. & Nakayama, K. Hidden cognitive states revealed in choice reaching tasks. Trends Cogn. Sci. 13, 360-6 (2009).
37. Freeman, J. B., Dale, R. & Farmer, T. A. Hand in motion reveals mind in motion. Front. Psychol. 2, 59 (2011).
38. Spivey, J. M. The Continuity of Mind (Oxford University Press, 2007).
39. Wojnowicz, M. T., Ferguson, M. J., Dale, R. & Spivey, M. J. The self-organization of explicit attitudes. Psychol. Sci. 20, 1428-35 (2009).
40. Usher, M. & McClelland, J. L. The time course of perceptual choice: The leaky, competing accumulator model. Psychol. Rev. 108, 550-592 (2001). (Pubitemid 33604137)
41. Teodorescu, A. R. & Usher, M. Disentangling decision models: From independence to competition. Psychol. Rev. (in press).
42. Vanrullen, R. & Thorpe, S. J. The time course of visual processing: From early perception to decision-making. J. Cogn. Neurosci. 13, 454-461 (2001). (Pubitemid 32500254)
43. Ratcliff, R., Philiastides, M. G. & Sajda, P. Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG. Proc. Natl. Acad. Sci. USA 106, 6539-44 (2009).
44. Hare, T. A., Schultz, W., Camerer, C. F., O'Doherty, J. P. & Rangel, A. Transformation of stimulus value signals into motor commands during simple choice. Proc. Natl. Acad. Sci. USA 108, 18120-18125 (2011).
45. Chib, V. S., De Martino, B., Shimojo, S. & O'Doherty, J. P. Neural mechanisms underlying paradoxical performance for monetary incentives are driven by loss aversion. Neuron 74, 582-94 (2012).
46. Niv, Y., Edlund, J. A., Dayan, P. & O'Doherty, J. P. Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain. J. Neurosci. 32, 551-62 (2012).
47. Glöckner, A., Herbold, A. K. An eye-tracking study on information processing in risky decisions: Evidence for compensatory strategies based on automatic processes. J. Behav. Dec. Mak. 24, 71-98 (2011).
48. Franco-Watkins, A. M. & Johnson, J. G. Applying the decision moving window to risky choice: Comparison of eye-tracking and mousetracing methods. Judgm. Decis. Mak. 6, 740-749 (2011).
49. Killeen, P. R. Mechanics of the animate. J. Exp. Anal. Behav. 57, 429-463 (1992).
50. Wang, X.-J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955-968 (2002). (Pubitemid 35447866)
51. Wong, K.-F. & Huk, A. C. Temporal dynamics underlying perceptual decision making: Insights from the interplay between an attractor model and parietal neurophysiology. Front. Neurosci. 2, 245-54 (2008).
52. Aparicio, C. F., Baum,W.M.Dynamics of choice: relative rate and amount affect local preference at three different time scales. J. Exp. Anal. Behav. 91, 293-317 (2009).
53. Ratcliff, R. & Frank, M. J. Reinforcement-based decision making in corticostriatal circuits: Mutual constraints by neurocomputational and diffusion models. Neural Comput. 24, 1186-229 (2012).
54. Hovland, C. I. & Sears, R. R. Experiments on motor conflict. I. Types of conflict and their modes of resolution. J. Exp. Psychol. 477-493 (1938).
55. Flaherty, C. F. Incentive contrast: A review of behavioral changes following shifts in reward. Anim. Learn. Behav. 10, 409-440 (1982). (Pubitemid 13108331)
56. Schöner, G. & Kelso, J. A. S. Dynamic pattern generation in behavioral and neural systems. Science 239, 1513-20 (1988).
57. Kelso, J. A. S. Dynamic Patterns: The Self-Organization of Brain and Behavior (The MIT Press, Cambridge, MA, 1995).
58. Buhrmester, M., Kwang, T. & Gosling, S. D. Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data? Persp. Psychol. Sci. 6, 3-5 (2011).
59. Wickham, H. ggplot2: Elegant graphics for data analysis (Springer Publishing Company, Incorporated, 2009).