Computational and Process Models of Decision Making in Psychology and Behavioral Economics

Neuroeconomics: Decision Making and the Brain: Second Edition

Volumn , Issue , 2013, Pages 35-47

  Johnson, Eric J ^a   Ratcliff, Roger ^b  

^a Columbia University ^*  (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

Computation Process Models; Decision Neuroscience; Drift Diffusion Models; Economic theory; Intertemporal Choice; Riskless Choice; Risky Choice

Indexed keywords

EID: 84902426015     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-416008-8.00003-6     Document Type: Chapter

References (91)

1. Allais M. Le comportement de l'homme rationnel devant le risqué, critique des postulats et axiomes de l'École Américaine. Econometrica 1953, 21:503-546.
2. Basso M.A., Wurtz R.H. Modulation of neuronal activity in superior colliculus by changes in target probability. J. Neurosci. 1998, 18:7519-7534.
3. Bernoulli D. Specimen theoriae novae de mensura sortis (Exposition of a new theory in the measurement of risk). Econometrica 1738, 22:23-36.
4. Birnbaum M.H. New paradoxes of risky decision-making. Psychol. Rev. 2008, 115(2):463.
5. Birnbaum M.H., Patton J.N., Lott M.K. Evidence against rank-dependent utility theories: tests of cumulative independence, interval independence, stochastic dominance, and transitivity. Organ. Behav. Hum. Decis. Process. 1999, 77(1):44-83.
6. Bleichrodt H., Pinto J.L., Wakker P.P. Making descriptive use of prospect theory to improve the prescriptive use of expected utility. Manage. Sci. 2001, 47(11):1498-1514.
7. Brandstätter E., Gigerenzer G., Hertwig R. The priority heuristic: making choices without trade-offs. Psychol. Rev. 2006, 113(2):409-432. doi:10.1037/0033-295X.113.2.409.
8. Brown S.D., Heathcote A.J. The simplest complete model of choice response time: Linear ballistic accumulation. Cog. Psychol. 2008, 57:153-178.
9. Camerer C., Babcock L., Loewenstein G., Thaler R. Labor supply of New York City cabdrivers: one day at a time. Q. J. Econ. 1997, 112(2):407-441.
10. Camerer C.F. Prospect theory in the wild: evidence from the field. Advances in Behavioral Economics 2004, 148-161. Princeton University Press, Princeton. C.F. Camerer, G. Loewenstein, M. Rabin (Eds.).
11. Deco G., Rolls E.T., Albantakis L., Romo R. Brain mechanisms for perceptual and reward-related decision-making. Prog. Neurobiol. 2012, (Epub 2 February).
12. Donkin C., Brown S., Heathcote A., Wagenmakers E.J. Diffusion versus linear ballistic accumulation: different models for response time, same conclusions about psychological mechanisms?. Psychon. Bull. Rev. 2011, 55:140-151.
13. Frederick S., Loewenstein G., O'Donoghue T. Time discounting and time preference: a critical review. J. Econ. Lit. 2002, 40(2):351-401.
14. Genesove D., Mayer C. Loss aversion and seller behavior: evidence from the housing market. Q. J. Econ. 2001, 116(4):1233-1260.
15. Gigerenzer G., Goldstein D.G. Reasoning the fast and frugal way: models of bounded rationality. Psychol. Rev. 1996, 103(4):650-669.
16. Glimcher P.W., Kable J., Louie K. Neuroeconomic studies of impulsivity: now or just as soon as possible?. Am. Econ. Rev. 2007, 97(2):142-147.
17. Gold J.I., Shadlen M.N. Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 2001, 5:10-16.
18. González-Vallejo C. Making trade-offs: a probabilistic and context-sensitive model of choice behavior. Psychol. Rev. 2002, 109(1):137-154. doi:10.1037//0033-295X.109.1.137.
19. González-Vallejo C., Reid A.A., Schiltz J. Context effects: proportional difference model and the reflection of preference. J. Exp. Psychol. Learn. 2003, 29(5):942-953. doi:10.1037/0278-7393.29.5.942.
20. Hanes D.P., Schall J.D. Neural control of voluntary movement initiation. Science 1996, 274:427-430.
21. Hardie B.G.S., Johnson E.J., Fader P.S. Modeling loss aversion and reference dependence effects on brand choice. Mark. Sci. 1993, 12(4):378-394.
22. Heekeren H.R., Marrett S., Bandettini P.A., Ungerleider L.G. A general mechanism for perceptual decision-making in the human brain. Nature 2004, 431:859-862.
23. Huber J., Payne J.W., Puto C. Adding asymmetrically dominated alternatives - violations of regularity and the similarity hypothesis. J. Consum. Res. 1982, 9(1):90-98.
24. Johnson E.J., Payne J.W. Effort and accuracy in choice. Manage. Sci. 1985, 31:395-414. Reprinted in: Production System Models of Cognition, P. Langley and P. Young (Eds.), Bradford Books: MIT Press, 1987.
25. Johnson E.J., Schulte-Mecklenbeck M., Willernsen M. Process models deserve process data: Comment on Brandstatter, Gigerenzer, and Hertwig (2006). Psychol. Rev. 2008, 115:263-272. doi:10.1037/0033-295X.115.1.263.
26. Kable J.W., Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 2007, 10(12):1625-1633. doi:10.1038/nn2007.
27. Kahneman D. A perspective on judgment and choice - mapping bounded rationality. Am. Psychol. 2003, 58(9):697-720. doi:10.1037/0003-066X.58.9.697.
28. Kahneman D., Tversky A. Prospect theory - analysis of decision under risk. Econometrica 1979, 47(2):263-291.
29. Kahneman D., Tversky A. Choices, values, and frames. Am. Psychol. 1984, 39(4):341-350.
30. Kahneman D., Tversky A. Choices, Values, and Frames 2000, Russell Sage Foundation, Cambridge University Press.
31. Kirby K.N., Herrnstein R.J. Preference reversals due to myopic discounting of delayed reward. Psychol. Sci. 1995, 6(2):83-89.
32. Knutson B., Rick S., Wimmer G.E., Prelec D., Loewenstein G. Neural predictors of purchases. Neuron 2007, 53(1):147-156. doi:10.1016/j.neuron.2006.11.010.
33. Laibson D. Golden eggs and hyperbolic discounting. Q. J. Econ. 1997, 112(2):443-477. doi:10.1162/003355397555253.
34. Leite F.P., Ratcliff R. Modeling reaction time and accuracy of multiple-alternative decisions. Atten., Percept. Psychophys. 2010, 72:246-273.
35. Loomes G. Modeling choice and valuation in decision experiments. Psychol. Rev. 2010, 117(3):902-924. doi:10.1037/a0019807.
36. Loomes G., Sugden R. Regret theory: an alternative theory of rational choice under uncertainty. Econ. J. 1982, 92(368):805-824.
37. Luce R.D. The choice axiom after twenty years. J. Math. Psychol. 1977, 15(3):215-233.
38. McClure S.M., Ericson K.M., Laibson D.I., Loewenstein G., Cohen J.D. Time discounting for primary rewards. J. Neurosci. 2007, 27(21):5796-5804. doi:10.1523/jneurosci.4246-06.2007.
39. McClure S.M., Laibson D.I., Loewenstein G., Cohen J.D. Separate neural systems value immediate and delayed monetary rewards. Science (New York, NY) 2004, 306(5695):503-507.
40. Morewedge C.K., Kahneman D. Associative processes in intuitive judgment. Trends Cogn. Sci. 2010, 14(10):435-440. doi:10.1016/j.tics.2010.07.004.
41. Niwa M., Ditterich J. Perceptual decisions between multiple directions of visual motion. J. Neurosci. 2008, 28:4435-4445.
42. Payne J.W., Bettman J.R., Johnson E.J. The Adaptive Decision-Maker 1991, Cambridge Univeristy Press, Cambridge.
43. Payne J.W., Bettman J.R., Johnson E.J. The use of multiple strategies in judgment and choice. Individual and Group Decision Making 1993, 19-39. Lawrence Erlbaum, NJ. J. Castellan (Ed.).
44. Peters J., Büchel C. Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 2010, 66(1):138-148. doi:10.1016/j.neuron.2010.03.026.
45. Philiastides M.G., Ratcliff R., Sajda P. Neural representation of task difficulty and decision making during perceptual categorization: a timing diagram. J. Neurosci. 2006, 26(35):8965-8975.
46. Plassmann H., O'Doherty J., Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 2007, 27(37):9984-9988. doi:10.1523/jneurosci.2131-07.2007.
47. Pleskac T.J., Busemeyer J.R. Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. Psychol. Rev. 2010, 117:864-901.
48. Pouget P., Logan G.D., Palmeri T.J., Boucher L., Paré M., Schall J.D. Neural basis of adaptive response time adjustment during saccade countermanding. J. Neurosci. 2011, 31:12604-12612.
49. Purcell B.A., Heitz R.P., Cohen J.Y., Schall J.D., Logan G.D., Palmeri T.J. Neurally-constrained modeling of perceptual decision-making. Psychol. Rev. 2010, 117:1113-1143.
50. Quiggin J. Generalized Expected Utility Theory 1993, Springer.
51. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision-making. Nat. Rev. Neurosci. 2008, 9(7):545-556. doi:10.1038/nrn2357.
52. Ratcliff R. A theory of memory retrieval. Psychol. Rev. 1978, 85:59-108.
53. Ratcliff, R., 1993. Methods for dealing with reaction time outliers. Psychol. Bull. 114, 510-532.
54. Ratcliff, R., 2013. Parameter variability and distributional assumptions in the diffusion model. Psychol. Rev. 120 (1), 281-292.
55. Ratcliff, R., Cherian, A., Segraves, M., 2003. A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. J. Neurophysiol. 90 (3), 1392-1407.
56. Ratcliff R., McKoon G. The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 2008, 20:873-922.
57. Ratcliff R., Tuerlinckx F. Estimating the parameters of the diffusion model: approaches to dealing with contaminant reaction times and parameter variability. Psychon. Bull. Rev. 2002, 9:438-481.
58. Ratcliff R., Van Dongen H.P.A. A diffusion model for one-choice reaction time tasks and the cognitive effects of sleep deprivation. Proc. Natl. Acad. Sci. 2011, 108:11285-11290.
59. Ratcliff, R., Starns, J.J. Modeling confidence judgments, response times, and multiple choices in decision making: recognition memory and motion discrimination. Psychological Review. (in press).
60. Ratcliff R., Thapar A., McKoon G. Individual differences, aging, and IQ in two-choice tasks. Cogn. Psychol. 2010, 60:127-157.
61. Ratcliff R., Thapar A., McKoon G. Effects of aging and IQ on item and associative memory. J. Exp. Psychol.: Gen. 2011, 140:464-487.
62. Ratcliff R., Philiastides M.G., Sajda P. Quality of evidence for perceptual decision-making is indexed by trial-to-trial variability of the EEG. Proc. Natl. Acad. Sci. 2009, 106:6539-6544.
63. Ratcliff, R., Thapar, A., Smith, P.L., McKoon, G., 2005. Aging and response times: A comparison of sequential sampling models. In: Duncan, J., McLeod, P., Phillips L. (Eds.), Measuring the Mind: Speed, Control, and Age. Oxford University Press, Oxford, U.K., pp. 3-32.
64. Read D., Frederick S., Orsel B., Rahman J. Four score and seven years from now: the date/delay effect in temporal discounting. Manage. Sci. 2005, 1326-1335.
65. Roe R.M., Busemeyer J.R., Townsend J.T. Multialternative decision field theory: a dynamic connectionist model of decision-making. Psychol. Rev. 2001, 108(2):370-392. doi:10.1037//0033-295X.108.2.370.
66. Roxin A., Ledberg A. Neurobiological models of two-choice decision-making can be reduced to a one-dimensional nonlinear diffusion equation. PLoS Comput. Biol. 2008, 4:e1000046.
67. Rubinstein, A., Fishburn, P.C., 1986. Algebraic aggregation theory. J. Econ. Theory, 38 (1), 63-77.
68. Russo J.E., Dosher B.A. Strategies for multiattribute binary choice. J. Exp. Psychol. Learn. Mem. Cogn. 1983, 9:676-696.
69. Savage L.J. The Foundation of Statistics 1954, Wiley, New York.
70. Scholten M., Read D. The psychology of intertemporal tradeoffs. Psychol. Rev. 2010, 117(3):925-944. doi:10.1037/a0019619.
71. Shah A.K., Oppenheimer D.M. Heuristics made easy: an effort-reduction framework. Psychol. Bull. 2008, 134(2):207-222. doi:10.1037/0033-2909.134.2.207.
72. Stone, M., 1960. Models for choice reaction time. Psychometrika 25, 251-260.
73. Tanaka, T., Camerer, C.F., Nguyen, Q., 2010. Risk and time preferences: linking experimental and household survey data from Vietnam. Am. Econ. Rev. 100 (1), 557-571.
74. Toubia, O., Johnson, E.J., Evgeniou, T., Delquié, P., 2012, February 13. Dynamic Experiments for Estimating Preferences: An Adaptive Method of Eliciting Time and Risk Parameters.
75. Toubia, O., Johnson, E.J., Evgeniou, T., Delquié, P., 2013. Dynamic Experiments for Estimating Preferences: An Adaptive Method of Eliciting Time and Risk Parameters. Management Science. 59 (3) 613-640.
76. Tversky A. Intransitivity of preferences. Psychol. Rev. 1969, 76(1):31-48. doi:10.1037/h0026750.
77. Tversky A. Elimination by aspects - theory of choice. Psychol. Rev. 1972, 79(4):281-299.
78. Tversky A., Kahneman D. Advances in prospect-theory - cumulative representation of uncertainty. J. Risk Uncertain. 1992, 5(4):297-323. Retrieved from: .
79. Tversky A., Simonson I. Context-dependent preferences. Manage. Sci. 1993, 39(10):1179-1189. Retrieved from: .
80. Usher, M., McClelland, J.L., 2001. On the time course of perceptual choice: The leaky competing accumulator model. Psychol. Rev. 108, 550-592.
81. Usher M., McClelland J.L. Loss aversion and inhibition in dynamical models of multialternative choice. Psychol. Rev. 2004, 111(3):757-769. doi:10.1037/0033-295X.111.3.757.
82. Vandekerckhove J., Tuerlinckx F. Fitting the Ratcliff diffusion model to experimental data. Psychon. Bull. Rev. 2007, 14:1011-1026.
83. Van Zandt, T., 2002. Analysis of response time distributions. In: Wixtedm J.T., (Vol. Ed.) and Pashler, H., (Series Ed.), Stevens' Handbook of Experimental Psychology (3rd Edition), Volume 4: Methodology in Experimental Psychology. Wiley Press, New York, pp. 461-516.
84. Vlaev I., Chater N., Stewart N., Brown G.D.A. Does the brain calculate value?. Trends Cogn. Sci. 2011, 15(11):546-554. doi:10.1016/j.tics.2011.09.008.
85. von Neumann J., Morgenstern O. Theory of Games and Economic Behavior 1953, New York John Wiley and Sons, Inc., Princeton NJ. third ed.
86. Voss A., Voss J. Fast-dm: a free program for efficient diffusion model analysis. Behav. Res. Methods 2007, 39:767-775.
87. Wakker P.P. Prospect Theory 2010, Cambridge University Press.
88. Warner J.T., Pleeter S. The personal discount rate: Evidence from military downsizing programs. Am. Econ. Rev. 2001, 33-53.
89. Wong K-F., Wang X-J. A recurrent network mechanism for time integration in perceptual decisions. J. Neurosci. 2006, 26:1314-1328.
90. Wu G., Zhang J., Gonzalez R. Decision under risk. Handbook Judgment Decision Making. 2004, 399-423.
91. Zauberman G., Lynch J. Resource slack and propensity to discount delayed investments of time versus money. J. Exp. Psychol.-Gen. 2005, 134(1):23-37. 10.1037/0096-3445.134.1.23.