Extending a biologically inspired model of choice: Multi-alternatives, nonlinearity and value-based multidimensional choice

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 362, Issue 1485, 2007, Pages 1655-1670

  Bogacz, Rafal ^a   Usher, Marius ^b   Zhang, Jiaxiang ^a   McClelland, James L ^c  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF LONDON   (United Kingdom)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Decision making; Nonlinear; Optimality; Perceptual choice; Preference reversal; Utility

Indexed keywords

EXPERIMENTAL STUDY; NEUROLOGY; NONLINEARITY;

EID: 34548544993     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.2007.2059     Document Type: Article

References (54)

1. Barnard, G. 1946 Sequential tests in industrial statistics. J. R. Stat. Soc. Suppl. 8, 1-26. (doi:10.2307/2983610)
2. Bernoulli, D. [1738] 1954 Exposition of a new theory on the measurement of risk. Ekonometrica 22, 23-36. (doi:10.2307/1909829)
3. Bogacz, R. & Gurney, K. 2007 The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput 19, 442-477.
4. Bogacz, R., Brown, E., Moehlis, J., Holmes, P. & Cohen, J. D. 2006 The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced choice tasks. Psychol. Rev. 113, 700-765.
5. Britten, K. H., Shadlen, M. N., Newsome, W. T. & Movshon, J. A. 1993 Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 10, 1157-1169.
6. Brown, E. & Holmes, P. 2001 Modeling a simple choice task: stochastic dynamics of mutually inhibitory neural groups. Stock. Dyn. 1, 159-191. (doi:10.1142/S0219493701000102)
7. Brown, E., Gao, J., Holmes, P., Bogacz, R., Gilzenrat, M. & Cohen, J. D. 2005 Simple networks that optimize decisions. Int. J. Bifurc. Chaos 15, 803-826. (doi:10.1142/S0218127405012478)
8. Busemeyer, J. R. & Townsend, J. T. 1993 Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol. Rev. 100, 432-459. (doi:10.1037/0033-295X.100.3.432)
9. Busemeyer, J. R., Townsend, J. T., Diederich, A. & Barkan, R. 2005 Contrast effects or loss aversion? Comment on Usher & McClelland (2004). Psychol. Rev. 111, 757-769.
10. Cisek, P. 2007 Cortical mechanisms of action selection: the affordance competition hypothesis. Phil. Trans. R. Soc. B 362, 1585-1599. (doi:10.1098/rstb.2007.2054)
11. Dhar, R., Nowlis, S. M. & Sherman, S. J. 2000 Trying hard or hardly trying: an analysis of context effects in choice. J. Consum. Psychol. 9, 189-200. (doi:10.1207/S15327663JCP0904_1)
12. Dragalin, V. P., Tertakovsky, A. G. & Veeravalli, V. V. 1999 Multihypothesis sequential probability ratio tests - part I: asymptotic optimality. IEEE Trans. Inf. Theory 45, 2448-2461. (doi:10.1109/18.796383)
13. Glimcher, P. W. 2004 Decisions, uncertainty, and the brain: the science of neuroeconomics. Cambridge, MA: MIT Press.
14. Gold, J. I. & Shadlen, M. N. 2002 Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36, 299-308. (doi:10.1016/S0896-6273(02)00971-6)
15. Hacking, I. 1980 Strange expectations. Phil. Sci. 47, 562-567. (doi:10.1086/288956)
16. Hertwig, R., Barron, G., Weber, E. U. & Erev, I. 2004 Decisions from experience and the effect of rare events in risky choice. Psychol. Sci. 15, 534-539. (doi:10.1111/j.0956-7976.2004.00715.x)
17. Houston, A. I., McNamara, J. & Steer, M. 2007 Do we expect natural selection to produce rational behaviour? Phil. Trans. R. Soc. B 362, 1531-1543. (doi:10.1098/rstb.2007.2051)
18. Kahneman, D. 2003 Maps of bounded rationality: psychology for behavioral economics. Am. Econ. Rev. 93, 1449-1475. (doi:10.1257/ 000282803322655392)
19. Kahneman, D. & Tversky, A. (eds) 2000 Choices, values and frames. Cambridge, UK: Cambridge University Press.
20. Kveraga, K., Boucher, L. & Hughes, H. C. 2002 Saccades operate in violation of Hick's law. Exp. Brain Res. 146, 307-314. (doi:10.1007/s00221-002-1168-8)
21. Laming, D. R. J. 1968 Information theory of choice reaction time. New York, NY: Wiley.
22. LeBoef, R. & Shafir, E. B. 2005 Decision-making. In Cambridge handbook of thinking and reasoning (eds K. J. Holyoak & R. G. Morisson). Cambridge, UK: Cambridge University Press.
23. Martin, R. 2004 The St. Petersburg paradox. In The Stanford encyclopedia of philosophy (ed. E. Zalta). Stanford, CA: Stanford University.
24. Mazurek, M. E., Roitman, J. D., Ditterich, J. & Shadlen, M. N. 2003 A role for neural integrators in perceptual decision making. Cereb. Cortex 13, 1257-1269. (doi:10.1093/cercor/bhg097)
25. McMillen, T. & Holmes, P. 2006 The dynamics of choice among multiple alternatives. J. Math. Psychol. 50, 30-57. (doi:10.1016/j.jmp. 2005.10.003)
26. Neyman, J. & Pearson, E. S. 1933 On the problem of the most efficient tests of statistical hypotheses. Phil. Trans. R. Soc. A 231, 289-337. (doi:10.1098/rsta.1933.0009)
27. Platt, M. L. & Glimcher, P. W. 1999 Neural correlates of decision variables in parietal cortex. Nature 400, 233-238. (doi:10.1038/22268)
28. Ratcliff, R. 1978 A theory of memory retrieval. Psychol. Rev. 83, 59-108. (doi:10.1037/0033-295X.85.2.59)
29. Ratcliff, R. 1988 Continuous versus discrete information processing: modeling accumulation of partial information. Psychol. Rev. 95, 238-255. (doi:10.1037/0033-295X.95.2.z238)
30. Roe, R. M., Busemeyer, J. R. & Townsend, J. T. 2001 Multialternative decision field theory: a dynamic connectionist model of decision making. Psychol. Rev. 108, 370-392. (doi:10.1037/0033-295X.108.2.370)
31. Roitman, J. D. & Shadlen, M. N. 2002 Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 22, 9475-9489.
32. Schall, J. D. 2001 Neural basis of deciding, choosing and acting. Nat. Rev. Neurosci. 2, 33-42. (doi:10.1038/35049054)
33. Seung, H. S. 2003 Amplification, attenuation, and integration. In The handbook of brain theory and neural networks (ed. M. A. Adbib), pp. 94-97, 2nd edn. Cambridge, MA: MIT Press.
34. Shadlen, M. N. & Newsome, W. T. 1998 The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J. Neurosci. 18, 3870-3896.
35. Shadlen, M. N. & Newsome, W. T. 2001 Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 86, 1916-1936.
36. Slovic, P. 1995 The construction of preference. Am. Psychol. 50, 364-371. (doi:10.1037/0003-066X.50.5.364)
37. Snowden, R. J., Treue, S. & Andersen, R. A. 1992 The response of neurons in areas V1 and MT of the alert rhesus monkey to moving random dot patterns. Exp. Brain Res. 88, 389-400. (doi:10.1007/BF02259114)
38. Stone, M. 1960 Models for choice reaction time. Psychometrika 25, 251-260. (doi:10.1007/BF02289729)
39. Sugrue, L. P., Corrado, G. S. & Newsome, W. T. 2004 Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787. (doi:10.1126/science.1094765)
40. Sugrue, L. P., Corrado, G. S. & Newsome, W. T. 2005 Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 6, 363-375. (doi:10.1038/nrn1666)
41. Teichner, W. H. & Krebs, M. J. 1974 Laws of visual choice reaction time. Psychol. Rev. 81, 75-98. (doi:10.1037/h0035867)
42. Tobler, P. N., Fiorillo, C. D. & Schultz, W. 2005 Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645. (doi:10.1126/science.1105370)
43. Tversky, A. 1972 Elimination by aspects: a theory of choice. Psychol. Rev. 79, 281-299. (doi:10.1037/h0032955)
44. Tversky, A. & Kahneman, D. 1979 Prospect theory: an analysis of decision under risk. Econometrica 47, 263-292. (doi:10.2307/1914185)
45. Tversky, A. & Kahneman, D. 1991 Loss aversion in riskless choice: a reference-dependent model. Q. J. Econometr. 106, 1039-1061. (doi:10.2307/2937956)
46. Tversky, A. & Simonson, I. 1993 Context-dependent preferences. Manage. Sci. 39, 1179-1189.
47. Usher, M. & Davelaar, E. J. 2002 Neuromodulation of decision and response selection. Neural Netw. 15, 635-645. (doi:10.1016/S0893- 6080(02)00054-0)
48. Usher, M. & McClelland, J. L. 2001 The time course of perceptual choice: the leaky, competing accumulator model. Psychol. Rev. 108, 550-592. (doi:10.1037/0033-295X.108.3.550)
49. Usher, M. & McClelland, J. L. 2004 Loss aversion and inhibition in dynamical models of multialternative choice. Psychol. Rev. 111, 759-769.
50. Usher, M. & Niebur, N. 1996 Modeling the temporal dynamics of IT neurons in visual search: a mechanism for top-down selective attention. J. Cogn. Neurosci. 8, 311-327.
51. Vickers, D. 1970 Evidence for an accumulator model of psychophysical discrimination. Ergonomics 13, 37-58.
52. Vickers, D. 1979 Decision processes in perception. New York, NY: Academic Press.
53. Wald, A. 1947 Sequential analysis. New York, NY: Wiley.
54. Wang, X. J. 2002 Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955-968. (doi:10.1016/S0896-6273(02) 01092-9)