The effect of probability discounting on reward seeking: A three-dimensional perspective

Frontiers in Behavioral Neuroscience

Volumn 8, Issue AUG, 2014, Pages

  Breton, Yannick André ^a   Conover, Kent ^b   Shizgal, Peter ^b  

^a UNIVERSITY OF MINNESOTA   (United States)

^b Center for Studies in Behavioral Neurobiology Groupe de Recherche en Neurobiologie Comportementale   (Canada)

Author keywords

Brain stimulation reward; Decision making; Operant conditioning; Risk; Subjective probability; Subjective value

Indexed keywords

BRAIN DEPTH STIMULATION; DECISION MAKING; INSTRUMENTAL CONDITIONING; PREDICTION; PROBABILITY; PULSE RATE; REWARD; STATISTICAL MODEL;

EID: 84982107198     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00284     Document Type: Article

References (26)

1. Arvanitogiannis, A., and Shizgal, P. (2008). The reinforcement mountain: allocation of behavior as a function of the rate and intensity of rewarding brain stimulation. Behav. Neurosci. 122, 1126-1138. doi: 10.1037/ a0012679
2. Baum, W., and Rachlin, H. (1969). Choice as time allocation. J. Exp. Anal. Behav. 12,861-874.doi:10.1901/jeab.1969.12-861
3. Breton, Y.-A., Marcus, J. C., and Shizgal, P. (2009). Rattus Psychologicus: construction of preferences by self-stimulating rats. Behav. Brain Res. 202, 77-91. doi: 10.1016/j.bbr.2009.03.019
4. Breton, Y.-A., Mullett, A., Conover, K., and Shizgal, P. (2013). Validation and extension of the reward-mountain model. Front. Behav. Neurosci. 7:125. doi: 10.3389/fnbeh.2013.00125
5. Charnov, E. L. (1976). Optimal foraging, the marginal value theorem. Theor. Popul Biol. 9, 129-136. doi: 10.1016/0040-5809(76)90040-X
6. Chung,K.,andDeisseroth,K.(2013). CLARITY for mapping the nervous system. Nat. Methods 10, 508-513. doi: 10.1038/nmeth.2481
7. Deisseroth, K. (2014). Circuit dynamics of adaptive and maladaptive behaviour. Nature505,309-317.doi:10.1038/nature12982
8. Gallistel, C. R. (1978). Self-stimulation in the rat: quantitative characteristics of the reward pathway. J. Comp. Physiol. Psychol. 92, 977-998. doi: 10.1037/h0077513
9. Gallistel, C. R., and Leon, M. (1991). Measuring the subjective magnitude of brain stimulation reward by titration with rate of reward. Behav. Neurosci. 105, 913-925.doi:10.1037/0735-7044.105.6.913
10. Gallistel, C. R., Stellar, J. R., and Bubis, E. (1974). Parametric analysis of brain stimulation reward in the rat:I.The transient process and the memory-containing process. J. Comp. Physiol. Psychol. 87, 848-859. doi: 10.1037/h0037220
11. Hau, R., Pleskac, T. J., Kiefer, J., and Hertwig, R. (2008). The experience gap in risky choice:The role of sample size and experienced probabilities. J. Behav. Decis. Making 21, 493-518. doi: 10.1002/bdm.598
12. Hernandez, G., Breton, Y.-A., Conover, K., and Shizgal, P. (2010). At what stage of neural processing does cocaine act to boost pursuit of rewards? PLoS ONE5:e15081.doi:10.1371/journal.pone.0015081
13. Hernandez, G., Trujillo-Pisanty, I., Cossette, M.-P., Conover, K., and Shizgal, P. (2012). Role of dopamine tone in the pursuit of brain stimulation reward. J. Neurosci. 32, 11032-11041. doi: 10.1523/JNEUROSCI.1051-12.2012
14. Herrnstein, R. (1970). On the lawofeffect. J. Exp. Anal. Behav. 13, 243-266. doi: 10.1901/jeab.1970.13-243
15. Herrnstein, R. (1974). Formalproperties ofthematchinglaw. J. Exp. Anal. Behav. 21,159-164.doi:10.1901/jeab.1974.21-159
16. Kahneman, D., and Tversky, A. (1979). Prospect theory: an analysis of decision under risk. Econometrica 42, 263-292. doi: 10.2307/1914185
17. Kalenscher, T., and van Wingerden, M. (2011). Why we should use animals to study economic decision making - a perspective. Front. Neurosci. 5:82. doi: 10.3389/fnins.2011.00082
18. Killeen, P. (1972). The matching law. J. Exp. Anal. Behav. 17, 489-495. doi: 10.1901/jeab.1972.17-489
19. Miller, H. (1976). Matching-based hedonic scaling in the pigeon. J. Exp. Anal. Behav. 26, 335-347. doi: 10.1901/jeab.1976.26-335
20. Prelec, D. (1998). The probability weighting function. Econometrica 66, 497-527. doi: 10.2307/2998573
21. Simmons,J.M.,andGallistel,C.R.(1994). Saturation of subjective reward magnitude as a function of current and pulse frequency. Behav.Neurosci.108,151-160. doi: 10.1037/0735-7044.108.1.151
22. Solomon, R. B., Conover, K., and Shizgal, P. (2007). "Estimation of subjective opportunity cost in rats working for rewarding brain stimulation: further progress," in Society for Neuroscience Abstract Viewer (San Diego, CA), 742.8.
23. Solomon, R. B., Trujillo-Pisanty, I., and Shizgal, P. (2010). "The maximum firing frequency of the neurons subserving brain stimulation reward," in Society for NeuroscienceAbstractViewer(San Diego, CA), 716.3.
24. Trujillo-Pisanty, I., Conover, K., and Shizgal, P. (2014). A new view of the effect of dopamine receptor antagonism on operant performance for rewarding brain stimulation in the rat. Psychopharmacology 231, 1351-1364. doi: 10.1007/s00213-013-3328-x
25. Trujillo-Pisanty, I., Hernandez, G., Moreau-Debord, I., Cossette, M.-P., Conover, K., Cheer, J. F., et al. (2011). Cannabinoid receptor blockade reduces the opportunity cost at which rats maintain operant performance for rewarding brain stimulation. J. Neurosci. 31, 5426-5435. doi: 10.1523/JNEUROSCI.0079-11.2011
26. Yizhar, O., Fenno, L. E., Davidson, T. J., Mogri, M., and Deisseroth, K. (2011). Optogenetics in neural systems. Neuron 71, 9-34. doi: 10.1016/j.neuron.2011.06.004