Choice as a Function of Reinforcer "Hold": From Probability Learning to Concurrent Reinforcement

Journal of Experimental Psychology: Animal Behavior Processes

Volumn 34, Issue 4, 2008, Pages 437-460

  Jensen, Greg ^a   Neuringer, Allen ^a  

^a REED COLLEGE   (United States)

Author keywords

limited hold; matching; pigeons; reinforcement probability; stochastic response

Indexed keywords

COLUMBA;

ANIMAL; ARTICLE; DECISION MAKING; LEARNING; PIGEONS AND DOVES; PSYCHOLOGICAL MODEL; REINFORCEMENT; TIME;

ANIMALS; CHOICE BEHAVIOR; COLUMBIDAE; LEARNING; MODELS, PSYCHOLOGICAL; REINFORCEMENT (PSYCHOLOGY); TIME FACTORS;

EID: 58949098384     PISSN: 00977403     EISSN: None     Source Type: Journal    
DOI: 10.1037/0097-7403.34.4.437     Document Type: Article

References (38)

1. Aparicio C.F., and Cabrera F. Choice with multiple alternatives: The barrier choice paradigm. Mexican Journal of Behavior Analysis 27 (2001) 97-118
2. Baum W.M. Matching, undermatching, and overmatching in studies of choice. Journal of the Experimental Analysis of Behavior 32 (1979) 269-281
3. Boelens H. Melioration and maximization of reinforcement minus costs of behavior. Journal of the Experimental Analysis of Behavior 42 (1984) 113-126
4. Buskist W., and Morgan D. Competitive fixed-interval performance in humans. Journal of the Experimental Analysis of Behavior 47 (1987) 145-158
5. Davison M., Krageloh C.U., Fraser M., and Breier B.H. Maternal nutrition and four-alternative choice. Journal of the Experimental Analysis of Behavior 87 (2007) 51-62
6. Fantino E. Behavior analysis and decision making. Journal of the Experimental Analysis of Behavior 69 (1998) 355-364
7. Fantino E., and Esfandiari A. Probability matching: Encouraging optimal responding in humans. Canadian Journal of Experimental Psychology 56 (2002) 58-63
8. Gallistel C.R., King A.P., Gottlieb D., Balci F., Papachristos E.B., Szalecki M., and Carbone K.S. Is matching innate?. Journal of the Experimental Analysis of Behavior 87 (2007) 161-199
9. Gallistel C.R., Mark T.A., King A.P., and Latham P.E. The rat approximates an ideal detector of changes in rates of reward: Implications for the law of effect. Journal of Experimental Psychology: Animal Behavior Processes 27 (2001) 354-372
10. Gharib A., Gade C., and Roberts S. Control of variation by reward probability. Journal of Experimental Psychology: Animal Behavior Processes 30 (2004) 271-282
11. Herrnstein R.J. On the law of effect. Journal of the Experimental Analysis of Behavior 13 (1970) 243-266
12. Herrnstein R.J., and Loveland D. Maximizing and matching on concurrent ratio schedules. Journal of the Experimental Analysis of Behavior 24 (1975) 107-116
13. Herrnstein R.J., Rachlin H., and Laibson D.I. The matching law (1997), Harvard University Press, Cambridge, MA
14. Heyman G.M. A Markov model description of changeover probabilities on concurrent variable-interval schedules. Journal of the Experimental Analysis of Behavior 31 (1979) 41-51
15. Killeen P., and Shumway G. Concurrent random interval schedules of reinforcement. Psychonomic Science 25 (1971) 155-156
16. Knuth D.E. The art of computer programming (1969), Addison-Wesley, Reading, MA
17. Lau B., and Glimcher P.W. Dynamic response-by-response models of matching behavior in rhesus monkeys. Journal of the Experimental Analysis of Behavior 84 (2005) 555-579
18. Lee D., Conroy M.L., McGreevy B.P., and Barraclough D.J. Reinforcement learning and decision making in monkeys during a competitive game. Cognitive Brain Research 22 (2004) 45-58
19. Lehr R., and Pavlik W.B. Within-subjects procedural variations in two-choice probability learning. Psychological Reports 26 (1970) 651-657
20. MacDonall J. Concurrent variable-ratio schedules: Implications for the generalized matching law. Journal of the Experimental Analysis of Behavior 50 (1988) 55-64
21. MacDonall J. A local model of concurrent performance. Journal of the Experimental Analysis of Behavior 71 (1999) 57-74
22. Machado A. Behavioral variability and frequency-dependent selection. Journal of the Experimental Analysis of Behavior 58 (1992) 2341-2363
23. Mackintosh N.J. The psychology of animal learning (1974), Academic Press, New York
24. Manabe K., Staddon J.E.R., and Cleaveland J.M. Control of vocal repertoire by reward in Budgerigars (Melopsittacus undulatus). Journal of Comparative Psychology 111 (1997) 50-62
25. Meisch R.A., and Spiga R. Matching under non-independent variable-ratio schedules of drug reinforcement. Journal of the Experimental Analysis of Behavior 70 (1998) 23-34
26. Morse W.H. Intermittent reinforcement. In: Honig W.K. (Ed). Operant behavior: Areas of research and application (1966), Appleton-Century-Crofts, New York 52-108
27. Myers J.L., Lohmeier J.H., and Well A.D. Modeling probabilistic categorization data: Exemplar memory and connectionist nets. Psychological Science 5 (1994) 83-89
28. Nevin J. Interval reinforcement of choice behavior in discrete trials. Journal of the Experimental Analysis of Behavior 12 (1969) 875-885
29. Nevin J.A. Overall matching versus momentary maximizing: Nevin (1969) revisited. Journal of Experimental Psychology: Animal Behavior Processes 5 (1979) 300-306
30. Nickerson R.A. The production and perception of randomness. Psychological Review 109 (2002) 330-357
31. Plowright C.M.S., and Shettleworth S.J. The role of shifting in choice behavior of pigeons on a two-armed bandit. Behavioural Processes 21 (1990) 157-178
32. Shah K., Bradshaw C.M., and Szabadi E. Performance of humans in concurrent variable-ratio variable-ratio schedules of monetary reinforcement. Psychological Reports 65 (1989) 515-520
33. Shanks D.R., Tunney R.J., and McCarthy J.D. A re-examination of probability matching and rational choice. Journal of Behavioral Decision Making 15 (2002) 233-250
34. Shimp C.P. Probabilistically reinforced choice behavior in pigeons. Journal of the Experimental Analysis of Behavior 9 (1966) 443-455
35. Silberberg A., Hamilton B., Ziriax J.M., and Casey J. The structure of choice. Journal of Experimental Psychology: Animal Behavior Processes 4 (1978) 368-398
36. Staddon J.E.R., Hinson J.M., and Kram R. Optimal choice. Journal of the Experimental Analysis of Behavior 35 (1981) 397-412
37. Vulkan N. An economist's perspective on probability matching. Journal of Economic Surveys 14 (2000) 101-118
38. Williams B.A. Reinforcement, choice, and response strength. In: Atkinson C.R., Herrnstein R.J., Lindzey G., and Luce R.D. (Eds). Stevens handbook of experimental psychology 2 (1988), Wiley, New York 167-244