Risky choice in pigeons: Preference for amount variability using a token reinforcement system

Journal of the Experimental Analysis of Behavior

Volumn 98, Issue 2, 2012, Pages 139-154

  Lagorio, Carla H ^a   Hackenberg, Timothy D ^b  

^a UNIVERSITY OF WISCONSIN EAU CLAIRE   (United States)

^b REED COLLEGE   (United States)

Author keywords

Adjusting amount; Gambling; Key peck; Pigeon; Reinforcer amount; Risky choice; Token reinforcement

Indexed keywords

ANIMAL; ARTICLE; DECISION MAKING; HIGH RISK BEHAVIOR; INSTRUMENTAL CONDITIONING; MALE; PIGEONS AND DOVES; REINFORCEMENT;

ANIMALS; CHOICE BEHAVIOR; COLUMBIDAE; CONDITIONING, OPERANT; MALE; RISK-TAKING; TOKEN ECONOMY;

EID: 84873493161     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2012.98-139     Document Type: Article

References (70)

1. Barnard, C. J., Brown, C. A. J., Houston, A., & McNamara, J. M. (1985). Risk-sensitive foraging in common shrews: An interruption model and the effects of mean and variance in reward rate. Behavioral Ecology and Sociobiology, 18, 139-146
2. Bateson, M., & Kacelnik, A. (1995). Preferences for fixed and variable food sources: Variability in amount and delay. Journal of the Experimental Analysis of Behavior, 63, 313-329
3. Bateson, M., & Kacelnik, A. (1998). Risk-sensitive foraging: Decision making in variable environments. In R. Dukas (Ed.), Cognitive ecology: The evolutionary ecology of information processing and decision making (pp. 297-341). Chicago: University of Chicago Press
4. Behar, I. (1961). Learned avoidance of non reward. Psychological Report, 9, 43-52
5. Bullock, C. E., & Hackenberg, T. D. (2006). Second-order schedules of token reinforcement with pigeons: Implications for unit price. Journal of the Experimental Analysis of Behavior, 85, 95-106
6. Caraco, T., & Chasin, M. (1984). Foraging preferences: Response to reward skew. Animal Behaviour, 32, 76-85
7. Caraco, T., Martindale, S., & Whittam, T. S. (1980). An empirical demonstration of risk-sensitive foraging preferences. Animal Behaviour, 28, 820-830
8. Case, D. A., Nichols, P., & Fantino, E. (1995). Pigeons' preference for variable-interval water reinforcement under widely varied water budgets. Journal of the Experimental Analysis of Behavior, 64, 299-311
9. Cicerone, R. A. (1976). Preference for mixed versus constant delay of reinforcement. Journal of the Experimental Analysis of Behavior, 25, 257-261
10. Clements, K. C. (1990). Risk-aversion in the foraging blue jay, Cyanocitta cristata. Animal Behavior, 40, 182-195
11. Dallery, J., & Locey, M. (2005). Effects of acute and chronic nicotine on impulsive choice in rats. Behavioural Pharmacology, 16, 15-23
12. Davison, M. C. (1969). Preference for mixed-interval versus fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 12, 247-252
13. Davison, M. C. (1972). Preference for mixed-interval versus fixed-interval schedules: Number of component intervals. Journal of the Experimental Analysis of Behavior, 17, 169-176
14. Dunn, R., & Spetch, M. L. (1990). Choice with uncertain outcomes: Conditioned reinforcement effects. Journal of the Experimental Analysis of Behavior, 53, 201-218
15. Epstein, R. (1981). Amount consumed as a function of magazine-cycle duration. Behaviour Analysis Letters, 1, 63-66
16. Essock, S. M., & Reese, E. P. (1974). Preference for and effects of variable as opposed to fixed reinforcer duration. Journal of the Experimental Analysis of Behavior, 21, 89-97
17. Fantino, E., Arbaraca, N., & Ito, M. (1987). Choice and optimal foraging: Tests of the delay reduction hypothesis and the optimal diet model. In M. L. Commons, A. Kacelnik, & S. J. Shettleworth (Eds.), Foraging. Quantitative analyses of behavior (Vol. 6, pp. 181-207). Hillsdale, NJ: Erlbaum
18. Fantino, E., Navarro, A., & O'Daly, M. (2005). The science of decision-making: Behaviours related to gambling. International Gambling Studies, 5, 169-186
19. Fantino. E., & Romanowich, P. (2006). Context as a variable influencing risky choice: a review. The Behavior Analyst Today, 7, 290-300
20. Foster, T. A., & Hackenberg, T. D. (2004). Unit price and choice in a token-reinforcement context. Journal of the Experimental Analysis of Behavior, 81, 5-25
21. Foster, T. A., Hackenberg, T. D., & Vaidya, M. (2001). Second-order schedules of token reinforcement with pigeons: Effects of fixed- and variable-ratio exchange schedules. Journal of the Experimental Analysis of Behavior, 76, 159-178
22. Gipson, C. D., Alessandri, J. J. D., Miller, H. C., & Zentall, T. R. (2009). Preference for 50% reinforcement over 75% reinforcement by pigeons. Learning and Behavior, 37, 289-298
23. Hackenberg, T. D. (2009). Token reinforcement: A review and analysis. Journal of the Experimental Analysis of Behavior, 91, 257-286
24. Hackenberg, T. D., & Vaidya, M. (2003). Determinants of pigeons' choices in token-based self-control procedures. Journal of the Experimental Analysis of Behavior, 79, 207-218
25. Hamm, S. L., & Shettleworth, S. J. (1987). Risk aversion in pigeons. Journal of Experimental Psychology: Animal Behavior Processes, 13, 376-383
26. Herrnstein, R. J. (1964). Aperiodicity as a factor in choice. Journal of the Experimental Analysis of Behavior, 7, 179-182
27. Hursh, S. R., & Fantino, E. (1973). Relative delay of reinforcement and choice. Journal of the Experimental Analysis of Behavior, 19, 437-450
28. Ito, M., Takatsuru, S., & Saeki, D. (2000). Choice between constant and variable alternatives by rats: Effects of different reinforcer amounts and energy budgets. Journal of the Experimental Analysis of Behavior, 73, 79-92
29. Iwasa, Y., Higashi, M., & Yamamura, N. (1981). Prey distribution as a factor in determining the choice of optimal foraging strategy. The American Naturalist, 117, 710-723
30. Jackson, K., & Hackenberg, T. D. (1996). Token reinforcement, choice, and self-control in pigeons. Journal of the Experimental Analysis of Behavior, 66, 29-49
31. Kacelnik, A., & Bateson, M. (1996). Risky theories-the effects of variance on foraging decisions. American Zoologist, 36, 402-434
32. Kahneman, D., & Tversky, A. (Eds.). (2000). Choices, values and frames. New York: Cambridge University Press and the Russell Sage Foundation
33. Kendall, S. B. (1989). Risk-taking behavior of pigeons in a closed economy. Psychological Record, 39, 211-220
34. Killeen, P. (1968). On the measurement of reinforcement frequency in the study of preference. Journal of the Experimental Analysis of Behavior, 11, 263-269
35. Lagorio, C. H., & Hackenberg, T. D. (2010). Risky choice in pigeons and humans: A cross-species comparison. Journal of the Experimental Analysis of Behavior, 93, 27-44
36. Leventhal, A. M., Morell, R. F., Morgan, E. J., & Perkins, C. C. (1959). The relation between mean reward and mean reinforcement. Journal of Experimental Psychology, 59, 284-287
37. Locey, M. L., & Dallery, J. (2009). Isolating behavioral mechanisms of intertemporal choice: Nicotine effects on delay discounting and amount sensitivity. Journal of the Experimental Analysis of Behavior, 91, 213-223
38. Locey, M. L., Pietras, C. J., & Hackenberg, T. D. (2009). Human risky choice: Delay sensitivity depends on reinforcer type. Journal of Experimental Psychology: Animal Behavior Processes, 35, 15-22
39. Logan, F. A. (1965). Decision making by rats: Uncertain outcome choices. Journal of Comparative Physiological Psychology, 59, 246-251
40. Madden, G. J., Ewan, E. E., & Lagorio, C. H. (2007). Toward an animal model of gambling: Delay discounting and the allure of unpredictable outcomes. Journal of Gambling Studies, 23, 63-83
41. Madden, G. J., & Hartman, E. C. (2006). A steady-state test of the demand curve analysis of relative reinforcer efficacy. Experimental and Clinical Psychopharmacology, 14, 79-86
42. Mazur, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436
43. Mazur, J. E. (1986). Fixed and variable ratios and delays: Further tests of an equivalence rule. Journal of Experimental Psychology: Animal Behavior Processes, 12, 116-124
44. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analysis of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 55-73). Hillsdale, NJ: Erlbaum
45. Mazur, J. E. (1989). Theories of probabilistic reinforcement. Journal of the Experimental Analysis of Behavior, 51, 87-99
46. Mazur, J. E. (1995). Conditioned reinforcement and choice with delayed and uncertain primary reinforcers. Journal of the Experimental Analysis of Behavior, 63, 139-150
47. Mazur, J. E. (1996). Choice with certain and uncertain reinforcers in an adjusting-delay procedure. Journal of the Experimental Analysis of Behavior, 66, 63-73
48. Mazur, J. E. (2001). Hyperbolic value addition and general models of animal choice. Psychological Review, 108, 96-112
49. Mazur, J. E. (2004). Risky choice: Selecting between certain and uncertain outcomes. Behavior Analyst Today, 5, 190-203
50. Menlove, R. L., Inden, H. M., & Madden, E. G. (1979). Preference for fixed over variable access to food. Animal Learning and Behavior, 7, 499-503
51. Navarick, D. J., & Fantino, E. (1975). Stochastic transitivity and the unidimensional control of choice. Learning and Motivation, 6, 179-201
52. Paulsen, D. J., Platt, M. L., Huettel, S. A., & Brannon, E. M. (2011). Decision-making under risk in children, adolescents, and young adults. Frontiers in Psychology, 2, 1-6
53. Pietras, C. J., & Hackenberg, T. D. (2005). Response-cost punishment via token loss with pigeons. Behavioral Processes, 69, 343-356
54. Potenza, M. N. (2009). The importance of animal models of decision-making, gambling and related behaviors: Implications for translational research in addiction. Neuropsychopharmacology, 34, 2623-2624
55. Raiff, B. R., Bullock, C. E., & Hackenberg, T. D. (2008). Response-cost punishment with pigeons: further evidence of response suppression via token loss. Learning and Behavior, 36, 29-41
56. Real, L. A. (1981). Uncertainty and pollinator-plant interactions: The foraging behavior of bees and wasps on artificial flowers. Ecology, 62, 20-26
57. Reboreda, J. C., & Kacelnik, A. (1991). Risk sensitivity in starlings: Variability in food amount and food delay. Behavioral Ecology, 2, 301-308
58. Reed, D. D., & Martens, B. K. (2011). Temporal discounting predicts student responsiveness to exchange delays in a classroom token system. Journal of Applied Behavior Analysis, 44, 1-18
59. Shafir, S. (2000). Risk-sensitive foraging: The effect of relative variability. Oikos, 88, 663-669
60. Snyderman, M. (1983). Delay and amount of reward in a concurrent chain. Journal of the Experimental Analysis of Behavior, 39, 437-447
61. Spetch, M. L., Belke, T. W., Barnet, R. C., Dunn, R., & Pierce, W. D. (1990). Suboptimal choice in a percentage-reinforcement procedure: Effects of signal condition and terminal-link length. Journal of the Experimental Analysis of Behavior, 53, 219-234
62. Staddon, J. E. R., & Innis, N. K. (1966). Preference for fixed vs. variable amounts of reward. Psychonomic Science, 4, 193-194
63. Stagner, J. P., & Zentall, T. R. (2010). Suboptimal choice behavior by pigeons. Psychonomic Bulletin & Review, 17, 412-416
64. Tarbox, R. S. F., Ghezzi, P. M., & Wilson, G. (2006). The effects of token reinforcement on attending in a young child with autism. Behavioral Interventions, 21, 155-164
65. Waddington, K. D. (1995). Bumblebees do not respond to variance in nectar concentration. Ethology, 101, 33-38
66. Wunderle, J. M., & O'Brien, T. G. (1985). Risk-aversion in hand reared bananaquits. Behavioral Ecology and Sociobiology, 17, 371-380
67. Yankelevitz, R. L., Bullock, C. E., & Hackenberg, T. D. (2008). Reinforcer accumulation in a token-reinforcement context with pigeons. Journal of the Experimental Analysis of Behavior, 90, 283-299
68. Young, J. S. (1981). Discrete-trial choice in pigeons: Effects of reinforcer magnitude. Journal of the Experimental Analysis of Behavior, 35, 23-29
69. Zentall, T. R. (2011). Maladaptive "gambling"by pigeons. Behavioural Processes, 87, 50-56
70. Zentall, T. R., & Stagner, J. (2011). Maladaptive choice behavior by pigeons: an animal analogue and possible mechanism for gambling (sub-optimal human decision-making behavior). Proceedings of the Royal Society: Biological Sciences, 278, 1203-1208