Second-order schedules of token reinforcement with pigeons: Effects of fixed- and variable-ratio exchange schedules

Journal of the Experimental Analysis of Behavior

Volumn 76, Issue 2, 2001, Pages 159-178

  Foster, Theresa A ^a   Hackenberg, Timothy D ^a   Vaidya, Manish ^b  

^a UNIVERSITY OF FLORIDA   (United States)

^b NONE

Author keywords

Behavioral units; Fixed ratio schedules; Key peck; Pigeons; Second order schedules; Token reinforcement; Variable ratio schedules

Indexed keywords

ANIMAL; ANIMAL BEHAVIOR; ARTICLE; DISCRIMINATION LEARNING; MALE; PIGEONS AND DOVES; REINFORCEMENT;

ANIMALS; BEHAVIOR, ANIMAL; COLUMBIDAE; DISCRIMINATION LEARNING; MALE; REINFORCEMENT SCHEDULE; TOKEN ECONOMY;

EID: 0035460277     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2001.76-159     Document Type: Article

References (50)

1. Baron, A., & Herpolsheimer, L. R. (1999). Averaging effects in the study of fixed-ratio response patterns. Journal of the Experimental Analysis of Behavior, 71, 145-153.
2. Blakely, E., & Schlinger, H. (1988). Determinants of pausing under variable-ratio schedules: Reinforcer magnitude, ratio size, and schedule configuration. Journal of the Experimental Analysis of Behavior, 50, 65-73.
3. Boakes, R. A., Poli, M., Lockwood, M. J., & Goodall, G. (1978). A study of misbehavior: Token reinforcement in the rat. Journal of the Experimental Analysis of Behavior, 29, 115-134.
4. Breland, K., & Breland, M. (1961). The misbehavior of organisms. American Psychologist, 16, 681-684.
5. Castro, B., & Weingarten, K. (1970). Toward experimental economics. Journal of Political Economy, 78, 598-607.
6. Catania, A. C. (1998). Learning. Upper Saddle River, NJ: Prentice Hall.
7. Cowles, J. T. (1937). Food-tokens as incentives for learning by chimpanzees. Comparative Psychological Monographs, 12, 1-96.
8. Davison, M. C. (1969). Successive interresponse times in fixed-ratio and second-order fixed-ratio performance. Journal of the Experimental Analysis of Behavior, 12, 385-389.
9. Duncan, B., & Fantino, E. (1970). Choice for periodic schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 14, 73-86.
10. Ellson, D. G. (1937). The acquisition of a token reward habit in dogs. Journal of Comparative Psychology, 24, 504-522.
11. Fantino, E. (1967). Preference for mixed-versus fixed-ratio schedules. Journal of the Experimental Analysis of Behavior, 10, 35-43.
12. Felton, M., & Lyon, D. O. (1966). The post-reinforcement pause. Journal of the Experimental Analysis of Behavior, 9, 131-134.
13. Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. New York: Appleton-Century-Crofts.
14. Field, D. P., Tonneau, F., Ahearn, W., & Hineline, P. N. (1996). Preference between variable-ratio and fixed-ratio schedules: Local and extended relations. Journal of the Experimental Analysis of Behavior, 66, 283-295.
15. Findley, J. D. (1962). An experimental outline for building and exploring multi-operant behavior repertoires. Journal of the Experimental Analysis of Behavior, 5, 113-166.
16. Findley, J. D., & Brady, J. V. (1965). Facilitation of large ratio performance by use of conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 8, 125-129.
17. Gollub, L. R. (1977). Conditioned reinforcement: Schedule effects. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 288-312). Englewood Cliffs, NJ: Prentice Hall.
18. Jackson, K. J., & Hackenberg, T. D. (1996). Token reinforcement, choice, and self-control in pigeons. Journal of the Experimental Analysis of Behavior, 66, 29-49.
19. Jwaideh, A. R. (1973). Responding under chained and tandem fixed-ratio schedules. Journal of the Experimental Analysis of Behavior, 19, 259-267.
20. Kagel, J. H. (1972). Token economies and experimental economics. Journal of Political Economy, 80, 779-785.
21. Kagel, J. H., & Winkler, R. C. (1972). Behavioral economics: Areas of cooperative research between economics and behavior analysis. Journal of Applied Behavior Analysis, 5, 335-342.
22. Kazdin, A. E. (1977). The token economy: A review and evaluation. New York: Plenum Press.
23. Kelleher, R. T. (1956). Intermittent conditioned reinforcement in chimpanzees. Science, 124, 679-680.
24. Kelleher, R. T. (1957a). Conditioned reinforcement in chimpanzees. Journal of Comparative and Physiological Psychology, 50, 571-575.
25. Kelleher, R. T. (1957b). A multiple schedule of conditioned reinforcement with chimpanzees. Psychological Reports, 3, 485-491.
26. Kelleher, R. T. (1958). Fixed-ratio schedules of conditioned reinforcement with chimpanzees. Journal of the Experimental Analysis of Behavior, 1, 281-289.
27. Kelleher, R. T. (1966). Chaining and conditioned reinforcement. In W. K. Honig (Ed.), Operant behavior: Areas of research and application (pp. 160-212). New York: Appleton-Century-Crofts.
28. Kintsch, W. (1965). Frequency distribution of interresponse times during VI and VR reinforcement. Journal of the Experimental Analysis of Behavior, 8, 347-352.
29. Lea, S. E. G. (1978). The psychology and economics of demand. Psychological Bulletin, 85, 441-466.
30. Lea, S. E. G., Tarpy, R. M., & Webley, P. (1987). The individual in the economy. New York: Cambridge University Press.
31. Lee, J. K., & Gollub, L. R. (1971). Second-order schedules with fixed-ratio components: Variation of component size. Journal of the Experimental Analysis of Behavior, 15, 303-310.
32. Malagodi, E. F. (1967a). Acquisition of the token-reward habit in the rat. Psychological Reports, 20, 1335-1342.
33. Malagodi, E. F. (1967b). Fixed-ratio schedules of token reinforcement. Psychonomic Science, 8, 469-470.
34. Malagodi, E. F. (1967c). Second-order chained and tandem schedules of token-reinforcement in the rat. Unpublished doctoral dissertation. University of Miami.
35. Malagodi, E. F. (1967d). Variable-interval schedules of token reinforcement. Psychonomic Science, 8, 471-472.
36. Marr, M. J. (1979). Second-order schedules and the generation of unitary response sequences. In M. D. Zeiler & P. Harzem (Eds.), Advances in the analysis of behaviour: Vol. 1. Reinforcement and the organization of behaviour (pp. 223-260). Chichester, England: Wiley.
37. Mazur, J. E. (1983). Steady-state performance on fixed, mixed, and random-ratio schedules. Journal of the Experimental Analysis of Behavior, 39, 293-307.
38. Midgley, M., Lea, S. E. G., & Kirby, R. M. (1989). Algorithmic shaping and misbehavior in the acquisition of token deposit by rats. Journal of the Experimental Analysis of Behavior, 52, 27-40.
39. Powell, R. W. (1968). The effects of small sequential changes in fixed-ratio size upon the post-reinforcement pause. Journal of the Experimental Analysis of Behavior, 11, 589-593.
40. Schwartz, B., & Gamzu, E. (1977). Pavlovian control of operant behavior: An analysis of autoshaping and its implications for operant conditioning. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 53-97). Englewood Cliffs, NJ: Prentice Hall.
41. Smith, M. F. (1939). The establishment and extinction of the token-reward habit in the cat. Journal of General Psychology, 20, 475-486.
42. Stubbs, D. A. (1971). Second-order schedules and the problem of conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 16, 289-313.
43. Waddell, T. R., Leander, J. D., Wehbe, F. M., & Malagodi, E. F. (1972). Schedule interactions in second-order fixed-interval (fixed-ratio) schedules of token reinforcement. Learning and Motivation, 3, 91-100.
44. Webbe, F. M., & Malagodi, E. F. (1978). Second-order schedules of token reinforcement: Comparisons of performance under fixed-ratio and variable-ratio exchange schedules. Journal of the Experimental Analysis of Behavior, 30, 219-224.
45. Winkler, R. C. (1971). The relevance of economic theory and technology to token reinforcement systems. Behavior Research and Therapy, 9, 81-88.
46. Winkler, R. C. (1980). Behavioral economics, token economies, and applied behavior analysis. In J. E. R. Staddon (Ed.), Limits to action: The allocation of individual behavior (pp. 269-297). New York: Academic Press.
47. Wolfe, J. B. (1936). Effectiveness of token rewards for chimpanzees. Comparative Psychological Monographs, 12, 1-72.
48. Zeiler, M. D. (1977). Schedules of reinforcement: The controlling variables. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 201-232). Englewood Cliffs, NJ: Prentice Hall.
49. Zeiler, M. D. (1999). Reversed schedule effects in closed and open economies. Journal of the Experimental Analysis of Behavior, 71, 171-186.
50. Zimmerman, J., & Ferster, C. B. (1964). Chained VI performance of pigeons maintained with an added stimulus. Journal of the Experimental Analysis of Behavior, 7, 83-89.