The effects of delayed reinforcement on variability and repetition of response sequences

Journal of the Experimental Analysis of Behavior

Volumn 86, Issue 2, 2006, Pages 159-179

  Odum, Amy L ^a   Ward, Ryan D ^a   Barnes, Christopher A ^b   Burke, K Anne ^a  

^a UTAH STATE UNIVERSITY   (United States)

^b UNIVERSITY OF NEW HAMPSHIRE   (United States)

Author keywords

Key peck; Multiple schedule; Operant; Pigeon; Repetition; Resistance to change; Stereotypy; Variability

Indexed keywords

ANIMAL; ARTICLE; COLOR VISION; INSTRUMENTAL CONDITIONING; LEARNING; ORIENTATION; PIGEONS AND DOVES; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT; STEREOTYPY;

ANIMALS; COLOR PERCEPTION; COLUMBIDAE; CONDITIONING, OPERANT; EXTINCTION, PSYCHOLOGICAL; ORIENTATION; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT SCHEDULE; SERIAL LEARNING; STEREOTYPED BEHAVIOR;

EID: 33748944016     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2006.58-05     Document Type: Article

References (42)

1. Blough, D. S. (1966). The reinforcement of least-frequent interresponse times. Journal of the Experimental Analysis of Behavior, 9, 581-591.
2. Brown, P. L., & Jenkins, H. M. (1968). Auto-shaping of the pigeon's key-peck. Journal of the Experimental Analysis of Behavior, 11, 1-8.
3. Catania, A. C., & Reynolds, G. S. (1968). A quantitative analysis of the responding maintained by interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 11, 327-383.
4. Cherot, C., Jones, A., & Neuringer, A. (1996). Reinforced variability decreases with approach to reinforcers. Journal of Experimental Psychology: Animal Behavior Processes, 22, 497-508.
5. Cohen, L., Neuringer, A., & Rhodes, D. (1990). Effects of ethanol on reinforced variations and repetitions by rats under a multiple schedule. Journal of the Experimental Analysis of Behavior, 54, 1-12.
6. Denney, J., & Neuringer, A. (1998). Behavioral variability is controlled by discriminative stimuli. Animal Learning & Behavior, 26, 154-162.
7. Doughty, A. H., & Lattal, K. A. (2001). Resistance to change of operant variation and repetition. Journal of the Experimental Analysis of Behavior, 76, 195-216.
8. Ferster, C. B. (1953). Sustained behavior under delayed reinforcement. Journal of Experimental Psychology, 45, 218-224.
9. Gallistel, C. R. (1990). The organization of learning (pp. 317-350). Cambridge, MA: MIT Press.
10. Goetz, E. M., & Baer, D. M. (1973). Social control of form diversity and the emergence of new forms in children's blockbuilding. Journal of Applied Behavior Analysis, 6, 209-217.
11. Grunow, A., & Neuringer, A. (2002). Learning to vary and varying to learn. Psychonomic Bulletin and Review, 9, 250-258.
12. Harper, D. N., & McLean, A. P. (1992). Resistance to change and the law of effect. Journal of the Experimental Analysis of Behavior, 57, 317-337.
13. Lattal, K. A. (1984). Signal functions in delayed reinforcement. Journal of the Experimental Analysis of Behavior, 42, 239-253.
14. Lattal, K. A. (1987). Considerations in the experimental analysis of reinforcement delay. In M. L. Commons & J. E. Mazur (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 107-123). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
15. Machado, A. (1989). Operant conditioning of behavioral variability using a percentile reinforcement schedule. Journal of the Experimental Analysis of Behavior, 52, 155-166.
16. Machado, A. (1997). Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. Journal of the Experimental Analysis of Behavior, 68, 1-25.
17. Miller, G. A., & Frick, F. C. (1949). Statistical behavioristics and sequences of responses. Psychological Review, 56, 311-324.
18. Miller, N., & Neuringer, A. (2000). Reinforcing variability in adolescents with autism. Journal of Applied Behavior Analysis, 33, 151-165.
19. Morgan, L., & Neuringer, A. (1990). Behavioral variability as a function of response topography and reinforcement contingency. Animal Learning & Behavior, 18, 257-263.
20. Neuringer, A. (1991). Operant variability and repetition as functions of interresponse time. Journal of Experimental Psychology: Animal Behavior Processes, 17, 3-12.
21. Neuringer, A. (1992). Choosing to vary and repeat. Psychological Science, 3, 246-250.
22. Neuringer, A. (2002). Operant variability: Evidence, functions, and theory. Psychonomic Bulletin & Review, 9, 672-705.
23. Neuringer, A. (2004). Reinforced variability in animals and people. American Psychologist, 59, 891-906.
24. Neuringer, A., Kornell, N., & Olufs, M. (2001). Stability and variability in extinction. Journal of Experimental Psychology: Animal Behavior Processes, 27, 79-94.
25. Nevin, J. A. (1973). The maintenance of behavior. In J. A. Nevin & G. S. Reynolds (Eds.), The study of behavior Learning, motivation, emotion, and instinct (pp. 201-236). Glenview, IL: Scott, Foresman.
26. Nevin, J. A. (1974). Response strength in multiple schedules. Journal of the Experimental Analysis of Behavior, 21, 389-408.
27. Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the Law of Effect. Behavioral and Brain Sciences, 23, 73-130.
28. Page, S., & Neuringer, A. (1985). Variability is an operant. Journal of Experimental Psychology: Animal Behavior Processes, 11, 429-452.
29. Pierce, C. H., Hanford, P. V., & Zimmerman, J. (1972). Effects of different delay of reinforcement procedures on variable-interval responding. Journal of the Experimental Analysis of Behavior, 19, 141-146.
30. Pryor, K. W., Haag, R., & O'Reilly, J. (1969). The creative porpoise: Training for novel behavior. Journal of the Experimental Analysis of Behavior, 12, 653-661.
31. Richards, R. W. (1981). A comparison between signaled and unsignaled delay of reinforcement. Journal of the Experimental Analysis of Behavior, 35, 145-152.
32. Schaal, D. W., & Branch, M. N. (1988). Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement. Journal of the Experimental Analysis of Behavior, 50, 33-54.
33. Schaal, D. W., & Branch, M. N. (1990). Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: Effects of delay signal duradon. Journal of the Experimental Analysis of Behavior, 53, 103-21.
34. Schaal, D. W., Shahan, T. A., Kovera, C. A., & Reilly, M. P. (1998). Mechanisms underlying the effects of unsignaled delayed reinforcement on key pecking of pigeons under variable-interval schedules. Journal of the Experimental Analysis of Behavior, 69, 103-122.
35. Schneider, S. M. (1990). The role of contiguity in free-operant unsignaled delay of positive reinforcement: A brief review. The Psychological Record, 40, 239-257.
36. Shahan, T. A., & Lattal, K. A. (2005). Unsignaled delay of reinforcement, relative time, and resistance to change. Journal of the Experimental Analysis of Behavior, 83, 201-219.
37. Sizemore, O. J., & Lattal, K. A. (1977). Dependency, temporal contiguity, and response-independent reinforcement. Journal of the Experimental Analysis of Behavior, 25, 119-125.
38. Sizemore, O. J., & Lattal, K. A. (1978). Unsignaled delay of reinforcement in variable-interval schedules. Journal of the Experimental Analysis of Behavior, 30, 169-175.
39. Stokes, P. D., Mechner, F., & Balsam, P. D. (1999). Effects of different acquisition procedures on response variability. Animal Learning & Behavior, 27, 28-41.
40. van Hest, A., van Haaren, F., & van de Poll, N. E. (1989). Operant conditioning of response variability in male and female Wistar rats. Physiology & Behavior, 45, 551-555.
41. Wagner, K., & Neuringer, A. (in press). Operant variability when reinforcement is delayed. Learning & Behavior.
42. Williams, B. A. (1976). The effects of unsignalled delayed reinforcement. Journal of the Experimental Analysis of Behavior, 26, 441-449.