Experience with dynamic reinforcement rates decreases resistance to extinction

Journal of the Experimental Analysis of Behavior

Volumn 105, Issue 2, 2016, Pages 291-306

  Craig, Andrew R ^a   Shahan, Timothy A ^a  

^a UTAH STATE UNIVERSITY   (United States)

Author keywords

Change detection; Dynamic reinforcement schedules; Extinction; Key pecking; Pigeons

Indexed keywords

ANIMAL; INSTRUMENTAL CONDITIONING; PERCEPTIVE DISCRIMINATION; PIGEONS AND DOVES; REINFORCEMENT;

ANIMALS; COLUMBIDAE; CONDITIONING, OPERANT; DISCRIMINATION (PSYCHOLOGY); EXTINCTION, PSYCHOLOGICAL; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE;

EID: 84961256541     PISSN: 00225002     EISSN: 19383711     Source Type: Journal    
DOI: 10.1002/jeab.196     Document Type: Article

References (39)

1. Baum, W. M. (2012). Extinction as discrimination: The molar view. Behavioural Processes, 90, 101-110.
2. Baum, W. M., & Davison, M. (2004). Choice in variable environments: Visit patterns in the dynamics of choice. Journal of the Experimental Analysis of Behavior, 81, 85- 127.
3. Brown, P., & Jenkins, H. M. (1968). Auto-shaping of the pigeon's key peck. Journal of the Experimental Analysis of Behavior, 11, 1-8.
4. Catania, A. C. (1973). The nature of learning. In J. A. Nevin & G. S. Reynolds (Eds.), The study of behavior (pp. 30-68). Glenview, IL: Scott Foresman.
5. Cohen, S. L. (1996). Behavioral momentum of typing behavior in college students. Journal of Behavior Analysis and Therapy, 1, 36-54.
6. Cohen, S. L. (1998). Behavioral momentum: The effects of the temporal separation of rates of reinforcement. Journal of the Experimental Analysis of Behavior, 69, 29-47.
7. Cohen, S. L., Riley, D. S., & Weigle, P. A. (1993). Tests of behavior momentum in simple and multiple schedules with rats and pigeons. Journal of the Experimental Analysis of Behavior, 60, 255-291.
8. Craig, A. R., Cunningham, P. J., & Shahan, T. A. (2015). Behavioral momentum and accumulation of mass in multiple schedules. Journal of the Experimental Analysis of Behavior, 103, 437-449.
9. Craig, A. R., Nevin, J. A., & Odum, A. L. (2014). Behavioral momentum and resistance to change. In F. K. McSweeney, & E. S. Murphy (Eds.), The Wiley-Blackwell handbook of operant and classical conditioning (pp. 249-274). Oxford, UK: Wiley-Blackwell.
10. Davison, M., & Baum, W. M. (2000). Choice in variable environments: Every reinforcer counts. Journal of the Experimental Analysis of Behavior, 74, 1-24.
11. Fleshler, M., & Hoffman, H. S. (1962). A progression for generating variable-interval schedules. Journal of the Experimental Analysis of Behavior, 5, 529-530.
12. Gallistel, C. R. (2012). Extinction from a rationalist perspective. Behavioural Processes, 90, 66-80.
13. Gallistel, C. R., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107, 289-344.
14. Gallistel, C. R., King, A. P., Gottlieb, D., Balci, F., Papachristos, E. B. ... & Carbone, K. S. (2007). Is matching innate? Journal of the Experimental Analysis of Behavior, 87, 161-199.
15. Gallistel, C. R., Mark, T. A., King, A. P., & Latham, P. E. (2001). The rat approximates an ideal detector of changes in rates of reward: Implications for the law of effect. Journal of Experimental Psychology: Animal Behavioral Processes, 27, 354-372.
16. Grace, R. C., & Nevin, J. A. (1997). On the relation between preference and resistance to change. Journal of the Experimental Analysis of Behavior, 67, 43-65.
17. rd ed. ). Oxford, UK: Oxford University Press.
18. Lattal, K. A. (1989). Contingencies on response rate and resistance to change. Learning and Motivation, 20, 191-203.
19. Lattal, K. A., St. Peter, C., & Escobar, R. (2013). Operant extinction: Elimination and generation of behavior. In G. J. Madden, W. V. Dube, T. D. Hackenberg, G. P. Hanley, & K. A. Lattal (Eds.), APA handbook of behavior analysis, Vol. 2: Translating principles into practice (pp. 77-107). Washington, D.C.: American Psychological Association.
20. Lattal, K. M., & Lattal, K. A. (2012). Facets of Pavlovian and operant extinction. Behavioural Processes, 90, 1-8.
21. Mackintosh, N. J. (1974). The psychology of animal learning. London, UK: Academic Press.
22. Mazur, J. E. (1995). Development of preference and spontaneous recovery in choice behavior with concurrent variable-interval schedules. Animal Learning & Behavior, 23, 93-103.
23. Mazur, J. E. (1996). Past experience, recency, and spontaneous recovery in choice behavior. Animal Learning & Behavior, 24, 1-10.
24. Nevin, J. A. (1974). Response strength in multiple schedules. Journal of the Experimental Analysis of Behavior, 21, 389-408.
25. Nevin, J. A. (1992a). An integrative model for the study of behavioral momentum. Journal of the Experimental Analysis of Behavior, 57, 301-316.
26. Nevin, J. A. (1992b). Behavioral contrast and behavioral momentum. Journal of Experimental Psychology: Animal Behavior Processes, 18, 126-133.
27. Nevin, J. A. (2002). Measuring behavioral momentum. Behavioural Processes, 57, 198- 287.
28. Nevin, J. A. (2012a). Behavior theory and information theory: Some parallels. Behavioural Processes, 90, 84-86.
29. Nevin, J. A. (2012b). Resistance to extinction and behavioral momentum. Behavioral Processes, 90, 89-97.
30. Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the law of effect. Behavioral and Brain Sciences, 23, 73-130.
31. Nevin, J. A., & Grace, R. C. (2005). Resistance to extinction in the steady state and in transition. Journal of Experimental Psychology: Animal Behavior Processes, 31, 199-212.
32. Nevin, J. A., Grace, R. C., Holland, S., & McLean, A. P. (2001). Variable-ratio versus variable-interval schedules: Response rate, resistance to change, and preference. Journal of the Experimental Analysis of Behavior, 76, 43-74.
33. Nevin, J. A., Mandell, C., & Atak, J. R. (1983). The analysis of behavioral momentum. Journal of the Experimental Analysis of Behavior, 39, 49-59.
34. Nevin, J. A., McLean, A. P., & Grace, R. C. (2001). Resistance to extinction: Contingency termination and generalization decrement. Animal Learning & Behavior, 29, 176-191.
35. Nevin, J. A., & Shahan, T. A. (2011). Behavioral momentum theory: Equations and applications. Journal of Applied Behavior Analysis, 44, 877-895.
36. Petscher, E. S., & Bailey, J. S. (2008). Comparing main and collateral effects of extinction and differential reinforcement of alternative behavior. Behavior Modification, 32, 468-488.
37. Rescorla, R. A., & Skucy, J. C. (1969). Effect of response-independent reinforcers during extinction. Journal of Comparative and Physiological Psychology, 67, 381-389.
38. Rounder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225-237.
39. Shull, R. L., & Grimes, J. A. (2006). Resistance to extinction following variable-interval reinforcement: Reinforcer rate and amount. Journal of the Experimental Analysis of Behavior, 85, 23-39.