Conditioned reinforcement and response strength

Journal of the Experimental Analysis of Behavior

Volumn 93, Issue 2, 2010, Pages 269-289

  Shahan, Timothy A ^a  

^a UTAH STATE UNIVERSITY   (United States)

Author keywords

Behavioral momentum theory; Choice; Conditioned reinforcement; Means to an end; Observing; Resistance to change; Response strength; Signpost; Token

Indexed keywords

ANIMAL; ARTICLE; DECISION MAKING; INSTRUMENTAL CONDITIONING; LEARNING; PSYCHOLOGICAL THEORY; REINFORCEMENT;

ANIMALS; ASSOCIATION LEARNING; CHOICE BEHAVIOR; CONDITIONING, OPERANT; PSYCHOLOGICAL THEORY; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE;

EID: 77952688422     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2010.93-269     Document Type: Article

References (85)

1. Ahearn, W. H., Clark, K. M., Gardenier, N. C., Chung, B. I., & Dube, W. V. (2003). Persistence of stereotypic behavior: Examining the effects of external reinforcers. Journal of Applied Behavior Analysis, 36, 439-448.
2. Autor, S. M. (1969). The strength of conditioned reinforcers as a function of frequency and probability of reinforcement. In D. P. Hendry (Ed.), Conditioned reinforcement (pp. 127-162). Homewood, IL: Dorsey Press.
3. Baum, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
4. Baum,W.M. (2002).Frommoleculartomolar:A paradigm shift in behavior analysis. Journal of the Experimental Analysis of Behavior, 78, 95-116.
5. Baum, W. M., & Rachlin, H. C. (1969). Choice as time allocation. Journal of the Experimental Analysis of Behavior, 12, 861-874.
6. Berlyne, D. E. (1956). Uncertainty and conflict: A point of contact between information-theory and behaviortherapy concepts. The Psychological Review, 64, 329-339.
7. Bickel, W. K., DeGrandpre, R. J., & Higgins, S. T. (1993). Behavioral economics: A novel experimental approach to the study of drug dependence. Drug and Alcohol Dependence, 33, 173-192.
8. Bolles, R. C. (1961). Is the "click" a token reward? The Psychological Record, 11, 163-168.
9. Bolles, R. C. (1967). Theory of motivation. New York: Harper & Row.
10. nd ed.). New York: Harper & Row.
11. Bouton, M. E. (2007). Learning and behavior: A contemporary synthesis. Sunderland, MA: Sinauer Associates.
12. Branch, M. (1983). Observing observing. Behavioral and Brain Sciences, 6, 705.
13. Case, D. A., Fantino, E., & Wixted, J. (1985). Human observing: Maintained by negative informative stimuli only if correlated with improvement in response efficiency. Journal of the Experimental Analysis of Behavior, 43, 289-300.
14. Case, D. A., Ploog, B. O., & Fantino, E. (1990). Observing behavior in a computer game. Journal of the Experimental Analysis of Behavior, 54, 185-199.
15. Cohen, S. L. (1996). Behavioral momentum of typing behavior in college students. Journal of Behavior Analysis and Therapy, 1, 36-51.
16. Cole, R. P., Barnet, R. C., & Miller, R. R. (1995). Temporal encoding in trace conditioning. Animal Learning & Behavior, 23, 144-153.
17. Cronin, P. B. (1980). Reinstatement of postresponse stimuli prior to reward in delayed-reward discrimination learning by pigeons. Animal Learning & Behavior, 8, 352-358.
18. Davison, M. (1983). Bias and sensitivity to reinforcement in a concurrent-chain schedule. Journal of the Experimental Analysis of Behavior, 40, 15-34.
19. Davison, M., & Baum, W. M. (2000). Choice in a variable environment: Every reinforcer counts. Journal of the Experimental Analysis of Behavior, 74, 1-24.
20. Davison, M., & Baum, W. M. (2006). Do conditional reinforcers count? Journal of the Experimental Analysis of Behavior, 86, 269-283.
21. Dinsmoor, J. A. (1983). Observing and conditioned reinforcement. Behavioral and Brain Sciences, 6, 693-728.
22. Dinsmoor, J. A. (1985). The role of observing and attention in establishing stimulus control. Journal of the Experimental Analysis of Behavior, 43, 365-381.
23. Dinsmoor, J. A., Browne, M. P., & Lawrence, C. E. (1972). A test of the negative stimulus as a reinforcer of observing. Journal of the Experimental Analysis of Behavior, 18, 79-85.
24. Dinsmoor, J. A., Mulvaney, D. E., & Jwaideh, A. R. (1981). Conditioned reinforcement as a function of duration of stimulus. Journal of the Experimental Analysis of Behavior, 36, 41-49.
25. Fantino, E. (1969). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723-730.
26. Fantino, E. (1977). Conditioned reinforcement: Choice and information. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 313-339). Englewood Cliffs, NJ: Prentice-Hall.
27. Fantino, E., & Romanowich, P. (2007). The effects of conditioned reinforcement rate on choice: A review. Journal of the Experimental Analysis of Behavior, 87, 409-421.
28. Gallistel, C. R., & Gibbon, J. (2002). The symbolic foundations of conditioned behavior. Mahwah, NJ: Lawrence Erlbaum Associates.
29. Gibbon, J., & Balsam, P. (1981). Spreading association in time. In C. M. Locurto, H. S. Terrace & J. Gibbon (Eds.), Autoshaping and conditioning theory (pp. 219-253). New York: Academic Press.
30. Gollub, L. (1977). Conditioned reinforcement: Schedule effects. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 288-312). Englewood Cliffs, NJ: Prentice-Hall.
31. Grace, R. C. (1994). A contextual model of concurrent-chains choice. Journal of the Experimental Analysis of Behavior, 61, 113-129.
32. Grace, R. C., & Nevin, J. A. (1997). On the relation between preference and resistance to change. Journal of the Experimental Analysis of Behavior, 67, 43-65.
33. Griffiths, R. R., Bigelow, G. E., & Henningfield, J. E. (1980). Similarities in animal and human drug-taking behavior. In N. K. Mello (Ed.), Advances in substance abuse, Vol. 1 (pp. 1-90). Greenwich, CT: JAI Press.
34. Grimes, J. A., & Shull, R. L. (2001). Response-independent milk delivery enhances persistence of pellet-reinforced lever pressing by rats. Journal of the Experimental Analysis of Behavior, 76, 179-194.
35. Hackenberg, T. D. (2009). Token reinforcement: A review and analysis. Journal of the Experimental Analysis of Behavior, 91, 257-286.
36. Harper, D. N. (1999). Drug-induced changes in responding are dependent on baseline stimulus-reinforcer contingencies. Psychobiology, 27, 95-104.
37. Hendry, D. P. (1969). Conditioned reinforcement. Home-wood, Ill: The Dorsey Press.
38. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267-272.
39. Herrnstein, R. J. (1964). Secondary reinforcement and rate of primary reinforcement. Journal of the Experimental Analysis of Behavior, 7, 27-36.
40. Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243-266.
41. Hursh, S. R. (1991). Behavioral economics of drug self-administration and drug abuse policy. Journal of the Experimental Analysis of Behavior, 56, 377-393.
42. Igaki, T., & Sakagami, T. (2004). Resistance to change in goldfish. Behavioural Processes, 66, 139-152.
43. Kelleher, R. T., & Gollub, L. R. (1962). A review of positive conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 5, 543-597.
44. Killeen, P. R. (1982). Incentive theory. In H. E. Howe & D. J. Bernstein (Eds.), Nebraska Symposium on Motivation, Volume 29 (pp. 169-216). Lincoln, NE: University of Nebraska Press.
45. Krägeloh, C. U., Davison, M., & Elliffe, D. M. (2005). Local preference in concurrent schedules: The effects of reinforcer sequences. Journal of the Experimental Analysis of Behavior, 84, 37-64.
46. Lieberman, D. A., Cathro, J. S., Nichol, K., & Watson, E. (1997). The role of S- in human observing behavior: Bad news is sometimes better than no news. Learning and Motivation, 28, 20-42.
47. Longstreth, L. E. (1971). A cognitive interpretation of secondary reinforcement. In J. K. Cole (Ed.), Nebraska Symposium on Motivation, Vol. 19 (pp. 33-81). Lincoln, NE: University of Nebraska Press.
48. Mace, F. C., Lalli, J. S., Shea, M. C., Lalli, E. P., West, B. J., Roberts, M., & Nevin, J. A. (1990). The momentum of human behavior in a natural setting. Journal of the Experimental Analysis of Behavior, 54, 163-172.
49. Mackintosh, N. J. (1974). The psychology of animal learning. Academic Press: London.
50. Mazur, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436.
51. Mazur, J. E. (1999). Preferences for and against stimuli paired with food. Journal of the Experimental Analysis of Behavior, 72, 21-32.
52. Mazur, J. E. (2001). Hyperbolic value addition and general models of animal choice. Psychological Review, 108, 96-112.
53. Mazur, J. E. (2006). Learning and behavior (Sixth Edition). Upper Saddle River, NJ: Prentice Hall.
54. Mulvaney, D. E., Dinsmoor, J. A., Jwaideh, A. R., & Hughes, L. H. (1974). Punishment of observing by the negative discriminative stimulus. Journal of the Experimental Analysis of Behavior, 21, 37-44.
55. Nevin, J. A. (1973). Conditioned reinforcement. In J. A. Nevin (Ed.), The study of behavior: Learning, motivation, emotion, and instinct (pp. 154-198). Glenview, Ill: Scott, Foresman and Company.
56. Nevin, J. A. (1974). Response strength in multiple schedules. Journal of the Experimental Analysis of Behavior, 21, 389-408.
57. Nevin, J. A. (1992). An integrative model for the study of behavioral momentum. Journal of the Experimental Analysis of Behavior, 57, 301-316.
58. Nevin, J. A. (2002). Measuring behavioral momentum. Behavioural Processes, 57, 187-198.
59. Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the law of effect. Behavioral and Brain Sciences, 23, 73-130.
60. Nevin, J. A., & Grace, R. C. (2005). Resistance to change in the steady state and in transition. Journal of Experimental Psychology: Animal Behavior Processes, 31, 199-212.
61. Nevin, J. A., Mandell, C., & Yarensky, P. (1981). Response rate and resistance to change in chained schedules. Journal of Experimental Psychology: Animal Behavior Processes, 7, 278-294.
62. Nevin, J. A., Tota, M. E., Torquato, R. D., & Shull, R. L. (1990). Alternative reinforcement increases resistance to change: Pavlovian or operant contingencies? Journal of the Experimental Analysis of Behavior, 53, 359-379.
63. Perone, M., & Baron, A. (1980). Reinforcement of human observing behavior by a stimulus correlated with extinction or increased effort. Journal of the Experimental Analysis of Behavior, 34, 239-261.
64. Perone, M., & Kaminski, B. J. (1992). Conditioned reinforcement of human observing behavior by descriptive and arbitrary verbal stimuli. Journal of the Experimental Analysis of Behavior, 58, 557-575.
65. Rachlin, H. (1976). Behavior and learning. San Francisco, CA: W. H. Freeman and Company.
66. Rachlin, H., Battalio, R., Kagel, J., & Green, L. (1981). Maximization theory in behavioral psychology. The Behavioral and Brain Sciences, 4, 371-417.
67. Rachlin, H., Green, L., Kagel, J. H., & Battalio, R. (1976). Economic demand theory and psychological studies of choice. In G. Bower (Ed.), The Psychology of Learning and Motivation, Vol. 10 (pp. 129-154). New York: Academic Press.
68. Schuster, R. H. (1969). A functional analysis of conditioned reinforcement. In D. P. Hendry (Ed.), Conditioned reinforcement (pp. 192-235). Homewood, IL: The Dorsey Press.
69. Shahan, T. A., & Burke, K. A. (2004). Ethanol-maintained responding of rats is more resistant to change in a context with added non-drug reinforcement. Behavioural Pharmacology, 15, 279-285.
70. Shahan, T. A., & Jimenez-Gomez, C. (2006). Effects of self-administered alcohol concentration on the frequency and persistence of rats' attending to alcohol cues. Behavioural Pharmacology, 17, 201-211.
71. Shahan, T. A., Magee, A., & Dobberstein, A. (2003). The resistance to change of observing. Journal of the Experimental Analysis of Behavior, 80, 273-293.
72. Shahan,T.A.,&Podlesnik,C.A. (2005).Rateof conditioned reinforcement affects observing rate but not resistance to change. Journal of the Experimental Analysis of Behavior, 84, 1-17.
73. Shahan, T. A., & Podlesnik, C. A. (2008a). Conditioned reinforcement value and resistance to change. Journal of the Experimental Analysis of Behavior, 89, 263-298.
74. Shahan, T. A., & Podlesnik, C. A. (2008b). Quantitative analyses of observing and attending. Behavioural Processes, 78, 145-157.
75. Shahan, T. A., Podlesnik, C. A., & Jimenez-Gomez, C. (2006). Matching and conditioned reinforcement rate. Journal of the Experimental Analysis of Behavior, 85, 167-180.
76. Squires, N., & Fantino, E. (1971). A model for choice in simple concurrent and concurrent-chains schedules. Journal of the Experimental Analysis of Behavior, 15, 27-38.
77. Staddon, J. E. R. (1983). Adaptive behavior and learning. New York: Cambridge University Press.
78. Vaughan, W. Jr (1985). Choice: A local analysis. Journal of the Experimental Analysis of Behavior, 43, 383-405.
79. Wike, E. L. (1966). Secondary reinforcement: Selected experiments. New York: Harper & Row.
80. Williams, B. A. (1988). Reinforcement, choice, and response strength. In R. C. Atkinson, R. J. Herrnstein, G. Lindzey & R. D. Luce (Eds.), Stevens' handbook of experimental psychology, Vol. 2 (pp. 167-244). New York: Wiley.
81. Williams, B. A. (1994a). Conditioned reinforcement: Neglected or outmoded explanatory construct? Psychonomic Bulletin & Review, 1, 457-475.
82. Williams, B. A. (1994b). Conditioned reinforcement: Experimental and theoretical issues. The Behavior Analyst, 17, 261-285.
83. Williams, B. A., & Dunn, R. (1991). Preference for conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 55, 37-46.
84. Wolfe, J. B. (1936). Effectiveness of token-rewards for chimpanzees. Comparative Psychology Monographs, 12,1-72.
85. Wyckoff, L. B. Jr. (1952). The role of observing responses in discrimination learning: Part 1. Psychological Review, 59, 431-442.