Schedules of reinforcement: The controlling variables

Handbook of Operant Behavior

Volumn , Issue , 2022, Pages 201-232

  Zeiler, Michael ^a  

^a EMORY UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84985076247     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781003256670-9     Document Type: Chapter

References (100)

1. Alleman, H. D., & Platt, J. R. Differential reinforcement of interresponse times with controlled probability of reinforcement per response. Learning and Motivation, 1973, 4, 40-73.
2. Amsel, A. Partial reinforcement effects on vigor and persistence. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation (Vol. 1). New York: Academic Press, 1967.
3. Anger, D. The dependence of interresponse times upon the relative reinforcement of different interresponse times. Journal of Experimental Psychology, 1956, 52, 145-161.
4. Appel, J. B., & HISS, R. H. The discrimination of contingent from noncontingent reinforcement. Journal of Comparative and Physiological Psychology, 1962, 55, 37-39.
5. Azzi, R., Fix, D. S. R., Keller, F. S., & Rocha e Silva, M. I. Exteroceptive control of response under delayed reinforcement. Journal of the Experimental Analysis of Behavior, 1964, 7, 159-162.
6. Berryman, R., & NevIn, J. A. Interlocking schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 1962, 5, 213-223.
7. Blough, D. S. Interresponse time as a function of continuous variables: A new method and some data. Journal of the Experimental Analysis of Behavior, 1963, 6, 237-246.
8. Blough, D. S. The reinforcement of least-frequent interresponse times. Journal of the Experimental Analysis of Behavior, 1966, 9, 581-591.
9. Blough, P. M., & Blough, D. S. The distribution of interresponse times in the pigeon during variable-interval reinforcement. Journal of the Experimental Analysis of Behavior, 1968, 11, 23-27.
10. Boren, J. J. Resistance to extinction as a function of the fixed ratio. Journal of Experimental Psychology, 1961, 61, 304-308.
11. Catania, A. C. Reinforcement schedules and psychophysical judgments: A study of some temporal properties of behavior. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules. Englewood Cliffs, N. J.: Prentice-Hall, Inc., 1970.
12. Catania, A. C. Reinforcement schedules: The role of responses preceding the one that produces the reinforcer. Journal of the Experimental Analysis of Behavior, 1971, 15, 271-287.
13. Catania, A. C, & Reynolds, G. S. A quantitative analysis of the responding maintained by interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 1968, 11, 327-383.
14. Crossman, E. K., Heaps, R. S., Nunes, D. L., & Alferink, L. A. The effects of number of responses on pause length with temporal variables controlled. Journal of the Experimental Analysis of Behavior, 1974, 22, in press.
15. Cumming, W. W., & Schoenfeld, W. N. Behavior under extended exposure to a high-value fixed interval reinforcement schedule. Journal of the Experimental Analysis of Behavior, 1958, 1, 245-263.
16. Day, R. B., & Platt, J. R. Several tests of the response-unit hypothesis of extinction. Paper read at the meeting of the Psychonomic Society, 1972.
17. DeCasper, A. J., & Zeiler, M. D. Time limits for completing fixed ratios, III: Stimulus variables. Journal of the Experimental Analysis of Behavior, 1974, 22, 285-300.
18. Denny, M. R., Wells, R. H., & Maatsch, J. L. Resistance to extinction as a function of the discrimination habit established during fixed-ratio reinforcement. Journal of Experimental Psychology, 1957, 6, 451-456.
19. Dews, P. B. Free-operant behavior under conditions of delayed reinforcement, 1: CRF-type schedules. Journal of the Experimental Analysis of Behavior, 1960, 3, 221-234.
20. A periods on responding on a fixed-interval schedule. Journal of the Experimental Analysis of Behavior, 1962, 6, 369-374.
21. Dews, P. B. Behavioral effects of drugs. In S. M. Farber & R. H. L. Wilson (Eds.), Conflict and creativity. New York: McGraw-Hill, 1963.
22. A periods on responding on a fixed-interval schedule, II: In a primate. Journal of the Experimental Analysis of Behavior, 1965, 8, 53-54.
23. A periods on responding on a fixed-interval schedule, III: Effects of changes in pattern of interruptions, parameters, and stimuli. Journal of the Experimental Analysis of Behavior, 1965, 8, 427-435.
24. D probes. Journal of the Experimental Analysis of Behavior, 1966, 9, 147-151.
25. A periods on responding on a fixed-interval schedule, V: Effects of periods of complete darkness and of occasional omissions of food presentations. Journal of the Experimental Analysis of Behavior, 1966, 9, 573-578.
26. Dews, P. B. Studies on responding under fixed-interval schedules of reinforcement: The effects on the pattern of responding of changes in requirements at reinforcement. Journal of the Experimental Analysis of Behavior, 1969, 12, 191-199.
27. Dews, P. B. The theory of fixed-interval responding. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1970.
28. Farmer, J., & Schoenfeld, W. N. Varying temporal placement of an added stimulus in a fixed-interval schedule. Journal of the Experimental Analysis of Behavior, 1966, 9, 369-375.
29. Felton, M., & Lyon, D. O. The post-reinforcement pause. Journal of the Experimental Analysis of Behavior, 1966, 9, 131-134.
30. Ferster, C. B. Sustained behavior under delayed reinforcement. Journal of Experimental Psychology, 1953, 45, 218-224.
31. Ferster, C. B., & Hammer, C. Variables determining the effects of delay in reinforcement. Journal of the Experimental Analysis of Behavior, 1965, 8, 243-254.
32. Ferster, C. B., & Perrott, M. C. Behavior principles. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1968.
33. Ferster, C. B., & Skinner, B. F. Schedules of reinforcement. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1957.
34. Findley, J. D. An experimental outline for building and exploring multioperant behavior repertoires. Journal of the Experimental Analysis of Behavior, 1962, 5, 113-116.
35. Gott, C. T., & Weiss, B. The development of fixed-ratio performance under the influence of ribonucleic acid. Journal of the Experimental Analysis of Behavior, 1972, 18, 481-497.
36. Hamilton, E. L. The effect of delayed incentive on the hunger drive in the white rat. Genetic Psychology Monographs, 1929, 5, 131-207.
37. Harvey, J. A. Behavior analysis of drug action. Glenview, 111.: Scott, Foresman, 1971.
38. Hawkes, L., & Shimp, C. P. Choice between response rates. Journal of the Experimental Analysis of Behavior, 1974, 21, 109-115.
39. Herrnstein, R. J. Superstition: A corollary of the principles of operant conditioning. In W. K. Honig (Ed.), Operant behavior: Areas of research and application. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1966.
40. Herrnstein, R. J., & Morse, W. H. Some effects of response-independent positive reinforcement on maintained operant behavior. Journal of Comparative and Physiological Psychology, 1957, 50, 461-467.
41. Herrnstein, R. J., & Morse, W. H. A conjunctive schedule of reinforcement. Journal of the Experimental Analysis of Behavior, 1958, 1, 15-24.
42. Hull, C. L. The goal gradient hypothesis and maze learning. Psychological Review, 1932, 39, 25-43.
43. Hull, C. L. A behavior system. New Haven: Yale University Press, 1952.
44. Jenkins, H. M. Sequential organization in schedules of reinforcement. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1970.
45. Kelleher, R. T. Chaining and conditioned reinforcement. In W. K. Honig (Ed.), Operant behavior: areas of research and application. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1966.
46. Kelleher, R. T., Fry, W., & Cook, L. Adjusting fixed-ratio schedules in the squirrel monkey. Journal of the Experimental Analysis of Behavior, 1964, 7, 69-77.
47. Kelleher, R. T., & Morse, W. H. Determinants of the specificity of behavioral effects of drugs. Ergebnisse der Physiologie, 1968, 60, 1-56.
48. Killeen, P. Reinforcement frequency and contingency as factors in fixed-ratio behavior. Journal of the Experimental Analysis of Behavior, 1969, 12, 391-395.
49. Lashley, K. S. The accuracy of movement in the absence of excitation from the moving organ. American Journal of Physiology, 1917, 43, 169-194.
50. Lashley, K. S. The problem of serial order in behavior. In L. A. Jeffress (Ed.), Cerebral mechanisms in behavior. New York: Wiley, 1951.
51. Lee, J. K., & Gollub, L. R. Second-order schedules with fixed-ratio components: Variation of component size. Journal of the Experimental Analysis of Behavior, 1971, 15, 303-310.
52. Malott, R. W., & Cumming, W. W. Schedules of inter-response time reinforcement. Psychological Record, 1964, 74, 211-252.
53. Marr, M. J. Sequence schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 1971, 15, 41-48.
54. McKearney, J. W. Rate-dependent effects of drugs: Modification by discriminative stimuli of the effects of amobar-bitol on schedule-controlled behavior. Journal of Experimental Analysis of Behavior, 1970, 14, 167-175.
55. Morgan, M. J. Fixed interval schedules and delay of reinforcement. Quarterly Journal of Experimental Psychology, 1970, 22, 663-673.
56. Morse, W. H. Intermittent reinforcement. In W. K. Honig (Ed.), Operant behavior: Areas of research and application. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1966.
57. Morse, W. H., & Kelleher, R. T. Schedules as fundamental determinants of behavior. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1970.
58. Morse, W. H., & Skinner, B. F. A second type of "superstition" in the pigeon. American Journal of Psychology, 1957, 70, 308-311.
59. Mowrer, O. H., & Jones, H. Habif strength as a function of the pattern of reinforcement. Journal of Experimental Psychology, 1945, 35, 293-311.
60. Neuringer, A. J. Superstitious key pecking after three peck-produced reinforcements. Journal of the Experimental Analysis of Behavior, 1970, 13, 127-134.
61. Neuringer, A. J., & Schneider, B. A. Separating the effects of interreinforcement time and number of interrein-forcement responses. Journal of the Experimental Analysis of Behavior, 1968, 11, 661-667.
62. Overmann, S. R., & Denny, M. R. The free-operant partial reinforcement effect: A discrimination analysis. Learning and Motivation, 1974, 5, 248-257.
63. Pierce, C. H., Hanford, P. W., & Zimmerman, J. Effects of different delay of reinforcement procedures on variable-interval responding. Journal of the Experimental Analysis of Behavior, 1972, 18, 141-146.
64. Platt, J. R. Percentile reinforcement: Paradigms for experimental analysis of response shaping. In G. H. Bower (Ed.), Psychology of learning and motivation: Advances in research and theory (Vol. 7). New York: Academic Press, 1973.
65. Platt, J. R., & Johnson, D. M. Localization of position within a homogeneous behavior chain: Effects of error contingencies. Learning and Motivation, 1971, 2, 386-414.
66. Pliskoff, S. S., & Goldiamond, I. Some discriminative properties of fixed ratio performance in the pigeon. Journal of the Experimental Analysis of Behavior. 1966, 9, 1-9.
67. Powell, R. W. The effect of small sequential changes in fixed-ratio size upon the post-reinforcement pause. Journal of the Experimental Analysis of Behavior, 1968, 11, 589-593.
68. Randolph, J. J., & Sewell, W. R. A chained adjusting ratio schedule. Psychological Reports, 1968, 22, 989-995.
69. Reynolds, G. S. Discrimination and emission of temporal intervals by pigeons. Journal of the Experimental Analysis of Behavior, 1966, 9, 65-68.
70. Reynolds, G. S., & Catania, A. C. Temporal discrimination in pigeons. Science, 1962, 135, 314-315.
71. Reynolds, G. S., & McLeod, A. On the theory of interre-sponse-time reinforcement. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 4). New York: Academic Press, 1970.
72. Richardson, K. A test of the effectiveness of the differential-reinforcement-of-low-rate schedule. Journal of the Experimental Analysis of Behavior, 1973, 20, 385-391.
73. Richardson, W. K., & Loughead, T. E. Behavior under large values of the differential-reinforcement-of-low-rate schedule. Journal of the Experimental Analysis of Behavior, 1974, 22, 121-129.
74. Rilling, M. E., & McDiarmid, C. G. Signal detection in fixed-ratio schedules. Science, 1965, 148, 526-527.
75. Schneider, B. A two-state analysis of fixed-interval responding in the pigeon. Journal of the Experimental Analysis of Behavior, 1969, 12, 667-687.
76. Schoenfeld, W. N, Cole, B. K., Blaustein, J., Lachter, G. D., Martin, J. M., & Vickery, C. Stimulus schedules: The t-t systems. New York: Harper & Row, 1972.
77. Shimp, C. P. The reinforcement of short interresponse times. Journal of the Experimental Analysis of Behavior. 1967, 10, 425-434.
78. Shimp, C. P. Magnitude and frequency of reinforcement and frequencies of interresponse times. Journal of the Experimental Analysis' of Behavior, 1968, 11, 525-535.
79. Shimp, C. P. The concurrent reinforcement of two interresponse times: The relative frequency of an interresponse time equals its relative harmonic length. Journal of the Experimental Analysis of Behavior, 1969, 12, 403-411.
80. Shimp, C. P. Synthetic variable-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 1973, 19, 311-330.
81. Shull, R. L. The response-reinforcement dependency in fixed-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 1970, 14, 55-60.
82. Shull, R. L. Sequential patterns in post-reinforcement pauses on fixed-interval schedules of food. Journal of the Experimental Analysis of Behavior, 1971, 15, 221-231.
83. Shull, R. L., Guilkey, M., & Witty, W. Changing the response unit from a single peck to a fixed number of pecks in fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 1972, 17, 193-200.
84. Sidman, M. Tactics of scientific research. New York: Basic Books, 1960.
85. Skinner, B. F. The behavior of organisms. New York: Appleton-Century-Crofts, 1938.
86. Skinner, B. F. "Superstition" in the pigeon. Journal of Experimental Psychology, 1948, 38, 168-172.
87. Skinner, B. F. A case history in scientific method. In S. Koch (Ed.), Psychology: A study of a science (Vol. 2). New York, McGraw-Hill, 1959.
88. Spence, K. W. Behavior theory and conditioning. New Haven: Yale University Press, 1956.
89. Staddon, J. E. R. Some properties of spaced responding in pigeons. Journal of the Experimental Analysis of Behavior, 1965, 8, 19-27.
90. Staddon, J. E. R. Asymptotic behavior: The concept of the operant. Psychological Review, 1967, 74, 377-391.
91. Staddon, J. E. R. Temporal effects of reinforcement: A negative "frustration" effect. Learning and Motivation, 1970, 1, 227-247.
92. Staddon, J. E. R. Reinforcement omission on temporal go-no-go schedules. Journal of the Experimental Analysis of Behavior, 1972, 18, 223-229.
93. Stubbs, A. The discrimination of stimulus duration by pigeons. Journal of the Experimental Analysis of Behavior, 1968, 11, 223-238.
94. Taub, E., & Berman, A. J. Movement and learning in the absence of sensory feedback. In S. J. Freedman (Ed.), The neuropsychology of spatially oriented behavior. Homewood, 111.: Dorsey Press, 1968.
95. Weiss, B., & Gott, C. T. A microanalysis of drug effects on fixed-ratio performance in pigeons. Journal of Pharmacology and Experimental Therapeutics, 1972, 180, 189-202.
96. Weissman, N. W., & Crossman, E. K. A comparison of two types of extinction following fixed-ratio training. Journal of the Experimental Analysis of Behavior, 1966, 9, 41-46.
97. Zeiler, M. D. Fixed and variable schedules of response-independent reinforcement. Journal of the Experimental Analysis of Behavior, 1968, 11, 405-414.
98. Zeiler, M. D. Time limits for completing fixed ratios. Journal of the Experimental Analysis of Behavior, 1970, 14, 275-286.
99. Zeiler, M. D. Superstitious behavior in children: An experimental analysis. In H. W. Reese (Ed.), Advances in child development and behavior (Vol. 7). New York: Academic Press, 1972.
100. Zeiler, M. D. Time limits for completing fixed ratios, II: Stimulus specificity. Journal of the Experimental Analysis of Behavior, 1972, 18, 243-251.