The operant reserve: A computer simulation in (accelerated) real time

Behavioural Processes

Volumn 69, Issue 2, 2005, Pages 257-278

  Catania, A Charles ^a  

^a UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

Author keywords

Computer simulation; Cumulative record; Extinction; Input output function; Inter response times; Operant reserve; Reflex reserve; Reinforcement schedules

Indexed keywords

BEHAVIORAL RESPONSE; COMPUTER SIMULATION; REAL TIME;

BEHAVIOR; COMPUTER SIMULATION; CONFERENCE PAPER; INSTRUMENTAL CONDITIONING; MOLECULAR DYNAMICS; MOLECULAR INTERACTION; REINFORCEMENT; STATISTICAL ANALYSIS; STIMULUS RESPONSE; THEORETICAL MODEL;

EID: 17444388054     PISSN: 03766357     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.beproc.2005.02.009     Document Type: Conference Paper

References (63)

1. W.M. Baum From molecular to molar: a paradigm shift in behavior analysis J. Exp. Anal. Behav. 78 2002 95 116
2. W.M. Baum Molar and molecular views of choice Behav. Process. 66 2004 349 359
3. L.A. Bizo, L.C. Kettle, and P.R. Killeen Animals don't always respond faster for more food: the paradoxical incentive effect Anim. Learn. Behav. 29 2001 66 78
4. Brandauer, C., 1958. The effects of uniform probabilities of reinforcement on the response rate of the pigeon. Doctoral Dissertation. Columbia University, unpublished.
5. A.C. Catania Concurrent operants W.K. Honig Operant Behavior: Areas of Research and Application 1966 Appleton-Century-Crofts New York 213 270
6. A.C. Catania Concurrent performances: inhibition of one response by reinforcement of another J. Exp. Anal. Behav. 12 1969 731 744
7. A.C. Catania Reinforcement schedules and psychophysical judgments: a study of some temporal properties of behavior W.N. Schoenfeld The Theory of Reinforcement Schedules 1970 Appleton-Century-Crofts New York 1 42
8. A.C. Catania Reinforcement schedules: the role of responses preceding the one that produces the reinforcer J. Exp. Anal. Behav. 15 1971 271 287
9. A.C. Catania The concept of the operant in the analysis of behavior Behaviorism 1 1973 103 116
10. A.C. Catania The flight from experimental analysis C.M. Bradshaw E. Szabadi C.F. Lowe Quantification of Steady-State Operant Behaviour 1981 Elsevier/North-Holland Amsterdam 49 64
11. A.C. Catania Time as a variable in behavior control I.H. Iversen K.A. Lattal Experimental Analysis of Behavior. Part 2 1991 Elsevier Amsterdam 1 19
12. A.C. Catania The unconventional philosophy of science of behavior analysis J. Exp. Anal. Behav. 60 1993 449 452
13. A.C. Catania Higher-order behavior classes: contingencies, beliefs, and verbal behavior J. Behav. Ther. Exp. Psychiat. 26 1995 191 200
14. A.C. Catania On the origins of behavior structure T.R. Zentall P. Smeets Stimulus Class Formation in Humans and Animals 1996 Elsevier Amsterdam 3 12
15. A.C. Catania Learning fourth ed. 1998 Prentice-Hall Upper Saddle River, NJ
16. A.C. Catania Metaphors, models and mathematics in the science of behavior Behav. Brain Sci. 23 2000 94 95
17. A.C. Catania The watershed years of 1958-1962 in the Harvard Pigeon Laboratory J. Exp. Anal. Behav. 77 2002 327 345
18. Catania, A.C. Attention-deficit/hyperactivity disorder (ADHD): delay-of-reinforcement gradients and other behavioral mechanisms. Behav. Brain Sci. 28, in press-a.
19. Catania, A.C. Attention-deficit/hyperactivity disorder (ADHD): one process or many? Behav. Brain Sci. 28, in press-b.
20. A.C. Catania, and K.J. Keller Contingency, contiguity, correlation, and the concept of causation P. Harzem M.D. Zeiler Predictability, Correlation, and Contiguity. Advances in Analysis of Behaviour, vol. 2 1981 Wiley Chichester 125 167
21. A.C. Catania, T.J. Matthews, P.J. Silverman, and R. Yohalem Yoked variable-interval and variable-ratio responding in pigeons J. Exp. Anal. Behav. 28 1977 155 161
22. A.C. Catania, and G.S. Reynolds A quantitative analysis of the behavior maintained by interval schedules of reinforcement J. Exp. Anal. Behav. 11 1968 327 383
23. A.C. Catania, T. Sagvolden, and K.J. Keller Reinforcement schedules: retroactive and proactive effects of reinforcers inserted into fixed-interval performances J. Exp. Anal. Behav. 49 1988 49 73
24. A.C. Catania, and E. Shimoff Responses and time in the quantitative analysis of the delay-of-reinforcement gradient Paper Presented at the Society for Quantitative Analyses of Behaviour San Francisco 1996
25. W.W. Cumming, and W.N. Schoenfeld Behavior under extended exposure to a high-value fixed interval reinforcement schedule J. Exp. Anal. Behav. 1 1958 245 263
26. P.B. Dews Free-operant behavior under conditions of delayed reinforcement: I. CRF-type schedules J. Exp. Anal. Behav. 3 1960 221 234
27. P.B. Dews The effect of multiple SD periods on responding on a fixed-interval schedule J. Exp. Anal. Behav. 5 1962 369 374
28. P.B. Dews The theory of fixed-interval responding W.N. Schoenfeld The Theory of Reinforcement Schedules 1970 Appleton-Century-Crofts New York 43 61
29. J.A. Dinsmoor Observing and conditioned reinforcement Behav. Brain Sci. 6 1983 693 728
30. J.A. Dinsmoor Stimulus control (Parts I and II) Behav. Anal. 18 1995 51 68 253-269
31. J.W. Donahoe Selectionism K.A. Lattal P.N. Chase Behavior Theory and Philosophy 2003 Kluwer Academic Publishers Dordrecht, Netherlands 103 128
32. J.W. Donahoe, J.E. Burgos, and D.C. Palmer A selectionist approach to reinforcement J. Exp. Anal. Behav. 60 1993 17 40
33. C.B. Ferster, and B.F. Skinner Schedules of Reinforcement 1957 Appleton-Century-Crofts New York
34. R.J. Herrnstein On the law of effect J. Exp. Anal. Behav. 13 1970 243 266
35. R.J. Herrnstein, and D.H. Loveland Maximizing and matching on concurrent ratio schedules J. Exp. Anal. Behav. 24 1975 107 116
36. C.L. Hull Principles of Behavior 1943 Appleton-Century-Crofts New York
37. J.E. Jans, and A.C. Catania Short-term remembering of discriminative stimuli in the pigeon J. Exp. Anal. Behav. 34 1980 177 183
38. R.T. Kelleher, W.C. Riddle, and L. Cook Observing responses in pigeons J. Exp. Anal. Behav. 5 1962 3 13
39. P.R. Killeen The reflex reserve J. Exp. Anal. Behav. 50 1988 319 331
40. P.R. Killeen Mathematical principles of reinforcement Behav. Brain Sci. 17 1994 105 172
41. P.R. Killeen Writing and overwriting short-term memory Psychon. Bull. Rev. 8 1 2001 18 43
42. Killeen, P.R., Gradus ad Parnassum. Behav. Brain Sci., in press.
43. K.S. Lashley The problem of serial order in behavior L.A. Jeffress Cerebral Mechanisms in Behavior 1951 Wiley New York 112 146
44. K.A. Lattal Combinations of response reinforcer dependence and independence J. Exp. Anal. Behav. 22 1974 357 362
45. J.E. Mazur An adjusting procedure for studying delayed reinforcement M.L. Commons J.E. Mazur J.A. Nevin H. Rachlin Quantitative Analyses of Behavior. The Effect of Delay and of Intervening Events on Reinforcement Value, vol. 5 1987 Erlbaum Hillsdale, NJ 283 308
46. A. Neuringer Operant variability: evidence, functions, and theory Psychon. Bull. Rev. 9 2002 672 705
47. J.A. Nevin, and R.C. Grace Behavioral momentum and the law of effect Behav. Brain Sci. 23 2000 73 130
48. Sagvolden, T., Johansen, E.B., Aase, H., Russell, V.A. A dynamic developmental theory of attention-deficit/hyperactivity disorder (ADHD) predominantly hyperactive/impulsive and combined subtypes. Behav. Brain Sci. 28, in press.
49. T. Sagvolden, K. Slåtta, and E. Arntzen Low doses of methylphenidate (Ritalin) may alter the delay-of-reinforcement gradient Psychopharmacology (Berlin) 95 1988 303 312
50. W.N. Schoenfeld, and B.K. Cole Stimulus Schedules: The t-t Systems 1972 Harper & Row New York
51. E. Shimoff, and A.C. Catania Using computers to teach behavior analysis Behav. Anal. 18 1995 307 316
52. C.P. Shimp Probabilistically reinforced choice behavior in pigeons J. Exp. Anal. Behav. 9 1966 443 455
53. O.J. Sizemore, and K.A. Lattal Dependency, temporal contiguity, and response-independent reinforcement J. Exp. Anal. Behav. 27 1977 119 125
54. B.F. Skinner Drive and reflex strength J. Gen. Psychol. 6 1932 22 37
55. B.F. Skinner The generic nature of the concepts of stimulus and response J. Gen. Psychol. 12 1935 40 65
56. B.F. Skinner The Behavior of Organisms: An Experimental Analysis 1938 Appleton-Century-Crofts New York
57. B.F. Skinner The nature of the operant reserve Psychol. Bull. 37 1940 423
58. B.F. Skinner Are theories of learning necessary? Psychol. Rev. 57 1950 193 216
59. B.F. Skinner The flight from the laboratory W. Dennis Current Trends in Psychology Theory 1961 University of Pittsburgh Press Pittsburgh
60. B.F. Skinner V.G. Laties A.C. Catania Cumulative Record, Definitive Edition 1999 B.F. Skinner Foundation Cambridge, MA
61. J.E.R. Staddon Some properties of spaced responding in pigeons J. Exp. Anal. Behav. 8 1965 19 27
62. W.M. Steinman Response rate and varied reinforcement: reinforcers of similar strengths Psychon. Sci. 10 1968 35 36
63. M.D. Zeiler Output dynamics M.D. Zeiler P. Harzem Advances in Analysis of Behaviour. Reinforcement and the Organization of Behaviour, vol. 1 1979 Wiley Chichester 79 115