Adjunctive behaviors are operants

Learning and Behavior

Volumn 41, Issue 1, 2013, Pages 1-24

  Killeen, Peter R ^a   Pellón, Ricardo ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA   (Spain)

Author keywords

Adjunctive; Conditioning; Contiguity; Contingency; Proximity; Schedule induced

Indexed keywords

ANIMAL; INSTRUMENTAL CONDITIONING; PSYCHOLOGICAL THEORY; REINFORCEMENT; REVIEW; TIME;

ANIMALS; CONDITIONING, OPERANT; PSYCHOLOGICAL THEORY; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; TIME FACTORS;

EID: 84874345654     PISSN: 15434494     EISSN: 15434508     Source Type: Journal    
DOI: 10.3758/s13420-012-0095-1     Document Type: Review

References (245)

1. Ainslie, G. (1992). Picoeconomics. New York: Cambridge University Press.
2. Ainslie, G. (2001). Breakdown of will. Cambridge University Press.
3. Albert, D., & Mah, C. (1972). An examination of conditioned reinforcement using a one-trial learning procedure. Learning and Motivation, 3, 369-388.
4. Alcock, J. (2005). Animal behavior: An evolutionary approach. Sunderland: Sinauer Association.
5. Álvarez, A., Íbias, J., & Pellón, R. (2011). Facilitación de la adquisición de bebida adjuntiva tras la entrega de comida más que en anticipación a la misma [Facilitation of acquisition of adjunctive drinking after food delivery more than in anticipation to food]. In H. Martínez, J. J. Irigoyen, F. Cabrera, J. Varela, P. Covarrubias & A. Jiménez (Eds.), Estudios sobre Comportamiento y Aplicaciones (Vol. II, pp. 55-69). Tlajomulco de Zúñiga, Jalisco, México: Segunda Generación.
6. Amsel, A., & Work, M. S. (1961). The role of learned factors in "spontaneous" activity. Journal of Comparative and Physiological Psychology, 54, 527-532.
7. Amsel, A., Work, M. S., & Penick, E. C. (1962). Activity during and between periods of stimulus change related to feeding. Journal of Comparative and Physiological Psychology, 55, 1114-1117.
8. Anderson, M. C., & Shettleworth, S. J. (1977). Behavioral adaptation to fixed-interval and fixed-time food delivery in golden hamsters. Journal of the Experimental Analysis of Behavior, 25, 33-49. (Pubitemid 8043351)
9. Anselme, P. (2010). The uncertainty processing theory of motivation. Behavioural Brain Research, 208, 291-310.
10. Arcediano, F., Escobar, M., & Miller, R. R. (2003). Temporal integration and temporal backward associations in human and nonhuman subjects. Learning & Behavior, 31, 242-256. (Pubitemid 37214579)
11. Arcediano, F., Escobar, M., & Miller, R. R. (2005). Bidirectional associations in humans and rats. Journal of Experimental Psychology. Animal Behavior Processes, 31, 301-318. (Pubitemid 41151878)
12. Armstrong, C. M., DeVito, L. M., & Cleland, T. A. (2006). One-trial associative odor learning in neonatal mice. Chemical Senses, 31, 343-349. (Pubitemid 43779035)
13. Avila, R., & Bruner, C. A. (1994). Varying the temporal placement of a drinking opportunity in a fixed-interval schedule. Journal of the Experimental Analysis of Behavior, 62, 307-314.
14. Baerends, G. P. (1976). The functional organization of behaviour. Animal Behaviour, 24, 726-738.
15. Balleine, B. W., & Dickinson, A. (1998). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419. (Pubitemid 28306930)
16. Baum, W. M. (1973). The correlation-based law of effect. Journal of the Experimental Analysis of Behavior, 20, 137-153.
17. Baum, W. M. (2005). Understanding behaviorism: Behavior, culture, and evolution (2nd ed.). Malden, MA: Blackwell Publishing.
18. Baum, W. M. (2012). Rethinking reinforcement: Allocation, induction, and contingency. Journal of the Experimental Analysis of Behavior, 97, 101-124.
19. Bevins, R. A., & Besheer, J. (2006). Object recognition in rats and mice: A one-trial non-matching-to-sample learning task to study'recognition memory'. Nature Protocols, 1, 1306-1311.
20. Bickel, W. K., Higgins, S. T., Kirby, K., & Johnson, L. M. (1988). An inverse relationship between baseline fixed-interval response rate and the effects of a tandem response requirement. Journal of the Experimental Analysis of Behavior, 50, 211-218.
21. Bindra, D. (1972). A unified account of classical conditioning and operant training. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 453-481). New York: Appleton-Century-Crofts.
22. Blass, E. (Ed.). (2001). Developmental psychobiology (Vol. 13). New York: Kluwer Academic.
23. Boakes, R. A. (1977). Performance on learning to associate a stimulus with positive reinforcement. In H. David & H. M. B. Hurwitz (Eds.), Operant-Pavlovian interactions (pp. 67-101). Hillsdale, NJ: Erlbaum.
24. Boakes, R. A. (1984). From Darwin to behaviourism: Psychology and the minds of animals. Cambridge: Cambridge University Press.
25. Boakes, R. A., Halliday, M. S., & Poli, M. (1975). Response additivity: Effects of superimposed free reinforcement on a variable-interval baseline. Journal of the Experimental Analysis of Behavior, 23, 177-191.
26. Boakes, R. A., Poli, M., Lockwood, M. J., & Goodall, G. (1978). A study of misbehavior: Token reinforcement in the rat. Journal of the Experimental Analysis of Behavior, 29, 115-134. (Pubitemid 8278684)
27. Bolles, R. C. (1970). Species-specific defense reactions and avoidance learning. Psychological Review, 71, 32-48.
28. Bolles, R. C. (1983). The explanation of behavior. Psychological Record, 33, 31-48.
29. Bouton, M. E. (2007). Learning and behavior: A contemporary synthesis. Sunderland, MA: Sinauer Associates, Inc.
30. Brackney, R. (2012). Habits and actions. In P. Killeen (Ed.) (Observation ed.). Tempe, AZ.
31. Bradshaw, C. M., & Killeen, P. R. (2012). A theory of behaviour on progressive ratio schedules, with applications in behavioural pharmacology. Psychopharmacology, OnLine First.
32. Breland, K., & Breland, M. (1961). The misbehavior of organisms. American Psychologist, 16, 681-684.
33. Brown, B. L., Hemmes, N. S., & Cabeza de Vaca, S. (1997). Timing of the CS-US interval by pigeons in trace and delay autoshaping. The Quarterly Journal of Experimental Psychology. B, 50, 40-53.
34. Brown, B. L., Hemmes, N. S., Cabeza de Vaca, S., & Pagano, C. (1993). Sign and goal tracking during delay and trace autoshaping in pigeons. Animal Learning & Behavior, 21, 360-368. (Pubitemid 23349839)
35. Brush, M. E., & Schaeffer, R. W. (1974). Effects of water deprivation on schedule-induced polydipsia. Bulletin of the Psychonomic Society, 4, 69-72.
36. Campbell, B. A., Smith, N. F., Misanin, J. R., & Jaynes, J. (1966). Species differences in activity during hunger and thirst. Journal of Comparative and Physiological Psychology, 61, 123-127.
37. Capaldi, E. J. (1978). Effects of schedule and delay of reinforcement on acquisition speed. Animal Learning & Behavior, 6, 330-334. (Pubitemid 9043322)
38. Catania, A. C. (Ed.). (1968). Contemporary research in operant behavior. Glenview, IL: Scott, Foresman and Company.
39. Catania, A. (1971a). Elicitation, reinforcement, and stimulus control. In R. Glaser (Ed.), The nature of reinforcement (pp. 196-220). New York: Academic Press.
40. Catania, A. C. (1971b). Reinforcement schedules: The role of responses preceding the one that produces the reinforcer. Journal of the Experimental Analysis of Behavior, 15, 271-287.
41. Catania, A. C. (1973). The concept of the operant in the analysis of behavior. Behaviorism, 1, 103-116.
42. Catania, A. C. (2005a). Attention-deficit/hyperactivity disorder (ADHD): Delay-of-reinforcement gradients and other behavioral mechanisms. The Behavioral and Brain Sciences, 28, 419-424. (Pubitemid 41440194)
43. Catania, A. C. (2005b). The operant reserve: A computer simulation in (accelerated) real time. Behavioural Processes, 69, 257-278. (Pubitemid 40544596)
44. Catania, A. C., Sagvolden, T., & Keller, K. J. (1988). Reinforcement schedules: Retroactive and proactive effects of reinforcers inserted into fixed-interval performances. Journal of the Experimental Analysis of Behavior, 49, 49-73.
45. Chapman, H. W., & Richardson, H. M. (1974). The role of systemic hydration in the acquisition of schedule-induced polydipsia by rats. Behavioral Biology, 12, 501-508.
46. Cherot, C., Jones, A., & Neuringer, A. (1996). Reinforced variability decreases with approach to reinforcers. Journal of Experimental Psychology. Animal Behavior Processes, 22, 497-508.
47. Christian, W. P., Schaeffer, R. W., & King, G. D. (1977). Schedule-induced behavior: Research and theory. Montreal: Eden Press.
48. Clark, F. C. (1962). Some observations on the adventitious reinforcement of drinking under food reinforcement. Journal of the Experimental Analysis of Behavior, 5, 61-63.
49. Cleaveland, J. M., Jäger, R., Rößner, P., & Delius, J. D. (2003). Ontogeny has a phylogeny: Background to adjunctive behaviors in pigeons and budgerigars. Behavioural Processes, 61, 143-158. (Pubitemid 36294247)
50. Cope, C. L., Sanger, D. J., & Blackman, D. E. (1976). Intragastric water and the acquisition of schedule-induced drinking. Behavioral Biology, 17, 267-270.
51. Costa, D. S. J., & Boakes, R. A. (2007). Maintenance of responding when reinforcement becomes delayed. Learning & Behavior, 35, 95-105. (Pubitemid 47047875)
52. Costa, D. S. J., & Boakes, R. A. (2009). Context blocking in rat autoshaping: Sign-tracking versus goal-tracking. Learning and Motivation, 40, 178-185.
53. Critchfield, T. S., & Lattal, K. A. (1993). Acquisition of a spatially defined operant with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 59, 373-387.
54. D'Amato, M. R., Safarjan, W. R., & Salmon, D. (1981). Long-delay conditioning and instrumental leaming: Some new findings. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 113-142). Mawah, NJ: Lawrence Earlbaum Associates.
55. Davey, G. C. L., Phillips, J. H., & Witty, S. (1989). Signal-directed behavior in the rat: Interactions between the nature of the CS and the nature of the UCS. Learning & Behavior, 17, 447-456. (Pubitemid 20018573)
56. Davis, H., & Hubbard, J. (1972). An analysis of superstitious behavior in the rat. Behaviour, 43, 1-12.
57. Davis, E. R., & Platt, J. R. (1983). Contiguity and contingency in the acquisition and maintenance of an operant. Learning and Motivation, 14, 487-512.
58. Dickinson, A. (1985). Actions and habits: The development of behavioural autonomy. Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 308, 67-78.
59. Dickinson, A. (2001). Causal learning: An associative analysis (The 28th Bartlett Memorial Lecture). The Quarterly Journal of Experimental Psychology. B, 54, 3-26. (Pubitemid 33217056)
60. Dickinson, A., Balleine, B., Watt, A., Gonzalez, F., & Boakes, R. A. (1995). Motivational control after extended instrumental training. Animal Learning & Behavior, 23, 197-206.
61. Dickinson, A., Watt, A., & Griffiths, W. J. H. (1992). Free-operant acquisition with delayed reinforcement. The Quarterly Journal of Experimental Psychology. B, 45, 241-258.
62. Domjan, M. (1983). Biological constraints on instrumental and classical conditioning: Implications for general process theory. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 19, pp. 215-277). New York: Academic Press.
63. Donahoe, J. W. (2006). Contingency: Its meaning in the experimental analysis of behavior. European Journal of Behavior Analysis, 7, 111-114.
64. Donahoe, J. W., Palmer, D. C., & Burgos, J. E. (1997). The SR issue: its status in behavior analysis and in Donahoe and Palmer's learning and complex behavior. Journal of the Experimental Analysis of Behavior, 67, 193.
65. Egger, M. D., & Miller, N. E. (1962). Secondary reinforcement in rats as a function of information value and reliability of the stimulus. Journal of Experimental Psychology, 64, 97-104.
66. Falk, J. L. (1961). Production of polydipsia in normal rats by an intermittent food schedule. Science, 133, 195-196.
67. Falk, J. L. (1966). Schedule-induced polydipsia as a function of fixed interval length. Journal of the Experimental Analysis of Behavior, 9, 37-39.
68. Falk, J. L. (1971). The nature and determinants of adjunctive behavior. Physiology & Behavior, 6, 577-588.
69. Fanselow, M. S. (1989). The adaptive function of conditioned defensive behavior: an ecological approach to Pavlovian stimulus-substitution theory. NATO Advanced Study Institutes series. Series D, Behavioural and social sciences, 48, 151-166.
70. Fanselow, M. S., & Sigmundi, R. A. (1986). Species-specific danger signals, endogenous opioid analgesia, and defensive behavior. Journal of Experimemal Psychology, 12, 301-309.
71. Fentress, J. C. (1983). Ethological models of hierarchy and patterning of species-specific behavior. In P. Teitelbaum & E. Satinoff (Eds.), Handbook of behavioral neurobiology (Vol. 6, pp. 185-234). New York: Plenum Press.
72. Ferrell, J. E. (2012). Bistability, bifurcations, and Waddington's epigenetic landscape. Current Biology, 22, R458-R466.
73. Fetterman, J. G., Killeen, P. R., & Hall, S. (1998). Watching the clock. Behavioural Processes, 44, 211-222.
74. Flory, R. K. (1971). The control of schedule-induced polydipsia: Frequency and amount of reinforcement. Learning and Motivation, 2, 215-227.
75. Gallistel, C. R. (1980). The organization of action: A new synthesis (Vol. 13). New York: Erlbaum Associates.
76. Gallo, A., Duchatelle, E., Elkhessaimi, A., Lepape, G. L., & Desportes, J. P. (1995). Topographic analysis of the rat's bar behaviour in the Skinner box. Behavioural Processes, 33, 319-327.
77. Garcia, J., McGowan, B. K., & Green, K. F. (1972). Biological constraints on conditioning. In H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 3-27). New York: Appleton-Century-Crofts.
78. Gharib, A., Gade, C., & Roberts, S. (2004). Control of variation by reward probability. Journal of Experimental Psychology. Animal Behavior Processes, 30, 271-282. (Pubitemid 39443252)
79. Gibbon, J., Baldock, M. D., Locurto, C. M., Gold, L., & Terrace, H. S. (1977). Trial and intertrial durations in autoshaping. Journal of Experimental Psychology. Animal Behavior Processes, 3, 264-284.
80. Gibbon, J., Berryman, R., & Thompson, R. L. (1974). Contingency spaces and measures in classical and instrumental conditioning. Journal of the Experimental Analysis of Behavior, 21, 585-605.
81. Gibbon, J., Farrell, L., Locurto, C. M., Duncan, H. J., & Terrace, H. S. (1980). Partial reinforcement in autoshaping with pigeons. Animal Learning and Behavior, 8, 45-59. (Pubitemid 10108262)
82. Good, I. J. (1961). A causal calculus. The British Journal for the Philosophy of Science, 11, 305-318.
83. Gottlieb, D. A. (2006). Effects of partial reinforcement and time between reinforced trials on terminal response rate in pigeon autoshaping. Behavioural Processes, 72, 6-13. (Pubitemid 43220333)
84. Graham, C. L. D., & John, H. (1989). Signal-directed behavior in the rat: Interactions between the nature of the CS and the nature of the UCS. Animal Learning & Behavior, 17, 447-456.
85. Haight, P. A., & Killeen, P. R. (1991). Adjunctive behavior in multiple schedules of reinforcement. Animal Learning & Behavior, 19, 257-263.
86. Hanson, S. J. (1977). The Rescorla-Wagner model and the temporal control of behavior. Unpublished Master's thesis, Arizona State University, Tempe, AZ.
87. Harris, J. A., Gharaei, S., & Pincham, H. L. (2011). Response rates track the history of reinforcement times. Journal of Experimental Psychology. Animal Behavior Processes, 37, 277-286.
88. Herrnstein, R. J. (1966). Superstition: A Corollary of the principles of operant conditioning. In W. K. Honig (Ed.), Operant behavior: Areas of research and application (pp. 33-51). New York: Appleton-Century-Crofts.
89. Herrnstein, R. J. (1977). The evolution of behaviorism. American Psychologist, 32, 593-603.
90. Hinson, J. M., & Staddon, J. E. R. (1978). Behavioral competition: A mechanism for schedule interactions. Science, 202, 432-434. (Pubitemid 9051833)
91. Hogan, J. A. (1994). Structure and development of behavior systems. Psychonomic Bulletin & Review, 1, 439-450.
92. Holland, P. C. (1979). The effects of qualitative and quantitative variation in the US on individual components of Pavlovian appetitive conditioned behavior in rats. Learning & Behavior, 7, 424-432. (Pubitemid 10177319)
93. Holland, P. C. (1980). CS-US interval as a determinant of the form of Pavlovian appetitive conditioned responses. Journal of Experimental Psychology. Animal Behavior Processes, 6, 155-174.
94. Holland, P. C. (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology. Animal Behavior Processes, 30, 104-117. (Pubitemid 38491959)
95. Innis, N. K., Simmelhag-Grant, V. L., & Staddon, J. E. R. (1983). Behavior induced by periodic food delivery: The effects of interfood interval. Journal of the Experimental Analysis of Behavior, 39, 309-322.
96. Iwata, B. A., Kahng, S. W., Wallace, M. D., & Lindberg, J. S. (2000). The functional analysis model of behavioral assessment. In J. Austin & J. E. Carr (Eds.), Handbook of applied behavior analysis (pp. 61-89). Reno, NV: Context Press.
97. Jenkins, W. O. (1943a). Studies in the spread of effect. I. The bi-directional gradient in the performance of white rats on a linear maze. Journal of Comparative Psychology, 35, 41-56.
98. Jenkins, W. O. (1943b). Studies in the spread of effect. II. The effect of increased motivation upon the bi-directional gradient. Journal of Comparative Psychology, 35, 57-63.
99. Jenkins, W. O. (1943c). Studies in the spread of effect. III. The effect of increased incentive upon the bi-directional gradient. Journal of Comparative Psychology, 35, 65-72.
100. Jenkins, H. M. (1970). Sequential organization in schedules of reinforcement. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules (pp. 63-109). New York: Appleton-Century-Crofts.
101. Johansen, E. B., Killeen, P. R., Russell, V. A., Tripp, G., Wickens, J. R., Tannock, R., et al. (2009). Origins of altered reinforcement effects in ADHD. Behavior and Brain Functions, 5, 7.
102. Johansen, E. B., Killeen, P. R., & Sagvolden, T. (2007). Behavioral variability, elimination of responses, and delay-of-reinforcement gradients in SHR and WKY rats. Behavior Brain Functions.
103. Johnson, L. M., Bickel, W. K., Higgins, S. T., & Morris, E. K. (1991). The effects of schedule history and the opportunity for adjunctive responding on behavior during a fixed-interval schedule of reinforcement. Journal of the Experimental Analysis of Behavior, 55, 313-322.
104. Jozefowiez, J., Staddon, J. E. R., & Cerutti, D. T. (2009). The behavioral economics of choice and interval timing. Psychological Review, 116, 519-539.
105. Keehn, J. D., & Burton, M. (1978). Schedule-induced drinking: Entrainment by fixed-and random-interval schedule-controlled feeding. T.-I.-T. Journal of Life Sciences, 8, 93.
106. Keith-Lucas, T., & Guttman, N. (1975). Robust-single-trial delayed backward conditioning. Journal of Comparative and Physiological Psychology, 88, 468-476.
107. Killeen, P. R. (1975). On the temporal control of behavior. Psychological Review, 82, 89-115.
108. Killeen, P. R. (1978). Superstition: A matter of bias, not detectability. Science, 199, 88-90. (Pubitemid 8295523)
109. Killeen, P. R. (1981). Learning as causal inference. In M. Commons & J. A. Nevin (Eds.), Quantitative studies of behavior (pp. 289-312). New York: Pergamon.
110. Killeen, P. R. (1994). Mathematical principles of reinforcement. The Behavioral and Brain Sciences, 17, 105-172. (Pubitemid 24987863)
111. Killeen, P. R. (2002). Scalar counters. Learning and Motivation, 33, 63-87.
112. Killeen, P. R. (2005). Gradus ad parnassum: Ascending strength gradients or descending memory traces? The Behavioral and Brain Sciences, 28, 432-434. (Pubitemid 41440201)
113. Killeen, P. R. (2011). Models of trace decay, eligibility for reinforcement, and delay of reinforcement gradients, from exponential to hyperboloid. Behavioural Processes, 8, 57-63.
114. Killeen, P. R., & Fetterman, J. G. (1993). Behavioral theory of timing: Transition analyses. Journal of the Experimental Analysis of Behavior, 59, 411-422.
115. Killeen, P. R., Fetterman, J. G., & Bizo, L. A. (1997). Time's causes. In C. M. Bradshaw & E. Szabadi (Eds.), Time and behaviour: Psychological and neurobiological analyses (pp. 79-131). Amsterdam: Elsevier Science Publishers BV.
116. Killeen, P. R., Hanson, S. J., & Osborne, S. R. (1978). Arousal: Its genesis and manifestation as response rate. Psychological Review, 85, 571-581.
117. Killeen, P. R., Sanabria, F., & Dolgov, I. (2009). The dynamics of conditioning and extinction. Journal of Experimental Psychology. Animal Behavior Processes, 35, 447-472.
118. Killeen, P. R., & Sitomer, M. T. (2003). MPR. Behavioural Processes, 62, 49-64. (Pubitemid 36511422)
119. Killeen, P. R., & Smith, J. P. (1984). Perception of contingency in conditioning: Scalar timing, response bias, and the erasure of memory by reinforcement. Journal of Experimental Psychology. Animal Behavior Processes, 10, 333-345.
120. Killeen, P. R., & Taylor, T. J. (2000a). How the propagation of error through stochastic counters affects time discrimination and other psychophysical judgments. Psychological Review, 107, 430-459.
121. Killeen, P. R., & Taylor, T. J. (2000b). Stochastic adding machines. Nonlinearity, 13, 1889-1903.
122. King, G. D. (1974a). The enhancement of schedule-induced polydipsia by preschedule noncontingent shock. Bulletin of the Psychonomic Society, 3, 46-48.
123. King, G. D. (1974b). Wheel running in the rat induced by a fixed-time presentation of water. Animal Learning & Behavior, 2, 325-328.
124. Kissileff, H. R. (1969). Food-associated drinking in the rat. Journal of Comparative and Physiological Psychology, 67, 284-300.
125. Kohman, R., Leising, K., Shaffer, M., & Higa, J. J. (2006). Effects of breaks in the interval cycle on temporal tracking in pigeons. Behavioural Processes, 71, 126-134. (Pubitemid 43163010)
126. Kwok, D.W.S., Livesey, E.J., & Boakes, R.A. (2012). Serial overshadowing of taste aversion learning by stimuli preceding the target taste. Learning & Behavior [Epub].
127. Lamas, E., & Pellón, R. (1995). Food-deprivation effects on punished schedule-induced drinking in rats. Journal of the Experimental Analysis of Behavior, 64, 47-60.
128. Lamas, E., & Pellón, R. (1997). Food deprivation and food-delay effects on the development of adjunctive drinking. Physiology & Behavior, 61, 153-158. (Pubitemid 27085542)
129. LaMon, B. C., & Zeigler, H. P. (1984). Grasping in the pigeon (Columba livia): Stimulus control during conditioned and consummatory responses. Animal Learning & Behavior, 12, 223-231. (Pubitemid 14068158)
130. Lattal, K. A. (1995). Contingency and behavior analysis. Behavior Analyst, 18, 209-224. (Pubitemid 126006377)
131. Lattal, K. A. (2010). Delayed reinforcement of operant behavior. Journal of the Experimental Analysis of Behavior, 93, 129-139.
132. Lattal, K. A., & Abreu-Rodrigues, J. (1997). Response-independent events in the behavior stream. Journal of the Experimental Analysis of Behavior, 68, 375-398. (Pubitemid 127457522)
133. Lattal, K. A., & Gleeson, S. (1990). Response acquisition with delayed reinforcement. Journal of Experimental Psychology. Animal Behavior Processes, 16, 27-39.
134. Lattal, K. A., & Williams, A. M. (1997). Body weight and response acquisition with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 67, 131-143. (Pubitemid 127456329)
135. Lett, B. T. (1975). Long-delay learning in the T-maze. Learning and Motivation, 6, 80-90.
136. Lieberman, D. A., Davidson, F. H., & Thomas, G. V. (1985). Marking in pigeons: The role of memory in delayed reinforcement. Journal of Experimental Psychology. Animal Behavior Processes, 11, 611-624.
137. Lieberman, D. A., McIntosh, D. C., & Thomas, G. V. (1979). Learning when reward is delayed: A marking hypothesis. Journal of Experimental Psychology. Animal Behavior Processes, 5, 224-242.
138. Livnat, A., & Pippenger, N. (2006). An optimal brain can be composed of conflicting agents. Proceedings of the National Academy of Sciences of the United States of America, 103, 3198-3202. (Pubitemid 43346447)
139. Locurto, C., Travers, T., Terrace, H., & Gibbon, J. (1980). Physical restraint produces rapid acquisition of the pigeon's key peck. Journal of the Experimental Analysis of Behavior, 34, 13-21.
140. Looney, T.A., & Cohen, P.S. (1982). Aggression induced by intermittent positive reinforcement. Neuroscience and Biobehavioral Reviews, 15-37. (Pubitemid 12108676)
141. López-Crespo, G., Rodríguez, M., Pellón, R., & Flores, P. (2004). Acquisition of schedule-induced polydipsia by rats in proximity to upcoming food delivery. Learning & Behavior, 32, 491-499. (Pubitemid 40396036)
142. Lucas, G. A., Timberlake, W., & Gawley, D. J. (1988). Adjunctive behavior of the rat under periodic food delivery in a 24-hour environment. Animal Learning & Behavior, 16, 19-30. (Pubitemid 18046540)
143. Machado, A. (1997). Learning the temporal dynamics of behavior. Psychological Review, 104, 241-265.
144. Machado, A., & Silva, F. J. (2007). Toward a richer view of the scientific method: The role of conceptual analysis. American Psychologist, 62, 671-681.
145. Mackintosh, N. J. (1974). The psychology of animal learning. New York: Academic Press.
146. Madden, G. J., & Perone, M. (2003). Effects of alternative reinforcement on human behavior: The source does matter. Journal of the Experimental Analysis of Behavior, 79, 193-206. (Pubitemid 38726561)
147. Millenson, J. R., Allen, R. B., & Pinker, S. (1977). Adjunctive drinking during variable and random-interval food reinforcement schedules. Animal Learning & Behavior, 5, 285-290. (Pubitemid 8184819)
148. Moore, B. W. (1973). The role of directed Pavlovian reactions in simple instrumental learning in the pigeon. In R. A. Hinde & J. Stevenson-Hinde (Eds.), Constraints on learning: Limitations and predispositions (pp. 159-188). New York: Academic Press.
149. Moran, G., & Rudolph, R. (1980). Some effects of lick-contingent delays on the development of schedule-induced polydipsia. Learning and Motivation, 11, 366-385.
150. Myerson, J., & Christiansen, B. (1979). Temporal control of eating on periodic water schedules. Physiology & Behavior, 23, 279-282. (Pubitemid 10233262)
151. Myerson, J., & Miezin, F. M. (1980). The kinetics of choice: An operant systems analysis. Psychological Review, 87, 160-174.
152. Neuringer, A. J. (1970). Superstitious key pecking after three peck-produced reinforcements. Journal of the Experimental Analysis of Behavior, 13, 127-134.
153. Okouchi, H. (2009). Response acquisition by humans with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 91, 377-390.
154. Osborne, S. R. (1978). A quantitative analysis of the effects of amount of reinforcement on two response classes. Journal of Experimental Psychology. Animal Behavior Processes, 4, 297-317.
155. Osborne, S. R., & Killeen, P. R. (1977). Temporal properties of responding during stimuli that preceed response-independent food. Learning and Motivation, 8, 533-550.
156. Palya, W. L., & Zacny, J. P. (1980). Stereotyped adjunctive pecking by caged pigeons. Animal Learning & Behavior, 8, 293-303. (Pubitemid 11160032)
157. Papini, M. R., & Bitterman, M. E. (1990). The role of contingency in classical conditioning. Psychological Review, 97, 396-403.
158. Patterson, A. E. (2009). Schedule-induced drinking: A re-examination of the "superstitious conditioning" hypothesis. Unpublished Dissertation, University of Sydney, Sydney.
159. Patterson, A.E., & Boakes, R.A. (2012). Interval, blocking and marking effects during the development of schedule-induced drinking. Journal of Experimental Psychology: Animal Behavior Processes [Epub], 1-12.
160. Pear, J. J., Moody, J. E., & Persinger, M. A. (1972). Lever attacking by rats during free-operant avoidance. Journal of the Experimental Analysis of Behavior, 18, 517.
161. Pellón, R., Bayeh, L., & Pérez-Padilla, Á. (2006). Schedule-induced polydipsia under explicit positive reinforcement. Paper presented at the Winter Conference on Animal Learning and Behavior.
162. Pellón, R., & Blackman, D. E. (1987). Punishment of schedule-induced drinking in rats by signaled and unsignaled delays in food presentation. Journal of the Experimental Analysis of Behavior, 48, 417-434.
163. Pellón, R., & Pérez-Padilla, Á. (2013). Response-food delay gradients for lever pressing and schedule-induced licking in rats. Learning & Behavior, accepted.
164. Penney, J., & Schull, J. (1977). Functional differentiation of adjunctive drinking and wheel running in rats. Animal Learning & Behavior, 5, 272-280. (Pubitemid 8184817)
165. Plonsky, M., Driscoll, C. D., Warren, D. A., & Rosellini, R. A. (1984). Do random time schedules induce polydipsia in the rat? Animal Learning and Behavior, 12, 355-362. (Pubitemid 15102471)
166. Porter, J. H., Young, R., & Moeschl, T. P. (1978). Effects of water and saline preloads on schedule-induced polydipsia in the rat. Physiology & Behavior, 21, 333-338. (Pubitemid 9038874)
167. Powell, R. W., & Curley, M. (1976). Instinctive drift in nondomesticated rodents. Bulletin of the Psychonomic Society, 8, 175-178.
168. Premack, D. (1965). Reinforcement theory. In D. Levine (Ed.), Nebraska Symposium on Motivation: Lincoln: University of Nebraska Press.
169. Rachlin, H. (1988). Molar behaviorism. In D. B. Fishman, F. Rotgers, & C. M. Franks (Eds.), Paradigms in behavior therapy: Present and promise (pp. 77-105). New York: Springer.
170. Rachlin, H. (1994). Behavior and mind: The roots of modern psychology. New York: Oxford University Press.
171. Rachlin, H. (2000). The science of self-control. Cambridge, MA: Harvard University Press.
172. Reid, A. K., Bachá, G., & Morán, C. (1993). The temporal organization of behavior on periodic food schedules. Journal of the Experimental Analysis of Behavior, 59, 1-27.
173. Reid, A. K., & Dale, R. H. I. (1985). Dynamic effects of food magnitude on interim-terminal interaction. Journal of the Experimental Analysis of Behavior, 39, 135-148.
174. Reid, A. K., & Staddon, J. E. R. (1982). Schedule-induced drinking: Elicitation, anticipation, or behavioral interaction? Journal of the Experimental Analysis of Behavior, 38, 1-18.
175. Reid, A. K., Vazquez, P. P., & Rico, J. A. (1985). Schedule induction and the temporal distributions of adjunctive behavior on periodic water schedules. Learning & Behavior, 13, 321-326. (Pubitemid 16203359)
176. Reilly, M. P., & Lattal, K. A. (2004). Within-session delay-of-reinforcement gradients. Journal of the Experimental Analysis of Behavior, 82, 21-35. (Pubitemid 39315786)
177. Rescorla, R. A. (1967). Pavlovian conditioning and its proper control procedures. Psychological Review, 74, 71-80.
178. Rescorla, R. A. (1972). "Configural" conditioning in discrete-trial bar pressing. Journal of Comparative and Physiological Psychology, 79, 307-317.
179. Rescorla, R. A. (1988). Pavlovian conditioning: It's not what you think it is. American Psychologist, 43, 151-160.
180. Revusky, S., & Garcia, J. (1970). Learned associations over long delays. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 6, pp. 1-83). San Diego: Academic Press.
181. Revusky, S., & Parker, L. A. (1976). Aversions to unflavored water and cup drinking produced by delayed sickness. Journal of Experimental Psychology. Animal Behavior Processes, 2, 342-353.
182. Reynierse, J. H., & Spanier, D. (1968). Excessive drinking in rats' adaptation to the schedule of feeding. Psychonomic Science, 10, 95-96.
183. Riley, A. L., Hyson, R. L., Baker, C. S., & Kulkosky, P. J. (1980). The interaction of conditioned taste aversions and schedule-induced polydipsia: Effects of repeated conditioning trials. Learning & Behavior, 8, 211-217. (Pubitemid 11160021)
184. Roca, A., & Bruner, C. A. (2011a). An analysis of the origin of excessive water intake of schedule-induced drinking. Revista Mexicana de Análisis de la Conducta, 37, 177-204.
185. Roca, A., & Bruner, C. A. (2011b). Effects of reinforcement frequency on lever pressing for water in food-deprived rats. Revista Mexicana de Análisis de la Conducta, 29, 119-130.
186. Roper, T. J. (1978). Diversity and substitutability of adjunctive activities under fixed-interval schedules of food reinforcement. Journal of the Experimental Analysis of Behavior, 30, 83-96. (Pubitemid 8378463)
187. Roper, T. J., & Crossland, G. (1982). Schedule-induced wood-chewing in rats and its dependence on body weight. Animal Learning & Behavior, 10, 65-71. (Pubitemid 12089889)
188. Roper, T. J., & Nieto, J. (1979). Schedule-induced drinking and other behavior in the rat, as a function of body weight deficit. Physiology & Behavior, 23, 673-678. (Pubitemid 10207027)
189. Roper, T. J., & Posadas-Andrews, A. (1981). Are schedule-induced drinking and displacement activities causally related? The Quarterly Journal of Experimental Psychology. B, 33, 181-193.
190. Sanabria, F., Sitomer, M. T., & Killeen, P. R. (2006). Negative automaintenance omission training is effective. Journal of the Experimental Analysis of Behavior, 86, 1-10. (Pubitemid 44091186)
191. Schaal, D. W., & Branch, M. N. (1990). Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: Effects of delay-signal duration. Journal of the Experimental Analysis of Behavior, 53, 103-121.
192. Segal, E. F. (1972). Induction and the provenance of operants. In R. M. Gilbert & J. R. Millenson (Eds.), Reinforcement: Behavioral analyses (pp. 1-34). New York: Academic Press.
193. Segal, E. F., Oden, D. L., & Deadwyler, S. A. (1965). Determinants of polydipsia: IV. Free-reinforcement schedules. Psychonomic Science, 3, 11-12.
194. Seligman, M. E. P. (1970). On the generality of the laws of learning. Psychological Review, 77, 406-418.
195. Sheffield, F. D., & Campbell, B. A. (1954). The role of experience in the "spontaneous" activity of hungry rats. Journal of Comparative and Physiological Psychology, 47, 97-100.
196. Shettleworth, S. J. (1988). Foraging as operant behavior and operant behavior as foraging: What have we learned. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 22, pp. 1-49). New York: Academic Press.
197. Shettleworth, S. J., & Juergensen, M. R. (1980). Reinforcement and the organization of behavior in golden hamsters: Brain stimulation reinforcement for seven action patterns. Journal of Experimental Psychology. Animal Behavior Processes, 6, 352-375.
198. Shimp, C. P. (1981). The local organization of behavior: Discrimination of and memory for simple behavioral patterns. Journal of the Experimental Analysis of Behavior, 36, 303-315.
199. Shull, R. L. (1970). A response-initiated fixed-interval schedule of reinforcement. Journal of the Experimental Analysis of Behavior, 13, 13-15.
200. Silva, F. J., Silva, K. M., & Pear, J. J. (1992). Sign-versus goal-tracking: Effects of conditioned-stimulus-to-unconditioned-stimulus distance. Journal of the Experimental Analysis of Behavior, 57, 17-31.
201. Silva, K. M., & Timberlake, W. (1997). A behavior systems view of conditioned states during long and short CS-US intervals. Learning and Motivation, 28, 465-490. (Pubitemid 127168496)
202. Silva, K. M., & Timberlake, W. (1998). The organization and temporal properties of appetitive behavior in rats. Animal Learning & Behavior, 26, 182-195. (Pubitemid 28268705)
203. Silva, F. J., & Timberlake, W. (2000). A clarification of the nature of backward excitatory conditioning. Learning and Motivation, 31, 67-80.
204. Silva, F. J., Timberlake, W., & Ozlem Cevik, M. (1998). A behavior systems approach to the expression of backward associations. Learning and Motivation, 29, 1-22. (Pubitemid 128343460)
205. Skinner, B. F. (1948). Superstition in the pigeon. Journal of Experimental Psychology, 38, 168-172.
206. Skinner, B. F. (1984). The phylogeny and ontogeny of behavior. The Behavioral and Brain Sciences, 7, 669-711.
207. Slater, P. J. B., & Ollason, J. C. (1972). The temporal pattern of behaviour in isolated male zebra finches: Transition analysis. Behaviour, 42, 248-269.
208. Smith, S. S., & Renner, K. E. (1976). Preference for food and water in rats as a function of delay of reward. Animal Learning & Behavior, 4, 299-302.
209. Sosa, R., dos Santos, C. V., & Flores, C. (2011). Training a new response using conditioned reinforcement. Behavioural Processes, 87, 231-236.
210. Spetch, M. L., & Honig, W. K. (1988). Characteristics of pigeons' spatial working memory in an open-field task. Learning & Behavior, 16, 123-131.
211. Spetch, M. L., Wilkie, D. M., & Pinel, J. P. (1981). Backward conditioning: A reevaluation of the empirical evidence. Psychological Bulletin, 89, 163-175.
212. Staddon, J. E. R. (1977). Schedule-induced behavior. In W. K. Honig & Staddon (Eds.), Handbook of operant behavior (pp. 125-152). Englewood Clifffs, NJ: Prentice-Hall.
213. Staddon, J. E. R. (1983). Adaptive behavior and learning. New York: Cambridge University Press.
214. Staddon, J. E. R., & Simmelhag, V. (1971). The " superstition" experiment: A re-examination of its implications for the principles of adaptive behavior. Psychological Review, 78, 3-43.
215. Staddon, J. E. R., & Zhang, Y. (1989). Response selection in operant learning. Behavioural Processes, 20, 189-197. (Pubitemid 20065952)
216. Staddon, J. E. R., & Zhang, Y. (1991). On the assignment-of-credit problem in operant learning. In M. Commons, S. Grossberg & Staddon (Eds.), Neural network models of conditioning and action (pp. 279-293). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
217. Stahlman, W. D., Roberts, S., & Blaisdell, A. P. (2010). Effect of reward probability on spatial and temporal variation. Journal of Experimental Psychology. Animal Behavior Processes, 36, 77-91.
218. Stein, L. (1964). Excessive drinking in the rat: Superstition or thirst? Journal of Comparative and Physiological Psychology, 58, 237-242.
219. Stokes, P. D., & Balsam, P. D. (1991). Effects of reinforcing preselected approximations on the topography of the rat's bar press. Journal of the Experimental Analysis of Behavior, 55, 213-231.
220. Stout, S. C., & Miller, R. R. (2007). Sometimes-competing retrieval (SOCR): A formalization of the comparator hypothesis. Psychological Review, 114, 759-783.
221. Sutphin, G., Byrne, T., & Poling, A. (1998). Response acquisition with delayed reinforcement: A comparison of two- lever procedures. Journal of the Experimental Analysis of Behavior, 69, 17-28. (Pubitemid 128457577)
222. Tang, M., Williams, S. L., & Falk, J. L. (1988). Prior schedule exposure reduces the acquisition of schedule-induced polydipsia. Physiology & Behavior, 44, 817-820. (Pubitemid 19037750)
223. Thorndike, E.L. (1933). An experimental study of rewards. Teachers College Contributions to Education.
224. Timberlake, W. (1993). Behavior systems and reinforcement: An integrative approach. Journal of the Experimental Analysis of Behavior, 60, 105-128.
225. Timberlake, W. (1994). Behavior systems, associationism, and Pavlovian conditioning. Psychonomic Bulletin & Review, 1, 405-420.
226. Timberlake, W. (1995). Reconceptualizing reinforcement - a causal, system approach to reinforcement and behavior-change. In W. Odonohue & L. Krasner (Eds.), Theories of behavior therapy (pp. 59-96). 750 First Street NE, Washington, DC 20002: Amer Psychological Assoc.
227. Timberlake, W. (2000). Motivational modes in behavior systems. In R. R. Mowrer & S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 155-209). Mawah, NJ: Erlbaum Associates.
228. Timberlake, W. (2001). Integrating niche-related and general process approaches in the study of learning. Behavioural Processes, 54, 79-94. (Pubitemid 32458018)
229. Timberlake, W., & Lucas, G. A. (1985). The basis of superstitious behavior: Chance contingency, stimulus substitution, or appetitive behavior? Journal of the Experimental Analysis of Behavior, 44, 279-299.
230. Timberlake, W., & Lucas, G. A. (1989). Behavior systems and learning: From misbehavior to general principles. In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Instrumental conditioning theory and the impact of constraints on learning (pp. 237-275). Hillsdale, NJ: Erlbaum.
231. Toates, F.M. (1971). The effect of pretraining on schedule induced polydipsia. Psychonomic Science, 219-220.
232. Tonneau, F. (2005). Windows. Behavioural Processes, 69, 237-247. (Pubitemid 40544594)
233. Wallace, M., & Singer, G. (1976). Schedule induced behavior: A review of its generality, determinants and pharmacological data. Pharmacology Biochemistry and Behavior, 5, 483-490. (Pubitemid 8011032)
234. Ward, R.D., Gallistel, C., Jensen, G., Richards, V.L., Fairhurst, S., & Balsam, P.D. (2012). Conditioned stimulus informativeness governs conditioned stimulus-unconditioned stimulus associability. Journal of Experimental Psychology: Animal Behavior Processes, in press.
235. Wearden, J., & Lejeune, H. (2006). "The stone which the builders rejected": Delay of reinforcement and response rate on fixed-interval and related schedules. Behavioural Processes, 71, 77-87. (Pubitemid 43163005)
236. Whishaw, I. Q., & Gorny, B. P. (1991). Postprandial scanning by the rat (Rattus norvegicus): The importance of eating time and an application of "warm-up" movements. Journal of Comparative Psychology, 105, 39-44.
237. Wilkenfield, J., Nickel, M., Blakely, E., & Poling, A. (1992). Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures. Journal of the Experimental Analysis of Behavior, 58, 431-443.
238. Williams, B. A. (1975). The blocking of reinforcement control. Journal of the Experimental Analysis of Behavior, 24, 215-226.
239. Williams, B. A. (1981). The following schedule of reinforcement as a fundamental determinant of steady state contrast in multiple schedules. Journal of the Experimental Analysis of Behavior, 35, 293-310.
240. Williams, B. A. (1991). Marking and bridging versus conditioned reinforcement. Animal Learning & Behavior, 19, 264-269.
241. Williams, B. A. (1999). Associative competition in operant conditioning: Blocking the response-reinforcer association. Psychonomic Bulletin & Review, 6, 618-623.
242. Williams, D. A., Johns, K. W., & Brindas, M. (2008). Timing during inhibitory conditioning. Journal of Experimental Psychology. Animal Behavior Processes, 34, 237-246. (Pubitemid 351671861)
243. Williams, S. L., Tang, M., & Falk, J. L. (1992). Prior exposure to a running wheel and scheduled food attenuates polydipsia acquisition. Physiology & Behavior, 52, 481-483.
244. Williams, D. R., & Williams, H. (1969). Auto-maintenance in the pigeon: Sustained pecking despite contingent non-reinforcement. Journal of the Experimental Analysis of Behavior, 12, 511-520.
245. Wong, P. T. P. (1977). A behavioral field approach to instrumental learning in the rat: I. Partial reinforcement effects and sex differences. Animal Learning and Behavior, 5, 5-13. (Pubitemid 8057994).