Effect of Reward Probability on Spatial and Temporal Variation

Journal of Experimental Psychology: Animal Behavior Processes

Volumn 36, Issue 1, 2010, Pages 77-91

  Stahlman, W David ^a   Roberts, Seth ^b,c   Blaisdell, Aaron P ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

behavioral variation; expectation; reward probability

Indexed keywords

ANIMAL; ANIMAL BEHAVIOR; ARTICLE; DEPTH PERCEPTION; INSTRUMENTAL CONDITIONING; MALE; PHYSIOLOGY; PIGEONS AND DOVES; PROBABILITY; REINFORCEMENT; REWARD; TIME PERCEPTION;

ANIMALS; BEHAVIOR, ANIMAL; COLUMBIDAE; CONDITIONING, OPERANT; MALE; PROBABILITY; REINFORCEMENT SCHEDULE; REWARD; SPACE PERCEPTION; TIME PERCEPTION;

COLUMBA; RATTUS;

EID: 76849102608     PISSN: 00977403     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0015971     Document Type: Article

References (40)

1. Antonitis J.J. Response variability in the white rat during conditioning, extinction, and reconditioning. Journal of Experimental Psychology 42 (1951) 273-281
2. Balsam P.D., Deich J.D., Ohyama T., and Stokes P.D. Origins of new behavior. In: O'Donohue W. (Ed). Learning and behavior therapy (1998), Allyn & Bacon, Boston 403-420
3. Beck C.H., and Loh E.A. Reduced behavioral variability in extinction: Effects of chronic treatment with the benzodiazepine, diazepam or with ethanol. Psychopharmacology 100 (1990) 323-327
4. Blough D.S. Interresponse time as a function of continuous variables: A new method and some data. Journal of the Experimental Analysis of Behavior 6 (1963) 237-246
5. Bowers M.T., Hill J., and Palya W.L. Interresponse time structures in variable-ratio and variable-interval schedules. Journal of the Experimental Analysis of Behavior 90 (2008) 345-362
6. Breland K., and Breland M. The misbehavior of organisms. American Psychologist 16 (1961) 681-684
7. Brown P.L., and Jenkins H.M. Auto-shaping the pigeon's key peck. Journal of the Experimental Analysis of Behavior 11 (1968) 1-8
8. Cherot C., Jones A., and Neuringer A. Reinforced variability decreases with approach to reinforcers. Journal of Experimental Psychology: Animal Behavior Processes 22 (1996) 497-508
9. Collins L., and Pearce J.M. Predictive accuracy and the effects of partial reinforcement on serial autoshaping. Journal of Experimental Psychology: Animal Behavior Processes 11 (1985) 548-564
10. Crow L.T. A comparison of the effects of extinction and satiety on operant response duration in the rat. Bulletin of the Psychonomic Society 11 (1978) 86-88
11. Devenport L.D. Extinction-induced spatial dispersion in the radial arm maze: Arrest by ethanol. Behavioral Neuroscience 98 (1984) 979-985
12. Eckerman D.A., and Lanson R.N. Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement, and extinction. Journal of the Experimental Analysis of Behavior 12 (1969) 73-80
13. Ferster C.B., and Skinner B.F. Schedules of reinforcement (1957), Appleton-Century-Crofts, New York
14. Frick F.C., and Miller G.A. A statistical description of operant conditioning. American Journal of Psychology 64 (1951) 20-36
15. Gharib A., Derby S., and Roberts S. Timing and the control of variation. Journal of Experimental Psychology: Animal Behavior Processes 27 (2001) 165-178
16. Gharib A., Gade C., and Roberts S. Control of variation by reward probability. Journal of Experimental Psychology: Animal Behavior Processes 30 (2004) 271-282
17. Guilhardi P., and Church R.M. The pattern of responding after extensive extinction. Learning & Behavior 34 (2006) 269-284
18. Hearst E., and Jenkins H.M. Sign-tracking: The stimulus-reinforcer relation and directed action (1974), Psychonomic Society, Austin, TX
19. Holt D.D., Green L., and Muenks W.M. Biological and economic effects on responding: Rate and duration of the pigeon's key peck. International Journal of Comparative Psychology 17 (2004) 203-221
20. Jenkins P.E. The determiners of keypeck duration. Animal Learning & Behavior 9 (1981) 501-507
21. Mechner F. Sequential dependencies of the lengths of consecutive response runs. Journal of the Experimental Analysis of Behavior 1 (1958) 229-233
22. Mechner F., Hyten C., Field D.P., and Madden G. Using revealed operants to study the structure and properties of human operant behavior. Psychological Record 47 (1997) 45-68
23. Morgan D.L., and Lee K. Extinction-induced response variability in humans. Psychological Record 46 (1996) 145-159
24. Neuringer A., Kornell N., and Olufs M. Stability and variability in extinction. Journal of Experimental Psychology: Animal Behavior Processes 27 (2001) 79-94
25. Pearce J.M., and Hall G. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review 87 (1980) 532-552
26. Rescorla R.A. Spontaneous recovery. Learning and Motivation 11 (2004) 501-509
27. Roberts S. Transform your data. Nutrition 24 (2008) 492-494
28. Roberts S., and Gharib A. Variation of bar-press duration: Where do new responses come from?. Behavioral Processes 75 (2006) 215-223
29. Schwartz B. Studies of operant and reflexive key pecks in the pigeon. Journal of the Experimental Analysis of Behavior 27 (1977) 301-313
30. Schwartz B. Development of complex, stereotyped behavior in pigeons. Journal of the Experimental Analysis of Behavior 33 (1980) 153-166
31. Schwartz B., and Williams D.R. Two different kinds of key peck in the pigeon: Some properties of responses maintained by negative and positive response-reinforcer contingencies. Journal of the Experimental Analysis of Behavior 18 (1972) 201-216
32. Shull R.L., Gaynor S.T., and Grimes J.A. Response rate viewed as engagement bouts: Effects of relative reinforcement and schedule type. Journal of the Experimental Analysis of Behavior 75 (2001) 247-274
33. Staddon J.E.R., and Simmelhag V.L. The "superstition" experiment: A reexamination of its implications for the principles of adaptive behavior. Psychological Review 71 (1971) 3-43
34. Stokes P. Creativity from constraints (2005), Springer, New York
35. Sutton R.S., and Barto A.G. Reinforcement learning: An introduction (1998), MIT Press, Cambridge, MA
36. Timberlake W. The functional organization of appetitive behavior: Behavior systems and learning. In: Zeiler M.D., and Harzem P. (Eds). Advances in analysis of behavior: Vol. 3. Biological factors in learning (1983), Wiley, Chichester, England 177-221
37. Timberlake W., and Lucas G.A. Behavior systems and learning: From misbehavior to general principles. In: Klein S.B., and Mowrer R.R. (Eds). Contemporary learning theory: Instrumental conditioning theory and the impact of biological constraints on learning (1989), Erlbaum, Hillsdale, NJ 237-276
38. Tolkamp B.J., and Kyriazakis I. To split behaviour into bouts, log-transform the intervals. Animal Behaviour 57 (1999) 807-817
39. Tukey J.W. Exploratory data analysis (1977), Addison Wesley, Reading, MA
40. Ziriax J.M., and Silberberg A. Discrimination and emission of different key-peck durations in the pigeon. Journal of Experimental Psychology: Animal Behavior Processes 4 (1978) 1-21