The Behavioral Economics of Choice and Interval Timing

Psychological Review

Volumn 116, Issue 3, 2009, Pages 519-539

  Jozefowiez, J ^a   Staddon, J E R ^b   Cerutti, D T ^c  

^a UNIVERSITY OF MINHO   (Portugal)

^b DUKE UNIVERSITY   (United States)

^c CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

behavioral economic model; choice; interval timing; reinforcement; Weber's law

Indexed keywords

ANIMAL; ARTICLE; DECISION MAKING; DIFFERENTIAL THRESHOLD; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; MOTIVATION; PERCEPTIVE DISCRIMINATION; PIGEONS AND DOVES; PSYCHOPHYSICS; RAT; REINFORCEMENT; STATISTICAL MODEL; TIME PERCEPTION;

ANIMALS; CHOICE BEHAVIOR; COLUMBIDAE; CONDITIONING, OPERANT; DIFFERENTIAL THRESHOLD; DISCRIMINATION (PSYCHOLOGY); HUMANS; MODELS, STATISTICAL; MOTIVATION; PROBABILITY LEARNING; PSYCHOPHYSICS; RATS; REINFORCEMENT SCHEDULE; TIME PERCEPTION;

EID: 67651027239     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0016171     Document Type: Article

References (72)

1. Ainslie G., and Monterosso L. A marketplace in the brain?. Science 306 (2004, October 15) 421-423
2. Bateson M., and Kacelnik K. Preference for fixed and variable food sources: Variability in amount and delay. Journal of the Experimental Analysis of Behavior 63 (1995) 313-329
3. Bizo L.A., Chu J.Y.M., Sanabria F., and Killeen P.R. The failure of Weber's law in time perception and production. Behavioural Processes 71 (2006) 201-210
4. Bizo L.A., and White K.G. The behavioral theory of timing: Reinforcer rate determines pacemaker rate. Journal of the Experimental Analysis of Behavior 61 (1994) 19-33
5. Bizo L.A., and White K.G. Pacemaker rate in the behavioral theory of timing. Journal of Experimental Psychology: Animal Behavior Processes 20 (1994) 308-321
6. Bizo L.A., and White K.G. Biasing the pacemaker in the behavioral theory of timing. Journal of the Experimental Analysis of Behavior 64 (1995) 225-235
7. Bizo L.A., and White K.G. Reinforcement context and pacemaker rate in the behavioral theory of timing. Animal Learning & Behavior 23 (1995) 376-382
8. Bush R.R., and Mosteller F. Stochastic models for learning (1955), Wiley, New York
9. Catania A.C. Reinforcement schedules and the psychophysical judgments: A study of some temporal properties of behavior. In: Schoenfeld W.N. (Ed). The theory of reinforcement schedules (1970), Appleton-Century-Crofts, New York 1-42
10. Cerutti D.T., and Staddon J.E.R. Immediacy versus anticipated delay in the time-left experiment: A test of the cognitive hypothesis. Journal of Experimental Psychology: Animal Behavior Processes 30 (2004) 45-57
11. Cerutti D.T., and Staddon J.E.R. Time and rate measures in choice transitions. Journal of the Experimental Analysis of Behavior 81 (2004) 135-154
12. Church R.M. Temporal learning. In: Pashler H., and Gallistel C.R. (Eds). Stevens' handbook of experimental psychology, Vol. 3: Learning, motivation and emotion. 3rd ed. (2004), Wiley, New York 365-393
13. Church R.M., and Deluty M.Z. Bisection of temporal intervals. Journal of Experimental Psychology: Animal Behavior Processes 3 (1977) 216-228
14. Crowley M.A., and Donahoe J.W. Matching: Its acquisition and generalization. Journal of the Experimental Analysis of Behavior 82 (2004) 143-159
15. Crystal J.D. Systematic nonlinearities in the perception of temporal intervals. Journal of Experimental Psychology: Animal Behavior Processes 25 (1999) 3-17
16. Dehaene S. Subtracting pigeons: Logarithmic or linear?. Psychological Sciences 12 (2001) 244-246
17. De Villiers P.A. Choice in concurrent schedules and a quantitative formulation of the law of effect. In: Honig W.K., and Staddon J.E.R. (Eds). Handbook of operant behavior (1977), Prentice Hall, Englewood Cliffs, NJ 233-287
18. Dews P.B. The theory of fixed-interval responding. In: Schoenfeld W.N. (Ed). The theory of reinforcement schedules (1970), Appleton-Century-Crofts, New York 43-61
19. Falmagne J.C. Elements of psychophysical theory (1985), Oxford University Press, Oxford, United Kingdom
20. Ferster C.B., and Skinner B.F. Schedules of reinforcement (1957), Appleton-Century-Crofts, New York
21. Foote A.L., and Crystal J.D. Metacognition in the rat. Current Biology 17 (2007) 551-555
22. Gallistel C.R., and Gibbon J. Time, rate, and conditioning. Psychological Review 107 (2000) 289-344
23. Gibbon J. Scalar expectancy theory and Weber's law in animal timing. Psychological Review 84 (1977) 279-385
24. Gibbon J. On the form and location of the psychometric bisection function for time. Journal of Mathematical Psychology 24 (1981) 58-87
25. Gibbon J., and Church R. Time left: Linear versus logarithmic subjective time. Journal of Experimental Psychology: Animal Behavior Processes 22 (1981) 3-38
26. Gibbon J., Church R.M., and Meck W.H. Scalar timing in memory. Annals of the New York Academy of Sciences 423 (1984) 52-77
27. Grace R.C., Berg M.E., and Kyonka E.G. Choice and timing in concurrent chains: Effects of initial-link duration. Behavioural Processes 71 (2006) 188-200
28. Guilhardi P., MacInnis M.L.M., Church R.M., and Machado A. Shifts in the psychophysical function in rats. Behavioural Processes 75 (2007) 167-175
29. Herrnstein R.J. Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior 9 (1961) 267-272
30. Hinson J.M., and Staddon J.E.R. Matching, maximizing and hill climbing. Journal of the Experimental Analysis of Behavior 40 (1983) 321-331
31. Jozefowiez J., Cerutti D.T., and Staddon J.E.R. Timing in choice experiments. Journal of Experimental Psychology: Animal Behavior Processes 31 (2005) 213-225
32. Jozefowiez J., Cerutti D.T., and Staddon J.E.R. Timescale invariance and Weber's law in choice. Journal of Experimental Psychology: Animal Behavior Processes 32 (2006) 229-238
33. Jozefowiez, J., Polack, C. W., & Miller, R. R. (2009). Economic factors influence human temporal judgments in a bisection task. Manuscript submitted for publication.
34. Jozefowiez J., and Staddon J.E.R. Operant behavior. In: Menzel R., and Byrne G. (Eds). Learning and memory: A comprehensive reference. Vol. 1: Learning theory and behavior (2008), Elsevier, Oxford, United Kingdom 75-102
35. Jozefowiez J., Staddon J.E.R., and Cerutti D.T. Metacognition in animals: How do we know that they know?. Comparative Cognition & Behavior Reviews 4 (2009) 19-29
36. Kacelnik A., and Bateson M. Risky theories: The effects of variance on foraging decisions. American Zoologist 36 (1996) 293-311
37. Killeen P.R., and Fetterman J.G. A behavioral theory of timing. Psychological Review 95 (1988) 274-295
38. Kirkpatrick K. A packet theory of timing. Behavioural Processes 57 (2002) 89-106
39. Lejeune H., and Wearden J.H. The comparative psychology of fixed-interval responding: Some quantitative analysis. Learning and Motivation 22 (1991) 84-111
40. Machado A. Learning the temporal dynamics of behavior. Psychological Review 104 (1997) 241-265
41. Machado A., and Arantes J. Further tests of the scalar expectancy theory (SET) and the learning-to-time (LeT) model in a temporal bisection task. Behavioural Processes 72 (2006) 195-206
42. Machado A., and Guilhardi P. Shifts in the psychometric function and their implications for models of timing. Journal of the Experimental Analysis of Behavior 74 (2000) 25-54
43. Machado A., and Keen R. Learning to time (LeT) or scalar expectancy theory (SET)? A critical test of two models of timing. Psychological Science 10 (1999) 285-290
44. Machado A., and Pata P. Testing the scalar expectancy theory (SET) and the learning-to-time model (LeT) in a double bisection task. Learning and Behavior 33 (2003) 111-122
45. Mazur J.E. Hyperbolic value addition and general models of animal choice. Psychological Review 108 (2001) 96-112
46. Metcalfe J., and Kober H. Self-reflective consciousness and the projectable self. In: Terrace H., and Metcalfe J. (Eds). The missing link in cognition: Origins of self-reflective consciousness (2005), Oxford University Press, New York 57-83
47. Preston R.A. Choice in the time-left experiment and in concurrent chains with a time-left terminal link. Journal of the Experimental Analysis of Behavior 61 (1994) 349-373
48. Shapiro M.S., Miller S., and Kacelnik A. Simultaneous and sequential choice as a function of reward delay and magnitude: Normative, descriptive and process-based models tested in the European starling (Sturnus vulgaris). Journal of Experimental Psychology: Animal Behavior Processes 34 (2008) 75-93
49. Shimp C.P. Probabilistically reinforced choice behavior in pigeons. Journal of the Experimental Analysis of Behavior 9 (1966) 443-455
50. Shull R.L., and Pliskoff S.S. Changeover delay and concurrent schedules: Some effects of relative performance measures. Journal of the Experimental Analysis of Behavior 10 (1967) 517-527
51. Skinner B.F. The behavior of organisms (1938), Appleton-Century-Crofts, New York
52. Smith J.D., Shields W.E., Allendoerfer K.R., and Washburn D.A. The uncertain response in humans and animals. Cognition 62 (1997) 75-97
53. Staddon J.E.R. Adaptive dynamics (2001), MIT Press, Cambridge, MA
54. Staddon J.E.R. Interval timing: A memory, not a clock. Trends in Cognitive Sciences 9 (2005) 312-314
55. Staddon J.E.R., and Cerutti D.T. Operant conditioning. Annual Review of Psychology 54 (2003) 115-144
56. Staddon J.E.R., and Ettinger R.H. Learning: An introduction to the principles of adaptive behavior (1989), Harcourt-Brace-Jovanovich, San Diego, CA
57. Staddon J.E.R., and Higa J.J. Multiple time scales in simple habituation. Psychological Review 103 (1996) 720-733
58. Staddon J.E.R., and Higa J.J. Time and memory: Towards a pacemaker-free theory of interval timing. Journal of the Experimental Analysis of Behavior 71 (1999) 215-251
59. Staddon J.E.R., Hinson J.M., and Kram R. Optimal choice. Journal of the Experimental Analysis of Behavior 35 (1981) 397-412
60. Staddon J.E.R., and Innis N.K. Preference for fixed vs. variable amounts of reward. Psychonomic Science 4 (1966) 193-194
61. Staddon J.E.R., Jozefowiez J., and Cerutti D.T. Metacognition: A problem, not a process (2007). http://psycrit.com/Targets/2007-Foote/2007-03-15_Staddon Available from Psycrit database at http://psycrit.com/Targets/2007-Foote/2007-03-15_Staddon
62. Staddon J.E.R., and Motheral S. On matching and maximizing in operant choice experiments. Psychological Review 85 (1978) 436-444
63. Staddon J.E.R., and Zhang Y. On the assignment-of-credit problem in operant learning. In: Commons M.L., Grossberg S., and Staddon J.E.R. (Eds). Neural networks of conditioning and action (1991), Erlbaum, Hillsdale, NJ 279-293
64. Stubbs D.A. The discrimination of stimulus duration by pigeons. Journal of the Experimental Analysis of Behavior 11 (1968) 223-238
65. Stubbs D.A. Temporal discrimination and a free-operant psychophysical procedure. Journal of the Experimental Analysis of Behavior 33 (1980) 167-185
66. Sutton R.S., and Barto A.G. Reinforcement learning: An introduction (1998), MIT Press, Cambridge, MA
67. Todorov J.C., Souza D.G., and Bori C.M. Momentary maximizing in concurrent schedules with a minimum interchangeover interval. Journal of the Experimental Analysis of Behavior 60 (1993) 415-435
68. Washburn D.A., Smith J.D., and Shields W.E. Rhesus monkeys (Macaca mulatta) immediately generalize the uncertain response. Journal of Experimental Psychology: Animal Behavior Processes 62 (2006) 185-189
69. Whitaker S., Lowe C.F., and Wearden J.H. When to respond? And how much? Temporal control and response output on mixed fixed-interval schedules with unequally-probable components. Behavioural Processes 77 (2008) 33-42
70. Williams B.A. Reinforcement, choice and response strength. In: Atkinson R.C., Herrnstein R.J., Lindzey G., and Luce R.D. (Eds). Stevens' handbook of experimental psychology, Vol. 2: Learning and cognition. 2nd ed. (1988), Wiley, New York 167-244
71. Wynne C.D.L., and Staddon J.E.R. Typical delay determines typical waiting time on periodic-food schedules: Static and dynamic tests. Journal of the Experimental Analysis of Behavior 50 (1988) 91-101
72. Zeiler M.D., and Powell D.G. Temporal control in fixed-interval schedules. Journal of the Experimental Analysis of Behavior 61 (1994) 1-9