Is matching innate?

Journal of the Experimental Analysis of Behavior

Volumn 87, Issue 2, 2007, Pages 161-199

  Gallistel, C R ^a,c   King, Adam Philip ^b   Gottlieb, Daniel ^a   Balci, Fuat ^a   Papachristos, Efstathios B ^a   Szalecki, Matthew ^a   Carbone, Kimberly S ^b  

^a RUTGERS UNIVERSITY   (United States)

^b FAIRFIELD UNIVERSITY   (United States)

^c RUTGERS UNIVERSITY   (United States)

Author keywords

Behavioral dynamics; Economic rationality; Hopper entry; Income; Investment; Law of effect; Matching; Mice; Reinforcement learning

Indexed keywords

ANIMAL; ANIMAL BEHAVIOR; ARTICLE; C57BL MOUSE; DRIVE; FEMALE; LEARNING; MOUSE; REINFORCEMENT;

ANIMALS; BEHAVIOR, ANIMAL; FEMALE; INSTINCT; LEARNING; MICE; MICE, INBRED C57BL; REINFORCEMENT (PSYCHOLOGY);

EID: 34247180711     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2007.92-05     Document Type: Article

References (45)

1. Balsam, P. D., Fairhurst, S., & Gallistel, C. R. (in press). Unsignaled unconditioned stimuli degrade contingencies by changing cycle time and temporal uncertainty. Journal of Experimental Psychology: Animal Behavior Processes.
2. Belke, T. W. (1992). Stimulus preference and the transitivity of preference. Animal teaming & Behavior, 20, 401-406.
3. Bush, R. R., & Mosteller, F. (1951). A mathematical model for simple learning. Psychological Review, 58, 313-323.
4. Catania, A. C. (1963). Concurrent performances: A baseline for the study of reinforcement magnitude. Journal of the Experimental Analysis of Behavior, 6, 299-300.
5. Church, R. M., & Guilhardi, P. (2005). A Turing test of a timing theory. Behavioural Processes, 69, 45-58.
6. Davis, D. G., Staddon, J. E. R., Machado, A., & Palmer, R. G. (1993). The process of recurrent choice. Psychological Review, 100, 320-341.
7. Davison, M., & Baum, W. M. (2000). Choice in a variable environment: Every reinforcer counts. Journal of the Experimental Analysis of Behavior, 74, 1-24.
8. Dragoi, V., & Staddon, J. E. R. (1999). The dynamics of operant conditioning. Psychological Review, 106, 20-61.
9. Dreyfus, L. R. (1991). Local shifts in relative reinforcement rate and time allocation on concurrent schedules. Journal of Experimental Psychology: Animal Behavior Processes, 17, 486-502.
10. Estes, W. K., & Burke, C. J. (1953). A theory of stimulus variability in learning. Psychological Review, 60, 276-286.
11. Gallistel, C. R., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107, 289-344.
12. Gallistel, C. R., Mark, T. A., King, A. P., & Latham, P. (2001). The rat approximates an ideal detector of changes in rates of reward: Implications for the law of effect. Journal of Experimental Psychology: Animal Behavior Processes, 27, 354-372.
13. Gallistel, C. R., Balsam, P. D., & Fairhurst, S. (2004). The learning curve: Implications of a quantitative analysis, Proceedings of the National Academy of Sciences, 101, 13124-13131.
14. Gibbon, J. (1981). The contingency problem in autoshaping. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.), Autoshaping and conditioning theory (pp. 285-308). New York: Academic.
15. Gibbon, J. (1995). Dynamics of time matching: Arousal makes better seem worse. Psychonomic Bulletin & Review, 2, 208-215.
16. Glover, S., & Dixon, P. (2004). Likelihood ratios: A simple and flexible statistic for empirical psychologists. Psychonomic Bulletin & Review. 11, 791-807.
17. Gottlieb, U. A. (2005). Acquisition with partial and continuous reinforcement in rat magazine approach. Journal of Experimental Psychology: Animal Behavior Processes, 31, 319-333.
18. Gottlieb, D. (2006). Is the number of trials a learning-relevant parameter? Manuscript submitted for publication.
19. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267-272.
20. Herrnstein, R. J., & Loveland, D. H. (1975). Maximizing and matching on concurrent ratio schedules. Journal of the Experimental Analysis of Behavior, 24, 107-116.
21. Herrnstein, R. J., & Prelec, D. (1991). Melioration: A theory of distributed choice. Journal of Economic Perspectives, 5, 137-156.
22. Heyman, G. M. (1979). A markov model description of changeover probabilities on concurrent variable-interval schedules. Journal of the Experimental Analysis of Behavior, 31, 41-51.
23. Heyman, G. M. (1982). Is time allocation unconditioned behavior? In M. Commons, R. Herrnstein, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 2. Matching and maximizing accounts (pp. 459-490). Cambridge, MA: Ballinger Press.
24. Higa, J. J., Thaw, J. M., & Staddon, J. E. R. (1993). Pigeons' wait-time responses to transitions in interfood-interval duration: Another look a cyclic schedule performance. Journal of the Experimental Analysis of Behavior, 59, 529-541.
25. Hinson, J. M., & Staddon, J. E. R. (1983). Matching, maximizing, and hill-climbing. Journal of the Experimental Analysis of Behavior, 40, 321-331.
26. Kass, R. E., & Raferty, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795.
27. Keller, J. V., & Gollub, L. R. (1977). Duration and rate of reinforcement as determinants of concurrent responding. Journal of the Experimental Analysis of Behavior, 28, 145-153.
28. Killeen, P. R. (1985). Incentive theory IV: Magnitude of reward. Journal of the Experimental Analysis of Behavior, 143, 407-417.
29. Killeen, P. R., & Bizo, L. A. (1998). The mechanics of reinforcement. Psychonomic Bulletin & Review, 5, 221-238.
30. Killeen, P. R., Hanson, S. J., & Osborne, S. R. (1978). Arousal: Its genesis and manifestation as response rate. Psychological Review, 85, 571-581.
31. Lea, S. E. G., & Dow, S. M. (1984). The integration of reinforcements over time. In J. Gibbon, & L. Allan (Eds.), Timing and time perception: Vol. 423 (pp. 269-277). New York: Annals of the New York Academy of Sciences.
32. Leon, M. I., & Gallistel, C. (1998). Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively. Journal of Experimental Psychology: Animal Behavior Processes, 24, 265-277.
33. Nevin, J. A. (1979). Overall matching versus momentary maximizing: Nevin (1969) revisited. Journal of Experimental Psychology: Animal Behavior Processes, 5, 300-306.
34. Neuringer, A. J. (1967). Effects of reinforcement magnitude on choice and rate of responding. Journal of the Experimental Analysis of Behavior, 10, 417-424.
35. Papachristos, E. B., & Gallistel, C. R. (2006). Autoshaped head poking in the mouse: A quantitative analysis of the learning curve. Journal of the Experimental Analysis of Behavior, 85, 293-308.
36. Paton, J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006, February 16). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature, 439, 865-870.
37. Real, P. G. (1983). A time-series analysis of changeover performance on concurrent variable-interval schedules. Animal Learning of Behavior, 11, 255-265.
38. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black, & W. F. Prokasy (Eds.), Classical conditioning II (pp. 64-99). New York: Appleton-Century-Crofts.
39. Schwartz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461-464.
40. Shettleworth, S. J., Krebs J. R., Stephens, D. W., & Gibbon, J. (1988). Tracking a fluctuating environment: A study of sampling. Animal Behaviour, 36, 87-105.
41. Skinner, B. F. (1976). Farewell, my lovelyl Journal of the Experimental Analysis of Behavior, 25, 218.
42. Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004, June 18). Matching behavior and the representation of value in the parietal cortex. Science, 304, 1782-1787.
43. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
44. Weiss, P. (1941). Self-differentiation of the basic patterns of coordination. Comparative Psychology Monographs, 17, 1-96.
45. Yechiam, E., & Busemeyer, J. R. (2005). Comparison of basic assumptions embedded in learning models for experienced-based decision making. Psychonomic Bulletin & Review, 12, 387-402.