Bayesian theories of conditioning in a changing world

Trends in Cognitive Sciences

Volumn 10, Issue 7, 2006, Pages 294-300

  Courville, Aaron C ^a   Daw, Nathaniel D ^b   Touretzky, David S ^c  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN ENTERPRISE; BAYESIAN THEORIES; PAVLOVIAN CONDITIONING;

BEHAVIORAL RESEARCH; CONSTRAINT THEORY; LEARNING SYSTEMS; SIGNAL PROCESSING; STATISTICAL MECHANICS; THEOREM PROVING;

COGNITIVE SYSTEMS;

ANIMAL BEHAVIOR; ARTICLE; BAYES THEOREM; CONDITIONING; LEARNING; REINFORCEMENT; STATISTICAL ANALYSIS;

ANIMALS; ASSOCIATION LEARNING; BAYES THEOREM; BEHAVIOR, ANIMAL; CONDITIONING, CLASSICAL; EXTINCTION, PSYCHOLOGICAL; HUMANS; INHIBITION (PSYCHOLOGY); PROBLEM SOLVING; REINFORCEMENT SCHEDULE; SOCIAL CHANGE; SOCIAL ENVIRONMENT; STOCHASTIC PROCESSES; UNCERTAINTY;

EID: 33746365099     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2006.05.004     Document Type: Article

References (33)

1. Rescorla R.A., and Wagner A.R. A theory of Pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement. In: Black A.H., and Prokasy W.F. (Eds). Classical Conditioning, 2: Current Research and Theory (1972), Appleton-Century-Crofts 64-69
2. Mackintosh N.J. A theory of attention: Variations in the associability of stimuli with reinforcement. Psychol. Rev. 82 (1975) 532-552
3. Pearce J.M., and Hall G. A model for Pavlovian learning: Variation in the effectiveness of conditioned but not unconditioned stimuli. Psychol. Rev. 87 (1980) 532-552
4. Le Pelley M.E. The role of associative history in models of associative learning: A selective review and a hybrid model. Q. J. Exp. Psychol. B. 57 (2004) 193-243
5. Dayan, P. and Long, T. (1998) Statistical models of conditioning. In Advances in Neural Information Processing Systems Vol. 10 (Kearns M.J. et al., eds), pages 117-123, MIT Press
6. Dayan P., et al. Learning and selective attention. Nat. Neurosci. 3 (2000) 1218-1223
7. Gallistel C.R., and Gibbon J. Time, rate and conditioning. Psychol. Rev. 107 (2000) 289-344
8. Courville A.C., and Touretzky D.S. Modeling temporal structure in classical conditioning. In: Dietterich T.G., et al. (Ed). Advances in Neural Information Processing Systems Vol. 14 (2001), MIT Press 3-10
9. Kakade S., and Dayan P. Acquisition and extinction in autoshaping. Psychol. Rev. 109 (2002) 533-544
10. Courville A.C., et al. Model uncertainty in classical conditioning. In: Thrun S., et al. (Ed). Advances in Neural Information Processing Systems Vol. 16 (2003), MIT Press 977-984
11. Courville A.C., et al. Similarity and discrimination in classical conditioning: A latent variable account. In: Saul L.K., et al. (Ed). Advances in Neural Information Processing Systems Vol. 17 (2004), MIT Press 313-320
12. Tenenbaum J.B., and Griffiths T.L. Structure learning in human causal induction. In: Leen T.K., et al. (Ed). Advances in Neural Information Processing Systems Vol. 13 (2001), MIT Press 59-65
13. Dayan P., Kakade S., et al. Explaining away in weight space. In: Leen T.K., et al. (Ed). Advances in Neural Information Processing Systems Vol. 13 (2001), MIT Press 451-457
14. Dayan P., and Yu A. ACh, uncertainty, and cortical inference. In: Dietterich T.G., et al. (Ed). Advances in Neural Information Processing Systems Vol. 14 (2001), MIT Press 189-196
15. Lubow R.E. Latent inhibition. Psychol. Bull. 79 (1973) 398-407
16. Hall G., and Pearce J.M. Latent inhibition of a CS during CS-US pairings. J. Exp. Psychol. Anim. Behav. Process. 5 (1979) 31-42
17. Lubow R.E., and Moore A.U. Latent inhibition: the effect of nonreinforced preexposure to the conditional stimulus. J. Comp. Physiol. Psychol. 52 (1959) 415-419
18. Hall G., and Pearce J.M. Restoring the associability of a preexposed CS by a surprising event. Q. J. Exp. Psychol. B. 34 (1982) 127-140
19. Blaisdell A.P., et al. Unblocking with qualitative change of unconditioned stimulus. Learn. Motiv. 28 (1997) 268-279
20. Blaisdell A.P., et al. Overshadowing and latent inhibition counteract each other: Support for the comparator hypothesis. J. Exp. Psychol. Anim. Behav. Process. 24 (1998) 335-351
21. Pavlov I.P. Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex (1927), Oxford University Press
22. Wilson P.N., et al. Restoration of the orienting response to a light by a change in its predictive accuracy. Q. J. Exp. Psychol. 44B (1992) 17-36
23. Holland P.C. Brain mechanisms for changes in processing of conditioned stimuli in Pavlovian conditioning: Implications for behavior theory. Anim. Learn. Behav. 25 (1997) 373-399
24. Gibbon J., et al. Partial reinforcement in autoshaping with pigeons. Anim. Learn. Behav. 8 (1980) 45-59
25. Rescorla R.A. Within-subject partial reinforcement extinction effect in autoshaping. Q. J. Exp. Psychol. B. 52 (1999) 75-87
26. Haselgrove M., et al. A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning. J. Exp. Psychol. Anim. Behav. Process. 30 (2004) 240-250
27. Pearce J.M., et al. Partial reinforcement in appetitive Pavlovian conditioning with rats. Q. J. Exp. Psychol. B. 50 (1997) 273-294
28. Rescorla R.A. Partial reinforcement reduces the associative change produced by nonreinforcement. J. Exp. Psychol. Anim. Behav. Process. 25 (1999) 403-414
29. Kaye H., and Pearce J.M. The strength of the orienting response during Pavlovian conditioning. J. Exp. Psychol. Anim. Behav. Process. 10 (1984) 90-109
30. Yu A.J., and Dayan P. Uncertainty, neuromodulation, and attention. Neuron 46 (2005) 681-692
31. Gallistel C.R., et al. The rat approximates an ideal detector of changes in rates of reward: Implications for the law of effect. J. Exp. Psychol. Anim. Behav. Process. 27 (2001) 354-372
32. Kurth-Nelson Z., and Redish A.D. μ-agents: Action-selection in temporally dependent phenomena using temporal difference learning over a collective belief structure. Soc. Neurosci. Abstr. 30 (2004) 2071
33. Gallistel C.R., et al. The learning curve: Implications of a quantitative analysis. Proc. Natl. Acad. Sci. U. S. A. 101 (2004) 13124-13131