Estimating the hidden learning representations

Journal of Physiology Paris

Volumn 101, Issue 1-3, 2007, Pages 110-117

  Brovelli, Andrea ^a   Coquelin, Pierre Arnaud ^b   Boussaoud, Driss ^a  

^a AIX MARSEILLE UNIVERSITÉ   (France)

^b CENTRE DE MATHÉMATIQUES APPLIQUÉES   (France)

Author keywords

Arbitrary visuomotor learning; Bayesian model; Maximum likelihood principle; Sequential Monte Carlo methods

Indexed keywords

ARTICLE; BAYES THEOREM; COGNITION; CORRELATION ANALYSIS; LEARNING; MATHEMATICAL MODEL; MAXIMUM LIKELIHOOD METHOD; MONTE CARLO METHOD; NERVE CELL PLASTICITY;

EID: 36649004370     PISSN: 09284257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2007.10.002     Document Type: Article

References (37)

1. Asaad W., and Rainer G. Neural activity in the primate prefrontal cortex during associative learning. Neuron 21 (1998) 1399-1407
2. Balleine B., and Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37 (1998) 407-419
3. Brasted P., and Wise S. Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur. J. Neurosci. 19 (2004) 721-740
4. Brasted, P., Wise, S., 2005. The arbitrary mapping of sensory inputs to volontary and involontary movements: Learning-dependent activity in the motor cortex and other telencephalic networks.
5. Cahusac P., Rolls E., Miyashita Y., and Niki H. Modification of the responses of hippocampal neurons in the monkey during the learning of a conditional spatial response task. Hippocampus 19 (1993) 29-42
6. Chen L., and Wise S. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73 (1995) 1101-1121
7. Chen L., and Wise S. Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73 (1995) 1122-1134
8. Coquelin, P.A., Deguest, R., Munos, R., 2007. Sensitivity analysis in feynman-kac models. Tech. Rep.
9. Dickinson A. Contemporary Animal Learning Theory (1980), Cambridge University Press, UK
10. Dickinson A. Instrumental Conditioning. In: Mackintosh N.J. (Ed). Animal cognition and learning (1994), Academic Press, London 45-79
11. Doucet A., Freitas N.D., and Gordon N. Sequential Monte Carlo Methods in Practice (2001), Springer
12. Doucet A., and Godsill S. On sequential monte carlo sampling methods for bayesian filtering. Stat. Comput. 10 (2000) 197-208
13. Hadj-Bouziane F., and Boussaoud D. Neuronal activity in the monkey striatum during conditional visuomotor learning. Exp. Brain Res. 153 2 (2003) 190-196
14. Herrnstein R. On the law of effect. J. Exp. Anal. Behav. 13 (1970) 243-266
15. Herrnstein R.J. Relative and absolute strength of response as a function of frequency of reinforcement. J. Exp. Anal. Behav. 4 (1961) 267-272
16. Macintosh N. A theory of attention: variations in the associability of stimuli with reinforcement. Psychol. Rev. 82 (1975) 276-298
17. Myung I.J. Tutorial on maximum likelihood estimation. J. Math. Psychol. 47 (2003) 90-100
18. Pasupathy A., and Miller E. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nat. 433 7028 (2005) 873-876
19. Pearce J., and Bouton M. Theories of associative learning in animals. Annu. Rev. Psychol. 52 (2001) 111-139
20. Pearce J., and Hall G. A model for pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87 (1980) 532-552
21. Rescorla, R.A., 1991. Associative relations in instrumental learning: The 18th barlett memorial lecture.
22. Rescorla R.A., and Wagner A.R. A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black A.H., and Prokasy W.F. (Eds). Classical Conditioning II: Current Theory and Research (1972), Appleton-Century-Crofts, New York 64-99
23. Samejima K., Doya K., Ueda K., and Kimura M. Estimating internal variables and parameters of a learning agent by a particle filter. Adv. Neural Inform. Process. Syst. 16 (2004) 1335-1342
24. Schultz W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57 (2006) 87-115
25. Schultz W., and Dickinson A. Neural coding of prediction errors. Annu. Rev. Neurosci. 23 (2000) 473-500
26. Seung, S., 2004. Operant matching. .
27. Spall J.C. Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control (2003), Wiley
28. Sugrue L., Corrado G., and Newsome W. Matching behavior and the representation of value in the parietal cortex. Science 304 5678 (2004) 1782-1787
29. Sugrue L., Corrado G., and Newsome W. Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 6 5 (2005) 363-375
30. Sutton R., and Barto A. Reinforcement Learning: An Introduction (1998), MIT Press
31. Suzuki W., and Brown E.N. Behavioral and neurophysiological analyses of dynamic learning processes. Behav. Cogn. Neurosci. Rev. 4 (2005) 67-95
32. Tremblay L., Hollerman J., and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80 2 (1998) 964-977
33. Tremblay L., and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J. Neurophysiol. 83 4 (2000) 1877-1885
34. Watkins C., and Dayan P. Q-learning. Mach. Learn. 8 (1992) 279-292
35. Williams Z., and Eskandar E. Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat. Neurosci. 9 4 (2006) 562-568
36. Wirth S., Yanike M., Frank L., Smith A., Brown E., and Suzuki W. Single neurons in the monkey hippocampus and learning of new associations. Science 300 5625 (2003) 1578-1581
37. Wise S., and Murray E. Arbitrary associations between antecedents and actions. Trends Neurosci. 23 (2000) 271-276