Chapter 18 Selection networks: Simulation of plasticity through reinforcement learning

Advances in Psychology

Volumn 121, Issue C, 1997, Pages 336-357

  Donahoe, John W ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77956724334     PISSN: 01664115     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0166-4115(97)80104-5     Document Type: Chapter

References (43)

1. D.G. Amaral M.P. Witter The three-dimensional organization of the hippocampal formation: A review of anatomical data Neuroscience 31 1989 571 591 (12)
2. A.G. Barto Adaptive critics and the basal ganglia J.C. Houk J.L. Davis D.C. Beiser Models of information processing in the basal ganglia 17 1995 MIT Press Cambridge, MA 215 232 (20)
3. M.F. Bear W. Singer Modulation of visual cortical plasticity by acetylcholine and noradrenaline Nature 320 1986 172 176 (8)
4. A.J. Berger P.L. Gaspar R.N. Verney Dopaminergic innervation of the cerebral cortex: Unexpected differences between rodents and primates Trends in Neurosciences 14 1991 21 27 (18)
5. D.S. Blough Steady state data and a quantitative model of operant generalization and discrimination J. of Experimental Psychology: Animal Behavior Processes 1 1975 3 21 (18)
6. R. Brown C. Hanlon Derivational complexity and order of acquisition in child speech J.R. Hayes Cognition and the development of language 1970 Wiley New York (18)
7. L.A. Chioda T.W. Berger Interactions between dopamine and amino-acid induced excitation and inhibition in the striatum Brain Research 375 1986 198 203 (18)
8. R.L. De Valois K.K. De Valois Spatial vision 1988 Oxford University Press New York (18)
9. J.W. Donahoe J.E. Burgos D.C. Palmer A selectionist approach to reinforcement J. of the Experimental Analysis of Behavior 60 1993 17 40 (4) (6) (18) (26)
10. J.W. Donahoe M.A. Crowley W.J. Millard K.A. Stickney A unified principle of reinforcement Quantitative models of behavior 2 1982 Ballinger Cambridge, MA 493 521 (1) (14) (18)
11. J.W. Donahoe D.C. Palmer The interpretation of complex behavior: Some reactions to Parallel Distributed Processing J. of the Experimental Analysis of Behavior 51 1989 399 416 (18)
12. J.W. Donahoe D.C. Palmer Learning and complex behavior 1994 Allyn & Bacon Boston (1) (4) (16) (14) (18) (26)
13. C. Emmeche S. Sampson The garden in the machine: The emerging science of Artificial Life 1991 Princeton University Press Princeton, NJ (1994), (4)
14. J.H. Fallon S.E. Laughlin Monoamine innervation of cerebral cortex and a theory of the role of monoamines in cerebral cortex and basal ganglia E.G. Jones A. Peters Cerebral cortex Further aspects of cortical Junction, including hippocampus 6 1987 Plenum New York 41 127 (18)
15. J.M. Fuster The prefrontal cortex 1989 Raven New York (18)
16. P.S. Goldman-Rakic Circuitry of primate prefrontal cortex and regulation of behavior by representational memory V.B. Mountcastle F. Plum S.R. Geiger Handbook of physiology Vol. I 1987 Oxford University Press New York 373 417 section 1, (18)
17. P.E. Goldman-Rakic M. Chafee H. Friedman Allocation of function in distributed circuits T. Ono L.R. Squire M.E. Raichle D.I. Perrett M. Fukada Brain mechanisms of perception and memory: From neuron to behavior 1993 Oxford University Press New York 445 456 (18)
18. P.M. Groves M. Garcia-Munoz J.C. Linder M.S. Manley M.E. Martone S.J. Young Elements of the intrinsic organization and information processing in the neostriatum J.C. Houk J.L. Davis D.G. Beiser Models of information processing in the basal ganglia 1995 MIT Press Cambridge 51 96 (17)
19. P.M. Groves J.C. Linder S.J. Young 5-Hydroxydopamine-labeIed axons: Three dimensional reconstructions of axons, synapses, and postsynaptic targets in rat neostriatum Neuroscience 58 1994 593 604 (17) (18)
20. H.K. Hartline F. Ratliffe Inhibitory interaction of receptor units in the eye of Limulus J. of General Physiology 40 1957 357 376 (18)
21. B.G. Hoebel Neuroscience and motivation: Pathways and peptides that define motivational systems R.A. Atkinson Stevens' handbook of experimental psychology 1988 Wiley New York 547 625 (18)
22. J.C. Houk J.L. Adams A.G. Barto J.C. Houk J.L. Davis D.C. Beiser A model of how the basal ganglia generate and use neural signals that predict reinforcement Models of information processing in the basal ganglia 1995 MIT Press Cambridge, MA 249 270 (17) (18) (20)
23. D.H. Hubel T.N. Wiesel Receptive fields and functional architecture of monkey striate cortex J. of Physiology (London) 195 1968 215 243 (18)
24. T.M. Jay F. Burette S. Laroche NMDA receptor-dependent long-term potentiation in the hippocampal afferent fiber system to the prefrontal cortex in the rat European J. of Neuroscience 7 1995 247 250 (18)
25. S. Kalsner T.C. Westfall Presynaptic receptors and the question of autoregulation of neurotransmitter release. Annals of the New York Academy of Sciences 604 1990 652 655 (5) (18)
26. L.J. Kamin B.A. Campbell R.M. Church Predictability, surprise, attention and conditioning Punishment and aversive behavior 1969 Appleton-Century-Crofts New York 279 296 (14) (18)
27. B.J. Knowlton J.A. Mangels L.R. Squire A neostriatal habit learning system in humans Science 273 1996 1399 1402 (18)
28. O.A. Lindvall A. Bjorklund I. Divac Oiganization of catecholamine neurons projecting to frontal cortex in the rat Brain Research 142 1978 1 24 (18)
29. J. Olds P. Milner Positive reinforcement produced by electrical stimulation of the septal and other regions of rat brain J. of Comparative and Physiological Psychology 47 1954 419 427 (18)
30. D.C. Palmer Chomsky's nativism: A critical review P.N. Chase L.J. Parrott Psychological aspects of language 1986 Charles Thomas Springfield, IL 49 60 (18)
31. I.P. Pavlov Conditioned reflexes 1927 Oxford University Press London Reprint: New York: Dover, 1960. (4) (18)
32. R.A. Rescorla Probability of shock in the presence and absence of CS in fear conditioning J. of Comparative and Physiological Psychology 66 1968 1 5 (4)
33. R.A. Rescorla A.R. Wagner A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement A.H. Black W.F. Prokasy Classical conditioning II: Current research and theory 1972 Appleton-Century-Crofts New York 64 99 (1) (12) (14) (17) (18) (21)
34. D.E. Rumelhart G.E. Hinton R.J. Williams Learning internal representations by error propagation D.E. Rumelhart J.L. McClelland Parallel distributed processing: Explorations in the microstructure of cognition, (Vol 1 1986 Bradford Books/MIT Press Cambridge, MA 318 362 (1) (12) (16) (18) (19) (25)
35. W. Schultz R. Romo T. Ljungberg J. Mirenowicz J.R. Hollerman A. Dickinson Reward-related signals carried by dopamine neurons J.C. Houk J.L. Davis D.G. Beiser Models of information processing in the basal ganglia 1995 MIT Press Cambridge, MA 233 248 (17) (18)
36. P. Shizgal C. Bielajew P.-P. Rompre Quantitative characteristics of the directly stimulated neurons subserving self-stimulation of the medial forebrain bundle: Psychophysical inference and electrophysiological measurement M.L. Commons R.M. Church J.R. Stellar A.R. Wagner Quantitative analyses of behavior Biological determinants of reinforcement 7 1988 Lawrence Erlbaum Hillsdale, NJ 59 85 (18)
37. W. Singer The formation of cooperative cell assemblies in the visual cortex J. of Experimental Biology 153 1990 177 197 (8)
38. B.F. Skinner The behavior of organisms 1938 Appleton-Century-Crofts New York (14) (16) (18)
39. K.W. Spence The role of secondary reinforcement in delayed reward learning Psychological Review 54 1947 1 8 (18)
40. L. Stein J.D. Belluzzi Cellular investigations on behavioral reinforcement Neuroscience and Biobehavior Reviews 13 1989 69 80 (18)
41. L. Stein B.G. Xue J.D. Belluzzi A cellular analogue of operant conditioning J. of the Experimental Analysis of Behavior 60 1993 41 53 (18)
42. J.R. Stellar E. Stellar The neurobiology of motivation and reward 1985 Springer-Verlag Heidelberg (18)
43. J. Wickens R. Kötter Cellular models of reinforcement J.C. Houk J.L. Davis D.G. Beiser Models of information processing in the basal ganglia 1995 MIT Press Cambridge, MA 187 214 (17) (18)