Chapter 4 Evolving artificial neural networks in pavlovian environments

Advances in Psychology

Volumn 121, Issue C, 1997, Pages 58-79

  Burgos, José E ^a,b  

^a UNIVERSIDAD CENTRAL DE VENEZUELA   (Venezuela)

^b UNIVERSIDAD CATÓLICA ANDRÉS BELLO   (Venezuela)

Author keywords

artificial neural networks; evolution; genetic algorithms; ISI functions; Pavlovian conditioning

Indexed keywords

EID: 77956758224     PISSN: 01664115     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0166-4115(97)80090-8     Document Type: Chapter

References (87)

1. D. Ackley M. Littman Interactions between learning and evolution C.G. Langton C. Taylor J.D. Farmer S. Rasmussen Artificial Life II: Proceedings of the Workshop on Artificial Life 1992 Addison-Wesley Redwood City 487 509 (4)
2. J. Allman Evolution of the cortex A. Peters E.G. Jones Cerebral cortex Comparative structure and evolution of cerebral cortex, Part I 8a 1990 Plenum Press New York 269 283 (4)
3. D.J. Amit Modeling brain function: The world of attractor neural networks 1989 Cambridge University Press Cambridge, UK (4)
4. E.A. Arbas I.A. Meinertzhagen S.R. Shaw Evolution in nervous systems Annual Review of Neuroscience 14 1991 9 38 (4)
5. C. Austin C. Cepko Lineage analysis of the mouse cerebral cortex using retrovirus vectors Society of Neuroscience Abstracts 15 1989 599 (4)
6. J.M. Baldwin A new factor in evolution American Naturalist 30 1896 441 451 (4)
7. R.K. Belew J. Mclnerney N.N. Schraudolph Evolving networks: Using the genetic algorithm with connectionist learning C.G. Langton C. Taylor J.D. Farmer S. Rasmussen Artificial Life II: Proceedings of the Workshop on Artificial Life 1992 Addison-Wesley Redwood City, CA 511 547 (4)
8. H. Bersini V. Detours Asynchrony induces stability in cellular automata based models R.A. Brooks P. Maes Artificial life IV: Proceedings of the Fourth International Workshop on the Synthesis and Simulation of Living Systems 1994 MIT Press Cambridge, MA 382 387 (4)
9. M.E. Bitterman Phyletic differences in learning American Psychologist 20 1965 396 410 (4)
10. R.C. Bolles Species-specific defense reactions and avoidance learning Psychological Review 77 1970 32 48 (4)
11. M.C. Brown W.G. Hopkins R.J. Keynes Essentials of neural development 1991 Cambridge University Press Cambridge, UK (4)
12. D.V. Buonomano J.H. Byrne Long-term synaptic changes produced by a cellular analog of classical conditioning in Aplysia Science 249 1990 420 423 (4)
13. J.H. Byrne K.J. Gingrich D.A. Baxter Computational capabilities of single neurons: Relationship to simple forms of associative and nonassociative learning in Aplysia R.D. Hawkins G.H. Bower Computational models of learning in simple neural models 1989 31 63 (4)
14. D.J. Cavicchio Adaptive search using simulated evolution 1970 Unpublished doctoral dissertation University of Michigan (4)
15. V.S. Caviness Jr. R.L. Sidman Time of origin of corresponding cell classes in the cerebral cortex of normal and reeler mutant mice: An autoradiographic analysis J. of Comparative Neurology 148 1973 141 151 (4)
16. D. Cliff Computational neuroethology: A provisional manifesto J.A. Meyer S.W. Wilson From animals to animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior 1991 MIT Press Cambridge, MA 263 272 (4)
17. M.L. Cooper P. Rakic Gradients of cellular maturation and synaptogenesis in the superior colliculus of the fetal rhesus monkey J. of Comparative Neurology 215 1983 165 186 (4)
18. M.A. Corner G.J.A. Ramakers Spontaneous firing as an epigenetic factor in brain development—physiological consequences of chronic tetrodotoxin and picrotoxin exposure on cultured rat neocortex neurons Developmental Brain Research 65 1992 57 64 (4)
19. K.A. De Jong An analysis of the behavior of a class of genetic adaptive systems 1975 Unpublished doctoral dissertation University of Michigan (4)
20. M. Domjan K.L. Hollis Reproductive behavior: A potential model for adaptive specializations in learning R.C. Bolles M.D. Beecher Learning and evolution 1988 Lawrence Erlbaum Hillsdale, NJ (4)
21. J.W. Donahoe J.E. Burgos D.C. Palmer A selectionist approach to reinforcement J. of the Experimental Analysis of Behavior 60 1993 17 40 (4) (6) (18) (26)
22. J.W. Donahoe D.C. Palmer Learning and complex behavior 1994 Allyn & Bacon Boston (1) (4) (16) (14) (18) (26)
23. J.W. Donahoe D.C. Palmer J.E. Burgos The S-R Issue: Its status in behavior analysis and in Donahoe and Palmer's Learning and Complex Behavior. J. of the Experimental Analysis of Behavior 1996 in press, (14) (18)
24. J.C. Eccles Evolution of the brain: Creation of the self London: Routledge 1989 (4)
25. M.F. Eckenhoff P. Rakic A quantitative analysis of synaptogenesis in the molecular layer of the dentate gyrus in the rhesus monkey Developmental Brain Research 64 1991 129 135 (4)
26. G.M. Edelman Neural Darwinism: The theory of neuronal group selection 1987 Basic Books New York (8) (4)
27. C. Emmeche S. Sampson The garden in the machine: The emerging science of Artificial Life 1991 Princeton University Press Princeton, NJ (1994), (4)
28. F. Etscorn R. Stephens Establishment of conditioned taste aversions with a 24-hour CS-US interval Physiological Psychology 1 1973 251 253 (4)
29. R.M. French A. Messinger Genes, phenes and the Baldwin Effect: Learning and evolution in a simulated population R.A. Brooks P. Maes Artificial life IV: Proceedings of the Fourth International Workshop on the Synthesis and Simulation of Living Systems 1994 MIT Press Cambridge, MA 277 282 (4)
30. P.W. Frey L.E. Ross Classical conditioning of the rabbit eyelid response as a function of interstimulus interval J. of Comparative and Physiological Psychology 65 1968 246 250 (4)
31. E.R. Gamzu D.R. Williams Associative factors underlying the pigeon's key pecking in autoshaping procedures J. of the Experimental Analysis of Behavior 19 1973 225 232 (4)
32. J. Garcia R. Koelling Relation of cue to consequence in avoidance learning Psychonomic Science 4 1966 123 124 (4)
33. J. Gibbon M.D. Baldock C. Locurto L. Gold H.S. Terrace Trial and intertrial durations in autoshaping J. of Experimental Psychology: Animal Behavior Processes 3 1977 264 284 (4)
34. D.E. Goldberg K. Deb A comparative analysis of selection schemes used in genetic algorithms G.J.E. Rawlins Foundations of genetic algorithms 1992 Morgan Kaufmann San Mateo, CA 69 93 (4)
35. S. Grossberg A neural network architecture for Pavlovian conditioning: Reinforcement, attention, forgetting, timing M.L. Commons S. Grossberg J.E.R. Staddon Neural network models of conditioning and action 1991 Lawrence Erlbaum Hillsdale, NJ 69 122 (4)
36. F. Gruau D. Whitley Adding learning to the cellular development of neural networks: Evolution and the Baldwin Effect Evolutionary Computation 1 1993 213 233 (4)
37. S.A. Harp T. Samad Genetic synthesis of neural network architecture L. Davies Handbook of genetic algorithms 1991 Van Nostrand Reinhold New York 202 221 (4)
38. I. Harvey The artificial evolution of behaviour J.A. Meyer S.W. Wilson From animals to animals: Proceedings of the First International Conference on Simulation of Adaptive Behavior 1991 MIT Press Cambridge, MA 263 272 (4)
39. R.D. Hawkins A biologically based computational model for several simple forms of learning R.D. Hawkins G.H. Bower Computational models of learning in simple neural systems 1989 Academic Press San Diego 65 108 (4)
40. R.A. Hinde Constraints on learning: An introduction to the problem R.A. Hinde J. Stevenson-Hinde Constraints on learning 1973 Academic Press London 1 19 (4)
41. G.E. Hinton S.J. Nowlan How learning can guide evolution Complex Systems 1 1987 495 502 (4)
42. J.H. Holland Adaptation in natural and artificial systems 1975 University of Michigan Press Ann Arbor (4) (19)
43. K.L. Hollis The biological function of Pavlovian conditioning: The best defense is a good offense J. of Experimental Psychology: Animal Behavior Processes 10 1984 413 425 (4)
44. K.L. Hollis The role of Pavlovian conditioning in territorial aggression and reproduction D.A. Dewsbury Contemporary issues in comparative psychology 1990 Sunderland, MA Sinauer (4)
45. K.L. Hollis E.L. Cadieux M.M. Colbert The biological function of Pavlovian conditioning: A mechanism for mating success in the blue gourami (Trichogaster trichopterus) J. of Comparative Psychology 103 1989 115 121 (4)
46. K.L. Hollis K.A. Martin E.L. Cadieux M.M. Colbert The biological function of Pavlovian conditioning: Learned inhibition of aggressive behavior in territorial fish Learning and Motivation 15 1984 459 478 (4)
47. K.L. Hollis J.B. Overmier Effect of telencephalon ablation on the reinforcing and eliciting properties of species specific events in Betta splendens J. of Comparative and Physiological Psychology 96 1982 574 590 (4)
48. E.R. Kandel Cellular mechanisms of learning and the biological basis of individuality E.R. Kandel J.H. Schwartz Principles of neural science 1985 Raven Press New York 816 833 (4)
49. R. Keesing D.G. Stork Evolution and learning in neural networks: The number and distribution of learning trials affect the rate of evolution R.P. Lippman J.E. Moody D.S. Touretzky Advances in neural information processing systems vol. 3 1991 Morgan Kaufmann San Mateo, CA 804 810 (4)
50. A.H. Klopf A neuronal model of classical conditioning Psychobiology 16 1988 85 125 (4)
51. A.H. Klopf J.S. Morgan The role of time in natural intelligence: Implications of classical and instrumental conditioning for neuronal and neural-network modeling M. Gabriel J. Moore Learning and computational neuroscience: Foundations of adaptive networks 1990 MIT Press Cambridge, MA 463 495 (4)
52. C.G. Langton Preface C.G. Langton C. Taylor J.D. Farmer S. Rasmussen Artificial life II 1992 Addison-Wesley Redwood City, CA (xiii- xviii), (4)
53. C.G. Langton Editor's introduction Artificial Life 1 1994 v-viii, (4)
54. A. Libby Two variables in the acquisition of depressant properties by a stimulus J. of Experimental Psychology 42 1951 100 107 (4)
55. S.K. McConnell Development and decision-making in the mammalian cerebral cortex Brain Research Review 13 1988 1 23 (2)(4)
56. S.K. McConnell The determination of neuronal fate in the cerebral cortex Trends in Neuroscience 12 1989 342 349 (4)
57. S.K. McConnell The generation of neuronal diversity in the central nervous system Annual Review of Neuroscience 14 1991 269 300 (4)
58. M.W. Miller Development of projection and local circuit neurons in neocortex A. Peters E.G. Jones Cerebral cortex Development and maturation of cerebral cortex 7 1988 Plenum Press New York 133 175 (4)
59. N. Miller Apraxia of speech C. Code The characteristics of aphasia 1989 Taylor & Francis London (24)
60. S.K. Mills J.H. Beatty The propensity interpretation of fitness Philosophy of Science 46 1979 263 286 (4)
61. J.W. Moore Implementing connectionist algorithms for classical conditioning in the brain M.L. Commons S. Grossberg J.E.R. Staddon Neural network models of conditioning and action 1991 Lawrence Erlbaum Hillsdale, NJ 181 191 (20)
62. J.W. Moore N.E. Berthier D.E.J. Blazis Classical eye blink conditioning: Brain systems and implementation of a computational model M. Gabriel J. Moore Learning and computational neuroscience: Foundations of adaptive networks 1990 Bradford Books/MIT Press Cambridge, MA 359 387 (4) (20) (21)
63. J. Paredis The evolution of behavior: Some experiments J.A. Meyer S.W. Wilson From animals to animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior 1991 MIT Press Cambridge, MA 263 272 (4)
64. J. Paredis Steps towards co-evolutionary classification neural networks R.A. Brooks P. Maes Artificial life IV: Proceedings of the Fourth International Workshop on the Synthesis and Simulation of Living Systems 1994 MIT Press Cambridge, MA 102 108 (4)
65. I.P. Pavlov Conditioned reflexes 1927 Oxford University Press London Reprint: New York: Dover, 1960. (4) (18)
66. D. Purves J.W. Lichtman Principles of neural development 1985 Sinauer Sunderland, MA (2) (4)
67. P. Rakic Intrinsic and extrinsic determinants of neocortical parcellation: A radial unit model P. Rakic W. Singer Neurobiology of the neocortex 1988 Wiley New York 5 27 (4)
68. P. Rakic Specification of cerebral cortical areas Science 241 1988 170 176 (2) (4)
69. P. Rakic J.P. Bourgeois M.F. Eckenhoff N. Zecevic P.S. Goldman-Rakic Concurrent overproduction of synapses in diverse regions of the primate cerebral cortex Science 232 1986 232 235 (4)
70. R.A. Rescorla Predictability and number of pairings in Pavlovian fear conditioning Psychonomic Science 4 1966 383 385 (4)
71. R.A. Rescorla Probability of shock in the presence and absence of CS in fear conditioning J. of Comparative and Physiological Psychology 66 1968 1 5 (4)
72. L.E. Ross Conditioned fear as a function of CS-UCS and probe stimulus intervals J. of Experimental Psychology 61 1961 265 273 (4)
73. J.D. Schaffer R.A. Caruana L.J. Eshelman Using genetic search to exploit the emergent behavior of neural networks S. Forrest Emergent computation 1990 North Holland Amsterdam (4)
74. J.D. Schaffer L.J. Eshelman D. Offutt Spurious correlations and premature convergence in genetic algorithms G.J.E. Rawlins Foundations of Genetic Algorithms 1991 Morgan Kaufmann San Mateo, CA 102 112 (4)
75. N.A. Schmajuk J.J. DiCarlo Neural dynamics of hippocampal modulation of classical conditioning M.L. Commons S. Grossberg J.E.R. Staddon Neural network models of conditioning and action 1991 Lawrence Erlbaum Hillsdale, NJ 149 180 (4)
76. N. Schneiderman Interstimulus interval function of the nictitating membrane response of the rabbit under delay versus trace conditioning J. of Comparative and Physiological Psychology 62 1966 397 402 (4)
77. M.E.P. Seligman J.L. Hager Biological boundaries on learning 1972 Appleton-Century-Crofts New York (4)
78. S.J. Shettleworth Food reinforcement and the organization of behaviour in golden hamsters R.A. Hinde J. Stevenson-Hinde Constraints on learning 1973 Academic Press New York 243 263 (4)
79. G.G. Simpson The Baldwin effect Evolution 7 1953 110 117 (4)
80. M.C. Smith S.R. Coleman I. Gormezano Classical conditioning of the rabbit’s nictitating membrane response at backward, simultaneous, and forward CS-US intervals J. of Comparative and Physiological Psychology 69 1969 226 231 (4)
81. R.S. Sutton A.G. Barto Toward a modem theory of adaptive networks: Expectation and prediction Psychological Review 88 1981 135 170 (1) (4) (17) (20) (21)
82. R.F. Thompson The neurobiology of learning and memory Science 233 1986 941 947 (4) (6)
83. R.F. Thompson T.W. Berger J. Madden IV. Cellular processes of learning and memory in the mammalian CNS Annual Review of Neuroscience 6 1983 447 491 (4)
84. P.M. Todd G.F. Miller Exploring adaptive agency II: Simulating the evolution of associative learning J.A. Meyer S.W. Wilson From animals to animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior 1991 MIT Press Cambridge, MA 263 272 (4)
85. D. Whitley T. Starkweather C. Bogart Genetic algorithms and neural networks: Optimizing connection weights and connectivity Parallel Computing 14 1990 347 361 (4)
86. E.O. Wilson Sociobiology 1975 Harvard University Press Cambridge, MA (1)
87. A.G. Yeo The acquisition of conditioned suppression as a function of interstimulus interval duration Quarterly J. of Experimental Psychology 26 1974 405 416 (4)