Projective simulation for artificial intelligence

Scientific Reports

Volumn 2, Issue , 2012, Pages

  Briegel, Hans J ^a,b   De Las Cuevas, Gemma ^a,b  

^a UNIVERSITY OF INNSBRUCK   (Austria)

^b ERICH SCHMID INSTITUTE OF MATERIALS SCIENCE   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BIOLOGY; COMPUTER SIMULATION; HUMAN; LEARNING; MEMORY; METHODOLOGY; PHYSIOLOGY; REINFORCEMENT; REPRODUCIBILITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; HUMANS; LEARNING; MEMORY; MODELS, BIOLOGICAL; NEURAL NETWORKS (COMPUTER); REINFORCEMENT (PSYCHOLOGY); REPRODUCIBILITY OF RESULTS;

EID: 84861122307     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep00400     Document Type: Article

References (47)

1. Sutton, Richard S. & Barto, Andrew G. Reinforcement learning. First edition (MIT Press, Cambridge Massachusetts, 1998).
2. Russel, Stuart J. & Norvig, Peter. Artifical intelligence - A modern approach. Second edition (Prentice Hall, New Jersey, 2003).
3. Pfeiffer, Rolf & Scheier, Christian. Understanding intelligence. First edition (MIT Press, Cambridge Massachusetts, 1999).
4. Briegel, Hans J. On machine creativity and the notion of free will. arXiv:1105.1759 (2011).
5. Nielsen, M. A. & Chuang, I. L. Quantum computation and quantum information, First edition. (Cambridge University Press, Cambridge 2000).
6. Floreano, Dario & Mattiussi, Claudio. Bio-inspired artificial intelligence: theories, methods, and technologies. First edition (MIT Press, Cambridge Massachusetts, 2008).
7. Tulving, Endel. Episodic and semantic memory. In Organization of Memory, ed. Tulving, E., Donaldson, W., pp. 2381-403 (1972).
8. For a recent review see Tulving, Endel, Episodic memory: From mind to brain. Annu. Rev. Psychol. 53, 1-25 (2002).
9. Ingvar, D. H. "Memory of the future": An essay on the temporal organization of conscious awareness. Human neurobiology 4, 127-136 (1985).
10. Tolman, Edward C. Cognitive maps in rats and men. The Psychological Review 55(4), 189-208 (1948).
11. Piaget, Jean. Mental imagery in the child: a study of the development of imaginal representation. (London: Routledge and Kegan Paul, 1971).
12. Clark, Andy & Grush, Rick. Towards a Cognitive Robotics. Adaptive Behavior 7, 5-16 (1999).
13. Hesslow, Germund. Conscious thought as simulation of behaviour and perception. TRENDS in Cognitive Sciences 6, 242-247 (2002).
14. Schacter, Daniel L., Addis, Donna Rose & Buckner, Randy L. Episodic Simulation of Future Events: Concepts, Data, and Applications. Ann. N. Y. Acad. Sci. 1124, 3960 (2008).
15. Hasselmo, Michael E. How we remember. Brain mechanisms of episodic memory. First edition (MIT Press, Cambridge, Massachusetts, 2011).
16. Lin, Long-Ji. Self-improving reactive agents based on reinforcement learning, planning and teaching. Machine Learning 8, 292-321 (1992).
17. Sutton, R. S. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proceedings of the Seventh International Conference on Machine Learning ICML90, Morgan Kaufmann, pp. 216-224 (1990).
18. Sutton, R. S., Precup, D., Singh, S. Between MDPs and semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artificial Intelligence 112, 181-211 (1999).
19. Ormoneit, D. & Sen, S. Kernel-based reinforcement learning. Machine Learning 49, 161178 (2002)
20. Sutton, R. S., Szepesvari, Cs., Geramifard, A. & Bowling, M. Dyna-style planning with linear function approximation and prioritized sweeping. Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, pp. 528-536 (2008).
21. McCallum, R. Andrew, Instance-Based Utile Distinctions for Reinforcement Learning with Hidden State. Proceedings of the Twelfth International Conference on Machine Learning, Morgan Kaufmann, pp. 387-395 (1995).
22. Parr, R. & Russell, S. Reinforcement Learning with Hierarchies of Machines. NIPS 10, 1043-1049 (1998).
23. Dietterich, T. G. Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research 13, 227-303 (2000).
24. Tani, Jun. Model-Based Learning for Mobile Robot Navigation from the Dynamical Systems Perspective. IEEE Trans. System, Man and Cybernetics 26, 421-436 (1996).
25. Hoffman, H. & Möller, R. Action Selection and Mental Transformation Basedon a Chain of Forward Models. In Schaal et al (eds.) Proceedings of the 8th Conference on Simulation of Adaptive Behavior (SAB '04), pp. 213-222, MIT Press (2004).
26. Vaughan, R. & Zuluaga, M. Use your illusion: Sensorimotor Self-simulation allows complex agents to plan with incomplete self-knowledge. In: Nolfi et al (eds.) SAB 2006, LNCS (LNAI) 4095, 298-309 Springer (2006).
27. Toussaint, M. A sensorimotor map: Modulating lateral interactions for anticipation and planning. Neural Computation 18, 1132-1155 (2006).
28. Butz, Martin V., Shirinov, Elshad & Reif, Kevin L. Self-Organizing Sensorimotor Maps Plus Internal Motivations Yield Animal-Like Behavior. Adaptive Behavior 18, 315-337 (2010).
29. Holland, John H. Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. (University of Michigan Press, Ann Arbor 1975).
30. Watkins, C. J. C. H. Learning from delayed rewards. PhD Thesis, University of Cambridge, England, 1989.
31. Braitenberg, Valentino. Vehicles: Experiments in synthetic psychology. First paperback edition (MIT Press, Cambridge Massachusetts, 1986).
32. Kandel, Eric. The molecular biology of memory storage: A dialog between genes and synapses. in "Nobel Lectures, Physiology or Medicine 1996-2000", Editor Hans Jrnvall (World Scientific Publishing Co., Singapore, 2003).
33. Antonov Igor, Antonova Irina, Kandel Eric R. & Hawkins Robert D. Activitydependent presynaptic facilitation and Hebbian LTP are both required and interact during classical conditioning in Aplysia. Neuron 37(1), 135147 (2003).
34. Heisenberg Martin. et al Attracting a fly's attention. Invited Talk at the ESF-EMBO Conference Functional Neurobiology in Minibrains: From Flies to Robots and Back Again, 17-22 October 2010, Sant Feliu de Guixols, Spain.
35. Sareen, Preeti S., Wolf Reinhard & Heisenberg Martin. Attracting the attention of a fly. PNAS 108, 7230-7235 (2011).
36. Godsil Chris & Royle Gordon. Algebraic Graph Theory. First edition (Springer, New York, 2001).
37. Wiseman, H. M. & Milburn, G. J. Quantum Measurement and Control. (Cambridge University Press, 2009).
38. Briegel, H. J. Projective simulation for artificial intelligence. Invited talk delivered at 6th conference on the Theory of Quantum Computation, Communication and Cryprography (TQC 2011), Madrid, Spain, 24-26 May 2011.
39. Grover Lev. Quantum Mechanics helps in searching for a needle in a haystack. Physical Review Letters 79, 325-328 (1997).
40. Aharonov Dorit, Ambainis Andris, Kempe Julia & Vazirani Umesh. Quantum Walks On Graphs. Proceedings of ACM Symposium on Theory of Computation (STOC'01), July 2001, pp. 50-59.
41. Hines, A. P. & Stamp, P. C. E. Quantum walks, quantum gates, and quantum computers. Physical Review A 75, 062321 (2007).
42. Kempe Julia. Quantum random walks - an introductory overview. Contemporary Physics 44, 307327 (2003).
43. Barreiro, J. T. et al. An open-system quantum simulator with trapped ions. Nature 470, 486-491 (2011).
44. Weimer Hendrik. et al. A Rydberg quantum simulator. Nature Physics 6, 382-388 (2010).
45. Diehl Sebastian. et al. Quantum states and phases in driven open quatum systems with cold atoms. Nature Physics 4, 878-883 (2008).
46. Feynman Richard. Simulating physics with computers. Int. J. Theor. Phys. 21, 467-488 (1982).
47. Deutsch David. Quantum Theory, the Church-Turing Principle and the Universal Quantum Computer. Proc. R. Soc. Lond. A 400, 97-117 (1985).