Learning behavior-selection by emotions and cognition in a multi-goal robot task

Journal of Machine Learning Research

Volumn 4, Issue 3, 2004, Pages 385-412

  Gadanho, Sandra Clara ^a  

^a INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

Autonomous robots; Emotion; Hybrid learning

Indexed keywords

ACTUATORS; ALGORITHMS; ARTIFICIAL INTELLIGENCE; BEHAVIORAL RESEARCH; COGNITIVE SYSTEMS; DECISION MAKING; ROBOTS;

EMOTION; GOAL STATE TRANSITIONS; HYBRID LEARNING; INFRASTRUCTURE;

LEARNING SYSTEMS;

EID: 2342578813     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: 10.1162/153244304773633870     Document Type: Article

References (39)

1. th IEEE International Symposium on Intelligent Control. Los Alamitos, CA: IEEE Computer Society Press, 1990.
2. Minoru Asada. An agent and an environment: A view on body scheme. In Jun Tani and Minoru Asada, editors, Proceedings of the 1996 IROS Workshop on Towards real autonomy, pages 19-24, Senri Life Science Center, Osaka, Japan, 1996.
3. t h European Meeting on Cybernetics and Systems Research, volume 2, pages 745-750, Austria, April 2002. University of Vienna.
4. Christian Balkenius. Natural intelligence in artificial creatures. Lund University Cognitive Studies 37, 1995.
5. Bruce Blumberg. Old Tricks, New Dogs: Ethology and interactive creatures. PhD thesis, MIT, 1996.
6. Stevo Bozinovski. A self-learning system using secondary reinforcement. In R. Trappl, editor, Cybernetics and Systems, pages 397-402. Elsevier Science Publishers, North Holland, 1982.
7. Cynthia Breazeal. Robot in society: Friend or appliance? In Agents'99 workshop on emotion-based agent architectures, pages 18-26, Seattle, WA, 1999.
8. Richard E. Cytowic. The man who tasted shapes. Abacus, London, 1993.
9. Antonio Damasio. The feeling of what happens. Harcout Brace & Company, New York, 1999.
10. Antonio R. Damasio. Descartes' error - Emotion, reason and human brain. Picador, London, 1994.
11. Clark Elliott. The affective reasoner: A process model of emotions in a multi-agent system. PhD thesis, Northwestern University, Evanston, Illinois, 1992. Field of Computer Science.
12. Gérald Foliot and Olivier Michel. Learning object significance with an emotion based process. In SAB'98 Workshop on Grounding Emotions in Adaptive Systems, pages 25-30, Zurich, Switzerland, 1998.
13. Masahiro Fujita, Rika Hasegawa, Gabriel Costa, Tsuyoshi Takagi, Jun Yokono, and Hideki Shimomura. Physically and emotionally grounded symbol acquisition for autonomous robots. In Lola Cafimero, editor, AAAI Fall Symposium on Emotional and Intelligent II: The tangled knot of social cognition, pages 43-48. Menlo Park, California: AAAI Press, 2001. Technical report FS-01-02.
14. Sandra Clara Gadanho. Reinforcement Learning in Autonomous Robots: An Empirical Investigation of the Role of Emotions. PhD thesis, University of Edinburgh, 1999.
15. Sandra Clara Gadanho and John Hallam. Emotion-triggered learning in autonomous robot control. Cybernetics and Systems - Special Issue: Grounding emotions in adaptive systems, 32(5):531-559, July 2001a.
16. Sandra Clara Gadanho and John Hallam. Robot learning driven by emotions. Adaptive Behavior, 9 (1), 2001b.
17. Joseph E. LeDoux. The Emotional Brain. Phoenix, London, 1998.
18. Long-Ji Lin. Reinforcement learning for robots using neural networks. PhD thesis, Carnegie Mellon University, 1993. Technical report CMU-CS-93-103.
19. Márcia Maçãs, Paulo Couto, Carlos Pinto-Ferreira, Luis Custódio, and Rodrigo Ventura. Experiments with an emotion-based agent using the DARE architecture. In Proceedings of the AISB'01 Symposium on Emotion, Cognition and Affective Computing, pages 105-112, University of York, U.K., March 2001.
20. Sridhar Mahadevan and Jonathan Connell. Automatic programming of behavior-based robots using reinforcement learning. Artificial intelligence, 55:311-365, 1992.
21. Yuval Marom and Gillian Hayes. Maintaining attentional capacity in a social robot. In R. Trappl, editor, Cybernetics and Systems 2000: Proceedings of the 15th European Meeting on Cybernetics and Systems Research. Symposium on Autonomy Control - Lessons from the emotional, volume 1, pages 693-698, Vienna, Austria, April 2000.
22. Maja J. Mataric. Reward functions for accelerated learning. In William W. Cohen and Haym Hirsh, editors, Machine Learning: Proceedings of the Eleventh International Conference, pages 181-189. San Francisco, CA: Morgan Kaufmann Publishers, 1994.
23. Lee McCauley and Stan Franklin. An architecture for emotion. In Dolores Canamero, editor, AAAI Fall Symposium on Emotional and Intelligent: The tangled knot of cognition, Technical Report FS-98-03, pages 122-127. Menlo Park, CA: AAAI Press, 1998.
24. Olivier Michel. Khepera Simulator package version 2.0: Freeware mobile robot simulator written at the University of Nice Sophia-Antipolis, March 1996. Downloadable from the World Wide Web at http://diwww.epfl.ch/lami/team/michel/ khep-sim/.
25. Justus H. Piater, Paul R. Cohen, Xiaoqin Zhang, and Michael Atighetchi. A randomized ANOVA procedure for comparing performance curves. In J. Shavlik, editor, Machine Learning: Proceedings of the Fifteenth International Conference, pages 430-438. Morgan Kaufmann Publishers, San Francisco, CA, 1999.
26. Miguel Rodriguez and Jean-Pierre Muller. Towards autonomous cognitive animats. In F. Morán, A. Moreno, J.J. Merelo, and P. Chacón, editors, Advances in artificial life - Proceedings of the Third European Conference on Artificial Life, Lecture Notes in Artificial Intelligence Volume 929, Berlin, Germany, 1995. Springer-Verlag.
27. Rui Sadio, Gonçalo Tavares, Rodrigo Ventura, and Luis Custódio. An emotion-based agent architecture application with real robots. In Lola Cañmero, editor, AAAI Fall Symposium on Emotional and Intelligent II: The tangled knot of social cognition, pages 117-122. Menlo Park, California: AAAI Press, 2001. Technical report FS-01-02.
28. Mathias Scheutz. The evolution of simple affective states in multi-agent environments. In Lola Cañmero, editor, Emotional and Intelligent II: The tangled knot of social cognition, pages 123-128, Menlo Park, California, 2001. AAAI Press. Technical report FS-01-02.
29. Magy Seif El-Nasr, John Yen, and Thomas Ioerger. Flame - a fuzzy logic adaptive model of emotions. Autonomous Agents and Multi-agent Systems, 1999.
30. H. A. Simon. Motivational and emotional controls of cognition. Psychological Review, 74:29-39, 1967.
31. Aaron Sloman and Monica Croucher. Why robots will have emotions. In IJCAI'81 - Proceedings of the Seventh International Joint Conference on Artificial Intelligence, pages 2369-71, 1981. Also available as Cognitive Science Research Paper 176, Sussex University.
32. R. Sun, E. Merrill, and T. Peterson. From implicit skills to explicit knowledge: a bottom-up model of skill learning. Cognitive Science, 25(2):203-244, 2001.
33. R. Sun and T. Peterson. Autonomous learning of sequential tasks: experiments and analysis. IEEE Transactions on Neural Networks, 9(6): 1217-1234, November 1998.
34. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning. The MIT Press, 1998.
35. Silvan S. Tomkins. Affect theory. In Klaus R. Scherer and Paul Ekman, editors, Approaches to Emotion. Lawrence Erlbaum, London, 1984.
36. Juan D. Velásquez. A computational framework for emotion-based control. In SAB'98 Workshop on Grounding Emotions in Adaptive Systems, pages 62-67, Zurich, Switzerland, 1998.
37. Rodrigo Ventura and Carlos Pinto-Ferreira. Emotion-based agents: Three approaches to implementation (preliminary report). In Juan D. Velsquez, editor, Workshop on Emotion-Based Agent Architectures, Seattle, U. S. A., 1999. Workshop of the Third International Conference on Autonomous Agents.
38. C. Watkins. Learning from delayed rewards. PhD thesis, King's College, Cambridge, 1989.
39. Ian Wright. Reinforcement learning and animat emotions. In Pattie Maes, Maja J. Mataric, JeanArcady Meyer, Jordan Pollack, and Stewart W. Wilson, editors, From animals to animats 4 - Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, pages 273-281. The MIT Press, 1996.