Emotion and reinforcement: Affective facial expressions facilitate robot learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4451 LNAI, Issue , 2007, Pages 113-132

  Broekens, Joost ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Affect; Human in the loop; Reinforcement learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SYSTEMS; EDUCATION; LEARNING SYSTEMS; REINFORCEMENT LEARNING; ROBOT LEARNING; ROBOTICS; ROBOTS;

AFFECT; AFFECTIVE COMMUNICATION; COMPUTER MODELLING; EMOTIONAL EXPRESSIONS; FACIAL EXPRESSIONS; HUMAN COMPUTING; HUMAN-IN-THE-LOOP; HYDERABAD , INDIA; INTERNATIONAL WORKSHOPS; JOINT CONFERENCE; REAL TIME; REINFORCEMENT SIGNAL; SIMULATED ROBOTS; SYSTEMATIC STUDY;

REINFORCEMENT;

EID: 49949094272     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-72348-6_6     Document Type: Conference Paper

References (48)

1. Ashby, F. G., Isen, A. M., Türken, U.: A Neuro-psychological theory of positive affect and its influence on cognition. Psychological Review 106 (3) (1999) 529-550
2. Avila-Garcia, O., Cañamero, L.: Using hormonal feedback to modulate action selection in a competitive scenario. In: From Animals to Animats 8: Proc. 8th Intl. Conf. on Simulation of Adaptive Behavior. MIT Press, Cambridge MA (2004) 243-252
3. Belavkin, R. V.: On relation between emotion and entropy. In: Proc. of the AISB'04 Symposium on Emotion, Cognition and Affective Computing. AISB Press (2004) 1-8
4. Berridge, K. C.: Pleasures of the brain. Brain and Cognition 52 (2003) 106-128
5. Blanchard, A. J., Cañamero, L.: Modulation of exploratory behavior for adaptation to the context. In: Proc. of the AISB'06 Symposium on Biologically Inspired Robotics (Biro-net). AISB Press (2006) 131-137
6. Botelho, L. M., Coelho, H.: Information processing, motivation and decision making. In: Proc. 4th International Workshop on Artificial Intelligence in Economics and Management. (1998)
7. Breazeal, C.: Affective interaction between humans and robots. In: J. Keleman, P. Sosik (eds): Proc. of the ECAL 2001. LNAI, Vol. 2159. Springer-Verlag, Berlin Heidelberg New York (2001)582-591
8. Breazeal, C., Brooks R.: Robot emotion: A functional perspective. In: J.-M. Fellous, M. Arbib (eds.): Who needs emotions: The brain meets the robot. Oxford University Press USA (2004) 271-310
9. Breazeal, C., Scassellati, B.: Robots that imitate humans. Trends in Cognitive Sciences 6(11) (2002) 481-487
10. Breazeal, C., Velasquez, J.: Toward teaching a robot infant' using emotive communication acts. In: Edmonds, B., Dautenhahn, K. (eds.): Socially Situated Intelligence: a workshop held at SAB'98, Zürich. University of Zürich Technical Report (1998) 25-40
11. Broekens, J., Kostens, W. A., Verbeek, F. J.: On emotion, anticipation and adaptation: Investigating the potential of affect-controlled selection of anticipatory simulation in artificial adaptive agents. In press (2007)
12. Cañamero, D.: Designing emotions for activity selection. Dept. of Computer Science Technical Report DAIMI PB 545. University of Aarhus Denmark (2000)
13. Charman, T., Baird, G.: Practitioner review: Diagnosis of autism spectrum disorder in 2- and 3-year-old children. Journal of Child Psychology and Psychiatry 43(3) (2002) 289-305
14. Clore, G. L. Gasper, K.: Feeling is believing: Some affective influences on belief. In: Frijda, N., Man-stead A. S. R., Bern, S. (eds.): Emotions and Beliefs. Cambridge Univ. Press, Cambridge UK (2000) 10-44
15. Cos-Aguilera, I., Cañamero, L., Hayes, G. M., Gillies, A.: Ecological integration of affordances and drives for behaviour selection. In: Proc. of the Workshop on Modeling Natural Action Selection. AISB Press (2005) 225-228
16. Custers, R., Aarts, H.: Positive affect as implicit motivator: On the nonconscious operation of behavioral goals. Journal of Personality and Social Psychology 89(2) (2005) 129-142
17. Damasio, A. R.: Descartes' error. Penguin Putnam, New York NY (1994)
18. Doya, K.: Metalearning and neuromodulation. Neural Networks 15 (4) (2002) 495-506
19. Dreisbach, G., Goschke, K.: How positive affect modulates cognitive control: Reduced perseveration at the cost of increased distractibility. Journal of Experimental Psychology: Learning, Memory, and Cognition 30(2) (2004) 343-353
20. Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robots and Autonomous Systems 42 (2003) 143-166
21. Forgas, J. P.: Feeling is believing? The role of processing strategies in mediating affective influences in beliefs. In: Frijda, N., Manstead A. S. R., Bern, S. (eds.): Emotions and Beliefs. Cambridge University Press, Cambridge UK (2000) 108-143
22. Frijda, N. H., Mesquita, B.: Beliefs through Emotions. In: Frijda, N., Manstead A. S. R., Bern, S. (eds.): Emotions and Beliefs. Cambridge University Press, Cambridge UK (2000) 45-77
23. Frijda, N. H., Manstead, A. S. R., Bern. S.: The influence of emotions on beliefs. In: Frijda, N., Man-stead A. S. R., Bern, S. (eds.): Emotions and Beliefs. Cambridge University Press, Cambridge UK (2000) 1-9
24. Gandanho, S. C.: Learning behavior-selection by emotions and cognition in a multi-goal robot task. Journal of Machine Learning Research 4 (2003) 385-412
25. Gasper, K., Clore, L. G.: Attending to the big picture: Mood and global versus local processing of visual information. Psychological Science 13(1) (2002) 34-40
26. Isbell, C. L. Jr., Shelton, C. R., Kearns, M., Singh, S., Stone, P.: A social reinforcement learning agent. In: Proceedings of the fifth international conference on Autonomous agents. ACM (2001.) 377-384
27. Kaelbling, L. P., Littman, M. L., Moore, A. W.: Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4 (1996) 237-285
28. Lin, L. J.: Reinforcement learning for robots using neural networks. Doctoral dissertation. Carnegie Mellon University, Pittsburgh (1993)
29. Mehrabian, A.: Basic Dimensions for a General Psychological Theory. OG&H Publishers, Cambridge Massachusetts (1980)
30. Mitsunaga, N., Smith, C., Kanda, T., Ishiguro, H., Hagita, N.: Robot behavior adaptation for human-robot interaction based on policy gradient reinforcement learning. In: Proc. Of the International Conference on Intelligent Robots and Systems (IROS). IEEE Press (2005) 218-225
31. Thrun, S., Bennewitz, M., Burgard, W., Cremers, A. B., Dellaert, F., Fox, D., Hähnel, D., Rosenberg, C. R., Roy, N., Schulte, J., Schulz, D.: A tour-guide robot that learns. In: Burgard, W., Christaller, T., Cremers, A.B. (eds.): Proc. of the 23rd Annual German Conference on Artificial Intelligence: Advances in Artificial Intelligence. LNAI, Vol. 1701. Springer-Verlag, London UK (1999) 14-26
32. Pantic, M., Pentland, A., Nijholt, A., Huang, T. S.: Human computing and machine understanding of human behavior: A Survey. Proc. ACM Int'l Conf. Multimodal Interfaces (2006) 239-248
33. Pantic, M., Rothkranz, L. J. M.: Automatic analysis of facial expressions: The state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (12) (2000) 1424-1445
34. th International FLAIR Conference. AAAI (2003) 361-365
35. th IASTED International Conference on Robotics and Applications, Honolulu HI. IASTED (2004)
36. Picard, R. W.: Affective Computing. MIT Press, Cambridge MA (1997)
37. Picard, R. W., Papert, S., Bender, W., Blumberg, B., Breazeal, C. Cavallo, D., Machover, T., Resnick, M., Roy, D., Strohecker, C.: Affective learning -A manifesto. BT Technology Journal 22(4) (2004) 253-269
38. Rolls, E. T.: Précis of The brain and emotion. Behavioral and Brain Sciences 23 (2000) 177-191
39. Russell, J. A.: Core affect and the psychological construction of emotion. Psychological Review 110(1) (2003) 145-72
40. Scherer, K. R.: Appraisal considered as a process of multilevel sequential checking. In: K. R. Scherer, A. Schorr, T. Johnstone (eds.): Appraisal processes in emotion: Theory, Methods, Research. Oxford Univ. Press, New York NY (2001) 92-120
41. Sutton, R., Barto, A.: Reinforcement learning: An introduction. MIT Press, Cambridge MA (1998)
42. Ogata, T., Sugano, S., Tani, J.: Open-end human robot interaction from the dynamical systems perspective: Mutual adaptation and incremental learning. In: Orchard, R., Yang, C., Ali, M. (eds.): 17th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems. LNCS, Vol. 3029. Springer (2004) 435-444
43. Thomaz, A.L., Breazeal, C.: Teachable characters: User studies, design principles, and learning performance. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.): Proc. of the 6th International Conference on Intelligent Virtual Agents (IVA 2006). LNCS, Vol. 4133, Springer (2006) 395-406
44. Thomaz, A. L., Breazeal, C.: Reinforcement learning with human teachers: Evidence of feedback and guidance with implications for learning performance. In: Proc. of the 21st National Conference on Artificial Intelligence. AAAI Press (2006b)
45. Thomaz, A.L., Hoffman, G., Breazeal, C.: Real-time interactive reinforcement learning for robots. In: Proc. of AAAI Workshop on Human Comprehensible Machine Learning. Pittsburgh, PA (2005)
46. Velasquez, J. D.: A computational framework for emotion-based control. In: SAB'98 Workshop on Grounding Emotions in Adaptive Systems (1998)
47. th International Conference on the Simulation of Adaptive Behavior (SAB): MIT Press, Cambridge MA (1996) 272-284
48. OpenCV: http://www.intel.com/technology/computing/opencv/index.htm