Affect-aware behaviour modelling and control inside an intelligent environment

Pervasive and Mobile Computing

Volumn 6, Issue 5, 2010, Pages 559-574

  Leon, Enrique ^a   Clarke, Graham ^b   Callaghan, Victor ^b   Doctor, Faiyaz ^b  

^a TECNALIA RESEARCH AND INNOVATION   (Spain)

^b UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

Ambient intelligence; Artificial neural networks; Emotion detection; Fuzzy controllers

Indexed keywords

AMBIENT INTELLIGENCE; AUTOMATION; BEHAVIORAL RESEARCH; DECISION MAKING; FUZZY NEURAL NETWORKS; INTELLIGENT AGENTS; INTELLIGENT BUILDINGS; NEURAL NETWORKS; PHYSIOLOGICAL MODELS;

BEHAVIOUR MODELLING; DECISION MAKING PROCESS; EMOTION DETECTION; EMOTIONAL INFORMATION; EXPLORATORY STUDIES; FUZZY CONTROLLERS; INTELLIGENT ENVIRONMENT; LOGIC INFERENCES;

FUZZY INFERENCE;

EID: 77957275707     PISSN: 15741192     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.pmcj.2009.12.002     Document Type: Article

References (56)

1. J. Ledoux The Emotional Brain 1998 Weidenfeld & Nicholson, The Orion Publishing Group Ltd. London, UK
2. A. Bechara The role of emotion in decision-making: Evidence from neurological patients with orbitofrontal damage Brain and Cognition 55 2004 30 40 (Pubitemid 38591428)
3. A. Damasio Descartes' Error: Emotion, Reason, and the Human Brain 1995 Avon Books New York, USA
4. J. Pixley Finance organizations, decisions and emotions British Journal of Sociology 53 1 2002 41 65
5. J. Mercer Rationality and psychology in international politics International Organization 59 2005 77 106 (Pubitemid 40284770)
6. D.P. Redlawsk Hot cognition or cool consideration: Testing the effects of motivated reasoning on political decision making Journal of Politics 64 4 2002 1021 1044
7. G. Music Affect and Emotion Ideas in Psychoanalysis 2001 Icon Books Ltd. Cambridge, UK
8. R. Picard Affective Computing 1997 MIT Press Cambridge, MA, USA
9. M. Garzon, P. Ankaraju, E. Drumwright, R. Kozma, Neurofuzzy recognition and generation of facial features in talking heads, in: IEEE International Conference on Fuzzy Systems, Honolulu, USA, 2002, pp. 926931 (Pubitemid 35466248)
10. K. Itoh, H. Miwa, M. Matsumoto, M. Zecca, H. Takanobu, S. Roccella, M.C. Carrozza, P. Dario, A. Takanishi, Various emotional expressions with emotion expression humanoid robot WE-4RII, in: First IEEE Technical Exhibition Based Conference on Robotics and Automation, Tokyo, Japan, 2004, pp. 3536 (Pubitemid 40859284)
11. S. Morishima, Real-time face analysis and synthesis using neural networks, in: IEEE Workshop on Neural Networks for Signal Processing, Sydney, New South Wales, Australia, 2000, pp. 1321 (Pubitemid 32070282)
12. L.D. Caamero, and J. Fredslund How does it feel? Emotional interaction with a humanoid LEGO robot K. Dautenhahn, The Human in the Loop. AAAI 2000 Fall Symposium 2000 AAAI Press Menlo Park, CA 23 28
13. H. Mobahi, S. Ansari, Fuzzy perception, emotion and expression for interactive robots, in: IEEE International Conference on Systems, Man and Cybernetics, Washington DC, USA, 2003, pp. 39183923
14. W.S. Ark, D.C. Dryer, D.J. Lu, The emotion mouse, in: Eighth International Conference on Human Computer Interaction, Edinburgh, Scotland, 1999, pp. 818823
15. R.S. Aylett, Agents and affect: Why embodied agents need affective systems, in: Third Hellenic Conference on AI, Samos, Greece, 2004, pp. 496504
16. J. Healey, R. Picard, F. Dabek, A new affect-perceiving interface and its application to personalized music selection, in: Workshop on Perceptual User Interfaces, San Francisco, CA, USA, 1998
17. K. Suzuki, A. Camurri, P. Ferrentino, S. Hashimoto, Intelligent agent system for human-robot interaction through artificial emotion, in: IEEE International Conference on Systems, Man and Cybernetics, San Diego, CA, USA, 1998, pp. 10551060
18. R.R. Avent, C.T. Ng, J.A. Neal, Machine vision recognition of facial affect using backpropagation neural networks, in: Sixteenth Annual International Conference of the IEEE on Engineering in Medicine and Biology Society, Baltimore, MD, 1994, pp. 13641365
19. M. Rosenblum, Y. Yacoob, and L.S. Davis Human expression recognition from motion using radial basis function network architecture IEEE Transactions on Neural Networks 7 5 1996 1121 1138 (Pubitemid 126776385)
20. T. Moriyama, S. Ozawa, Emotion recognition and synthesis system on speech, in: IEEE International Conference on Multimedia Computing and Systems, Florence, Italy, 1999, pp. 840844
21. J. Nicholson, K. Takahashi, and R. Nakatsu Emotion recognition in speech using neural networks Neural Computing and Applications 9 4 2000 290 296 (Pubitemid 33216586)
22. K.H. Kim, S.W. Bang, S.R. Kim, Development of person-independent emotion recognition systems based on multiple physiological signals, in: Second Joint EMBS/BMES Conference, Houston, USA, 2002, pp. 5051
23. F. Nasoz, C.L. Lisetti, K. Alvarez, N. Finkelstein, Emotion recognition from physiological signals for user modelling of affect, in: Third Workshop Affective and Attitude User Modelling, Pittsburgh, USA, 2003
24. R. Picard, E. Vyzaz, and J. Healey Toward machine emotional intelligence: Analysis of affective physiological state IEEE Transactions on Pattern Analysis and Machine Intelligence 23 10 2001 1175 1191 (Pubitemid 33047955)
25. L.C. De Silva, P.C. Ng, Bimodal emotion recognition, in: IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, 2000, pp. 332335
26. Y. Yoshitomi, S.-Ill Kim, T. Kawano, T. Kitazoe, Effect of sensor fusion for recognition of emotional states using voice, face image and thermal image of face, in: IEEE International Workshop on Robot and Human Interactive Communication, Osaka, Japan, 2000, pp. 178183
27. H. Schultheis IPRAEnhancing the sensing abilities of ambient intelligence Computational Intelligence 23 4 2007 464 483 (Pubitemid 350264775)
28. E. Leon, G. Clarke, V. Callaghan, and F. Sepulveda Real-time detection of emotional changes for inhabited environments Computers and Graphics 5 23 2004 635 642
29. P. Ekman An argument for basic emotions Cognition & Emotion 6 3/4 1992 169 200
30. M. Bradley, and P. Lang Measuring emotion: The self-assessment manikin and the semantic differential Journal of Behavior Therapy and Experimental Psychiatry 25 1 1994 49 59 (Pubitemid 24214918)
31. F. Amigoni, N. Gatti, C. Pinciroli, and M. Roveri What planner for ambient intelligence applications? IEEE Transactions on Systems, Man and Cybernetics Part A: Systems and Humans 35 1 2005 7 21 (Pubitemid 40085382)
32. T.S. Barger, D.E. Brown, and M. Alwan Health-status monitoring through analysis of behavioral patterns IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 35 1 2005 22 27 (Pubitemid 40085383)
33. K. Eng, R.J. Douglas, and P.F.M.J. Verschure An interactive space that learns to influence human behaviour IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 35 1 2005 66 77 (Pubitemid 40099538)
34. E.O. Heierman, M. Youngblood, D.J. Cook, Mining temporal sequences to discover interesting patterns, in: Workshop on Mining Temporal and Sequential Data, Tenth ACM International Conference on Knowledge Discovery and Data Mining, Seattle, WA, USA, 2004
35. M.C. Mozer, R.H. Dodier, M. Anderson, L. Vidmar, R.F. Cruickshank III, and D. Miller The neural network house: An overview Lars Niklasson, Mikael Boden, Current Trends in Connectionism 1995 Lawrence Erlbaum Associates Hillsdale, NJ, USA 371 380
36. U. Rutishauser, J. Joller, and R. Douglas Control and learning of ambience by an intelligent building IEEE Transactions on Systems, Man and Cybernetics Part A: Systems and Humans 35 1 2005 121 132 (Pubitemid 40085389)
37. M. Ball, V. Callaghan, M. Gardner, D. Trossen, Exploring adjustable autonomy and addressing user concerns in intelligent environments, in: Intelligent Environments 09, Barcelona, Spain, July 2009
38. V. Callaghan, G. Clarke, and J. Chin Some sociotechnical aspects of intelligent buildings and pervasive computing research Intelligent Buildings International Journal 1 1 2008
39. F. Adelstein, S.K.S. Gupta, G. Richard III, and L. Schwiebert Fundamentals of Mobile and Pervasive Computing 2005 McGraw-Hill Professional Engineering New York, NY, USA
40. A. Herbon, A. Oehme, E. Zentsch, Emotions in ambient intelligenceAn experiment on how to measure affective states, in: 20th BCS HCI Group Conference 2006, University of London
41. J. Zhou, C. Yu, J. Riekki, E. Krkkinen, AmE framework: A model for emotion-aware ambient intelligence, in: International Conference on Affective Computing and Intelligent Interaction, ACII2007, Lisbon, Portugal, 2007
42. M.A. Kramer Autoassociative neural networks Computers and Chemical Engineering 16 4 1992 313 328
43. K.S. Fu Sequential Methods in Pattern Recognition and Machine Learning 1968 Academic Press New York, NY, USA
44. E. Leon, G. Clarke, V. Callaghan, and F. Sepulveda A user-independent real-time emotion recognition system for software agents in domestic environments Engineering Applications of Artificial Intelligence 20 3 2007 337 345 (Pubitemid 46366646)
45. E. Leon, G. Clarke, F. Sepulveda, V. Callaghan, Real-time physiological emotion detection mechanisms: Effects of exercise and affect intensity, in: Twenty-seventh Annual International Conference IEEE EMBS, Shanghai, China, 2005, pp. 47194722 (Pubitemid 46229999)
46. F. Doctor, H. Hagras, and V. Callaghan An intelligent fuzzy agent approach to realising ambient intelligence in intelligent inhabited environments IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 35 1 2005 55 65 (Pubitemid 40085386)
47. E.H. Mamdami, and S. Assilina An experiment in linguistic synthesis with a fuzzy logic controller International Journal of Man-Machine Studies 7 1 1975 1 13
48. J.M. Mendel Uncertain Rule-based Fuzzy Logic Systems: Introduction and New Directions 2001 Prentice Hall PTR, Prentice Hall Inc.
49. P. Ekman, R.W. Levenson, and W.V. Friesen Autonomic nervous system activity distinguishes among emotions Science 221 1983 1208 1210 (Pubitemid 13001240)
50. R. Sinha, W.R. Lovallo, and O.A. Parsons Cardiovascular differentiation of emotions Psychosomatic Medicine 54 4 1992 422 435
51. E. Leon, G. Clarke, F. Sepulveda, V. Callaghan, Optimised attribute selection for physiological emotion detection, in: Twenty-sixth Annual International Conference IEEE EMBS, San Francisco, USA, 2004, pp. 184187
52. L. Berkowitz Aggression: Its Causes, Consequences, and Control 1993 McGraw-Hill New York, NY, USA
53. H. Ebine, Y. Shiga, M. Ikeda, O. Nakamura, The recognition of facial expressions with automatic detection of reference face, in: Canadian Conference on Electrical and Computer Engineering, Halifax, Nova Scotia, Canada, 2000
54. T. Kurozumi, Y. Shinza, Y. Kenmochi, K. Kotan, Facial individuality and expression analysis by eigenface method based on class features or multiple discriminant analysis, in: International Conference on Image Processing, Kobe, Japan, 1999 (Pubitemid 30550523)
55. D. Kahneman, A.B. Krueger, D.A. Schkade, N. Schwarz, and A.A. Stone A survey method for characterizing daily life experience: The day reconstruction method Science 306 2004 1776 1780 (Pubitemid 39601395)
56. L. Shen, E. Leon, R. Shen, V. Callaghan, Exploratory research on an affective elearning model, in: International Symposium e-Learning and Emerging Digital Tech (LET07), London, UK, 2007