Anxiety-based affective communication for implicit human-machine interaction

Advanced Engineering Informatics

Volumn 21, Issue 3, 2007, Pages 323-334

  Rani, Pramila ^a   Sarkar, Nilanjan ^b   Adams, Julie ^c  

^a METIS DESIGN CORPORATION   (United States)

^b VANDERBILT UNIVERSITY   (United States)

^c VANDERBILT UNIVERSITY   (United States)

Author keywords

Affective computing; Anxiety detection; Fuzzy logic; Human machine interaction; Physiological responses; Regression trees

Indexed keywords

DECISION MAKING; ENGINEERING TECHNOLOGY; FUZZY LOGIC; HUMAN FORM MODELS; PATTERN RECOGNITION; REGRESSION ANALYSIS;

AFFECTIVE COMMUNICATION; ANXIETY STATE; ANXIETY-RECOGNITION SYSTEM; PHYSIOLOGICAL SIGNALS; TASK PERFORMANCE;

HUMAN COMPUTER INTERACTION;

EID: 34250886936     PISSN: 14740346     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.aei.2006.11.009     Document Type: Article

References (65)

1. Picard R. Affective Computing (1997), The MIT Press, Cambridge
2. Simon H. Motivational and Emotional Controls of Cognition, Models of Thought (1979), Yale University Press pp. 29-38
3. A. Sloman and M. Croucher, Why Robots will Have Emotions, in: Proceedings of the Seventh International Conference on Artificial Intelligence, 1981, pp. 197-202.
4. N. Tsapatsoulis, K. Karpouzis, G. Stamou, F. Piat and S. Kollias, A Fuzzy System for Emotion Classification based on the MPEG-4 Facial Definition Parameter Set, in: Proceedings of the EUSIPCO-2000, Tampere, Finland, 2000.
5. D.W. Massaro, Multimodal emotion perception: analogous to speech processes, in: Proceedings of the ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, 2000, pp. 114-121.
6. Rani P., Sarkar N., Smith C., and Kirby L. Anxiety detecting robotic systems - towards implicit human-robot collaboration. Robotica 22 1 (2004) 85-95
7. E. Hudlicka, M.D. McNeese, Assessment of user affective and belief states for inference adaptation: application to an air force pilot task, User Modeling and User Adapted Interaction. 12 (need a year) 1-47.
8. V.A. Petrushin, Emotion recognition agents in real world, in: Proceedings of the AAAI Fall Symposium on Socially Intelligent Agents: Human in the Loop, 2000.
9. Moriyama T., Saito H., and Ozawa S. Evaluation of the relation between emotional concepts emotional parameters on speech. IEICE Journal J82-DII 10 (1999) 1710-1720
10. Ark W., Dryer D., and Lu D. The emotion mouse. In: Bullinger H.J., and Ziegler J. (Eds). Human-Computer Interaction: Ergonomics and User Interfaces vol. 1 (1999), Lawrence Erlbaum Assoc., London 818-823
11. Picard R.W., Vyzas E., and Healy J. Toward machine emotional intelligence: analysis of affective psychological states. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 10 (2001) 1175-1191
12. J. Zhao and G. Kearney, Classifying facial movement by backpropagation neural networks with fuzzy inputs, in: Proceedings of the International Conference on Neural Information Processing, 1996, pp. 454-457.
13. W.A. Fellenz, J.G. Taylor, R. Cowie, E. Douglas-Cowie, F. Piat, S. Kollias, C. Orovas, B. Apolloni, On emotion recognition of faces and of speech using neural networks, fuzzy logic and the ASSESS systems, in: Proceedings of the of IEEE-INNS-ENNS International Joint Conference on Neural Networks, 2000, pp. 2093.
14. V.A. Petrushin, Emotion recognition in speech signal: experimental study, development and application, in: Proceedings of the Sixth International Conference on Spoken Language processing, 2000, pp. 454-457.
15. P. Rani, N. Sarkar, An Adaptive Neuro-Fuzzy Technique for Emotion Recognition, TR: 1-04, Robotics and Autonomous System Lab, Vanderbilt University, 2004.
16. Y. Qi, R.W. Picard, Context-sensitive Bayesian classifiers and application to mouse pressure pattern classification, in: Proceedings of the International Conference on Pattern Recognition, Quebec City, Canada, 2002.
17. N. Sebe, I. Cohen, A. Garg, T.S. Huang, Emotion Recognition using a Cauchy Naive Bayes Classifier, in: Proceedings of International Conference on Pattern Recognition, 2002, pp. 10017-10021.
18. I. Cohen, A. Garg, T.S. Huang, Emotion recognition using multilevel HMM, in: Proceedings of the NIPS Workshop on Affective Computing, Colorado, 2000.
19. Gomer F.E., Silverstein L.D., Berg W.K., and Lassiter D.L. Changes in electromyographic activity associated with occupational stress and poor performance in the workplace. Human Factors 29 2 (1987) 131-143
20. Kramer A.F., Sirevaag E.J., and Braune R. A Psychophysiological assessment of operator workload during simulated flight missions. Human Factors 29 2 (1987) 145-160
21. Aasman J., Mulder G., and Mulder L.J.M. Operator effort and the measurement of heart-rate variability. Human Factors 29 2 (1987) 161-170
22. Vicente K.J., Thornton D.C., and Moray N. Spectral analysis of sinus arrhythmia: a measure of mental effort. Human Factors 29 2 (1987) 171-182
23. Y. Hayakawa and S. Sugano, Real time simple measurement of mental strain in machine operation, in: Proceedings of the ISCIE 1998 Japan-USA Symposium on Flexible Automation, Otsu, Japan, 1998, pp. 35-42.
24. Tripathi K.K., Mukundan C.R., and Mathew T.L. Attentional modulation of heart rate variability during PC-based cognitive tasks. Indian Journal of Aerospace and Medicine 47 1 (2003) 1-10
25. Wilson G.F. An analysis of mental workload in pilots during flight using multiple Psychophysiological measures. The International Journal of Aviation Psychology 12 1 (2002) 3-18
26. Iszo L., Mischinger G., and Lang E. Validating a new method for ergonomic evaluation of human-computer interfaces. Periodica Polytechnica Series: Social and Management Science 7 2 (1999) 119-134
27. A.L. Garlach, F.H. Wilhelm, W.T. Roth, Embarrassment and Social Phobia: the role of parasympathetic activation, Behavior Modification (in press).
28. Rottenberg J., Wilhelm F.H., and Roth W.T. Vagal rebound during resolution of tearful crying among depressed and nondepressed individuals. Psychophysiology 40 1 (2003) 1-6
29. Lisetti C., Nasoz F., LeRouge C., Ozyer O., and Alvarez K. Developing multimodal intelligent affective interfaces for tele-home health care. International Journal of Human-Computer Studies 59 1-2 (2003) 245-255, 200
30. M.V. Scanlon, Acoustic Sensor for Health Status Monitoring, in: Proceedings of the of IRIS Acoustic and Sensing, vol. 2, 1998, pp. 205-222.
31. .
32. Hart S., and Staveland L. Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock P.A., and Meshkati N. (Eds). Human Mental Workload (1988), Elsevier Science Publishers
33. Bradley M.M. Emotion and motivation. In: Cacioppo J.T., Tassinary L.G., and Berntson G. (Eds). Handbook of Psychophysiology (2000), Cambridge University Press, New York 602-642
34. Rohrmann S., Hennig J., and Netter P. Changing psychobiological stress reactions by manipulating cognitive processes. International Journal of Psychophysiology 33 2 (1999) 149-161
35. Dawson M.E., Schell A.M., and Filion D.L. The electrodermal system. In: Cacioppo J.T., and Tassinary L.G. (Eds). Principles of Psychophysiology: Physical, Social, and Inferential Elements (1990), Cambridge University Press, New York 295-324
36. Lacey J.L., and Lacey B.C. Verification and extension of the principle of autonomic response-stereotypy. American Journal of Psychology 71 1 (1958) 50-73
37. Wright R.A., and Kirby L.D. Effort determination of cardiovascular response: an integrative analysis with applications in social psychology. In: Zanna M. (Ed). Advances in Experimental Social Psychology vol. 33 (2001), Academic Press 255-307
38. Smith C.A. Dimensions of appraisal and physiological response in emotion. Journal of Personality and Social Psychology 56 3 (1989) 339-353
39. Rani P., Sims J., Brackin R., and Sarkar N. Online stress detection using psychophysiological signal for implicit human-robot cooperation. Robotica 20 6 (2002) 673-686
40. McCraty R., Atkinson M., Tiller W.A., Rein G., and Watkins A.D. The effects of emotions on short-term power spectral analysis of heart rate variability. American Journal of Cardiology 76 14 (1991) 1089-1093
41. Tiller W.A., McCraty R., and Atkinson M. Cardiac coherence: a new noninvasive measure of autonomic nervous system order. Alternative Therapies in Health and Medicine 2 1 (1996) 52-65
42. Bloom J., and Trautt G.M. Finger pulse volume as a measure of anxiety: further evaluation. Psychophysiology 14 6 (1978) 541-544
43. Smith T.W., Houston B.K., and Stucky R.J. Effects of threat of shock and control over shock on finger pulse volume, pulse rate and systolic blood pressure. Biological Psychology 20 1 (1985) 31-38
44. Dimberg U. Facial electromyography and emotional reactions. Psychophysiology 27 (1990) 481-494
45. Ekman P., and Friesen W.V. A new pan cultural facial expression of emotion. Motivation and Emotion 10 2 (1986)
46. E. Vyzas, R.W. Picard, Offline and online recognition of emotion expression from physiological data, in: Proceedings of the Workshop on Emotion-Based Agent Architectures at the Third International Conference on Autonomous Agents, Seattle, 1999, pp. 1175-1191.
47. Scheirer J., Fernandez R., Klein J., and Picard R. Frustrating the user on purpose: a step toward building an affective computer. Interacting with Computers 14 2 (2002) 93-118
48. S. Susarla, A. Adcock, R. Van Eck, K. Moreno, A.C. Graesser, Development and evaluation of a lesson authoring tool for AutoTutor, in: V. Aleven, U. Hoppe, J. Kay, R. Mizoguchi, H. Pain, F. Verdejo, K. Yacef (Eds.), AIED2003 Supplemental Proceedings, Australia, 2003, pp. 378-387.
49. C. Conati, X. Zhou, Modeling Students' Emotions from Cognitive Appraisal in Educational Games, in: Proceedings of the Sixth International Conference on Intelligent Tutoring Systems, France, 2002.
50. A. Kapoor, S. Mota, R. Picard, Towards a learning companion that recognizes affect, in: Proceedings of the AAAI Fall Symposium, 2001.
51. Weidner G., Kohlmann C., Horsten M., Wamala S.P., Schenck-Gustafsson K., Högbom M., and Orth-Gomer K. Cardiovascular reactivity to mental stress in the Stockholm female coronary risk study. Psychosomatic Medicine 63 (2001) 917-924
52. Weidner G., and Messina C.R. Cardiovascular reactivity to mental stress. In: Orth-Gomer K., Chesney M.A., and Wenger N.K. (Eds). Women, Stress, and Heart Disease (1998), Lawrence Erlbaum Associates, Mahwah, NJ 219-236
53. Thought Technology Limited. .
54. Zadeh L. Fuzzy Sets. Information and Control 8 3 (1965) 338-353
55. Kandel A. Fuzzy Techniques in Pattern recognition (1982), Wiley-Interscience, New York
56. Pal S.K., and Majumder D. Fuzzy Mathematical Approach to Pattern Recognition (1986), Wiley (Halsted Press), New York
57. Quinlan J.R. Induction of decision trees. Machine Learning 1 (1986) 81-106
58. Kokol P., Mernik M., Završnik J., Kancler K., and Malèiæ I. Decision trees and automatic learning and their use in cardiology. Journal of Medical Systems 9 4 (1994) 201-206
59. Gilpin E., Plshen R.A., Henning H., and Ross J. Risk prediction after myocardial infarction: comparison of three multivariate technologies. Cardiology 70 (1983) 73-84
60. Henning H., Gilpin E.A., Covell J.W., Swan E.A., A O'rourke R., and Ross Jr. J. Prognosis after acute myocardial infarction, multivariate analysis of mortality and survival. Circulation 59 (1976) 1124-1136
61. Breiman L., Friedman J., Olshen R., and Stone C. Classification and Regression Trees (1984), Wadsworth International Group
62. Dilllman R.O., and Koizol J.A. Statistical approach to immunosuppression classification using lymphocyte surface markers and functional assays. Cancer Research 43 (1983) 417-421
63. S. Downey, M.J. Russell, A decision tree approach to task independent speech recognition, in: Proceedings of the Institute Acoustics Autumn Conference on Speech and Hearing, vol. 14(6), 1992, pp. 181-188.
64. Kawachi I., Sparrow D., Vokonas P.S., and Weiss S.T. Decreased heart rate variability in men with phobic anxiety. American Journal of Cardiology 75 (1995) 882-885
65. Veldhuizen I.J., Gaillard A.W., and de Vries J. The influence of mental fatigue on facial EMG activity during a simulated workday. Biological Psychology 63 1 (2003) 59-78