Affect prediction from physiological measures via visual stimuli

International Journal of Human Computer Studies

Volumn 69, Issue 12, 2011, Pages 801-819

  Zhou, Feng ^a   Qu, Xingda ^a   Helander, Martin G ^a   Jiao, Jianxin ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Affect elicitation; Affect prediction; Affective computing; Data mining; Humancomputer interaction; Physiological measure

Indexed keywords

AFFECT ELICITATION; AFFECT PREDICTION; AFFECTIVE COMPUTING; HUMAN-COMPUTER; PHYSIOLOGICAL MEASURE;

DATA MINING; FORECASTING; MATHEMATICAL MODELS; PHYSIOLOGY; TREES (MATHEMATICS);

PHYSIOLOGICAL MODELS;

EID: 80051906377     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2011.07.005     Document Type: Article

References (61)

1. J.N. Bailenson, E.D. Pontikakis, I.B. Mauss, J.J. Gross, M.E. Jabon, C.A.C. Hutcherson, C. Nass, and J. Oliver Real-time classification of evoked emotions using facial feature tracking and physiological responses International Journal of HumanComputer Studies 66 5 2008 303 317
2. J. Bazan, H.S. Nguyen, S.H. Nguyen, P. Synak, and J. Wróblewski Rough set algorithms in classification problem L. Polkowski, S. Tsumoto, T. Lin, Rough Set Methods and Applications 2000 Physica-Verlag Heidelberg/New York 49 88
3. J. Bazan, and M. Szczuka Rses and rseslib - a collection of tools for rough set computations Lecture Notes in Artificial Intelligence 2000 Springer-Verlag Berlin, Heidelberg pp. 592601
4. A.S. Bernstein The orienting response and direction of stimulus change Psychonomic Science 12 1969 127 128
5. M.M. Bradley, and P.J. Lang Affective reactions to acoustic stimuli Psychophysiology 37 2000 204 215 (Pubitemid 30140285)
6. M.M. Bradley, M. Codispoti, B.N. Cuthbert, and P.J. Lang Emotion and motivation I: defensive and appetitive reactions in picture processing Emotion 1 3 2001 276 298
7. M.M. Bradley, M. Codispoti, D. Sabatinelli, and P.J. Lang Emotion and motivation II: sex differences in picture processing Emotion 1 3 2001 300 319
8. J.T. Cacioppo, and L.G. Tassinary Inferring psychological significance from physiological signals American Psychologist 45 1 1990 16 28
9. G. Chanel, J.J.M. Kierkels, M. Soleymani, and T. Pun Short-term emotion assessment in a recall paradigm International Journal of HumanComputer Studies 66 8 2009 607 627
10. O.D. Creutzfeldt, S. Watanabe, and H.D. Lux Relations between EEG phenomena and potentials of single cortical cells. I. Evoked responses after thalamic and epicortical stimulation Electroencephalography and Clinical Neurophysiology 20 1966 1 18
11. Detenber, B.H.; 2001. Measuring emotional responses in human factors research: some theoretical and practical considerations. In: Proceedings of the International Conference on Affective Human Factors Design. Asean Academic Press, London. pp. 124130.
12. E. Diener, C.N. Scollon, and R.E. Lucas The evolving concept of subjective well-being: the multifaceted nature of happiness Advances in Cell Aging & Gerontology 15 2003 187 219 (Pubitemid 137640671)
13. P. Ekman An argument for basic emotions Cognition and Emotion 6 1992 169 200
14. S.H. Fairclough Fundamentals of physiological computing Interacting with Computers 21 12 2009 133 145
15. R.A. Fisher The statistical utilization of multiple measurements Annals of Eugenics 8 1938 376 386
16. Fodor, I.K.; 2002. A Survey of Dimension Reduction Techniques. LLNL Technical Report, UCRL-ID-148494.
17. J.R.J. Fontaine, K.R. Scherer, E.B. Roesch, and P.C. Ellsworth The world of emotions is not two-dimensional Psychological Science 18 12 2007 1050 1057
18. C.A. Frantzidis, C. Bratsas, M.A. Klados, E. Konstantinidis, C.D. Lithari, A.B. Vivas, C.L. Papadelis, E. Kaldoudi, C. Pappas, and P.D. Bamidis On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications IEEE Transactions on Information Technology in Biomedicine 14 2 2010 309 318
19. A.J. Fridlund, and C.E. Izard Electromyographic studies of facial expressions of emotions and patterns of emotions J.T. Cacioppo, R.E. Petty, Social Psychophysiology: A Sourcebook 1983 Guilford Press New York 243 286
20. G. Gora, and A. Wojna Riona: a new classification system combining rule induction and instance-based learning Fundamenta Informaticae 51 4 2002 369 390 (Pubitemid 35393872)
21. D. Grandjean, D. Sander, and K.R. Scherer Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization Consciousness & Cognition 17 2 2008 484 495
22. Gu, Y.; Tan, S.L.; Wong, K.J. Ho, M-H.R.; Qu, L.; 2010. A GMM based 2-stage architecture for multi-subject emotion recognition using physiological responses. In: The 1st Augmented Human International Conference, Megève, France.
23. S. Haykin Adaptive Filter Theory third ed. 1996 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
24. M.G. Helander, and H.M. Khalid Affective and pleasurable design G. Salvendy, Handbook of Human Factors and Ergonomics third ed. 2006 Wiley Interscience New York
25. M.G. Helander, and M.P. Tham Hedonomics-affective human factors design Ergonomics 46 13/14 2003 1269 1272
26. S.V. Ioannou, A.T. Raouzaiou, V.A. Tzouvaras, T.P. Mailis, K.C. Karpouzis, and S.D. Kollias Emotion recognition through facial expression analysis based on a neurofuzzy network Neural Networks 18 4 2005 423 435 (Pubitemid 40922649)
27. J. Jiao, Q. Xu, J. Du, Y. Zhang, M.G. Helander, H.M. Khalid, P. Helo, and C. Ni Analytical affective design with ambient intelligence for mass customization and personalization International Journal of Flexible Manufacturing Systems 19 2007 570 595
28. E.R. Kandel, J.H. Schwartz, and T.M. Jessell Principles of Neural Science fourth ed. 2000 McGraw-Hill New York
29. C.D. Katsis, N. Katertsidis, G. Ganiatsas, and D.I. Fotiadis Toward emotion recognition in car-racing drivers: a biosignal processing approach IEEE Transactions on Systems, Man and Cybernetics, Part A 38 3 2008 502 512 (Pubitemid 351649883)
30. J. Klein, Y. Moon, and R.W. Picard This computer responds to user frustration Interacting with Computers 14 2 2002 119 140
31. Lang, P.J.; Bradley, M.M.; Cuthbert, B.N.; 2008. International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual. Gainesville, FL, Technical Report A-8.
32. P.J. Lang, M.K. Greenwald, M.M. Bradley, and A.O. Hamm Looking at pictures: affective, facial, visceral, and behavioral reactions Psychophysiology 30 3 1993 261 273 (Pubitemid 23108336)
33. J. Laparra-Hernández, J.M. Belda-Lois, E. Medina, N. Campos, and R. Poveda EMG and GSR signals for evaluating users perception of different types of ceramic flooring International Journal of Industrial Ergonomics 39 2 2009 326 332
34. R.S. Lazarus Emotions and Adaptation 1991 Oxford University Press New York
35. R.W. Levenson Autonomic specificity and emotion R.J. Davidson, K.R. Scherer, H.H. Goldsmith, Handbook of Affective Sciences first ed. 2003 Oxford University Press New York 213 225
36. C.L. Lisetti, and F. Nasoz Using noninvasive wearable computers to recognize human emotions from physiological signals EURASIP Journal of Applied Signal Processing 2004 2004 1672 1687
37. C. Liu, K. Conn, N. Sarkar, and W. Stone Physiology-based affect recognition for computer-assisted intervention of children with autism spectrum disorder International Journal of HumanComputer Studies 66 9 2008 662 677
38. R. Mandryk, and M. Atkins A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies International Journal of HumanComputer Studies 65 4 2007 329 347 (Pubitemid 46216840)
39. A.M. Martinez, and A.C. Kak PCA versus LDA IEEE Transactions on Pattern Analysis and Machine Intelligence 23 2 2001 228 233 (Pubitemid 32254716)
40. B. Mesquita Emotions as dynamic cultural phenomena R.J. Davison, K.R. Scherer, H.H. Goldsmith, Handbook of Affective Sciences 2003 Oxford University Press New York 871 890
41. J.A. Mikels, B.L. Fredrickson, G.R. Larkin, C.M. Lindberg, S.J. Maglio, and P.A. Reuter-Lorenz Emotional category data on images from the International Affective Picture System Behavior Research Methods 37 4 2005 626 630 (Pubitemid 43688770)
42. F. Nasoz, K. Alvarez, C.L. Lisetti, and N. Finkelstein Emotion recognition from physiological signals for presence technologies International Journal of Cognition, Technology and Work. Special Issue on Presence 6 2003 1
43. S.H. Nguyen Regularity analysis and its applications in data mining L. Polkowski, S. Tsumoto, T.Y. Lin, Rough Set Methods and Applications: New Developments in Knowledge Discovery in Information Systems. 2000 Physica-Verlag GmbH Heidelberg, Germany 289 378
44. E. Niedermeyer, and F.H. Lopes da Silva Electroencephalography: Basic Principles, Clinical Applications, and Related Fields fifth ed 2004 Lippincott Williams & Wilkins Philadelphia
45. C.P. Niemic Studies of emotion: a theoretical and empirical review of psychophysiological studies of emotion Journal of Undergraduate Research 1 2002 15 18
46. R. Nisbett The Geography of Thought: How Asians and Westerners Think Differently...and Why 2003 The Free Press New York
47. Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data first ed. 1991 Springer Berlin
48. R.W. Picard Affective computing 1997 The MIT Press Cambridge, MA
49. R.W. Picard, E. Vyzas, and J. Healey Toward machine emotional intelligence: analysis of affective physiological state IEEE Transactions on Pattern Analysis and Machine Intelligence 23 10 2001 1175 1191 (Pubitemid 33047955)
50. P.-Y. Oudeyer The production and recognition of emotions in speech: features and algorithms International Journal HumanComputer Studies 59 1-2 2003 157 183
51. M. Pantic, and L.J.M. Rothkrantz Toward an affect-sensitive multimodal human-computer interaction Proceedings of the IEEE 91 9 2003 1370 1390 (Pubitemid 40890819)
52. R. Plutchik Emotion: A Psychoevolutionary Synthesis 1980 Harper and Row New York
53. J. Scheirer, R. Fernandez, J. Klein, and R.W. Picard Frustrating the user on purpose: a step toward building an affective computer Interacting with Computers 14 2 2002 93 118 (Pubitemid 34199154)
54. Schiano, D.J.; Ehrlich, S.M.; Sheridan, K.; 2004. Categorical imperative not: facial affect is perceived continuously. In: Conference on Human Factors in Computing Systems, Vienna, Austria, pp. 4956.
55. K. Shelley, and S. Shelley Pulse oximeter waveform: photoelectric plethysmography C. Lake, R. Hines, C. Blitt, Clinical Monitoring. Saunders Company 2001 420 428
56. R.M. Stern, W.J. Ray, and K.S. Quigley Psychophysiological Recording second ed. 2001 Oxford University Press New York
57. A.A. Stone, and S. Shiffman Ecological momentary assessment (EMA) in behavioral medicine Annals of Behavioral Medicine 16 3 1994 199 202 (Pubitemid 24280823)
58. D. Ververidis, and C. Kotropoulos Emotional speech recognition: resources, features, and methods Speech Communication 48 9 2006 1162 1181 (Pubitemid 44128615)
59. P.D. Welch The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms IEEE Transtractions on Audio Electroacoustics AU-15 1967 70 73
60. R.M. Yerkes, and J.D. Dodson The relation of strength of stimulus to rapidity of habit-formation Journal of Comparative Neurology and Psychology 18 1908 459 482
61. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Transactions on Pattern Analysis and Machine Intelligence 31 1 2009 39 58