Affective Interaction: Understanding, Evaluating, and Designing for Human Emotion

Reviews of Human Factors and Ergonomics

Volumn 7, Issue 1, 2011, Pages 197-217

  Lottridge, Danielle ^a   Chignell, Mark ^b   Jovicic, Aleksandra ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

affect; affective cognition; affective interaction; arousal; cultural differences; emotion; emotion assessment; emotional design; emotional intelligence; evaluation methods; individual differences; user testing; valence

Indexed keywords

EID: 84858960235     PISSN: 1557234X     EISSN: None     Source Type: Book Series    
DOI: 10.1177/1557234X11410385     Document Type: Article

References (145)

1. Anderson A.K.Affective influences on the attentional dynamics supporting awareness.Journal of Experimental Psychology General. 2005;134:258-281.
2. Arnold M.B.Emotion and personality: Vol. 1. Psychological aspects. New York, NY: Columbia University Press; 1960:.
3. Arriaga P.,Esteves F.,Carneiro P.,Monteiro M.B.Violent computer games and their effects on state hostility and physiological arousal.Aggressive Behavior. 2006;32:358-371.
4. Aspinwall L.G.,Brunhart S.M.Distinguishing optimism from denial: Optimistic beliefs predict attention to health threats.Personality and Social Psychology Bulletin. 1996;22:933-1003.
5. Bar-On R.EQ-i: Bar-On Emotional Quotient Inventory: A measure of emotional intelligence. Technical manual. Toronto, ON: Multi-Health Systems; 1997:.
6. Baumgartner H.,Sujan M.,Padgett D.Patterns of affective reactions to advertisements: The integration of moment-to-moment responses into overall judgments.Journal of Marketing Research. 1997;34:219-232.
7. Bechara A.,Damasio H.,Tranel D.,Damasio A.R.Deciding advantageously before knowing the advantageous strategy.Science. 1997;275:1293-1295.
8. Becker M.H.,Janz N.K.On the effectiveness and utility of health hazard/ health risk appraisal in clinical and nonclinical settings.Health Services Research. 1987;22:537-551.
9. Biddle S.J. H.Physical activity and psychological well-being. Biddle S.J. H.Fox K.R.Boutcher S.H., ed. London, UK: Routledge; 2000:63-87.
10. BioccaF. (1997). The cyborg's dilemma: Progressive embodiment in virtual environments. Journal of Computer-Mediated Communication, 3. Retrieved from http://www.ascusc.org/jcmc/vol3/issue2/biocca2.html.
11. Bless H.,Fiedler K.Affective states and the influence of activated general knowledge.Personality and Social Psychology Bulletin. 1995;21:766-778.
12. Boucsein W.Electrodermal activity. New York, NY: Plenum Press; 1992:.
13. Boyd T.C.,Hughes G.D.Validating realtime response measures.Advances in Consumer Research. 1992;19:649-656.
14. Breazeal C.Emotion and sociable humanoid robots.International Journal of Human-Computer Studies. 2003;59:119-155.
15. Broadbent D.E.,Broadbent M.H. P.From detection to identification: response to multiple targets in rapid serial visual presentation.Perception and Psychophysics. 1987;42:105-113.
16. Cacioppo J.T.,Gardner W.L.Emotion.Annual Review of Psychology. 1999;50:191-214.
17. Cacioppo J.T.,Gardner W.L.,Berntson G.G.The affect system has parallel and integrative processing components: Form follows function.Journal of Personality and Social Psychology. 1999;76:839-855.
18. Campos J.J.,Frankel C.B.,Camras L.On the nature of emotion regulation.Child Development. 2004;75:377-394.
19. Carliner S.Physical, cognitive, and affective: A three-part framework for information design.Technical Communication. 2002;47:561-576.
20. Carver C.S.Pleasure as a sign you can attend to something else: Placing positive feelings within a general model of affect.Cognition and Emotion. 2003;17:241-261.
21. Champney R.,Stanney K.Using emotions in usability. In Proceedings of the Human Factors and Ergonomic Society 51st Annual Meeting; 2007. 1044.
22. Cherry E.C.Some experiments on the recognition of speech, with one and with two ears.Journal of Acoustic Society of America. 1953;25:975-979.
23. Cole P.M.,Martin S.E.,Dennis T.A.Emotion regulation as a scientific construct: Methodological challenges and directions for child development research.Child Development. 2004;75:317-333.
24. Conati C.Probablistic assessment of users' emotions in educational games.Applied Artificial Intelligence. 2002;16:555-575.
25. Conway A.R. A.,Kane M.J.,Engle R.W.Working memory capacity and its relation to general intelligence.Trends in Cognitive Science. 2003;7:547-552.
26. Cowie R.,Douglas-Cowie E.,Savvidou S.,McMahon E.,Sawey M.,Schröder M.ISCA Workshop on Speech and Emotion. Newcastle, Northern Ireland, UK: International Speech Communication Association; 2000:19-24.
27. Damasio A.Descartes' error: Emotion, reason and the human brain. New York, NY: Grossett/Putnam; 1994:.
28. Damasio A.The feeling of what happens: Body and emotion in the making of consciousness. New York, NY: Harcourt; 1999:.
29. Darwin C.The expression of the emotions in man and animals. London, UK: Murray; 1872:.
30. Davidson R.J.The nature of emotion, fundamental questions. Ekman P.Davidson R.J., ed. Oxford, UK: Oxford University Press; 1994:51-56.
31. Davis M.,Whalen P.J.The amygdala: Vigilance and emotion.Molecular Psychiatry. 2001;6:13-34.
32. Demirbilek O.,Sener B.Product design, semantics and emotional response.Ergonomics. 2003;46:1346-1360.
33. Derbraix C.,Poncin I.European advances in consumer research. Dubois B.Lowrey T.M.Shrum L.J.Vanhuele M., ed. Duluth, MN: Association for Consumer Research; 1999:166-173.
34. Desmet P.Funology: From usability to enjoyment. Blythe M.A.Monk A.F.Overbeeke K.Wright P.C., ed. Amsterdam, Netherlands: Kluwer Academic Press; 2003:111-123.
35. Dormann C. Paper presented at the Proceedings of Home Oriented Informatics and Telematics (HOIT); 2003Irvine, CA; 2003.
36. Dror O.The scientific image of emotion.Configurations. 1999;7:355-401.
37. Egan D.E.Handbook of human-computer interaction. Helander M., ed. Berlin, Germany: Springer Verlag; 1988:543-568.
38. Ekman P.Are there basic emotions?.Psychological Review. 1992;99:550-553.
39. Ekman P.,Sorenson E.R.,Friesen W.V.Pancultural elements in facial displays of emotions.Science. 1969;164:86-88.
40. Endsley M.Design and evaluation for situation awareness enhancement. Proceedings of the Human Factors Society 32nd Annual Meeting; 1988; 97.
41. Fagan B.M.World prehistory: A brief introduction. 2008). World prehistory: A brief introduction (7th ed.). Upper Saddle River, NJ: Prentice Hall.Upper Saddle River, NJ: Prentice Hall; 2008:.
42. Fong T.,Nourbakhsh I.,Dautenhahn K.A survey of socially interactive robots.Robotics and Autonomous Systems. 2003;42:143-166.
43. Forgas J.P.Affect and cognition.Perspectives on Psychological Science. 2008;3:94-101.
44. Forlizzi J.,Battarbee K.Understanding experience in interactive systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, practices, methods, and techniques; 2004. 261.
45. Fredrickson B.L.,Kahneman D.Duration neglect in retrospective evaluations of affective episodes.Journal of Personality and Social Psychology. 1993;65:45-55.
46. Gawande A.The checklist manifesto: How to get things right. New York, NY: Metropolitan Books; 2009:.
47. Ghani J.A.,Deshpande S.P.Task characteristics and the experience of optimal flow in human-computer interaction.Journal of Psychology. 1994;128:381-391.
48. Goldsmith H.,Campos J.The development of attachment and affiliative systems. Emde R.Harmon R., ed. New York, NY: Plenum; 1982:161-193.
49. Goleman D.Emotional intelligence. New York, NY: Bantam Books; 1995:.
50. Goswami U.Neuroscience and education: From research to practice?.Nature Reviews Neuroscience. 2006;7:406-411.
51. Gottman J.M.,Levenson R.W.A valid procedure for obtaining self-report of affect in marital interaction.Journal of Consulting and Clinical Psychology. 1985;53:151-160.
52. Gray J.R.Emotional modulation of cognitive control: Approach-withdrawal states double-dissociate spatial from verbal two-back task performance.Journal of Experimental Psychology. 2001;130:436-452.
53. Hager J.,Ekman P.Social psychophysiology: A sourcebook. Cacioppo J.T.Petty R.E., ed. New York, NY: Guilford Press; 1983:287-306.
54. Halgren E.,Marinkovic K.The cognitive neurosciences. Gazzaniga M., ed. Cambridge, MA: MIT Press; 1995:1137-1151.
55. Hancock P.A.,Meshkati N.Human mental workload. Amsterdam, Netherlands: Elsevier; 1988:.
56. Hancock P.A.,Szalma J.L.Neuroergonomics: The brain at work. Parasuraman R.Rizzo M., ed. Oxford, UK: Oxford University Press; 2006:195-206.
57. Hancock P.A.,Warm J.S.A dynamic model of stress and sustained attention.Human Factors. 1989;31:519-537.
58. Hassenzahl M.Encyclopedia of human computer interaction. Ghaoui C., ed. Hershey, PA: Idea Group Reference; 2006:266-272.
59. Hazlett R.L.Measuring emotional valence during interactive experiences: Boys at video game play. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '06; 2006. 1023.
60. Hovland C.I.,Lumsdaine L.A.,Sheffield F.D.Experiments on mass communication. Princeton, NJ: Princeton University Press; 1949:.
61. Hutcherson C.A.,Goldin P.R.,Ochsner K.N.,Gabrieli J.D.,Feldman Barret L.,Gross J.J.Attention and emotion: Does rating emotion alter neural responses to amusing and sad films?.NeuroImage. 2005;27:656-668.
62. Immordino-Yang M.H.,Damasio A.R.We feel, therefore we learn: The relevance of affective and social neuroscience to education.Mind, Brain and Education. 2007;1:3-10.
63. James W.The principles of psychology. Cambridge, MA: Harvard University Press; 1981:.
64. Jordan P.W.The four pleasures: Taking human factors beyond usability. In Proceedings of the 13th Triennial Conference of the International Ergonomics Association; 1997. 364.
65. Kahneman D.Attention and effort. Englewood Cliffs, NJ: Prentice Hall; 1973:.
66. Kahneman D.Choices, values, and frames. Kahneman D.Tversky A., ed. New York, NY: Russell Sage Foundation; 2000:758-774.
67. Kaliouby R.,Robinson P.Real-time inference of complex mental states from facial expressions and head gestures. In Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop CVPRW'04; 2004. 154.
68. Kidd C.,Breazeal C.Sociable robot systems for real-world problems. In Proceedings of Fourteenth IEEE Workshop on Robot and Human Interactive Communication (Ro-Man05); 2005. 353.
69. Kim J.,Lee J.,Choi D.Designing emotionally evocative homepages: An empirical study of the quantitative relations between design factors and emotional dimensions.International Journal of Human-Computer Studies. 2003;59:899-940.
70. Kramer A.F.Physiological metrics of mental workload: A review of recent progress. San Diego, CA: Navy Personnel Research and Development Center; 1990:.
71. Kunda Z.Social cognition: Making sense of people. Cambridge, MA: MIT Press; 1999:.
72. Lane R.D.,Quinlan D.M.,Schwartz G.E.,Walker P.A.,Zeitlin S.B.The levels of emotional awareness scale: A cognitive-developmental measure of emotion.Journal of Personality Assessment. 1990;55:124-134.
73. Lang P.The cognitive psychophysiology of emotion: Anxiety and the anxiety disorders. Hillsdale, NJ: Lawrence Erlbaum; 1985:.
74. Lang P.The emotion probe: Studies of motivation and attention.American Psychologist. 1995;50:372-385.
75. Laurens G.,Desmet P.Designing a research tool: A case study in how design and research can cross-fertilize each other. In Proceedings of the DRS2008 Design Research Society Biennial Conference; Sheffield, UK; 2008.
76. LeDoux J.The emotional brain, the mysterious underpinnings of emotional life. New York, NY: Simon & Schuster; 1996:.
77. LeDoux J.Encyclopedia of neuroscience. Squire Larry R., ed. Oxford, UK: Academic Press; 2009:903-908.
78. Lee J.D.Attention: From theory to practice. Kramer A.Wiegmann D.Kirlik A., ed. New York, NY: Oxford University Press; 2006:73-89.
79. Leventhal H.Advances in experimental social psychology. Berkowitz L., ed. New York, NY: Academic Press; 1970:120-186.
80. Li J.,Chignell M.H.Communication of emotion in social robots through simple head and arm movements.International Journal of Social Robots. 2011;3:125-142.
81. Lin T.,Hu W.,Omata M.,Imamiya A.Do physiological data relate to traditional usability indexes?. In Proceedings of the 17th Australia Conference on Computer-Human Interaction: OZCHI; 2005. 1.
82. LottridgeD. (2010). Measuring emotional responses to interaction (Unpublished dissertation). University of Toronto, Toronto, Canada.
83. Lottridge D.M.,Chignell M.H.Emotional bandwidth: Information theory analysis of affective response ratings using a continuous slider. Human-Computer Interaction-INTERACT 2009, 12th IFIP TC 13 International Conference, Lecture Notes in Computer Science 5726; 2009a. 111.
84. Lottridge D.,Chignell M.Emotional majority agreement: A psychometric property of affective self-report instruments. In Proceedings of the IEEE International Conference-Science and Technology for Humanity TIC-STH. 2009b. 795.
85. Lottridge D.,Chignell M.Emotrace: Tracing emotions through human-system interaction. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting. 2009c. 1541.
86. Lottridge D.,Chignell M.Sliders rate valence but not arousal: Psychometrics of self-reported emotion assessment. In Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting. 2010. 1766.
87. Lykken D.T.,Venables P.H.Direct measurement of skin conductance: A proposal for standardization.Psychophysiology. 1971;8:656-672.
88. MacKinnon A.,Jorm A.F.,Christensen H.,Korten A.E.,Jacomb P.A.,Rodgers B.A short form of the Positive and Negative Affect Schedule: Evaluation of factorial validity and invariance across demographic variables in a community sample.Personality and Individual Differences. 1999;27:405-416.
89. Mackworth N.H.Vigilance.Nature. 1956;178:1375-1377.
90. MacLean P.D.Some psychiatric implications of physiological studies on frontotemporal portion of limbic system (visceral brain).Electroencephalography and Clinical Neurophysiology. 1952;4:407-418.
91. Mandryk R.L.,Inkpen K.M.Physiological indicators for the evaluation of co-located collaborative play. In Proceedings of the ACM Conference on Computer Supported Cooperative Work CSCW. 2004. 102.
92. Marks I.M.,Nesse R.M.Fear and fitness: An evolutionary analysis of anxiety disorders.Ethology and Sociobiology. 1994;15:247-261.
93. Matsumoto D.More evidence for the universality of a contempt expression.Motivation and Emotion. 1992;16:363-368.
94. Matthews G.,Emo A.K.,Funke G.,Zeidner M.,Roberts R.D.,Costa P.T.,Schulze R.Emotional intelligence, personality, and task-induced stress.Journal of Experimental Psychology: Applied. 2006;12:96-107.
95. Matthews G.,Roberts R.D.,Zeidner M.Seven myths about emotional intelligence.Psychological Inquiry. 2004;15:179-196.
96. Mauss I.B.,Levenson R.W.,McCarter L.,Wilhelm F.H.,Gross J.J.The tie that binds? Coherence among emotional experience, behavior, and autonomic physiology.Emotion. 2005;5:175-190.
97. Mayer J.D.,Salovey P.Emotional development and emotional intelligence: Implications for educators. Salovey P.Sluyter D., ed. New York, NY: Basic Books; 1997:3-31.
98. Medvec V.H.,Madey S.F.,Gilovich T.When less is more: Counterfactual thinking and satisfaction among Olympic medalists.Journal of Personality and Social Psychology. 1995;69:603-610.
99. Mesquita B.,Karasawa M.Different emotional lives.Cognition and Emotion. 2002;16:127-141.
100. Miller N.E.Electrical stimulation of the brain. Sheer D.E., ed. Austin: University of Texas Press; 1961:387-396.
101. Mutrie N.,Faulkner G.Positive psychology in practice. Linley P.A.Joseph S., ed. New York, NY: Wiley; 2004:146-164.
102. Nahl D.Information counseling inventory of affective and cognitive reactions while learning the Internet.Internet Reference Services Quarterly. 1997;2:11-33.
103. Nass C.The man who lied to his laptop: What computers can teach us about human relationships. New York, NY: Current; 2010:.
104. Nickel P.,Nachreiner F.Sensitivity and diagnosticity of the 0.1 Hz component of heart rate variability as an indicator of mental workload.Human Factors. 2003;45:575-590.
105. Norman D.Emotional design: Why we love (or hate) everyday things. New York, NY: Basic Books; 2005:.
106. Norman D.A.,Ortony A.,Russell D.M.Affect and machine design: Lessons for the development of autonomous machines.IBM Systems Journal. 2003;421:38-44.
107. Ochsner K.N.,Bunge S.A.,Gross J.J.,Gabrieli J.D.Rethinking feelings: An FMRI study of the cognitive regulation of emotion.Journal of Cognitive Neuroscience. 2002;14:1215-1229.
108. Ochsner K.N.,Gross J.J.The cognitive control of emotion.Trends in Cognitive Sciences. 2005;9:242-249.
109. Olson C.K.Children's motivations for video game play in the context of normal development.Review of General Psychology. 2010;14:180-187.
110. Partala T.,Surakka V.The effects of affective interventions in human-computer interaction.Interacting With Computers. 2004;16:295-309.
111. Peterman J.N.The program analyzer: A new technique in studying liked and disliked items in radio programs.Journal of Applied Psychology. 1940;23:725-741.
112. Phelps E.A.Emotion and cognition: Insights from studies of the human amygdala.Annual Review of Psychology. 2006;24:27-53.
113. Picard R.W.Affective computing. Cambridge, MA: MIT Press; 1997:.
114. Raghunathan R.,Trope Y.Walking the tightrope between feeling good and being accurate: Mood as a resource in processing persuasive messages.Journal of Personality and Social Psychology. 2002;83:510-525.
115. Ravaja N.Spatial presence and emotions during video game playing: Does it matter with whom you play?.Presence. 2006;15:381-392.
116. Ravaja N.,Salminen M.,Saari T.,Laarni J.,Holopainen J.,Jarvinen A.Emotional response patterns and sense of presence during video games: Potential criterion variables for game design. In Proceedings of the Third Nordic Conference on Human-Computer Interaction (NordiCHI '04). 2004. 339.
117. Ravaja N.,Tupeinen M.,Saari T.,Puttonen S.,Keltikangas-Jarvinen L.The psychophysiology of James Bond: Phasic emotional responses to violent video game events.Emotion. 2008;8:114-120.
118. Rasmussen J.Skills, rules, knowledge: Signals, signs, and symbols, and other distinctions in human performance models.IEEE Transactions on Systems, Man and Cybernetics. 1983;13:257-266.
119. Reeves B.,Nass C.The media equation: How people treat computers, television, and new media like real people and places. Cambridge, UK: Cambridge University Press; 1996:.
120. Rosenstock I.M.Why people use health services.Milbank Quarterly. 1966;44:94.
121. Rozell E.J.,Gardner W.L.Cognitive, motivation, and affective processes associated with computer related performance: A path analysis.Computers in Human Behavior. 2000;16:199-222.
122. Russell J.A.A circumplex model of affect.Journal of Personality and Social Psychology. 1980;39:1161-1178.
123. Russell J.A.Culture and the categorization of emotions.Psychological Bulletin. 1991;110:426-450.
124. Russell J.A.Core affect and the psychological construction of emotion.Psychological Review. 2003;110:145-172.
125. Russell J.A.,Barrett L.F.Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant.Journal of Personality and Social Psychology. 1999;76:805-819.
126. Russell J.A.,Mehrabian A.Evidence for a three-factor theory of emotions.Journal of Research in Personality. 1977;11:273-294.
127. Russell J.A.,Weiss A.,Mendelsohn G.A.Affect Grid: A single-item scale of pleasure and arousal.Journal of Personality and Social Psychology. 1989;57:493-502.
128. Saito S.,Towse J.N.Working memory as a construct in cognitive science: An illustrious past and a highly promising future.Psychologia. 2007;50:69-75.
129. Scherer K.R.Studying the emotion-antecedent appraisal process.Cognition and Emotion. 1993;7:325-355.
130. Self C.A.,Rogers R.W.Coping with threats to health: Effects of persuasive appeals on depressed, normal, and antisocial personalities.Journal of Behavioral Medicine. 1990;13:343-357.
131. Shibata T.,Wada K.Robot therapy: A new approach for mental healthcare of the elderly.Gerontology. 2010.
132. Stayman D.M.,Aaker D.A.Continuous measurement of self-report of emotional response.Psychology & Marketing. 1993;10:199-214.
133. Streit M.,Ioannides A.A.,Liu L.,Wolwer W.,Dammers J.,Gross J.,Gaebel W.,Muller-Gartner H.W.Neurophysiological correlates of the recognition of facial expressions of emotion as revealed by magnetoencephalography.Brain Research: Cognitive Brain Research. 1999;7:481-491.
134. Taylor A.H.Physical activity and psychological well-being. Biddle S.J. H.Fox K.R.Boutcher S.H., ed. London, UK: Routledge; 2000:10-45.
135. Thompson R.A.Emotion regulation: A theme in search of definition.Monographs of the Society for Research in Child Development. 1994;59:.
136. Wang H.,Chignell M.,Ishizuka M.Empathic tutoring software agents using real- time eye tracking, eye tracking research and application. In Proceedings of Symposium on Eye Tracking Research and Applications; 2006. 73.
137. Watson D.,Clark L.A.,Tellegen A.Development and validation of brief measures of positive and negative affect: The PANAS Scales.Journal of Personality and Social Psychology. 1988;54:1063-1070.
138. White L.K.,Helfinstein S.M.,Reeb-Sutherland B.C.,Degnan K.A.,Fox N.A.The role of attention in the regulation of fear and anxiety.Developmental Neuroscience. 2009;31:309-317.
139. Wickens C.D.,Goh J.,Helleberg J.,Horrey W.J.,Talleur D.A.Attentional models of multi-task pilot performance using advanced display technology.Human Factors. 2003;45:360-380.
140. Williams M.A.,Morris A.P.,McGlone F.,Abbott D.F.,Mattingley J.B.Amygdala responses to fearful and happy facial expressions under conditions of binocular rivalry.Journal of Neuroscience. 2004;24:2898-2904.
141. Wilson G.F.Handbook of human factors testing and evaluation. 2002). Psychophysiological test methods and procedures. In CharltonS. G.O'BrienT. G. (Eds.), Handbook of human factors testing and evaluation (2nd ed., pp. 127-156). Mahwah, NJ: Lawrence Erlbaum.Charlton S.G.O'Brien T.G., ed. Mahwah, NJ: Lawrence Erlbaum; 2002:127-156.
142. Zajonc R.B.Feeling and thinking: preferences need no inferences.American Psychologist. 1980;35:151-175.
143. Zentner M.,Bates J.E.Child temperament: An integrative review of concepts, research programs, and measures.European Journal of Developmental Science. 2008;2:7-37.
144. Zhang P.,Li N.The importance of affective quality.Communications of the ACM. 2005;48:105-108.
145. Zuckerman M.,Neeb M.Sensation seeking and psychopathology.Psychiatry Research. 1979;1:255-264.