Modeling of operators emotion and task performance in a virtual driving environment

International Journal of Human Computer Studies

Volumn 69, Issue 9, 2011, Pages 571-586

  Cai, Hua ^a   Lin, Yingzi ^a  

^a Northeastern University   (United States)

Author keywords

Driving simulation; Emotion assessment; Emotion elicitation; Emotion model; Emotionperformance relation; Human performance modeling

Indexed keywords

DRIVING SIMULATION; EMOTION ASSESSMENT; EMOTION ELICITATION; EMOTION MODELS; EMOTIONPERFORMANCE RELATION; HUMAN PERFORMANCE MODELING;

INTELLIGENT SYSTEMS;

AUTOMOBILE DRIVERS;

EID: 79959486554     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2011.05.003     Document Type: Article

References (67)

1. J.N. Bailenson, E.D. Pontikakis, I.B. Mauss, J.J. Gross, M.E. Jabon, C.A.C. Hutcherson, C. Nass, and O. John Real-time classification of evoked emotions using facial feature tracking and physiological responses International Journal of HumanComputer Studies 66 5 2008 303 317
2. S. Baron, D.S. Kruster, and B.M. Huey Quantitative Modeling of Human Performance in Complex, Dynamic Systems 1990 National Academy Press Washington, DC
3. R. Beale, and C. Creed Affective interaction: how emotional agents affect users International Journal of HumanComputer Studies 67 9 2009 755 776
4. T. Bickmore, and R. Picard Establishing and maintaining long-term humancomputer relationships ACM Transactions on Computer Human Interaction 59 1 2005 21 30
5. P. Blignaut, and A. Naude The influence of temperament style on a students choice of and performance in a computer programming course Computers in Human Behavior 24 3 2008 1010 1020 (Pubitemid 351305146)
6. P. Bouchner, R. Pieknik, S. Novotny, J. Pekny, M. Hajny, and C. Borzova Fatigue of car drivers - detection and classification based on the experiments on car simulators WSEAS Transactions on Systems 5 12 2006 2789 2794 (Pubitemid 44823049)
7. L. Boyle, J. Tippin, A. Paul, and M. Rizzo Driver performance in the moments surrounding a microsleep Transportation Research Part F: Traffic Psychology and Behaviour 11 2 2008 126 136
8. S. Brave, C. Nass, and K. Hutchinson Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent International Journal of HumanComputer Studies 62 2 2005 161 178 (Pubitemid 40206241)
9. K.A. Brookhuis, and D. De Waard Assessment of drivers workload: performance, subjective and physiological indices P. Hancock, P. Desmond, Stress, Workload and Fatigue: Theory, Research and Practice 2001 Lawrence Erlbaum New Jersey 321 333
10. Cai, H.; Lin, Y.; 2007. An experiment to non-intrusively collect driver physiological parameters towards cognitive/emotional state recognition. SAE Paper no. 2007-01-0401, SAE 2007 World Congress, Detroit, MI, USA.
11. H. Cai, Y. Lin, and B. Cheng Mimicking human driving behaviors autonomous vehicles in realistic traffic flow simulation International Journal of Simulation and Process Modeling 6 2 2010 126 136
12. J. Cerully, and W. Klein Effects of emotional state on behavioral responsiveness to personal risk feedback Journal of Risk Research 13 5 2010 591 598
13. G. Chanel, J.J.M. Kierkels, M. Soleymani, and T. Pun Short-term emotion assessment in a recall paradigm International Journal of HumanComputer Studies 67 8 2009 607 627
14. J. Coan, and J. Allen Handbook of Emotion Elicitation and Assessment (Series in Affective Science) 2007 Oxford University Press USA ISBN:13: 978-0195169157 (April 19, 2007)
15. Cochran, R.E.; Lee, F.J.; Chown, E.; 2006. Modeling emotion: Arousals impact on memory. In: Proceedings of the 28th Annual Conference of the Cognitive Science Society, Vancouver, British Columbia, Canada, pp. 11331138.
16. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J.G. Taylor Emotion recognition in humancomputer interaction IEEE Signal Processing Magazine 18 1 2001 32 80
17. M. Csikszentmihalyi Flow: The Psychology of Optimal Experience (P.S.). 2008 Harper Perennial
18. A.R. Damasio Reflections on the neurobiology of emotion and feeling J. Branquinho, The Foundations of Cognitive Science 2001 Oxford University Press
19. C.S. Dula, and E.S. Geller Risky, aggressive, or emotional driving: addressing the need for consistent communication in research Journal of Safety Research 34 5 2003 559 566
20. P. Ekman, R.J. Davidson, and W.V. Friesen Emotional expression and brain physiology II: the Duchenne smile Journal of Personality and Social Psychology 58 1990 342 353
21. J.R. Foucher, H. Otzenbergerb, and D. Gounotb Where arousal meets attention: a simultaneous fMRI and EEG recording study NeuroImage 22 2 2004 688 697 (Pubitemid 38759431)
22. J.J. Gross, J.M. Richards, and O.P. John Emotion regulation in everyday life D.K. Snyder, J. Simpson, J.N. Hughes, Emotion Regulation in Couples and Families: Pathways to Dysfunction and Health 2006 American Psychological Association Washington, DC 13 35
23. J.M. Haight, and V. Kecojevic Automation vs. human intervention: what is the best fit for the best performance? Process Safety Progress 24 1 2005 45 51 (Pubitemid 40345662)
24. J.D. Herrington, A. Mohanty, N.S. Koven, J.E. Fisher, J.L. Stewart, M.T. Banich, A.G. Webb, G.A. Miller, and W. Heller Emotion-modulated performance and activity in left dorsolateral prefrontal cortex Emotion 5 2 2005 200 207 (Pubitemid 40993309)
25. E.R. Hirt, R.J. Melton, H.E. McDonald, and J.M. Harackiewicz Processing goals, task interest, and the moodperformance relationship: a mediational analysis Journal of Personality and Social Psychology 71 1995 245 261 (Pubitemid 126418536)
26. S.G. Hart, and L.E. Staveland Development of NASA-TLX (task load index): results of empirical and theoretical research P.A. Hancock, N. Meshkati, Human Mental Workload 1988 Elsevier Science Publishers, North-Holland
27. A.M. Isen, A.S. Rosenzweig, and M.J. Young The influence of positive effect on clinical problem solving Medical Decision Making 11 3 1991 221 227
28. M. Isomursu, M. Tähti, S. Väinämö, and K. Kuutti Experimental evaluation of five methods for collecting emotions in field settings with mobile applications International Journal of HumanComputer Studies 65 4 2007 404 418 (Pubitemid 46216845)
29. W.A. Johnston, and V.J. Dark Selective attention Annual Review of Psychology 37 1986 43 75
30. C.D. Katsis, N. Katertsidis, G. Ganiatsas, and D.I. Fotiadis Toward emotion recognition in car-racing drivers: a biosignal processing approach IEEE Transactions on Systems, Man, and Cybernetics-Part A (Systems and Humans) 38 3 2008 502 512 (Pubitemid 351649883)
31. T. Kontogiannis Stress and operator decision making in coping with emergencies International Journal of HumanComputer Studies 45 1 1996 75 104 (Pubitemid 126359966)
32. M.D. Korhonen, D.A. Clausi, and M.E. Jernigan Modeling emotional content of music using system identification IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 36 3 2005 588 599
33. K. Kroemer, H. Kroemer, and E. Kroemer-Elbert Ergonomics: How to Design For ease and Efficiency 2nd ed 2001 Prentice-Hall Inc. ISBN:13:978-0137524785
34. R.D. Lane, and L. Nadel Cognitive Neuroscience of Emotion 2000 Oxford University Press New York 0-19-511888-X
35. P.J. Lang The three system approach to emotion N. Birbaumer, A. Ohman, The Organization of Emotion 1993 Hogrefe-Huber Toronto 18 30
36. Lang, P.J.; 1980. Behavioral treatment and biobehavioral assessment: computer applications. In: Sidowski, J.; Johnson, J.; Williams, T. (Eds.), Technology in Mental Health Care Delivery Systems, Norwood, NJ, pp. 119137.
37. Y. Lin, W.J. Zhang, and L.G. Watson Using eye movement parameters for evaluating humanmachine interface frameworks under normal control operation and fault detection situation International Journal of HumanComputer Studies 59 6 2003 837 873
38. Y. Lin, W.J. Zhang, and R.J. Koubek Effective attention allocation behavior and its measurement: a preliminary study Interacting with Computers 16 6 2004 1195 1210
39. C.L. Lisetti, and F. Nasoz Using noninvasive wearable computers to recognize human emotions from physiological signals EURASIP Journal on Applied Signal Processing 11 2004 1672 1687
40. R. Looije, M. Neerincx, and F. Cnossen Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors International Journal of Human Computer Studies 68 6 2010 386 397
41. R. Ma, and D.B. Kaber Situation awareness and workload in driving while using adaptive cruise control and a cell phone International Journal of Industrial Ergonomics 35 10 2005 939 953 (Pubitemid 41368029)
42. P. Madhavan, D.A. Wiegmann, and F.C. Lacson Automation failures on tasks easily performed by operators undermine trust in automated aids Human Factors 48 2 2006 241 256 (Pubitemid 44061485)
43. C. Marshall Make the most of your emotional intelligence Chemical Engineering Progress 97 2 2001 92 95 (Pubitemid 32253839)
44. J.D. Mayer, and P. Salovey What is emotional intelligence? P. Salovey, D. Sluyter, Emotional Development and Emotional Intelligence: Implications for Educators 1997 Basic Books New York 3 31
45. McCall, J.C.; Trivedi, M.M.; 2006. Human behavior based predictive brake assistance. In: Proceedings of the IEEE Intelligent Vehicles Symposium, IV, pp. 812.
46. F. Nasoz, C. Lisetti, and A. Vasilakos Affectively intelligent and adaptive car interfaces Information Sciences 180 20 2010 3817 3836
47. Nass, C.; Jonsson, I.M.; Harris, H.; Reaves, B.; Endo, J.; Takayama, L.; 2005. Improving automotive safety by pairing driver emotion and car voice emotion. In: Conference on Human Factors in Computing Systems, pp. 19731976.
48. D.A. Norman Emotion and design: attractive things work better Interactions Magazine ix 4 2002 36 42
49. A. Ortony, G.L. Clore, and A. Collins The Cognitive structure of Emotions 1988 Cambridge University Press New York
50. C. Peter, and A. Herbon Emotion representation and physiology assignments in digital systems Interacting with Computers 18 2 2006 139 170 (Pubitemid 43267407)
51. R.W. Pew More than 50 years of history and accomplishments in human performance model development Human Factors 50 3 2008 489 496 (Pubitemid 352029810)
52. R.W. Picard Affective Computing 1997 MIT Press Cambridge, MA
53. R.W. Picard, and J. Klein Computers that recognize and respond to user emotion: theoretical and practical implications Interacting with Computers 14 2 2002 141 169 (Pubitemid 34199156)
54. J. Posner, J.A. Russell, and B.S. Peterson The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology Development and Psychopathology 17 2005 715 734
55. G.B. Reid, and T.E. Nygren The subjective workload assessment technique: a scaling procedure for measuring mental workload P. Hancock, N. Meshkati, Human Mental Workload 1988 Amsterdam, the Netherlands North-Holland
56. T.H. Reus, and Y. Lu Rhyme and reason: emotional capability and the performance of knowledge-intensive work groups Human Performance 17 2 2004 245 266 (Pubitemid 38830394)
57. Roberts, N.A.; Tsai, J.L.; Coan, J.A.; 2007. Emotion elicitation using dyadic interaction tasks. In: Coan, James, A.; Allen, John J.B. (Eds.), Handbook of Emotion Elicitation and Assessment, p. 106.
58. R. Ross, and D. Antonowicz Antisocial Drivers 2004 Charles C Thomas Publisher. Illinois, USA 0-398-07496-8 pp. 86164
59. J.A. Russell A circumplex model of affect Journal of Personality and Social Psychology 39 6 1980 1161 1178
60. N. Sebe, M.S. Lew, I. Cohen, Y. Sun, and T.S. Huang Authentic facial expression analysis Journal of Image and Vision Computing 25 12 2007 1856 1893
61. M. Seif El-Nasr, J. Yen, and T. Ioerger FLAME - a fuzzy logic adaptive model of emotions Autonomous Agents and Multi-agent Systems 3 2000 219 257
62. B.G. Silverman, G. Bharathy, M. Johns, R.J. Eidelson, T.E. Smith, and B. Nye Sociocultural games for training and analysis IEEE Transactions on Systems, Man, and Cybernetics - Part A (Systems and Humans) 37 6 2007 1113 1130 (Pubitemid 350130848)
63. J. Smith, and K. MacLean Communicating emotion through a haptic link: design space and methodology International Journal of HumanComputer Studies 65 4 2007 376 387 (Pubitemid 46216843)
64. A.J. Szameitat, J. Rummel, D.P. Szameitat, and A. Sterr Behavioral and emotional consequences of brief delays in humancomputer interaction International Journal of HumanComputer Studies 67 7 2009 561 570
65. H. Topi, J.S. Valacich, and J.A. Hoffer The effects of task complexity and time availability limitations on human performance in database query tasks International Journal of HumanComputer Studies 62 3 2005 349 379 (Pubitemid 40330062)
66. J. Tzeng Toward a more civilized design: studying the effects of computers that apologize International Journal of Human Computer Studies 61 3 2004 319 345
67. C.D. Wickens Multiple resources and performance prediction Theoretical Issues in Ergonomics Science 3 2 2002 159 177