Empirically building and evaluating a probabilistic model of user affect

User Modeling and User-Adapted Interaction

Volumn 19, Issue 3, 2009, Pages 267-303

  Conati, Cristina ^a   MacLaren, Heather ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b Humanature Studios   (Canada)

Author keywords

Affective computing; Dynamic Bayesian networks; Evaluation; User modeling

Indexed keywords

AFFECTIVE COMPUTING; AFFECTIVE MODEL; DIAGNOSTIC INFORMATION; DIAGNOSTIC MODEL; DYNAMIC BAYESIAN NETWORK; DYNAMIC BAYESIAN NETWORKS; EDUCATIONAL COMPUTER GAME; EMOTIONAL REACTIONS; EMPIRICAL STUDIES; EVALUATION; EXPLICIT INFORMATION; GENERAL THEORY; MULTIPLE USER; OCC MODEL; PLAN RECOGNITION; PROBABILISTIC FRAMEWORK; PROBABILISTIC MODELS; TARGET APPLICATION; THEORETICAL MODELS; USER EMOTIONS; USER GOALS; USER MODELING;

COMPUTER SCIENCE; DISTRIBUTED PARAMETER NETWORKS; GAME THEORY; GESTURE RECOGNITION; INFERENCE ENGINES; INTELLIGENT AGENTS; INTELLIGENT NETWORKS; KNOWLEDGE BASED SYSTEMS; SPEECH RECOGNITION;

BAYESIAN NETWORKS;

EID: 68149100832     PISSN: 09241868     EISSN: 15731391     Source Type: Journal    
DOI: 10.1007/s11257-009-9062-8     Document Type: Article

References (62)

1. Alessi, S.M., Trollip, S.R.: Multimedia for Learning: Methods and Development. 3rd edn. Allyn & Bacon, Needham Heights (2001)
2. Baker, R.S., Corbett, A.T., Koedinger, K.R., Wagner, A.Z.: Off-task behavior in the cognitive tutor classroom: when students "game the system". In: CHI'04: Conference on Human Factors in Computing systems, pp. 383-390. Vienna, Austria (2004)
3. Bosma, W., André, E.: Exploiting emotions to disambiguate dialogue acts. In: IUI'04, International Conference on Intelligent User Interfaces, pp. 85-92. Madeira, Portugal (2004)
4. Chalfoun, P., Haffar, S., Frasson, C.: Predicting the emotional reaction of the learner with a machine learning technique. In: Workshop on Motivational and Affective Issues in ITS, ITS'06, International Conference on Intelligent Tutoring Systems. Jhongli, Taiwan (2006)
5. Cohen J.: Statistical Power Analysis for the Behavioral Sciences. 2nd edn. Lawrence Earlbaum Associates, Hillsdale (1988)
6. C. Conati 2002 Probabilistic assessment of users' emotions in educational games. Special issue on "Merging Cognition and Affect in HCI" J. Appl. Artifi. Intell. 16 7-8 555 575
7. Conati, C.: How to evaluate models of user affect? In: ADS'04, Tutorial and Research Workshop on Affective Dialog Systems, pp. 288-300. Kloster Irsee, Germany (2004) (Pubitemid 38851692)
8. Conati C., Klawe M.: Socially intelligent agents in educational games. In: Dautenhahn, K., Bond, A., Canamero, D., Edmonds, B. (eds) Socially Intelligent Agents-Creating Relationships with Computers and Robots, pp. 213-220. Kluwer Academic Publishers, Dordrecht (2002)
9. Conati, C., Maclaren, H.: Evaluating a probabilistic model of student affect. In: ITS'04, International Conference on Intelligent Tutoring Systems, pp. 55-66. Maceio, Brazil (2004)
10. Conati, C., Zhao, X.: Building and evaluating an intelligent pedagogical agent to improve the effectivenesss of an education game. In: IUI'04, International Conference on Intelligent User Interfaces, pp. 6-13. Funchal, Madeira, Portugal (2004)
11. Conati, C., Chabbal, R., Maclaren, H.: A study on using biometric sensors for detecting user emotions in educational games. In: Workshop on "Assessing and Adapting to User Attitude and Affects: Why, When, and How?" in conjunction with UM'03, 9th International Conference on User Modeling, Pittsburgh, USA (2003)
12. D. Cordova M. Lepper 1996 Intrinsic motivation and the process of learning: beneficial effects of contextualization, personalization, and choice J. Educ. Psychol. 88 715 730
13. P.T. Costa R.R. McCrae 1992 Four ways five factors are basic Personal. Individ. Differ. 13 653 665
14. S.D. Craig A.C. Graesser J. Sullins B. Gholson 2004 Affect and learning: an exploratory look into the role of affect in learning with auto tutor J. Educ. Media 29 241 250 (Pubitemid 39473944)
15. T. Dean K. Kanazawa 1989 A model for reasoning about persistance and causation Comput. Intell. 5 3 142 150
16. S.K. D'Mello S.D. Craig J. Sullins A.C. Graesser 2006 Predicting affective states expressed through an Emote-Aloud procedure from autotutor's mixed-initiative dialogue Int. J. Artifi. Intell. Educ. 16 3 28
17. D'Mello, S.K., Chipman, P., Graesser, A.C.: Posture as a predictor of learner's affective engagement. In: Proceedings of the 29th Annual Cognitive Science Society, pp. 571-576. Stresa, Italy (2006)
18. S.K. D'Mello S.D. Craig A.W. Witherspoon B.T. McDaniel A.C. Graesser 2008 Automatic detection of learner's affect from conversational cues User Model. User-Adapt. Interact. 18 1-2 45 80
19. de Vincente, A., Pain, H.: Motivation self-report in ITS. In: AIED'99, 9th International Conference on Artificial Intelligence in Education, pp. 651-659. Le Mans, France (1999)
20. Dias, J., Paiva, A.: Feeling and reasoning: a computational model for emotional characters. In: Progress in Artificial Intelligence, 12th Portuguese Conference on Artificial Intelligence, EPIA 2005, pp. 127-140. Covilhã, Portugal (2005)
21. Elliot C., Rickel J., Lester J.C.: Lifelike pedagogical agents and affective computing: an exploratory synthesis. In: Wooldridge, M., Veloso, M. (eds) Artificial Intelligence Today, pp. 195-211. Springer, Berlin (1999)
22. Esuli, A., Fagni, T., Sebastiani, F., Aizerman, M.: MP-Boost: A multiple-pivot boosting algorithm and its application to text categorization. In: 13th International Symposium on String Processing and Information Retrieval (SPIRE'06), pp. 1-12. Glasgow, UK (2006) (Pubitemid 44618993)
23. Fisher R.A.: The Design of Experiment. Hafner, New York (1935)
24. Gebhard, P.: ALMA-a layered model of affect. In: 4th International Joint Conference of Autonomous Agents & Multi-Agent Systems (AAMAS'05), pp. 29-36. Utrecht, The Netherlands (2005)
25. Gratch, J.: Emile: marshalling passions in training and education. In: 4th International Conference on Autonomous Agents, pp. 325-332. Barcelona, Spain (2000) (Pubitemid 30881408)
26. J. Gratch S. Marsella 2004 A domain independent framework for modeling emotion J. Cogn. Syst. Res. 5 4 269 306 (Pubitemid 39625018)
27. W.G. Graziano L.A. Jensen-Campbell J.F. Finch 1997 The self as a mediator between personality and adjustment J. Personal. Soc. Psychol. 73 392 404 (Pubitemid 127456255)
28. J.A. Healey R.W. Picard 2005 Detecting stress during real-world driving tasks using physiological sensors IEEE Trans. Intell. Transp. Syst. 6 2 156 166 (Pubitemid 40925766)
29. Heckerman D.: A tutorial on learning with Bayesian networks. In: Jordan, M. (eds) Learning in Graphical Models, pp. 301-354. MIT Press, Cambridge (1999)
30. E. Hudlicka M. McNeese 2002 Assessment of user affective and belief states for interface adaptation: application to an air force pilot User Model. User Adapt. Interact. 12 1 1 47 (Pubitemid 34109557)
31. Jameson A.: "Adaptive Interfaces and Agents". In: Jacko, J.A., Sears, A. (eds) Human-Computer Interface Handbook, pp. 305-330. Erlbaum, Mahwah (2003)
32. Kapoor, A., Picard, R.W.: Multimodal Affect Recognition in Learning Environments. In: 13th Annual ACM International Conference on Multimedia, pp. 677-682. Singapore (2005)
33. Kim, J., André, E.: Emotion recognition using physiological and speech signal in short-term observation. In: PIT'06, Perception and Interactive Techologies, pp. 53-64. Kloster Irsee, Germany (2006) (Pubitemid 44072270)
34. Klawe, M.: When does the use of computer games and other interactive multimedia software help students learn mathematics? In: Technology and NCTM Standards 2000 Conference, Arlington, VA (1998)
35. P.J. Lang M.K. Greenwald M.M. Bradley A.O. Hamm 1993 Look at pictures: affective, facial, visceral, and behavioral reactions Psychophysiology 30 261 273 (Pubitemid 23108336)
36. Lee, J., Luchini, K., Michael, B., Norris, C., Solloway, E.: More than just fun and games: assessing the value of educational video games in the classroom. In: Proceedings of ACM SIGCHI 2004, pp. 1375-1378. Vienna, Austria (2004)
37. Lepper M., Woolverton M., Mumme D., Gurtner J.L.: Motivational techniques of expert human tutors: lessons for the design of computer-based tutors. In: Lajoie, S.P., Derry, S.J. (eds) Computers as Cognitive Tools, pp. 75-105. Lawrence Erlbaum Associates, New Jersey (1993)
38. Li, X., Ji, Q.: Active affective state detection and user assistance. In: Workshop on "Assessing and Adapting to User Attitude and Affects: Why, When, and How?" in conjunction with UM'03, 9th International Conference on User Modeling. Pittsburgh, PA (2003)
39. Linnenbrink E.A., Pintrich P.R.: The Role of Motivational Beliefs in Conceptual Change. In: Limon, M., Mason, L. (eds) Reconsidering Conceptual Change: Issues in Theory and Practice, pp. 115-135. Kluwer Academic Publishers, Dordrecht (2002)
40. Litman, D.J., Forbes-Riley, K.: Predicting Student Emotions in Computer-Human Tutoring Dialogues. In: 42nd Annual Meeting of the Association for Computational Linguistics (ACL), pp. 352-359. Barcelona, Spain (2004)
41. R.L. Mandryk K.M. Inkpen T.W. Calvert 2006 Using psychophysiological techniques to measure user experience with entertainment technologes. Special issue on User Experience J. Behav. Inf. Technol. 25 141 158
42. Manske, M., Conati, C.: Modeling learning in educational games. In: AIED'05, 12th International Conference on AI in Education, pp. 411-418. Amsterdam (2005)
43. McQuiggan, S., Lee, S., Lester, J.: Early prediction of student frustration. In: Second Int. Conf. on Affective Computing and Intelligent Interactions, pp. 698-709. Lisbona, Portugal (2007)
44. A. Mehrabian 1996 Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament Curr. Psychol. 14 261 292
45. Mitchell T.: Machine Learning. McGraw Hill, New York (1997)
46. Ortony A., Clore G.L., Collins A.: The Cognitive Stucture of Emotions. Cambridge University Press, Cambridge (1988)
47. C. Peter A. Herbon 2006 Emotion representation and physiology assignments in digital systems Interact. Comput. 18 2 139 170 (Pubitemid 43267407)
48. R.W. Picard E. Vyzas J.A. Healey 2001 Toward machine emotional intelligence: analysis of affective physiological state IEEE Trans. Pattern Anal. Mach. Intell. 23 10 1175 1191 (Pubitemid 33047955)
49. Prendinger, H., Ishizuka, M.: SCREAM: scripting emotion-based agent minds, pp. 350-351. AAMAS, Bologna, Italy (2002)
50. Prendinger, H., Mori, J., Ishizuka, M.: Recognizing, modeling, and responding to users' affective states. In: UM'05 10th International Conference on User Modeling, pp. 60-69. Edinburgh, UK (2005)
51. Rodrigo, M.T., Baker, R., D'Mello, S.T., Gonzales, et~al.: Comparing learners' affect while using an intelligent tutoring system and a simulation problem solving game. In: Intelligent Tutoring Systems 2008, pp. 40-49. Montreal, Canada (2008)
52. J. Scheirer R. Fernandez J. Klein R.W. Picard 2002 Frustrating the user on purpose: a step toward building an affective computer Interact. Comput. 14 2 93 118 (Pubitemid 34199154)
53. F. Sebastiani 2002 Machine learning in automated text categorization ACM Comput. Surv. 34 1 1 47
54. Seif El-Nasr, M., Yen, J., Ioerger T.R.: FLAME-fuzzy logic adaptive model of emotions, pp. 219-257. Autonomous Agents and Multi-Agent Systems, Barcelona, Spain (2000)
55. Streit, M., Batliner, A., Portele, T.: Cognitive-model-based interpretation of emotions in a multi-model dialog system. In: ADS'04 Tutorial and Research Workshop on Affective Dialogue Systems, pp. 65-76. Kloster Irsee, Germany (2004)
56. Thayer Robert E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989)
57. Van Eck R.: Building artificially intelligent learning games. In: Gibson, D., Aldrich, C., Prensky, M. (eds) Games and Simulations in Online Learning: Research and Development Frameworks, pp. 271-307. Information Science Pub, Hershey, PA (2007)
58. K. Van Lehn Z. Niu 2001 Bayesian student modeling, user interfaces and feedback: a sensitivity analysis Int. J. Artifi. Intell. Educ. 12 2 154 184
59. J.J. Vogel A. Greenwood-Ericksen J. Cannon-Bowers C.A. Bowers 2006 Using virtual reality with and without gaming attributes for academic achievement J. Res. Technol. Educ. 39 1 105 118
60. G.N. Yannakakis J. Hallam H.H. Lund 2008 Entertainment capture through heart rate activity in physical interactive playgrounds User Model. User-Adapt. Interact. 18 1-2 207 243 (Pubitemid 351185637)
61. Zakharov, K., Mitrovic, A., Johnston, L.: Towards emotionally-intelligent pedagogical agents. In: Intelligent Tutoring Systems, 9th Int. Conf., ITS 2008, pp. 19-28. Montreal, Canada (2008)
62. Zhou, X., Conati, C.: Inferring user goals from personality and behavior in a causal model of user affect. In: IUI'03, International Conference on Intelligent User Interfaces, pp. 211-218. Miami, FL (2003)