Monitoring affect states during effortful problem solving activities

International Journal of Artificial Intelligence in Education

Volumn 20, Issue 4, 2010, Pages 361-389

  D'Mello, Sidney K ^a   Lehman, Blair ^b   Person, Natalie ^b  

^a UNIVERSITY OF MEMPHIS   (United States)

^b RHODES COLLEGE   (United States)

Author keywords

Affective states; emotions; intelligent tutoring systems; LSAT; problem solving

Indexed keywords

EID: 79959316616     PISSN: 15604292     EISSN: None     Source Type: Journal    
DOI: 10.3233/JAI-2010-012     Document Type: Article

References (118)

1. Afzal, S., &Robinson, P. (2009). Natural Affect Data - Collection &Annotation in a Learning Context. Paper presented at the Proceedings of 2009 International Conference on Affective Computing &Intelligent Interaction, Amsterdam.
2. Aleven, V., &Koedinger, K. (2002). An effective metacognitive strategy: Learning by doing and explaining with a computer-based Cognitive Tutor. Cognitive Science, 26(2), 147-179.
3. Aleven,V., McLaren, B., Roll, I.,& Koedinger,K. (2006). Toward meta-cognitive tutoring:Amodel of help-seeking with a cognitive tutor. International Journal of Artificial Intelligence in Education, 16, 101-128.
4. Anderson, J. (1990). Analysis of student performance with the LISP tutor. In J. Frederiksen, R. Glaser, A. M. Lesgold &M. Shafto (Eds.), Diagnostic monitoring of skill and knowledge acquisition (pp. 27-50). Hillsdale, NJ: Erlbaum.
5. Anderson, J., Douglass, S., &Qin, Y. (2005). How should a theory of learning and cognition inform instruction? In A. Healy (Eds.), Experimental cognitive psychology and it's applications (pp. 47-58). Washington, DC.: American Psychological Association.
6. Arroyo, I., Woolf, B., Cooper, D., Burleson, W., Muldner, K., &Christopherson, R. (2009). Emotion sensors go to school. In V. Dimitrova, R. Mizoguchi, B. Du Boulay &A. Graesser (Eds.), Proceedings of 14th International Conference on Artificial Intelligence In Education (pp. 17-24). Amsterdam: IOS Press.
7. Aviezer, H., Hassin, R., Ryan, J., Grady, C., Susskind, J., Anderson, A., et al. (2008). Angry, disgusted, or afraid? Studies on the malleability of emotion perception. Psychological Science, 19(7), 724-732.
8. Azevedo, R., &Bernard, R. M. (1995). A meta-analysis of the effects of feedback in computer-based instruction. Journal of Educational Computing Research, 13(2), 111-127.
9. Baker, R., D'Mello, S., Rodrigo, M.,& Graesser,A. (2010). Better to be frustrated than bored: The incidence and persistence of affect during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies, 68 (4), 223-241.
10. Bangert-Drowns, R. L., Kulik, C. L. C., Kulik, J. A., &Morgan, M. (1991). The instructional-effect of feedback in test-like events. Review of Educational Research, 61(2), 213-238.
11. Barrett, L. (2006). Are emotions natural kinds? Perspectives on Psychological Science 1, 28-58.
12. Barrett, L. F. (2009). Variety is the spice of life: A psychological construction approach to understanding variability in emotion. Cognition &Emotion, 23(7), 1284-1306.
13. Berlyne, D. (1960). Conflict, arousal, and curiosity. New York: McGraw-Hill Inc.
14. Berlyne, D. (1978). Curiosity in learning. Motivation and Emotion, 2, 97-175.
15. Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32(3), 347-364.
16. Black, P., &William, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy &Practice, 5(1), 7-74.
17. Bless, H., &Fielder, K. (1995). Affective states and the influence of activated general knowledge. Personality and Social Psychology Bulletin, 21, 766-778.
18. Boekaerts, M., Pintrich, P. R., &Zeidner, M. (Eds.). (2000). Handbook of self-regulation. San Diego: Academic Press.
19. Bransford, D., Brown, A., &Cocking, R. (Eds.). (2000). How people learn: Brain, mind, experience, and school committee on developments in the science of learning Washington, DC: National Academy Press.
20. Brosch, T., Pourtois, G., &Sander, D. (2010). The perception and categorisation of emotional stimuli: A review. Cognition &Emotion, 24(3), 377-400.
21. Brown, A. (1987). Metacognition, executive control, self-regulation, and other more mysterious mechanisms. In F. E. Weinert &R. H. Kluwe (Eds.),
22. F. E. Weinert &R. H. Kluwe (Eds.), Metacognition, motivation, and understanding (pp. 65-116). Hillsdale: Erlbaum. Burleson, W., &Picard, R. (2007). Evidence for gender specific approaches to the development of emotionally intelligent learning companions. IEEE Intelligent Systems, 22(4), 62-69.
23. Calvo, R., &D'Mello, S. (Eds.). (in preparation). New perspectives on affect and learning technologies. New York: Springer.
24. Calvo, R. A., &D'Mello, S. K. (2010). Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on Affective Computing, 1(1), 18-37.
25. Castellano, G., Kessous, L., &Caridakis, G. (2008). Emotion recognition through multiple modalities: face, body gesture, speech. In C. Peter &R. Beale (Eds.), Affect and Emotion in Human-Computer Interaction (LNCS, vol. 4868) (pp. 92-103). Heidelberg: Springer.
26. Chi, M., Siler, S., Jeong, H., Yamauchi, T., &Hausmann, R. (2001). Learning from human tutoring. Cognitive Science, 25(4), 471-533.
27. Clore, G. L., &Huntsinger, J. R. (2007). How emotions inform judgment and regulate thought. Trends in Cognitive Sciences, 11(9), 393-399.
28. Coan, J., &Allen, J. (Eds.). (2007). Handbook of emotion elicitation and assessment. New York: Oxford University Press.
29. Conati, C., &Maclaren, H. (2009). Empirically building and evaluating a probabilistic model of user affect. User Modeling and User-Adapted Interaction, 19(3), 267-303.
30. Craig, S., Graesser, A., Sullins, J., &Gholson, B. (2004). Affect and learning: An exploratory look into the role of affect in learning. Journal of Educational Media, 29, 241-250.
31. Cromley, J., Azevedo, R., &Olson, E. (2005). Self-regulation of learning with multiple representations in hypermedia. In
32. Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. New York: Harper and Row.
33. D'Mello, S., Craig, S., Sullins, J., &Graesser, A. (2006). Predicting affective states expressed through an emotealoud procedure from AutoTutor's mixed-initiative dialogue. International Journal of Artificial Intelligence in Education, 16(1), 3-28.
34. D'Mello, S., Craig, S., Witherspoon, A., McDaniel, B., &Graesser, A. (2008). Automatic detection of learner's affect from conversational cues. User Modeling and User-Adapted Interaction, 18(1-2), 45-80.
35. D'Mello, S., &Graesser, A. (2010a). Modeling cognitive-affective dynamics with Hidden Markov Models. In R. Catrambone &S. Ohlsson (Eds.), Proceedings of the 32nd Annual Cognitive Science Society (pp. 2721-2726). Austin, TX: Cognitive Science Society.
36. D'Mello, S., &Graesser, A. (2010b). Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features. User Modeling and User-adapted Interaction, 20(2), 147-187.
37. D'Mello, S., Olney, A.,& Graesser,A. (in press). Affect, meta-affect, and affect regulation during complex learning. In R. Azevedo & V. Aleven (Eds.), International Handbook of Metacognition and Learning Technologies. New York: Springer.
38. D'Mello, S., Olney, A., &Person, N. (in press). Mining collaborative patterns in tutorial dialogues. Journal of Educational Data Mining, 2(1), 1-37.
39. D'Mello, S., Taylor, R., Davidson, K., &Graesser, A. (2008). Self versus teacher judgments of learner emotions during a tutoring session with AutoTutor. In B.Woolf, E. Aimeur, R. Nkambou & S. Lajoie (Eds.), Proceedings of the 9th international conference on Intelligent Tutoring Systems. Berlin, Heidelberg: Springer-Verlag
40. Verlag. D'Mello, S., Craig, S., Fike, K., &Graesser, A. (2009). Responding to learners' cognitive-affective states with supportive and shakeup dialogues. In J. Jacko (Eds.), Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction (pp. 595-604). Berlin/Heidelberg: Springer.
41. D'Mello, S., &Graesser, A. (in press-a). Emotions during Learning with AutoTutor. In P. Durlach &A. Lesgold (Eds.), Adaptive Technologies for Training and Education. Cambridge, U.K: Cambridge University Press.
42. D'Mello, S., &Graesser, A. (in press-b). The half-life of cognitive-affective states during complex learning. Cognition &Emotion.
43. D. McNamara &J. Trafton (Eds.), Proceedings of the 29th Annual Cognitive Science Society (pp. 203-208). Austin, TX: Cognitive Science Society.
44. Deci, E. L. (1992). On the nature and functions of motivation theories. Psychological Science, 3(3), 167-171.
45. Dweck, C. (2002). Messages that motivate: How praise molds students' beliefs, motivation, and performance (in surprising ways). In J. Aronson (Eds.), Improving academic achievement: Impact of psychological factors on education (pp. 61-87). Orlando, FL: Academic Press.
46. Efklides, A. (2006). Metacognition and affect: What can metacognitive experiences tell us about the learning process? Educational Research Review, 1(1), 3-14.
47. Ekman, P. (1992). An argument for basic emotions. Cognition &Emotion, 6(3-4), 169-200.
48. Entwistle, N. (1988). Styles of learning and teaching. London: David Fulton.
49. Farrell, E., Peguero, G., Lindsey, R., &White, R. (1988). Giving voice to high-school students - Pressure and boredom, ya know what Im sayin. American Educational Research Journal, 25(4), 489-502.
50. Festinger, L. (1957). A theory of cognitive dissonance. Stanford, CA: Stanford University Press.
51. Fielder, K. (2001). Affective states trigger processes of assimilation and accommodation. In K. Martin &G. Clore (Eds.), Theories of Mood and Cognition: A User's Guidebook (pp. 85-98). Mahwah, NJ: Erlbaum.
52. Fontaine, J., Scherer, K., Roesch, E., &Ellsworth, P. (2007). The world of emotions is not two-dimensional. Psychological Science, 18(12).
53. Forbes-Riley, K., &Litman, D. (2010). Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system. Computer Speech and Language, 25(1), 105-126.
54. Forbes-Riley, K., Rotaru, M., &Litman, D. (2008). The relative impact of student affect on performance models in a spoken dialogue tutoring system. User Modeling and User-Adapted Interaction, 18(1-2), 11-43.
55. Frijda, N. H. (2009). Emotions, individual differences and time course: Reflections. Cognition &Emotion, 23(7), 1444-1461.
56. Gertner, A., &VanLehn, K. (2000). Andes: A coached problem solving environment for physics. In G. Gauthier, C. Frasson &K. VanLehn (Eds.), Proceedings of the International Conference on Intelligent Tutoring Systems (pp. 133-142). Berlin / Heidelberg: Springer.
57. Graesser, A., Chipman, P., King, B., McDaniel, B., &D'Mello, S. (2007). Emotions and learning with AutoTutor. In R. Luckin, K. Koedinger &J. Greer (Eds.), 13th International Conference on Artificial Intelligence in Education (pp. 569-571). Amsterdam: IOS Press.
58. Graesser, A., Jeon, M., &Dufty, D. (2008). Agent technologies designed to facilitate interactive knowledge construction. Discourse Processes, 45(4-5), 298-322.
59. Graesser, A., Lu, S., Olde, B., Cooper-Pye, E., &Whitten, S. (2005). Question asking and eye tracking during cognitive disequilibrium: Comprehending illustrated texts on devices when the devices break down. Memory and Cognition, 33, 1235-1247.
60. Graesser, A., McDaniel, B., Chipman, P.,Witherspoon, A., D'Mello, S.,& Gholson, B. (2006). Detection of emotions during learning with AutoTutor. In R. Sun &N. Miyake (Eds.), Proceedings of the 28th Annual Conference of the Cognitive Science Society (pp. 285-290). Austin, TX: Cognitive Science Society.
61. Graesser, A., &Olde, B. (2003). How does one know whether a person understands a device? The quality of the questions the person asks when the device breaks down. Journal of Educational Psychology, 95(3), 524-536.
62. Graesser, A. C., D'Mello, S. K., &Person, N. (2009). Meta-knowledge in tutoring. In D. Hacker, J. Dunlosky &A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 361-382). Mahwah, NJ:
63. Erlbaum. Guthrie, J. T., &Alvermann, D. E. (1999). Engaged reading: Processes, practices, and policy implications. New York: Teachers College Press New York.
64. Heider, F. (1958). The psychology of interpersonal relations. New York: John Wiley &Sons.
65. Heider, F. (1958). The psychology of interpersonal relations. New York: John Wiley &Sons. Hertel, G., Neuhof, J., Theuer, T., &Kerr, N. (2000). Mood effect on cooperation in small groups: Does positive mood simply lead to more cooperation? Cognition and Emotion, 14, 441-472.
66. Isen, A. (2008). Some ways in which positive affect influences decision making and problem solving. In M. Lewis, J. Haviland-Jones &L. Barrett (Eds.), Handbook of emotions (3rd ed., pp. 548-573). New York, NY: Guilford.
67. Isen, A., Daubman, K., &Nowicki, G. (1987). Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology, 52, 1122-1131.
68. Isen, A. M. (2003). Positive affect, systematic cognitive processing, and behavior: Toward integration of affect, cognition, and motivation. In F. Dansereau &F. J. Yammarino (Eds.), Multi-level issues in organizational behavior and strategy (pp. 55-62). Oxford: JAI/Elsevier Science.
69. Izard, C., &Ackerman, B. (2000). Motivational, organizational, and regulatory functions of discrete emotions. In M. Lewis &J. Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 253-264). New York: Guilford Press.
70. Izard, C. E. (2007). Basic emotions, natural kinds, emotion schemas, and a new paradigm. Perspectives on Psychological Science, 2(3), 260-280.
71. Jonassen, D., Peck, K., & Wilson, B. (1999). Learning with technology: A constructivist perspective. Upper Saddle River, NJ: Prentice Hall.
72. Klein, J., Moon, Y., &Picard, R. (2002). This computer responds to user frustration: Theory, design, and results. Interacting with Computers, 14(2), 119-140.
73. Kort, B., Reilly, R., &Picard, R. (2001). An affective model of the interplay between emotions and learning. Paper presented at the Proceedings of the International Conference of Advanced Learning Technologies, Madison, WI.
74. Larson, R. W., &Richards, M. H. (1991). Boredom in the middle school years - Blaming schools versus blaming students. American Journal of Education, 99(4), 418-443.
75. Lazarus, R. (2000). The cognition-emotion debate: A bit of history. In M. Lewis &J. Haviland-Jones (Eds.), Handbook of Emotions (2nd ed., pp. 1-20). New York: Guilford Press.
76. Lehman, B., Matthews, M., D'Mello, S., &Person, N. (2008). What are you feeling? Investigating student affective states during expert human tutoring sessions. In B. Woolf, E. Aimeur, R. Nkambou &S. Lajoie (Eds.), Proceedings of the 9th International Conference on Intelligent Tutoring Systems (pp. 50-59). Berlin, Heidelberg: Springer.
77. Lepper, M., & Woolverton, M. (2002). The wisdom of practice: Lessons learned from the study of highly effective tutors. In J. Aronson (Ed.), Improving academic achievement: Impact of psychological factors on education (pp. 135-158). Orlando, FL: Academic Press.
78. Lesgold, A., Lajoie, S., Bunzo, M., &Eggan, G. (1992). SHERLOCK: A coached practice environment for an electronics troubleshooting job. In J. H. Larkin &R. W. Chabay (Eds.), Computer-assisted instruction and intelligent tutoring systems (pp. 201-238). Hillsdale, NJ: Erlbaum.
79. LSAT. (2008). Law School Admissions Test (Publication. Retrieved August 14, 2008: http://www.lsat.org
80. Mandler, G. (1976). Mind and emotion. New York: Wiley.
81. Mandler, G. (1999). Emotion. In B. M. Bly &D. E. Rumelhart (Eds.), Cognitive science. Handbook of perception and cognition (2nd ed., pp. 367-382). San Diego, CA: Academic Press.
82. Mann, S., &Robinson, A. (2009). Boredom in the lecture theatre: an investigation into the contributors, moderators and outcomes of boredom amongst university students. British Educational Research Journal, 35(2), 243-258.
83. McLeod, D. B. (1988). Affective issues in mathematical problem solving: Some theoretical considerations. Journal for Research in Mathematics Education, 19(2), 134-141.
84. McQuiggan, S., Mott, B., &Lester, J. (2008). Modeling self-efficacy in intelligent tutoring systems: An inductive approach. User Modeling and User-Adapted Interaction, 18(1-2), 81-123.
85. Meyer, D., &Turner, J. (2006). Re-conceptualizing emotion and motivation to learn in classroom contexts. Educational Psychology Review, 18(4), 377-390.
86. Moors, A. (2009). Theories of emotion causation: A review. Cognition &Emotion, 23(4), 625-662.
87. Ohman, A., &Soares, J. (1993). On the automatic nature of phobic fear - Conditioned electrodermal responses to masked fear-relevant stimuli. Journal of Abnormal Psychology, 102(1), 121-132.
88. Pekrun, R. (2010). Academic emotions. In T. Urdan (Eds.), APA educational psychology handbook (Vol. 2). Washington, DC: American Psychological Association.
89. Pekrun, R., Goetz, T., Daniels, L., Stupnisky, R. H., &Raymond, P. (2010). Boredom in achievement settings: Exploring control-value antecedents and performance outcomes of a neglected emotion. Journal of Educational Psychology, 102(3), 531-549.
90. Perkins, R. E., &Hill, A. B. (1985). Cognitive and affective aspects of boredom. British Journal of Psychology, 76(MAY), 221-234.
91. Piaget, J. (1952). The origins of intelligence. New York: International University Press.
92. Prosser, M., &Trigwell, K. (1999). Understanding learning and teaching: The experience in higher education. Buckingham: Open University Press.
93. Robinson, W. P. (1975). Boredom at school. British Journal of Educational Psychology, 45, 141-152.
94. Robison, J., McQuiggan, S., &Lester, J. (2009). Evaluating the consequences of affective feedback in intelligent tutoring systems. Paper presented at the International Conference on Affective Computing &Intelligent Interaction, Amsterdam.
95. Rodrigo, M., &Baker, R. (in press). Comparing the incidence and persistence of learners' affect during interactions with different educational software packages. In R. Calvo &S. D'Mello (Eds.), New Perspective on Affect and Learning Technologies. New York: Springer.
96. Rosenberg, E., &Ekman, P. (1994). Coherence between expressive and experiential systems in emotion. Cognition &Emotion, 8(3), 201-229.
97. Rozin, P., &Cohen, A. (2003). High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of maturally occurring facial expressions of Americans. Emotion, 3, 68-75.
98. Russell, J. (2003). Core affect and the psychological construction of emotion. Psychological Review, 110, 145-172.
99. Russell, J. A., Bachorowski, J. A.,& Fernandez-Dols, J. M. (2003). Facial and vocal expressions of emotion. Annual Review of Psychology, 54, 329-349.
100. Russell, J. A., Weiss, A., &Mendelsohn, G. A. (1989). Affect Grid - A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology, 57(3), 493-502.
101. Scherer, K. R. (2009). The dynamic architecture of emotion: Evidence for the component process model. Cognition &Emotion, 23(7), 1307-1351.
102. Schwarz, N. (1990). Feelings as information: Informational and motivational functions of affective states. In E. Higgins &R. Sorrentino (Eds.), Handbook of motivation and cognition (pp. 527-561). New York: Guilford Press.
103. Schwarz, N. (2000). Emotion, cognition, and decision making. Cognition and Emotion, 14, 433-440.
104. Schwarz, N. (in press). Feelings-as-Information Theory. In P. Van Lange, A. Kruglanski &T. Higgins (Eds.), Handbook of theories of social psychology: Sage.
105. Schwarz, N., &Skurnik, I. (2003). Feeling and thinking: Implications for problem solving. In J. Davidson &R. Sternberg (Eds.), The Psychology of Problem Solving (pp. 263-290). New York: Cambridge University Press.
106. Shute, V. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189.
107. Silvia, P. J. (2009). Looking past pleasure: Anger, confusion, disgust, pride, surprise, and other unusual aesthetic emotions. Psychology of Aesthetics Creativity and the Arts, 3(1), 48-51.
108. Snow, R. E., Corno, L., &Jackson, D. (1996). Individual differences in affective and conative functions. In D. Berliner &R. Caldee (Eds.), Handbook of educational psychology. New York: Macmillan.
109. Spering, M., Wagener, D., &Funke, J. (2005). The role of emotions in complex problem-solving. Cognition and Emotion, 19(8), 1252-1261.
110. Stein, N., Hernandez, M., &Trabasso, T. (2008). Advances in modeling emotions and thought: The importance of developmental, online, and multilevel analysis. In M. Lewis, J. M. Haviland-Jones &L. F. Barrett (Eds.), Handbook of emotions (3rd ed., pp. 574-586). New York: Guilford Press.
111. Stein, N.,& Levine, L. (1991). Making sense out of emotion. In A. O.W. Kessen, & F, Kraik (Eds.) (Ed.), Memories, thoughts, and emotions: Essays in honor of George Mandler (pp. 295-322). Hillsdale, NJ: Erlbaum.
112. Stemmler, G., Heldmann, M., Pauls, C., &Scherer, T. (2001). Constraints for emotion specificity in fear and anger: The context counts. Psychophysiology, 38(2), 275-291.
113. Tobias, S. (1994). Interest, prior knowledge, and learning. Review of Educational Research, 64, 37-54.
114. VanLehn, K., Siler, S., Murray, C., Yamauchi, T., &Baggett, W. (2003). Why do only some events cause learning during human tutoring? Cognition and Instruction, 21(3), 209-249.
115. Weiner, B. (1986). An attributional theory of motivation and emotion. New York: Springer-Verlag.
116. Weiner, B. (1986). An attributional theory of motivation and emotion. New York: Springer-Verlag. Winnie, P. H. (2001). Self-regulated learning viewed from models of information processing. In B. Zimmerman &D. H. Schunk (Eds.), Self-regulated learning and academic achievement: Theoretical perspectives (2nd ed., pp. 153-189). Mahwah: Lawrence Erlbaum Associates.
117. Woolf, B., Arroyo, I., Muldner, K., Burleson, W., Cooper, D., Dolan, R., et al. (2010). The effect of motivational learning companions on lowachieving students and students with disabilities In J. Kay & V. Aleven (Eds.), Proceedings of 10th International Conference on Intelligent Tutoring Systems (pp. 327-337). Berlin / Heidelberg: Springer.
118. Zeng, Z., Pantic, M., Roisman, G., &Huang, T. (2009). A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1), 39-58.