Predicting facial indicators of confusion with hidden markov models

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6974 LNCS, Issue PART 1, 2011, Pages 97-106

  Grafsgaard, Joseph F ^a   Boyer, Kristy Elizabeth ^a   Lester, James C ^a  

^a North Carolina State University   (United States)

Author keywords

Affect prediction; hidden Markov models; intelligent tutoring systems; tutorial dialogue

Indexed keywords

AFFECT PREDICTION; AFFECTIVE STATE; EFFECTIVE LEARNING; FACIAL EXPRESSIONS; FACIAL MOVEMENTS; HIDDEN MARKOV MODELING; INTELLIGENT TUTORING SYSTEM; PREDICTIVE MODELS; PREDICTIVE POWER; QUALITATIVE REPRESENTATION; STUDENT LEARNING; TUTORIAL DIALOGUE; TUTORING SYSTEM;

COMPUTER AIDED INSTRUCTION; FORECASTING; INTELLIGENT COMPUTING;

HIDDEN MARKOV MODELS;

EID: 80054836296     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24600-5_13     Document Type: Conference Paper

References (25)

1. Bloom, B.S.: The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher 13, 4-16 (1984)
2. D'Mello, S.K., Lehman, B., Sullins, J., Daigle, R., Combs, R., Vogt, K., Perkins, L., Graesser, A.C.: A Time For Emoting: When Affect-Sensitivity Is and Isn't Effective at Promoting Deep Learning. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010, Part I. LNCS, vol. 6094, pp. 245-254. Springer, Heidelberg (2010)
3. Koedinger, K.R., Anderson, J.R., Hadley, W.H., Mark, M.A.: Intelligent Tutoring Goes To School in the Big City. Intl. Jl. of Artificial Intelligence in Education 8, 30-43 (1997)
4. D'Mello, S., Olney, A., Person, N.: Mining Collaborative Patterns in Tutorial Dialogues. Jl. of Educational Data Mining 2, 1-37 (2010)
5. D'Mello, S.K., Lehman, B., Person, N.: Monitoring Affect States During Effortful Problem Solving Activities. International Jl. of Artificial Intelligence in Education 20 (2010)
6. Arroyo, I., Cooper, D.G., Burleson, W., Woolf, B.P., Muldner, K., Christopherson, R.M.: Emotion Sensors Go To School. In: 14th International Conference on Artificial Intelligence in Education (2009)
7. Burleson, W.: Affective Learning Companions: Strategies for Empathetic Agents with Real-Time Multimodal Affective Sensing to Foster Meta-Cognitive and Meta-Affective Approaches to Learning, Motivation, and Perseverance. MIT Ph.D. thesis (2006)
8. McQuiggan, S.W., Robison, J.L., Lester, J.C.: Affective Transitions in Narrative-Centered Learning Environments. Educational Technology & Society 13, 40-53 (2010)
9. Craig, S.D., Graesser, A.C., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. Jl. of Educational Media 29, 241-250 (2004)
10. McDaniel, B.T., D'Mello, S.K., King, B.G., Chipman, P., Tapp, K., Graesser, A.C.: Facial Features for Affective State Detection in Learning Environments. In: Proceedings of the 29th Annual Meeting of the Cognitive Science Society, pp. 467-472 (2007)
11. Russell, J.A., Bachorowski, J., Fernandez-Dols, J.: Facial and vocal expressions of emotion. Annual Review of Psychology 54, 329-349 (2003)
12. Afzal, S., Robinson, P.: Natural Affect Data - Collection & Annotation in a Learning Context. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, pp. 1-7 (2009)
13. Graesser, A.C., Olde, B.A.: How does one know whether a person understands a device? The quality of the questions the person asks when the device breaks down. Jl. of Educational Psychology 95, 524-536 (2003)
14. Ekman, P., Friesen, W.V., Hager, J.C.: Facial Action Coding System. A Human Face, Salt Lake City, USA (2002)
15. Boyer, K.E., Ha, E.Y., Wallis, M., Phillips, R., Vouk, M., Lester, J.: Discovering Tutorial Dialogue Strategies with Hidden Markov Models. In: Proceedings of the 14th International Conference on Artificial Intelligence in Education, pp. 141-148 (2009)
16. Boyer, K.E., Phillips, R., Ingram, A., Ha, E.Y., Wallis, M.D., Vouk, M.A., Lester, J.C.: Characterizing the Effectiveness of Tutorial Dialogue with Hidden Markov Models. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6094, pp. 55-64. Springer, Heidelberg (2010)
17. D'Mello, S.K., Craig, S.D., Graesser, A.C.: Multi-Method Assessment of Affective Experience and Expression during Deep Learning. International Jl. of Learning Technology 4, 165-187 (2009)
18. Baker, R.S.J.d., D'Mello, S.K., Rodrigo, M.M.T., Graesser, A.C.: Better to Be Frustrated than Bored: The Incidence, Persistence, and Impact of Learners' Cognitive-Affective States during Interactions with Three Different Computer-Based Learning Environments. International Jl. of Human-Computer Studies 68, 223-241 (2010)
19. Picard, R.W., Papert, S., Bender, W., Blumberg, B., Breazeal, C., Cavallo, D., Machover, T., Resnick, M., Roy, D., Strohecker, C.: Affective Learning - A Manifesto. BT Technology Jl. 22, 253-269 (2004)
20. Woolf, B.P., Burleson, W., Arroyo, I., Dragon, T., Cooper, D.G., Picard, R.W.: Affectaware tutors: recognising and responding to student affect. International Jl. of Learning Technology 4, 129-164 (2009)
21. Calvo, R.A., D'Mello, S.K.: Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Transactions on Affective Computing 1, 18-37 (2010)
22. D'Mello, S.K., Graesser, A.: Multimodal Semi-Automated Affect Detection from Conversational Cues, Gross Body Language, and Facial Features. User Modeling and User- Adapted Interaction 20, 147-187 (2010)
23. Grafsgaard, J.F., Boyer, K.E., Phillips, R., Lester, J.C.: Modeling Confusion: Facial Expression, Task, and Discourse in Task-Oriented Tutorial Dialogue. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS, vol. 6738, pp. 98-105. Springer, Heidelberg (2011)
24. Rabiner, L.R.: A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proceedings of the IEEE 77, 257-286 (1989)
25. Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A Survey Of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 39-58 (2009)