Mind and Body: Dialogue and Posture for Affect Detection in Learning Environments

Frontiers in Artificial Intelligence and Applications

Volumn 158, Issue , 2007, Pages 161-168

  D’Mello, Sidney ^a   Graesser, Arthur ^a  

^a UNIVERSITY OF MEMPHIS   (United States)

Author keywords

Affect; AutoTutor; emotions; posture patterns; tutorial dialogue

Indexed keywords

LEARNING SYSTEMS;

AFFECT; AFFECT DETECTION; AFFECTIVE STATE; AUTOMATIC DETECTION; AUTOTUTOR; EMOTION; INTELLIGENT TUTORING; LEARNING ENVIRONMENTS; POSTURE PATTERN; TUTORIAL DIALOG;

COMPUTER AIDED INSTRUCTION;

EID: 84900862378     PISSN: 09226389     EISSN: 18798314     Source Type: Book Series    
DOI: None     Document Type: Conference Paper

References (23)

1. Picard, R. (1997). Affective Computing. The MIT Press, Cambridge, MA.
2. Issroff, K. & del Soldato, T. (1996). Incorporating motivation into computer-supported collaborative learning. Proceedings of the European Conference on Artificial Intelligence in Education.
3. Lepper. M, R., & Chabay, R.W. (1988). Socializing the intelligent tutor: Bringing empathy to computer tutors. In H. Mandi & A. Lesgold (Eds.), Learning Issues for Intelligent Tutoring Systems (pp. 242-257). Hillsdale, NJ: Erlbaum.
4. Pantic, M., & Rothkrantz, L. J. M. (2003). Towards an affect-sensitive multimodal human-computer interaction. IEEE Special Issue on Multimodal Human-Computer Interaction, 91(9), 370-1390.
5. Graesser, A., Wiemer-Hastings, K., Wiemer-Hastings, P., Kreuz, R., & the Tutoring Research Group (2000). AutoTutor: A simulation of a human tutor. Journal of Cognitive Systems Research, 1, 35-51.
6. Clark, A. (1997). Being there: Putting brain body and world together again. Cambridge, MIT Press.
7. Glenberg, A. M., & Kaschak, M. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9, 558-565.
8. Picard, R. W., Vyzas, E ., & Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions Pattern Analysis and Machine Intelligence, 25(10), 1175-1191
9. Chen, L. S., Huang, T. S., Miyasato, T., & Nakatsu, R. (1998). Multimodal human emotion/expression recognition. In Proc. FG (pp. 396-401).
10. Dasarathy, B. V. (1997). Sensor fusion potential exploitation: Innovative architectures and illustrative approaches. Proc. IEEE, 85, 24-38.
11. Yoshitomi, Y ., Kim, S., Kawano, T, & Kitazoe, T. (2000). Effect of sensor fusion for recognition of emotional states using voice, face image and thermal image of face. In Proc. ROMAN (pp. 178-183).
12. Kapoor, A. and Picard, R. E. (2005), Multimodal Affect Recognition in Learning Environments, ACM MM'05, November 6-11, 2005, Singapore.
13. Ekman, P, & Friesen, W. V. (1978). The facial action coding system: A technique for the measurement of facial movement. Palo Alto: Consulting Psychologists Press.
14. Craig, S. D., Graesser, A. C, Sullins, J., & Gholson, B. (2004). Affect and learning: An exploratory look into the role of affect in learning. Journal of Educational Media, 29, 241-250.
15. D'Mello, S. K., Craig, S. D., Sullins, J., & Graesser, A. C. (2006). Predicting affective states through an emote-aloud procedure from AutoTutor's mixed-initiative dialogue. International Journal of Artificial Intelligence in Education, 16, 3-28.
16. thAnnual Meetings of the Cognitive Science Society (pp. 285-290). Mahwah, NJ: Erlbaum.
17. Marsic, I ., Medi, A., and Flanagan, J. L. (2000) Natural Communication with Information Systems, Proceedings of the IEEE, 88(8), 1354-1366.
18. Pentland, A. (2000). Looking at people: sensing for ubiquitous and sensable computing. IEEE Trans. Pattern Analysis and Machine Intelligence, 22, 107-119.
19. Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review,104, 211-240.
20. Robson C. (1993). Real word research: A resource for social scientist and practitioner researchers. Oxford: Blackwell.
21. Holmes, N., & Spence, C. (2005). Multisensory Integration: Space, Time and Superadditivity. Current Biology, 15(18), 762-764.
22. Jaimes, A., & Sebe, N. (2005) Multimodal human computer interaction: A survey. IEEE International Workshop on Human-Computer Interaction (HCI2005), Beijing, China.
23. D'Mello, S. K ., Picard, R., & Graesser, A. C. (in review). Towards an affect-sensitive AutoTutor.