Automated measurement of children's facial expressions during problem solving tasks

2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

Volumn , Issue , 2011, Pages 30-35

  Littlewort, Gwen C ^a   Bartlett, Marian S ^a   Salamanca, Linda P ^b   Reilly, Judy ^b  

^a UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^b SAN DIEGO STATE UNIVERSITY   (United States)

Author keywords

adaptive tutoring; Facial Action Coding System; facial expression recognition; FACS; problem solving; spontaneous expressions

Indexed keywords

ADAPTIVE TUTORING; FACIAL ACTION CODING SYSTEM; FACIAL EXPRESSION RECOGNITION; FACS; SPONTANEOUS EXPRESSIONS;

COGNITIVE SYSTEMS; COMPUTER KEYBOARDS; FACE RECOGNITION; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION;

PROBLEM SOLVING;

EID: 79958698494     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2011.5771418     Document Type: Conference Paper

References (34)

1. Anderson, J.R., C.F. Boyle, and B.J. Reiser, (1985). Intelligent Tutoring Systems. Science vol. 228, pp. 456-462.
2. Bailenson, J.N. and N. Yee, Digital Chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science, 2005. 16: p. 814-819. (Pubitemid 41597894)
3. Bartlett, M. S., G. Littlewort, et al. (2004). Machine Learning Methods for Fully Automatic Recognition of Facial Expressions and Facial Actions. IEEE International Conference on Systems, Man & Cybernetics. The Hague, Netherlands: 592-597. (Pubitemid 40415923)
4. Bartlett M.S., Littlewort G.C., Frank M.G., Lainscsek C., Fasel I., and Movellan J.R., (2006). Automatic recognition of facial actions in spontaneous expressions. Journal of Multimedia., 1(6) p. 22-35.
5. Bartlett, M. S., Littlewort-Ford, G.C., and Movellan, J.R. (2008). "Computer Expression Recognition Toolbox. ." Proc: 8th Int'l IEEE Conference on Automatic Face and Gesture Recognition, Amsterdam.
6. Bloom, B.S. (1984). The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher, Vol. 13, No. 6, pp. 4-16.
7. Boersma, P. (2001). Praat, a system for doing phonetics by computer. Glot International 5(9/10): 341-345.
8. Brand, M. Voice puppetry. in ACM SIGGRAPH. 1999: ACM Press/Addison-Wesley Publishing Co.
9. Burleson, W. and R.W. Picard, Evidence for Gender SpecificApproaches to the Development of Emotionally Intelligent Learning Companions. IEEE Intelligent Systems, Special issue on Intelligent Educational Systems, 2007.
10. Cassell, J. and K.R. Thórisson, The Power of a Nod and a Glance: Envelope vs. Emotional Feedback in Animated Conversational Agents. International Journal of Applied Artificial Intelligence, 1999. 13(4-5): p. 519-538.
11. Chaffar, S. & Frasson, C. (2004). Inducing optimal emotional state for learning in intelligent tutoring systems. In Lester, Vicari, & Paraguacu (Eds.), Proceedings, Intelligent tutoring systems. Springer.
12. Chesebro, J.L. and McCroskey, J.C. (2001). The relationship of teacher clarity and immediacy with student state receiver apprehension, affect, and cognitive learning. Communication Education, 50, 59-68.
13. Conati, C., A. Gertner, and K. van Lehn, (2002) "Using Bayesian Networks to Manage Uncertainty in Student Modeling", User Modeling and User-Adapted Interaction 12: 371-417.
14. D'Mello, Graesser, & Picard, (2007). Towards an Affect sensitive Auto tutor. IEEE Intelligent Systems. July/AUG p. 53-61.
15. Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P. & Sejnowski, T.J. (1999). "Classifying facial actions." IEEE Trans. Pattern Analysis and Machine Intelligence 21(10): 974-989. (Pubitemid 129304131)
16. Eckhardt, M., Fasel, I.R. and Movellan, J.R. (2009). Towards Practical Facial Feature Detection. International Journal of Pattern Recognition and Artificial Intelligence 23(3) pp. 379-400.
17. Ekman, P. and W. Friesen (1978). Facial Action Coding System: A Technique for the Measurement of Facial Movement. Palo Alto, CA, Consulting Psychologists Press.
18. Ekman, P. (2003). Darwin, deception, and facial expression. Annals New York Academy of sciences, Vol. 1000, pp. 205-221.
19. Fasel, I., Fortenberry B., Movellan J.R. "A generative framework for real-time object detection and classification.," Computer Vision and Image Understanding 98, 2005.
20. Graesser, A.C., Jackson, G.T., & McDaniel, B. (in press). AutoTutor holds conversations with learners that are responsive to their cognitive and emotional states. Educational Technology.
21. Gratch, Wang, Gerten, Fast, & Duffy (2007). Creating rapport with virtual agents. Int. Conf. on Intelligent Virtual Agents, Paris, France.
22. Kearney, P., Plax, T.G., Smith, V.R., and Sorensen, G. (1988). Effects of teacher immediacy and strategy type on college student resistance to ontask demands. Communication Education, 37, 54-67.
23. Koedinger K.R and John R. Anderson J.R., "Intelligent Tutoring Goes to School in the Big City", Int'l Journal of Artificial Intelligence in Education (1997), 8, 30-43.
24. Kort, B., R. Reilly, and R.W. Picard, "An Affective Model of Interplay between Emotions and Learning: Reengineering Educational Pedagogy-Building a Learning Companion," Proc. 2nd IEEE Int'l Conf. Advanced Learning Technologies (ICALT 2001), IEEE CS Press, 2001, p. 43.
25. Litman, D.J. and K. Forbes-Riley, "Predicting Student Emotions in Computer-Human Tutoring Dialogues," Proc. 42nd Ann. Meeting Assoc. for Computational Linguistics, Assoc. for Computational Linguistics, 2004, pp. 352-359.
26. Littlewort G.C., Bartlett M.S., Fasel I, Susskind J, Movellan "An automatic system for measuring facial expression in video." Computer Vision and Image Understanding: Special Issue on Face Processing in Video 24(6) p615-625,2006 (Pubitemid 43867835)
27. McQuiggan, S. W., and Lester, J. C. (2007). Leveraging Affect for Narrative-Centered Guided Discovery Learning Environments. Supplementary Proceedings of the 13th Inter-national Conference on Artificial Intelligence in Education (AIED 2007), (pp 67-74).
28. Mottet, T.P., Parker-Raley, J., Cunningham, C., Beebe, S.A., and Raffeld, P. C. (2006). Testing the neutralizing effect of instructor immediacy on student course workload expectancy violation and tolerance for instructor unavailability. Communication Education, 55, 147-166. (Pubitemid 43453826)
29. Rocca, K.A. (2004). College student attendance: Impact of instructor immediacy and verbal aggression. Communication Education, 53, 185-195. (Pubitemid 38727235)
30. Rocca, K.A. and McCroskey, J. C. (1999). The interrelationship of student ratings of instructors' immediacy, verbal aggressiveness, homophily, and interpersonal attraction. Communication Education, 48, 308-316.
31. Sheldon-Biddle, E., Malone, L., McBride, D.: Objective measurement of student affect tooptimize automated instruction. In: Proceedings of Workshop on Modelling User Attitudes and Affect, User Modeling (2003).
32. Viola, P. & Jones, M. (2004). Robust real-time face detection. J. Computer Vision, Vol. 57, No. 2, pp. 137-154.
33. Whitehill, J., Bartlett, M.S., and Movellan, J.R. Measuring the Difficulty of a Lecture-Using Automatic Facial Expression Recognition. Proceedings of the International Conference on Intelligent Tutoring Systems 2008 (short paper).
34. Woolf, B., Burelson, W., and Arroyo, I. (2007). Emotional Intelligence for Computer Tutors. Supplementary Proceedings of the 13th International Conference on Artificial In-telligence in Education (AIED 2007), (pp 6-15).