"How do you know that I don't understand?" A look at the future of intelligent tutoring systems

Computers in Human Behavior

Volumn 24, Issue 4, 2008, Pages 1342-1363

  Sarrafzadeh, Abdolhossein ^a   Alexander, Samuel ^a   Dadgostar, Farhad ^a   Fan, Chao ^a   Bigdeli, Abbas ^b  

^a MASSEY UNIVERSITY   (New Zealand)

^b CSIRO   (Australia)

Author keywords

Affective computing; Affective tutoring systems; Emotion detection; Facial expressions; Human computer interaction; Lifelike agents

Indexed keywords

AUTOMATIC TELLER MACHINES; HUMAN COMPUTER INTERACTION; INTELLIGENT SYSTEMS; TICKET ISSUING MACHINES;

AFFECTIVE COMPUTING; AFFECTIVE TUTORING SYSTEMS; EMOTION DETECTION; FACIAL EXPRESSIONS; LIFELIKE AGENTS;

LEARNING SYSTEMS;

EID: 42249086462     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2007.07.008     Document Type: Article

References (56)

1. Aleven V., and Koedinger K. Limitations of student control: Do students know when they need help?. Proc. ITS'2000 (2000), Springer-Verlag 292-303
2. Aleven V., Koedinger K.R., and Cross K. Tutoring answer explanation fosters learning with understanding. In: Lajoie S.P., and Vivet M. (Eds). Proc. AIED'99 (1999), IOS Press 199-206
3. Alexander, S. T. V., & Sarrafzadeh, A. (2004). Interfaces that adapt like humans. Proceedings of Asia-Pacific Computer-Human Interaction 2004, Rotorua, New Zealand.
4. Alexander, S. T. V., Sarrafzadeh, A., & Fan, C. (2003). Pay attention! The computer is watching: Affective tutoring systems. Proceedings of E-Learn 2003, Phoenix, Arizona.
5. Alexander, S. T. V., Hill, S., & Sarrafzadeh, A. (2005). How do human tutors adapt to affective state?. Proceedings of User Modeling, Edinburgh, Scotland.
6. Alibali M., and diRusso A. The function of gesture in learning to count: More than keeping track. Cognitive Development 14 (1999) 37-56
7. Anderson J.R., Corbett A.T., Koedinger K.R., and Pelletier R. Cognitive tutors: Lessons learned. The Journal of the Learning Sciences 4 2 (1995) 167-207
8. Beebe, S. A. & Butland, M. (1994). Emotional response and learning: Explaining affinity seeking behaviours in the classroom. In Proceedings of the Annual Meeting of the International Communication Association Conference, Sydney, Australia.
9. Burleson, W., & Picard, R. W. (2004). Affective agents: Sustaining Motivation to learn through failure and a state of stuck. Social and Emotional Intelligence in Learning Environments Workshop In conjunction with the 7th International Conference on Intelligent Tutoring Systems, Maceio - Alagoas, Brasil, August 31st, 2004.
10. Cassell J. A framework for gesture generation and interpretation. In: Cipolla R., and Pentland A. (Eds). Computer Vision for Human-Machine Interaction (1998), Cambridge University Press
11. Chaffar, S., & Frasson, C. (2004). Inducing optimal emotional state for learning in Intelligent Tutoring Systems, In Proceedings of the 7th International Conference on Intelligent Tutoring Systems, ITS 2004, Maceió, Alagoas, Brazil, August 30 - September 3, 2004, Lecture Notes in Computer Science, Volume 3220, 45-54.
12. Conati, C., & Maclaren, H. (2005). Data-driven Refinement of a Probabilistic Model of User Affect. Proceedings of User Modeling, Edinburgh, Scotland.
13. Conati, C., & VanLehn, K. (2001). Providing adaptive support to the understanding of instructional material, Proc. Intelligent User Interfaces '01, Santa Fe, New Mexico, 2001, 41-47.
14. Cristianini N., and Shawe-Taylor J. An introduction to support vector machines and other kernel-based learning methods (2000), Cambridge University Press, Cambridge, UK
15. Dadgostar, F., Ryu, H., Sarrafzadeh, A. & Overmyer, S. P. (2005). Making sense of student use of nonverbal cues for intelligent tutoring systems. Proceedings of CHISIG, Canberra, Australia.
16. De Silva, L. C., Miyasato, T., & Nakatsu R. (1997). Facial emotion recognition using multimodal information, In Proc. IEEE International Conference on Information, Communications and Signal Processing, USA, 397-401.
17. de Vicente, A. (2003). Towards tutoring systems that detect students' motivation: an investigation, Ph.D. Thesis, School of Informatics. University of Edinburgh.
18. D'Mello S.K., Craig S.D., Gholson B., Franklin S., Picard R.W., and Graesser A.C. Integrating affect sensors in an intelligent tutoring system. Affective Interactions: The Computer in the Affective Loop Workshop at 2005 International conference on Intelligent User Interfaces (2005), AMC Press, New York 7-13
19. D'Mello, S. K., Craig, S. D., Gholson, B., Franklin, S., Picard, R. & Graesser, A. C. (2005). Integrating affect sensors in an intelligent tutoring system. In Affective Interactions: The Computer in the Affective Loop Workshop at 2005 International conference on Intelligent User Interfaces.
20. Edwards, L. D. (2005). Metaphors and gesture in fraction talk. In: The 4th Congress of the European Society for Research in Mathematics Education. Spain, Sant Feliu de Guixols.
21. Ekman P. Strong evidences for universals in facial expressions: A reply to Russel's mistaken critique. Psychological Bulletin 115 1 (1994) 268-286
22. Ekman P. Should we call it expression or communication?. Innovations in Social Science Research 10 4 (1997) 333-344
23. Ekman P., and Friesen W.V. Facial action coding system (1978), Consulting Psychologists Press
24. Falangan, J., Huang, T., Jones P., & Kasif, S. (1997). Final report of the NSF Workshop on Human-Centers Systems: Information, Interactivity, and Intelligence. Washington D.C.: NSF.
25. Fan, C., Johnson, M., Messom, C. & Sarrafzadeh, A. (2003). Machine vision for an Intelligent Tutor. Proceedings of the International Conference on Computational Intelligence, Robotics and Autonomous Systems, Singapore.
26. Fasel B., and Luettin J. Automatic facial expression analysis: A survey. Pattern Recognition 36 1 (2003) 259-275
27. Goldin-Meadow S. Hearing gesture: How our hands help us think (2003), Belknap, Cambridge, MA
28. Goldin-Meadow S., and Singer M.A. From children's hands to adult's ears: Gesture's role in the learning process. Development Psychology 39 3 (2003) 509-520
29. Golman S.D.M. Teaching a smarter learner. Journal of Computer and System Sciences 52 (1996) 255-267
30. Hager, J. C. & Ekman, P. (1995). Essential behavioral science of the face and gesture that computer scientists need to know. International workshop on automatic face and gesture recognition. Zurich.
31. Hayhoe M. Vision visual routines: A functional account of vision. Visual Cognition 7 (2000) 43-64
32. Huang, T. S., Chen, L. S., & Tao, H. (1998). Bimodal emotion recognition by man and machine, ATR Workshop on Virtual Communication Environments. Japan.
33. Johnson W.L., Rickel J.W., and Lester J.C. Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education 11 (2000) 47-78
34. Johnson, W. L., Shaw, E., Marshall, A. & Labore, C. (2003). Evolution of user interaction: The case of Agent Adele. In Proceedings of the Intelligent User Interface '03 (pp. 93-100). Miami.
35. Kort, B., Reilly, R. Picard, R. W. (2001). An affective model of interplay between emotions and learning: Reengineering educational pedagogy - building a learning companion. Proceedings of IEEE International Conference on Advanced Learning Technologies. 43-48.
36. Kwon, O. N., Ju, M. K., Park, J. S., Cho, K. H., & Ewha, K. H. (2003). Gesture in the context of mathematical argumentation. Proceedings of the 27th conference of the International group for the Psychology of Mathematics Education held jointly with the 25th Conference of PME-NA; Honolulu, USA.
37. Litman D.J., and Forbes-Riley K. Recognizing student emotions and attitudes on the basis of utterances in spoken tutoring dialogues with both human and computer tutors. Speech Communication. 48 5 (2006) 559-590
38. McNeill D. Hand and mind (1992), The University of Chicago Press, Chicago
39. Mehrabian A. Nonverbal communication (1972), Aldine-Atherson, Chicago
40. Mehrabian A. Silent messages: Implicit communication of emotions and attitudes (1981), Wadsworth, Belmont, CA
41. Montepare J., Koff E., Ziatchik D., and Albert M. The use of body movements and gestures as cues to emotions in younger and older adults. Journal of Nonverbal Behavior 23 2 (1999) 133-152
42. New Zealand Ministry of Education. (2003). Book 1. The Number Framework, Numeracy Professional Development Projects. Wellington: Ministry of Education.
43. Pantic, M., & Rothkrantz, L. J. M. (1999). An expert system for multiple emotional classification of facial expressions. IEEE International Conference on Tools with Artificial Intelligence. Chicago, 113-120.
44. Pantic, M., & Rothkrantz, L. J. M. (2003). Toward an affect-sensitive multimodal human-computer interaction. Proceedings of the IEEE. 91(9), 1370-1390.
45. Person, N. K., & Graesser, A. C., The Tutoring Research Group. (2003). Fourteen facts about human tutoring: Food for thought for ITS developers. AI-ED 2003 Workshop Proceedings on Tutorial Dialogue Systems: With a View Toward the Classroom. Sydney, Australia.
46. Picard R.W. Affective computing (1997), MIT Press, Cambridge, Mass
47. In: Prendinger H., and Ishizuka M. (Eds). Life-like characters, tools, affective functions, and applications. Cognitive Technologies Series (2004), Springer, Berlin Heidelberg
48. Reeves B., and Nass C.I. The Media equation: how people treat computers, television and new media like real people and places (1996), Cambridge University Press
49. Sarrafzadeh, A. (2002). Representing domain knowledge structure in Intelligent Tutoring Systems. Proceedings of the International Conference on Information and Communication Technologies in Education. Spain, November 02, 665-9.
50. Sarrafzadeh, A., Fan, C., Dadgostar, F., Alexander, S. T. V., & Messom, C. (2004) Frown gives game away: Affect sensitive tutoring systems for elementary mathematics. Proceedings of the IEEE Conference on Systems, Man and Cybernetics. The Hague.
51. Self J.A. Theoretical foundations for intelligent tutoring systems. International Journal of Artificial Intelligence in Education 1 4 (1990) 3-14
52. Shergil, G., Sarrafzadeh, A., Diegel, O. & Shekar, A. (2004). Computerized Sales Assistants: The application of computer technology to measure consumer interest: A conceptual framework. Working Paper Series. Issue 4.25, September 2004, Massey University; ISSN 1174-5320.
53. Strauss, M., Reynolds, C., Hughes, S., Park, K., McDarby, G., & Picard R. W. (2005). The HandWave Bluetooth Skin Conductance Sensor. Proceedings of Affective Computing and Intelligent Interaction. Beijing, China.
54. The Urban Teacher Collaborative. (2000). The urban teacher challenge: Teacher demand and supply in the Great City Schools. A study by The Urban Teacher Collaborative: Council of the Great City Schools, Recruiting New Teachers, Inc. and Council of the Great City Colleges of Education. Washington, DC: Council of the Great City Schools [Online].
55. van Mulken, S., André, E., & Muller, J. (1998). The persona effect: How substantial is it? Proceedings of Human Computer Interaction. Berlin.
56. Vapnik V.N. The nature of statistical learning theory (2000), Springer-Verlag New York, Inc., New York, NY, USA