A selective meta-analysis on the relative incidence of discrete affective states during learning with technology

Journal of Educational Psychology

Volumn 105, Issue 4, 2013, Pages 1082-1099

  D'Mello, Sidney ^a  

^a UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

Affect; Emotion; Learning; Meta analysis; Technology

Indexed keywords

EID: 84887513232     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0032674     Document Type: Article

References (110)

1. Acee, T. W., Kim, H., Kim, H. J., Kim, J.-I., Chu, H.-N. R., Kim, M., .. Wicker, F. W. (2010). Academic boredom in under-and overchallenging situations. Contemporary Educational Psychology, 35, 17-27. doi:10.1016/j.cedpsych.2009.08.002
2. Afzal, S., & Robinson, P. (2011). Natural affect data: Collection and annotation. In R. A. Calvo & S. K. D'Mello (Eds.), New perspectives on affect and learning technologies (pp. 55-70). New York, NY: Springer. doi:10.1007/978-1-4419-9625-1_5
3. Ainley, M. (2008). Interest: A significant thread binding cognition and affect in the regulation of learning. International Journal of Psychology, 43, 17-18.
4. Ainsworth, S. (2008). How do animations influence learning? In D. Robinson & G. Schraw (Eds.), Current perspectives on cognition, learning, and instruction: Recent innovations in educational technology that facilitate student learning (pp. 37-67). Charlotte, NC: Information Age.
5. Aleven, V., McLaren, B. M., Sewall, J., & Koedinger, K. (2009). A new paradigm for intelligent tutoring systems: Example-tracing tutors. International Journal of Artificial Intelligence in Education, 19, 105-154.
6. Alhothali, A. (2011). Modeling user affect using interaction events (Master's thesis). University of Waterloo, Waterloo, Ontario, Canada.
7. Allison, P. D. (1999). Multiple regression. Thousand Oaks, CA: Pine Forge Press.
8. Arroyo, I., Woolf, B., Cooper, D., Burleson, W., Muldner, K., & Christopherson, R. (2009). Emotion sensors go to school. In V. Dimitrova, R. Mizoguchi, B. du Boulay, & A. Graesser (Eds.), Proceedings of the 14th International Conference on Artificial Intelligence in Education (pp. 17-24). Amsterdam, the Netherlands: IOS Press.
9. Baker, R. S., Corbett, A. T., Koedinger, K. R., & Wagner, A. Z. (2004). Off-task behavior in the cognitive tutor classroom: When students "game the system". In E. Dykstra-Erickson & M. Tscheligi (Eds.), Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 383-390). New York, NY: Association for Computing Machinery.
10. Baker, R. J. S. D., D'Mello, S. K., Rodrigo, M. T., & Graesser, A. C. (2010). Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies, 68, 223-241. doi:10.1016/ j.ijhcs.2009.12.003
11. Baker, R. S. J. D., Gowda, S. M., Wixon, M., Kalka, J., Wagner, A. Z., Salvi, A.,.. Rossi, L. (2012). Towards sensor-free affect detection in cognitive tutor algebra. In K. Yacef, O. Zaïane, H. Hershkovitz, M. Yudelson, & J. Stamper (Eds.), Proceedings of the 5th International Conference on Educational Data Mining (pp. 126-133). Retrieved from http://educationaldatamining.org/EDM2012/uploads/procs/Full_Papers/edm2012_full_1.pdf
12. Baker, R. S. J. D., Moore, G. R., Wagner, A. Z., Kalka, J., Salvi, A., Karabinos, M.,.. Yaron, D. (2011). The dynamics between student affect and behavior occurring outside of educational software. In S. D'Mello, A. Graesser, B. Schuller, & J. Martin (Eds.), Proceedings of the fourth biannual International Conference on Affective Computing and Intelligent Interaction (pp. 14-24). Berlin, Germany: Springer-Verlag.
13. Baker, R., Rodrigo, M., & Xolocotzin, U. (2007). The dynamics of affective transitions in simulation problem-solving environments. In A. Paiva, P. Rui, & W. Rosalind (Eds.), Proceedings of the Second International Conference on Affective Computing and Intelligent Interaction (pp. 666-677). Berlin, Germany: Springer.
14. Beal, C. R., Arroyo, I. M., Cohen, P. R., & Woolf, B. P. (2010). Evaluation of AnimalWatch: An intelligent tutoring system for arithmetic and fractions. Journal of Interactive Online Learning, 9, 64-77.
15. Berlyne, D. (1978). Curiosity in learning. Motivation and Emotion, 2, 97-175. doi:10.1007/BF00993037
16. Bong, M. (2001). Between-and within-domain relations of academic motivation among middle and high school students: Self-efficacy, task value, and achievement goals. Journal of Educational Psychology, 93, 23-34. doi:10.1037/0022-0663.93.1.23
17. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Hoboken, NJ: Wiley. doi:10.1002/9780470743386
18. Burleson, W., & Picard, R. (2004, August). Affective agents: Sustaining motivation to learn through failure and a state of "stuck." Paper presented at the ITS 2004 Workshop Proceedings on Social and Emotional Intelligence in Learning Environments, Maceió, Brazil.
19. Calvo, R. A., & D'Mello, S. K. (2010). Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on Affective Computing, 1, 18-37. doi:10.1109/T-AFFC.2010.1
20. Calvo, R. A., & D'Mello, S. K. (Eds.). (2011). New perspectives on affect and learning technologies. New York, NY: Springer. doi:10.1007/978-1-4419-9625-1
21. Chaouachi, M., & Frasson, C. (2010). Exploring the relationship between learner EEG mental engagement and affect. In J. Kay & V. Aleven (Eds.), Proceedings of 10th International Conference on Intelligent Tutoring Systems (pp. 291-293). Berlin, Germany: Springer.
22. Clifford, M. (1988). Failure tolerance and academic risk-taking in ten-to twelve-year-old students. British Journal of Educational Psychology, 58, 15-27. doi:10.1111/j.2044-8279.1988.tb00875.x
23. Cochran, W. G. (1954). The combination of estimates from different experiments. Biometrics, 10, 101-129. doi:10.2307/3001666
24. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159. doi:10.1037/0033-2909.112.1.155
25. Conati, C., & Maclaren, H. (2009). Empirically building and evaluating a probabilistic model of user affect. User Modeling and User-Adapted Interaction, 19, 267-303. doi:10.1007/s11257-009-9062-8
26. Corbett, A. (2001). Cognitive computer tutors: Solving the two-sigma problem. In M. Bauer, P. Gmytrasiewicz, & J. Vassileva (Eds.), Proceedings of the 8th International Conference on User Modeling (pp. 137-147). Berlin, German: Springer.
27. Cordova, D. I., & Lepper, M. R. (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88, 715-730. doi:10.1037/0022-0663.88.4.715
28. Craig, S. D., D'Mello, S., Witherspoon, A., & Graesser, A. (2008). Emote aloud during learning with AutoTutor: Applying the facial action coding system to cognitive-affective states during learning. Cognition & Emotion, 22, 777-788. doi:10.1080/02699930701516759
29. Craig, S., Graesser, A., Sullins, J., & Gholson, B. (2004). Affect and learning: An exploratory look into the role of affect in learning. Journal of Educational Media, 29, 241-250. doi:10.1080/ 1358165042000283101
30. Csikszentmihalyi, M. (1975). Beyond boredom and anxiety. San Francisco, CA: Jossey-Bass.
31. Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. New York, NY: Harper and Row.
32. Daschmann, E. C., Goetz, T., & Stupnisky, R. H. (2011). Testing the predictors of boredom at school: Development and validation of the precursors to boredom scales. British Journal of Educational Psychology, 81, 421-440. doi:10.1348/000709910X526038
33. Deci, E., & Ryan, R. (2002). The paradox of achievement: The harder you push, the worse it gets. In J. Aronson (Ed.), Improving academic achievement: Impact of psychological factors on education (pp. 61-87). Orlando, FL: Academic Press. doi:10.1016/B978-012064455-1/50007-5
34. D'Mello, S., Craig, S., Witherspoon, A., McDaniel, B., & Graesser, A. (2008). Automatic detection of learner's affect from conversational cues. User Modeling and User-Adapted Interaction, 18, 45-80. doi:10.1007/ s11257-007-9037-6
35. D'Mello, S., & Graesser, A. (2011). The half-life of cognitive-affective states during complex learning. Cognition & Emotion, 25, 1299-1308. doi:10.1080/02699931.2011.613668
36. D'Mello, S., & Graesser, A. (2012). Dynamics of affective states during complex learning. Learning and Instruction, 22, 145-157. doi:10.1016/ j.learninstruc.2011.10.001
37. D'Mello, S., & Graesser, A. (in press). Confusion. In R. Pekrun & L. Linnenbrink-Garcia (Eds.), Handbook of emotions and education. New York, NY: Taylor & Francis. doi:10.1016/j.learninstruc.2012.05.003
38. D'Mello, S., & Kory, J. (2012). Consistent but modest: Comparing multimodal and unimodal affect detection accuracies from 30 studies. In L.-P. Morency, D. Bohus, H. Aghajan, A. Nijholt, J. Cassell, & J. Epps (Eds.), Proceedings of the 14th ACM International Conference on Multimodal Interaction (pp. 31-38). New York, NY: ACM.
39. D'Mello, S., Lehman, S., Pekrun, R., & Graesser, A. (2012). Confusion can be beneficial for learning. Learning and Instruction. Advance online publication. doi:10.1016/j.learninstruc.2012.05.003
40. D'Mello, S., Lehman, B., Sullins, J., Daigle, R., Combs, R., Vogt, K.,.. Graesser, A. (2010). A time for emoting: When affect-sensitivity is and isn't effective at promoting deep learning. In J. Kay & V. Aleven (Eds.), Proceedings of the 10th International Conference on Intelligent Tutoring Systems (pp. 245-254). Berlin, Germany: Springer.
41. D'Mello, S., & Mills, C. (in press). Emotions while writing about emotional and non-emotional topics. Motivation and Emotion.
42. D'Mello, S., Olney, A., Williams, C., & Hays, P. (2012). Gaze tutor: A gaze-reactive intelligent tutoring system. International Journal of Human-Computer Studies, 70, 377-398. doi:10.1016/j.ijhcs.2012.01.004
43. Dole, J. A., & Sinatra, G. M. (1998). Reconceptualizing change in the cognitive construction of knowledge. Educational Psychologist, 33, 109-128. doi:10.1207/s15326985ep3302&3_5
44. du Boulay, B., Avramides, K., Luckin, R., Martínez-Mirón, E., Méndez, G., & Carr, A. (2010). Towards systems that care: A conceptual framework based on motivation, metacognition and affect. International Journal of Artificial Intelligence in Education, 20, 197-229.
45. Dweck, C. (2006). Mindset. New York, NY: Random House.
46. Ekman, P. (1992). An argument for basic emotions. Cognition & Emotion, 6, 169-200. doi:10.1080/02699939208411068
47. Forbes-Riley, K., & Litman, D. (2009). Adapting to student uncertainty improves tutoring dialogues. In V. Dimitrova, R. Mizoguchi, B. du Boulay, & A. Graesser (Eds.), Proceedings of the 14th International Conference on Artificial Intelligence in Education (pp. 33-40). Amsterdam, the Netherlands: IOS Press.
48. Forbes-Riley, K., & Litman, D. J. (2011a). Benefits and challenges of real-time uncertainty detection and adaptation in a spoken dialogue computer tutor. Speech Communication, 53, 1115-1136. doi:10.1016/j .specom.2011.02.006
49. Forbes-Riley, K., & Litman, D. (2011b). When does disengagement correlate with learning in spoken dialog computer tutoring? In S. Bull & G. Biswas (Eds.), Proceedings of the 15th International Conference on Artificial Intelligence in Education (pp. 81-89). Berlin, Germany:Springer.
50. Goetz, T., Frenzel, A. C., Pekrun, R., Hall, N. C., & Lüdtke, O. (2007). Between-and within-domain relations of students' academic emotions. Journal of Educational Psychology, 99, 715-733. doi:10.1037/0022-0663.99.4.715
51. Goetz, T., Pekrun, R., Hall, N., & Haag, L. (2006). Academic emotions from a social-cognitive perspective: Antecedents and domain specificity of students' affect in the context of Latin instruction. British Journal of Educational Psychology, 76, 289-308. doi:10.1348/000709905X42860
52. Graesser, A., Chipman, P., Haynes, B., & Olney, A. (2005a). AutoTutor:An intelligent tutoring system with mixed-initiative dialogue. IEEE Transactions on Education, 48, 612-618. doi:10.1109/TE.2005.856149
53. Graesser, A., Chipman, P., King, B., McDaniel, B., & D'Mello, S. (2007). Emotions and learning with AutoTutor. In R. Luckin, K. Koedinger, & J. Greer (Eds.), Proceedings of the 13th International Conference on Artificial Intelligence in Education (pp. 569-571). Amsterdam, the Netherlands: IOS Press.
54. Graesser, A. C., Lu, S., Olde, B. A., Cooper-Pye, E., & Whitten, S. (2005). Question asking and eye tracking during cognitive disequilibrium: Comprehending illustrated texts on devices when the devices break down. Memory & Cognition, 33, 1235-1247. doi:10.3758/BF03193225
55. Graesser, A., McDaniel, B., Chipman, P., Witherspoon, A., D'Mello, S., & Gholson, B. (2006). Detection of emotions during learning with AutoTutor. In R. Sun & N. Miyake (Eds.), Proceedings of the 28th Annual Conference of the Cognitive Science Society (pp. 285-290). Austin, TX: Cognitive Science Society.
56. Hammerstrøm, K., Wade, A., & Jørgensen, A.-M. K. (2010). Searching for studies: A guide to information retrieval for Campbell Systematic Reviews. Retrieved from http://campbellcollaboration.org/lib/project/179/
57. Harley, J., Bouchet, F., & Azevedo, R. (2012). Measuring learners' cooccurring emotional responses during their interaction with a pedagogical agent in MetaTutor. In S. Cerri, W. Clancey, G. Papadourakis, & K. Panourgia (Eds.), Proceedings of the 11th International Conference on Intelligent Tutoring Systems (pp. 40-45). Berlin, Germany: Springer-Verlag.
58. Hedges, L. V., & Pigott, T. D. (2001). The power of statistical tests in meta-analysis. Psychological Methods, 6, 203-217. doi:10.1037/1082-989X.6.3.203
59. Hidi, S. (2006). Interest: A unique motivational variable. Educational Research Review, 1, 69-82. doi:10.1016/j.edurev.2006.09.001
60. Hoque, M. E., & Picard, R. W. (2011, March). Acted vs. natural frustration and delight: Many people smile in natural frustration. Paper presented at the IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, Washington, DC.
61. Hulleman, C. S., Durik, A. M., Schweigert, S. A., & Harackiewicz, J. M. (2008). Task values, achievement goals, and interest: An integrative analysis. Journal of Educational Psychology, 100, 398-416. doi:10.1037/0022-0663.100.2.398
62. Immordino-Yang, M. H., & Damasio, A. (2007). We feel, therefore we learn: The relevance of affective and social neuroscience to education. Mind, Brain, and Education, 1, 3-10. doi:10.1111/j.1751-228X.2007.00004.x
63. Izard, C. E. (2007). Basic emotions, natural kinds, emotion schemas, and a new paradigm. Perspectives on Psychological Science, 2, 260-280. doi:10.1111/j.1745-6916.2007.00044.x
64. Johnson, W., & Valente, L. (2008, July). Tactical language and culture training systems: Using artificial intelligence to teach foreign languages and cultures. Paper presented at the 20th National Artificial Intelligence Conference, Menlo Park, CA.
65. Kapoor, A., Burleson, B., & Picard, R. (2007). Automatic prediction of frustration. International Journal of Human-Computer Studies, 65, 724-736. doi:10.1016/j.ijhcs.2007.02.003
66. Kappas, A. (2010). Smile when you read this, whether you like it or not:Conceptual challenges to affect detection. IEEE Transactions on Affective Computing, 1, 38-41. doi:10/1109/T-AFFc.2010.6
67. Lehman, B., D'Mello, S. K., Chauncey, A., Gross, M., Dobbins, A., Wallace, P.,.. Graesser, A. C. (2011). Inducing and tracking confusion with contradictions during critical thinking and scientific reasoning. In S. Bull & G. Biswas (Eds.), Proceedings of the 15th International Conference on Artificial Intelligence in Education (pp. 171-178). New York, NY: Springer.
68. Lehman, B., D'Mello, S., & Person, N. (2008, June). All alone with your emotions: An analysis of student emotions during effortful problem solving activities. Workshop on Emotional and Cognitive Issues held in conjunction with the Ninth International Conference on Intelligent Tutoring Systems, Montreal, Quebec, Canada.
69. Lench, H. C., Bench, S. W., & Flores, S. A. (2013). Searching for evidence, not a war: Reply to Lindquist, Siegel, Quigley, and Barrett (2013). Psychological Bulletin, 139, 264-268. doi:10.1037/a0029296
70. Lepper, M., & Woolverton, M. (2002). The wisdom of practice: Lessons learned from the study of highly effective tutors. In J. Aronson (Ed.), Improving academic achievement: Impact of psychological factors on education (pp. 135-158). Orlando, FL: Academic Press. doi:10.1016/B978-012064455-1/50010-5
71. Lindquist, K. A., Siegel, E. H., Quigley, K. S., & Barrett, L. F. (2013). The hundred-year emotion war: Are emotions natural kinds or psychological constructions? Comment on Lench, Flores, and Bench (2011). Psychological Bulletin, 139, 255-263. doi:10.1037/a0029038
72. Linnenbrink, E., & Pintrich, P. (2002). The role of motivational beliefs in conceptual change. In M. Limon & L. Mason (Eds.), Reconsidering conceptual change: Issues in theory and practice (pp. 115-135). Dordrecht, the Netherlands: Kluwer Academic. doi:10.1007/0-306-47637-1_6
73. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
74. Litman, D., & Forbes-Riley, K. (2006). Recognizing student emotions and attitudes on the basis of utterances in spoken tutoring dialogues with both human and computer tutors. Speech Communication, 48, 559-590. doi:10.1016/j.specom.2005.09.008
75. Mandler, G. (1984). Mind and body: Psychology of emotion and stress. New York, NY: Norton.
76. Mandler, G. (1999). Emotion. In B. M. Bly & D. E. Rumelhart (Eds.), Cognitive science: Handbook of perception and cognition (2nd ed., pp. 367-384). San Diego, CA: Academic Press.
77. Mayer, R. (Ed.). (2005). The Cambridge handbook of multimedia learning. New York, NY: Cambridge University Press. doi:10.1017/CBO9780511816819
78. McDaniel, B., D'Mello, S., King, B., Chipman, P., Tapp, K., & Graesser, A. (2007). Facial features for affective state detection in learning environments. In D. McNamara & G. Trafton (Eds.), Proceedings of the 29th annual meeting of the Cognitive Science Society (pp. 467-472). Austin, TX: Cognitive Science Society.
79. Meyer, D., & Turner, J. (2006). Re-conceptualizing emotion and motivation to learn in classroom contexts. Educational Psychology Review, 18, 377-390. doi:10.1007/s10648-006-9032-1
80. Mills, C., & D'Mello, S. K. (2012). Emotions during writing on topics that align or misalign with personal beliefs. In S. Cerri, W. Clancey, G. Papadourakis, & K. Panourgia (Eds.), Proceedings of the 11th International Conference on Intelligent Tutoring Systems (pp. 638-639). Berlin, Germany: Springer-Verlag.
81. Mota, S., & Picard, R. (2003, June). Automated posture analysis for detecting learner's interest level. Paper presented at the Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, Madison, WI.
82. Öhman, A. (2008). Fear and anxiety: Overlap and dissociation. In M. Lewis, J. M. Haviland-Jones, & L. Feldman Barrett (Eds.), Handbook of emotions (3rd ed., pp. 709-729). New York, NY: Guilford Press.
83. Pantic, M., & Rothkrantz, L. (2003). Toward an affect-sensitive multimodal human-computer interaction [Review]. Proceedings of the IEEE, 91, 1370-1390. doi:10.1109/JPROC.2003.817122
84. Parnes, S. J. (1975). Aha! Insights into creative behavior. Buffalo, NY:DOK.
85. Pekrun, R. (2010). Academic emotions. In K. R. Harris, S. Graham, & T. Urdan (Eds.), APA educational psychology handbook: Vol. 2. Individual differences and cultural and contextual factors. Washington, DC: American Psychological Association.
86. Pekrun, R., Goetz, T., Daniels, L. M., Stupnisky, R. H., & Perry, R. H. (2010). Boredom in achievement settings: Exploring control-value antecedents and performance outcomes of a neglected emotion. Journal of Educational Psychology, 102, 531-549. doi:10.1037/a0019243
87. Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students' self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37, 91-105. doi:10.1207/S15326985EP3702_4
88. Pekrun, R., & Linnenbrink-Garcia, L. (Eds.). (in press). Handbook of emotions and education. New York, NY: Taylor & Francis.
89. Piaget, J. (1952). The origins of intelligence. New York, NY: International University Press. doi:10.1037/11494-000
90. Picard, R. (1997). Affective computing. Cambridge, MA: MIT Press.
91. Pour, P. A., Hussein, S., AlZoubi, O., D'Mello, S., & Calvo, R. (2010). The impact of system feedback on learners' affective and physiological states. In J. Kay & V. Aleven (Eds.), Proceedings of 10th International Conference on Intelligent Tutoring Systems (pp. 264-273). Berlin, Germany:Springer-Verlag.
92. Rodrigo, M., & Baker, R. (2011a). Comparing the incidence and persistence of learners' affect during interactions with different educational software packages. In R. A. Calvo & S. K. D'Mello (Eds.), New perspectives on affect and learning technologies (pp. 183-202). New York, NY: Springer. doi:10.1007/978-1-4419-9625-1_14
93. Rodrigo, M., & Baker, R. (2011b). Comparing learners' affect while using an intelligent tutor and an educational game. Research and Practice in Technology Enhanced Learning, 6, 43-66.
94. Rosenberg, E. (1998). Levels of analysis and the organization of affect. Review of General Psychology, 2, 247-270. doi:10.1037/1089-2680.2.3.247
95. Sabourin, J., Mott, B., & Lester, J. (2011). Modeling learner affect with theoretically grounded dynamic bayesian networks. In S. D'Mello, A. Graesser, B. Schuller, & J. Martin (Eds.), Proceedings of the Fourth International Conference on Affective Computing and Intelligent Interaction (pp. 286-295). Berlin, Germany: Springer-Verlag.
96. Sazzad, M. S., AlZoubi, O., Calvo, R. A., & D'Mello, S. K. (2011). Affect detection from multichannel physiology during learning. In S. Bull & G. Biswas (Eds.), Proceedings of the 15th International Conference on Artificial Intelligence in Education (pp. 131-138). New York, NY:Springer.
97. Schutz, P., & Pekrun, R. (Eds.). (2007). Emotion in education. San Diego, CA: Academic Press.
98. Siegler, R., & Jenkins, E. (Eds.). (1989). Strategy discovery and strategy generalization. Hillsdale, NJ: Erlbaum.
99. Silvia, P. J. (2009). Looking past pleasure: Anger, confusion, disgust, pride, surprise, and other unusual aesthetic emotions. Psychology of Aesthetics, Creativity, and the Arts, 3, 48-51. doi:10.1037/a0014632
100. Stein, N., & Levine, L. (1991). Making sense out of emotion. In W. Kessen, A. Ortony, & F. Kraik (Eds.), Memories, thoughts, and emotions:Essays in honor of George Mandler (pp. 295-322). Hillsdale, NJ:Erlbaum.
101. Strain, A., & D'Mello, S. (2011). Emotion regulation during learning. In S. Bull & G. Biswas (Eds.), Proceedings of the 15th International Conference on Artificial Intelligence in Education (pp. 566-568). New York, NY: Springer.
102. Valstar, M. F., Mehu, M., Jiang, B., & Pantic, M. (2012). Meta-analysis of the first facial expression recognition challenge. IEEE Transactions on Systems, Man, and Cybernetics: Part B. Cybernetics, 42, 966-979. doi:10.1109/TSMCB.2012.2200675
103. VanLehn, K. (2006). The behavior of tutoring systems. International Journal of Artificial Intelligence in Education, 16, 227-265.
104. VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46, 197-221. doi:10.1080/00461520.2011.611369
105. VanLehn, K., Siler, S., Murray, C., Yamauchi, T., & Baggett, W. (2003). Why do only some events cause learning during human tutoring? Cognition and Instruction, 21, 209-249. doi:10.1207/S1532690XCI2103_01
106. Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36, 1-48.
107. Vuorela, M., & Nummenmaa, L. (2004). Experienced emotions, emotion regulation and student activity in a web-based learning environment. European Journal of Psychology of Education, 19, 423-436. doi:10.1007/BF03173219
108. Woolf, B., Arroyo, I., Muldner, K., Burleson, W., Cooper, D., Dolan, R., & Christopherson, R. (2010). The effect of motivational learning companions on low achieving students and students with disabilities. In J. Kay & V. Aleven (Eds.), Proceedings of the 10th International Conference on Intelligent Tutoring Systems (pp. 327-337). Berlin, Germany:Springer.
109. Zeidner, M. (2007). Test anxiety in educational contexts: Concepts, findings, and future directions. In P. Schutz & R. Pekrun (Eds.), Emotions in education (pp. 165-184). San Diego, CA: Academic Press. doi:10.1016/B978-012372545-5/50011-3
110. Zeng, Z., Pantic, M., Roisman, G., & Huang, T. (2009). A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 39-58. doi:10.1109/TPAMI.2008.52