The effects of a pedagogical agent's smiling expression on the learner's emotions and motivation in a virtual learning environment

International Review of Research in Open and Distributed Learning

Volumn 17, Issue 5, 2016, Pages 248-266

  Liew, Tze Wei ^a   Mat Zin, Nor Azan ^b   Sahari, Noraidah ^b   Tan, Su Mae ^a  

^a MULTIMEDIA UNIVERSITY   (Malaysia)

^b UNIVERSITI KEBANGSAAN MALAYSIA   (Malaysia)

Author keywords

Emotion; Emotion contagion; Motivation; Pedagogical agent; Smiling expression; Virtual learning environment

Indexed keywords

EID: 84991641482     PISSN: None     EISSN: 14923831     Source Type: Journal    
DOI: 10.19173/irrodl.v17i5.2350     Document Type: Article

References (53)

1. Atkinson, R. K. (2002). Optimizing learning from examples using animated pedagogical agents. Journal of Educational Psychology, 94(2), 416-427.
2. Beale, R., & Creed, C. (2009). Affective interaction: How emotional agents affect users. International Journal of Human-Computer Studies, 67(9), 755-776.
3. Burleson, W., Picard, R. W., Perlin, K., & Lippincott, J. (2004, July). A platform for affective agent research. In Workshop on Empathetic Agents, International Conference on Autonomous Agents and Multiagent Systems, Columbia University, New York, NY.
4. Creed, C., & Beale, R. (2008). Psychological responses to simulated displays of mismatched emotional expressions. Interacting with Computers, 20(2), 225-239.
5. de Melo, C. M., Carnevale, P., & Gratch, J. (2012, September). The effect of virtual agents' emotion displays and appraisals on people's decision making in negotiation. In Y. Nakano, M. Neff, A. Paiva, & M. Walker (Eds.), Intelligent Virtual Agents, 12th International Conference, IVA 2012, Santa Cruz, CA, USA (pp. 53-66). New York: Springer.
6. Epstude, K., & Mussweiler, T. (2009). What you feel is how you compare: How comparisons influence the social induction of affect. Emotion, 9(1), 1-14.
7. Guadagno, R. E., Swinth, K. R., & Blascovich, J. (2011). Social evaluations of embodied agents and avatars. Computers in Human Behavior, 27(6), 2380-2385.
8. Guo, Y. R., & Goh, D. H. L. (2015). Affect in embodied pedagogical agents meta-analytic review. Journal of Educational Computing Research, 53(1), 124-149.
9. Hatfield, E., Cacioppo, J. T., & Rapson, R.L. (1994). Emotional contagion. Cambridge [England]:Cambridge University Press.
10. Hayes, A. L., Ulinski, A. C., & Hodges, L. F. (2010, January). That avatar is looking at me! Social inhibition in virtual worlds. In Y. Nakano, M. Neff, A. Paiva, & M. Walker (Eds.), Intelligent Virtual Agents (pp. 454-467). Berlin Heidelberg: Springer.
11. Holmes, J. (2007). Designing agents to support learning by explaining. Computers & Education, 48(4), 523-547.
12. Isen, A. M., & Reeve, J. (2005). The influence of positive affect on intrinsic and extrinsic motivation: Facilitating enjoyment of play, responsible work behavior, and self-control. Motivation and Emotion, 29(4), 295-323.
13. Kim, Y., & Baylor, A. L. (2006). A social-cognitive framework for pedagogical agents as learning companions. Educational Technology Research and Development, 54(6), 569-596.
14. Kim, Y., & Baylor, A. L. (2015). Research-based design of pedagogical agent roles: A review, progress, and recommendations. International Journal of Artificial Intelligence in Education, 26(1), 160-169.
15. Kim, Y., & Wei, Q. (2011). The impact of learner attributes and learner choice in an agent-based environment. Computers & Education, 56(2), 505-514.
16. Klein, J., Moon, Y., & Picard, R. W. (2002). This computer responds to user frustration: Theory, design, and results. Interacting with computers, 14(2), 119-140.
17. Krämer, N. C., & Bente, G. (2010). Personalizing e-learning. The social effects of pedagogical agents. Educational Psychology Review, 22(1), 71-87.
18. Krämer, N., Kopp, S., Becker-Asano, C., & Sommer, N. (2013). Smile and the world will smile with you-The effects of a virtual agent's smile on users' evaluation and behavior. International Journal of Human-Computer Studies, 71(3), 335-349.
19. Ku, J., Jang, H. J., Kim, K. U., Kim, J. H., Park, S. H., Lee, J. H., . & Kim, S. I. (2005). Experimental results of affective valence and arousal to avatar's facial expressions. CyberPsychology & Behavior, 8(5), 493-503.
20. Lester, J. C., Converse, S. A., Kahler, S. E., Barlow, S. T., Stone, B. A., & Bhogal, R. S. (1997, March). The persona effect: Affective impact of animated pedagogical agents. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 359-366). ACM.
21. Liew, T. W., & Su-Mae, T. (2016). The Effects of Positive and Negative Mood on Cognition and Motivation in Multimedia Learning Environment. Journal of Educational Technology & Society, 19(2), 104-115.
22. Liew, T. W., Tan, S. M., & Jayothisa, C. (2013). The effects of peer-like and expert-like pedagogical agents on learners' agent perceptions, task-related attitudes, and learning achievement. Educational Technology & Society, 16(4), 275-286.
23. Mayer, R. E., Sobko, K., & Mautone, P. D. (2003). Social cues in multimedia learning: Role of speaker's voice. Journal of Educational Psychology, 95(2), 419.
24. McIntosh, D. N., Druckman, D., & Zajonc, R. B. (1994). Socially induced affect. In D. Druckman & R.A. Bjork (Eds.), Learning, remembering, believing: Enhancing human performance (pp. 251-276). Washington, DC: National Academy Press.
25. Moreno, R., & Flowerday, T. (2006). Students' choice of animated pedagogical agents in science learning: A test of the similarity-attraction hypothesis on gender and ethnicity. Contemporary Educational Psychology, 31(2), 186-207.
26. Moreno, R., Mayer, R. E., Spires, H. A., & Lester, J. C. (2001). The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction, 19(2), 177-213.
27. Nass, C., & Lee, K. M. (2001). Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. Journal of Experimental Psychology: Applied, 7(3), 171-181.
28. Neumann, R., & Strack, F. (2000). "Mood contagion": The automatic transfer of mood between persons. Journal of Personality and Social Psychology, 79(2), 211.
29. Niedenthal, P. M., Mermillod, M., Maringer, M., & Hess, U. (2010). The simulation of smiles (SIMS) model: Embodied simulation and the meaning of facial expression. Behavioral and Brain Sciences, 33(06), 417-433.
30. Ochs, M., Niewiadomski, R., Brunet, P., & Pelachaud, C. (2012). Smiling virtual agent in social context. Cognitive processing, 13(2), 519-532.
31. Ochs, M., & Pelachaud, C. (2013). Socially aware virtual characters: The social signal of smiles [Social Sciences]. Signal Processing Magazine, IEEE, 30(2), 128-132.
32. Ozogul, G., Johnson, A. M., Atkinson, R. K., & Reisslein, M. (2013). Investigating the impact of pedagogical agent gender matching and learner choice on learning outcomes and perceptions. Computers & Education, 67, 36-50.
33. Pertaub, D. P., Slater, M., & Barker, C. (2002). An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoperators and Virtual Environments, 11(1), 68-78.
34. Plant, E. A., Baylor, A. L., Doerr, C. E., & Rosenberg-Kima, R. B. (2009). Changing middle-school students' attitudes and performance regarding engineering with computer-based social models. Computers & Education, 53(2), 209-215.
35. Qu, C., Brinkman, W. P., Ling, Y., Wiggers, P., & Heynderickx, I. (2014). Conversations with a virtual human: Synthetic emotions and human responses. Computers in Human Behavior, 34, 58-68.
36. Reeves, B., & Nass, C. (1996). How people treat computers, television, and new media like real people and places (pp. 19-36). Cambridge, UK: CSLI Publications and Cambridge university press.
37. Rehm, M., & André, E. (2005, July). Catch me if you can: exploring lying agents in social settings. In Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems (pp. 937-944). ACM.
38. Rosenberg-Kima, R. B., Baylor, A. L., Plant, E. A., & Doerr, C. E. (2008). Interface agents as social models for female students: The effects of agent visual presence and appearance on female students' attitudes and beliefs. Computers in Human Behavior, 24(6), 2741-2756.
39. Schroeder, N. L., Adesope, O. O., & Gilbert, R. B. (2013). How effective are pedagogical agents for learning? A meta-analytic review. Journal of Educational Computing Research, 49(1), 1-39.
40. Searls, D. B. (2012). Ten simple rules for online learning. PLoS Comput Biol, 8(9), e1002631.
41. Tinwell, A., Grimshaw, M., Nabi, D. A., & Williams, A. (2011). Facial expression of emotion and perception of the Uncanny Valley in virtual characters. Computers in Human Behavior, 27(2), 741-749.
42. Tsai, J., Bowring, E., Marsella, S., Wood, W., & Tambe, M. (2012, January). A study of emotional contagion with virtual characters. In Y. Nakano, M. Neff, A. Paiva, & M. Walker (Eds.), Intelligent Virtual Agents (pp. 81-88). Berlin Heidelberg: Springer.
43. Um, E., Plass, J. L., Hayward, E. O., & Homer, B. D. (2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485-498.
44. Veletsianos, G. (2010). Contextually relevant pedagogical agents: Visual appearance, stereotypes, and first impressions and their impact on learning. Computers & Education, 55(2), 576-585.
45. Veletsianos, G., & Russell, G. S. (2014). Pedagogical agents. In M.Spector, D. Merrill, J. Elen, & M.J. Bishop (Eds.), Handbook of Research on Educational Communications and Technology, 4th Edition (pp. 759-769). New York: Springer.
46. Wang, C. C., & Yeh, W. J. (2013). Avatars with sex appeal as pedagogical agents: Attractiveness, trustworthiness, expertise, and gender differences. Journal of Educational Computing Research, 48(4), 403-429.
47. Wang, N., Johnson, W. L., Mayer, R. E., Rizzo, P., Shaw, E., & Collins, H. (2008). The politeness effect: Pedagogical agents and learning outcomes. International Journal of Human-Computer Studies, 66(2), 98-112.
48. Watson, D., & Clark, L. A. (1999). The PANAS-X: Manual for the positive and negative affect schedule-expanded form. Iowa City: University of Iowa.
49. Wong, J. W. E., & McGee, K. (2012, January). Frown more, talk more: Effects of facial expressions in establishing conversational rapport with virtual agents. In Y. Nakano, M. Neff, A. Paiva, & M. Walker (Eds.), Intelligent Virtual Agents (pp. 419-425). Berlin Heidelberg: Springer.
50. Yilmaz, R., & Kiliç-çakmak, E. (2012). Educational interface agents as social models to influence learner achievement, attitude and retention of learning. Computers & Education, 59(2), 828-838.
51. Yung, H. I., & Paas, F. (2015). Effects of cueing by a pedagogical agent in an instructional animation: A cognitive load approach. Journal of Educational Technology & Society, 18(3), 153-160.
52. Yusoff, M., & Zin, N. (2013). Exploring suitable emotion-focused strategies in helping students to regulate their emotional state in a tutoring system: Malaysian case study. Electronic Journal of Research in Educational Psychology, 11(3), 717-742.
53. Zanbaka, C. A., Ulinski, A. C., Goolkasian, P., & Hodges, L. F. (2007, April). Social responses to virtual humans: Implications for future interface design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1561-1570). ACM.