Emotional Design in Digital Media for Learning

Emotions, Technology, Design, and Learning

Volumn , Issue , 2015, Pages 131-161

  Plass, Jan L ^a   Kaplan, Ulas ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Affect; Cognition; Emotion; Emotion schema; Emotional design; Integrated cognitive affective model of multimedia learning; Learning; Working memory

Indexed keywords

EID: 85152819954     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-801856-9.00007-4     Document Type: Chapter

References (105)

1. M.B. Arnold (1960) Emotion and personality. New York, NY: Columbia University Press
2. J. Aronson, M.J. Lustina, C. Good, K. Keough, C.M. Steele and J. Brown (1999) When white men can’t do math: Necessary and sufficient factors in stereotype threat. Journal of Experimental Social Psychology 35(1), 29-46.
3. H. Astleitner (2000) Designing emotionally sound instruction: The FEASP-approach. Instructional Science 28 169-198.
4. A.D. Baddeley (1986) Working memory. Oxford, UK: Oxford University Press
5. R.S. Baker, S.K. D’Mello, M.M.T. Rodrigo and A.C. Graesser (2010) Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive-affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies 68(4), 223-241.
6. Biles, M. L., & Plass, J. L. (in press). Good badges, Evil badges: The impact of badge design on cognitive & motivational outcomes. In L. Muilenburg & B. Zane, Digital badges in education: Trends, issues, and cases. Routlegde: Taylor and Francis.
7. M.L. Biles, J.M. Szczuka, J.L. Plass and N.C. Krämer (2014) The affective design of video game characters: A cross cultural investigation. Paper presented at The 7th annual subway summit on cognition and education research, New York
8. C.J. Boyatzis and R. Varghese (1994) Children’s emotional associations with colors. The Journal of Genetic Psychology 155(1), 77-85.
9. R.A. Calvo (2010) Latent and emergent models in affective computing. Emotion Review 2(3), 288-289.
10. N. Cowan (2001) Metatheory of storage capacity limits. Behavioral and Brain Sciences 24(01), 154-176.
11. S.D. Craig, A.C. Graesser, J. Sullins and B. Gholson (2004) Affect and learning: An exploratory look into the role of affect in learning with AutoTutor. Journal of Educational Media 29 241-250.
12. N.R. Crick and K.A. Dodge (1994) A review and reformulation of social-information-processing mechanisms in children’s social adjustment. Psychological Bulletin 115 74-101.
13. S. D’Mello, S. Craig, K. Fike and A. Graesser (2009) Responding to learners’ cognitive-affective states with supportive and shakeup dialogues. Human-computer interaction. Ambient, ubiquitous and intelligent interaction Berlin Heidelberg: Springer 595-604.
14. S.K. D’Mello and A.C. Graesser (2012) Dynamics of affective states during complex learning. Learning and Instruction 22 145-157.
15. S. D’Mello and A. Graesser (2014) Confusion and its dynamics during device comprehension with breakdown scenarios. Acta Psychologica 151 106-116.
16. E.L. Deci and R.M. Ryan (1985) Information-processing theories. Intrinsic motivation and self-determination in human behavior US: Springer 213-242.
17. D.M. Dehn and S. Van Mulken (2000) The impact of animated interface agents: A review of empirical research. International Journal of Human-Computer Studies 52(1), 1-22.
18. D. Derryberry and D.M. Tucker (1994) Motivating the focus of attention. P.M. Niedenthal, S. Kitayama (Eds) The heart’s eye: Emotional influences in perception and attention San Diego, CA: Academic Press 167-196.
19. K. Dion, E. Berscheid and E. Walster (1972) What is beautiful is good. Journal of Personality and Social Psychology 24(3), 285.
20. C. Disalvo and F. Gemperle (2007, December 20) From seduction to fulfillment: The use of anthropomorphic form in design. http://www.anthropomorphism.org/pdf/Seduction.pdf Retrieved from,
21. S. Domagk, R.N. Schwartz and J.L. Plass (2010) Interactivity in multimedia learning: An integrated model. Computers in Human Behavior 26 1024-1033.
22. A. Erez and A.M. Isen (2002) The influence of positive affect on the components of expectancy motivation. Journal of Applied Psychology 87(6), 1055.
23. N.H. Frijda (1986) The emotions. Cambridge, UK: Cambridge University Press
24. A.C. Graesser and S.K. D’Mello (2011) Theoretical perspectives on affect and deep learning. R. Calvo, S.K. D’Mello (Eds) New perspectives on affect and learning technologies New York: Springer 11-22.
25. S.F. Harp and R.E. Mayer (1997) The role of interest in learning from scientific text and illustrations: On the distinction between emotional interest and cognitive interest. Journal of Educational Psychology 89(1), 92.
26. B. Hayes-Roth and P. Doyle (1998) Animate characters. Autonomous Agents and Multi-Agent Systems 1(2), 195-230.
27. S. Hidi (1990) Interest and its contribution as a mental resource for learning. Review of Educational Research 60(4), 549-571.
28. S. Hidi and K.A. Renninger (2006) The four-phase model of interest development. Educational Psychologist 41(2), 111-127.
29. C. Hongpaisanwiwat and M. Lewis (2003) Attentional effect of animated character. M. Rauterberg, M. Menozzi, J. Wesson (Eds) Proceedings of INTERACT’03 Amsterdam, the Netherlands: IOS Press 423-430.
30. E. Hudlicka (2003) To feel or not to feel: The role of affect in human-computer interaction. International Journal of Human-Computer Studies 59(1), 1-32.
31. A.M. Isen, K.A. Daubman and G.P. Nowicki (1987) Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology 52(6), 1122.
32. A.M. Isen, T.E. Shalker, M. Clark and L. Karp (1978) Affect, accessibility of material in memory, and behavior: A cognitive loop? Journal of Personality and Social Psychology 36(1), 1.
33. C.E. Izard (1977) Human emotions. New York, NY: Plenum Press
34. C.E. Izard (1993) Four systems for emotion activation: Cognitive and noncognitive processes. Psychological Review 100 68-90.
35. C.E. Izard (2007) Basic emotions, natural kinds, emotion schemas, and a new paradigm. Perspectives on Psychological Science 2 260-280.
36. C.E. Izard (2009) Emotion theory and research: Highlights, unanswered questions, and emerging issues. Annual Review of Psychology 60 1-25.
37. U. Kaplan and G.N. Epstein (2011) Psychophysiological coherence as a function of mental imagery practice. Imagination, Cognition and Personality 31(4), 297-312.
38. U. Kaplan, G.N. Epstein and A. Sullivan Smith (2014–2015) Microdevelopment of daily well-being through mental imagery practice. Imagination, Cognition and Personality 34(1), 73-96.
39. U. Kaplan and T. Tivnan (2014) Moral motivation based on multiple developmental structures: An exploration of cognitive and emotional dynamics. The Journal of Genetic Psychology: Research and Theory on Human Development 175(3), 181-201.
40. U. Kaplan and T. Tivnan (2014) Moral motivational pluralism: Moral judgment as a function of the dynamic assembly of multiple developmental structures. Journal of Adult Development 21(4), 193-206.
41. U. Kaplan and T. Tivnan (2014) Multiplicity of emotions in moral judgment and motivation. Ethics & Behavior 24(6), 421-443.
42. H. Kloos and G.C. Van Orden (2009) Soft-assembled mechanisms for the unified theory. J.P. Spencer, M. Thomas, J. McClelland (Eds) Toward a unified theory of development? Connectionism and dynamics systems theory reconsidered New York, NY: Oxford University Press 253-267.
43. U. Konradt, R. Filip and S. Hoffmann (2003) Flow experience and positive affect during hypermedia learning. British Journal of Educational Technology 34(3), 309-327.
44. R.S. Lazarus (1968) Emotions and adaptation: Conceptual and empirical relations. Nebraska symposium on motivation 175-266. Vol. 16
45. R.S. Lazarus (1991) Emotion and adaptation. New York, NY: Oxford University Press
46. J. Lemke (2015) Feeling & meaning: A unitary bio-semiotic account. P.P. Trifonas (Eds) International handbook of semiotics New York: Springer
47. K. Lewin (1946) Behavior and development as a function of the total situation. L. Carmichael (Eds) Manual of child psychology New York, NY: Wiley 791-844.
48. M.D. Lewis (1995) Cognition-emotion feedback and the self-organization of developmental paths. Human Development 38 71-102.
49. M.D. Lewis (2000) Emotional self-organization at three time scales. M.D. Lewis, I. Granic (Eds) Emotion, development, and self-organization: Dynamic systems approaches to emotional development Cambridge, UK: Cambridge University Press 37-69.
50. M.D. Lewis (2002) Interacting time scales in personality (and cognitive) development: Intentions, emotions, and emergent forms. N. Granott, J. Parziale (Eds) Microdevelopment: Transition processes in development and learning Cambridge, UK: Cambridge University 183-212.
51. M.D. Lewis (2005) Bridging emotion theory and neurobiology through dynamic systems modeling. Behavioral and Brain Sciences 28 169-194.
52. M.D. Lewis and L. Douglas (1998) A dynamic systems approach to cognition-emotion interactions in development. M.F. Mascolo, S. Griffin (Eds) What develops in emotional development? New York, NY: Plenum 159-188.
53. M. Lewis, J.M. Haviland-Jones and L.F. Barrett (Eds) (2010) Handbook of emotions New York: Guilford Press
54. E.A. Linnenbrink and P.R. Pintrich (2002) Achievement goal theory and affect: An asymmetrical bidirectional model. Educational Psychologist 37 69-78.
55. E.A. Linnenbrink and P.R. Pintrich (2002) The role of motivational beliefs in conceptual change. M. Limon, L. Mason (Eds) Reconsidering conceptual change: Issues in theory and practice Dordrecht, the Netherlands: Kluwer Academic 115-135.
56. K. Lorenz and S. Generale (1950) Ganzheit und Teil in der tierischen und menschlichen Germeinschaft [Wholeness and part in animal and human community]. Part and Parcel in Animal and Human Societies 3 9.
57. R.E. Mayer (2005) Cognitive theory of multimedia learning. The Cambridge handbook of multimedia learning New York: Cambridge University Press 31-48.
58. R.E. Mayer and R. Moreno (1998) A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology 90(2), 312.
59. R.E. Mayer and R. Moreno (2003) Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist 38(1), 43-52.
60. M. Mitchell (1993) Situational interest: Its multifaceted structure in the secondary school mathematics classroom. Journal of Educational Psychology 85(3), 424.
61. A. Mitrovic and P. Suraweera (2000) Evaluating an animated pedagogical agent. Intelligent tutoring systems Berlin, Heidelberg: Springer 73-82.
62. R. Moreno (2007) Optimising learning from animations by minimising cognitive load: Cognitive and affective consequences of signaling and segmentation methods. Applied Cognitive Psychology 21(6), 765-781.
63. R. Moreno and R.E. Mayer (2000) Engaging students in active learning: The case for personalized multimedia messages. Journal of Educational Psychology 92(4), 724.
64. R. Moreno and R. Mayer (2007) Interactive multimodal learning environments. Educational Psychology Review 19(3), 309-326.
65. R. Moreno, R.E. Mayer, H.A. Spires and J.C. Lester (2001) The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction 19(2), 177-213.
66. A.C. North and D.J. Hargreaves (1999) Music and driving game performance. Scandinavian Journal of Psychology 40(4), 285-292.
67. B. Park, J.L. Plass and R. Brünken (2014) Cognitive and affective processes in multimedia learning. Learning and Instruction 29 125-127.
68. R. Pekrun (2000) A social-cognitive, control-value theory of achievement emotions. J. Heckhausen (Eds) Motivational psychology of human development: Developing motivation and motivating development New York, NY, US: Elsevier Science 143-163. 10.1016/S0166-4115(00) 80010-2
69. R. Pekrun (2006) The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review 18(4), 315-341.
70. R. Pekrun, A.J. Elliot and M.A. Maier (2006) Achievement goals and discrete achievement emotions: A theoretical model and prospective test. Journal of Educational Psychology 98(3), 583.
71. R. Pekrun and E.J. Stephens (2010) Achievement emotions: A control-value approach. Social and Personality Psychology Compass 4(4), 238-255.
72. R. Picard (1997) Affective computing. Cambridge, MA: MIT Press
73. R.W. Picard (2003) Affective computing: Challenges. International Journal of Human-Computer Studies 59(1), 55-64.
74. R.W. Picard (2010) Emotion research by the people, for the people. Emotion Review 2(3), 250-254.
75. R.W. Picard and J. Klein (2002) Computers that recognise and respond to user emotion: Theoretical and practical implications. Interacting with Computers 14(2), 141-169.
76. R.W. Picard, E. Vyzas and J. Healey (2001) Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1175-1191.
77. J.L. Plass, S. Heidig, E.O. Hayward, B.D. Homer and E. Um (2014) Emotional design in multimedia learning: Effects of shape and color on affect and learning. Learning and Instruction 29 128-140. 10.1016/j.learninstruc.2013.02.006
78. J.L. Plass, B.D. Homer, E.O. Hayward, J. Frye, T.T. Huang, M. Biles, et al. (2012) The effect of learning mechanics design on learning outcomes in a computer-based geometry game. E-learning and games for training, education, health and sports. Lecture notes in computer science Vol. 7516/2012 65-71. 10.1007/978-3-642-33466-5_7
79. J.L. Plass, R. Moreno and R. Brünken (Eds) (2010) Cognitive load theory New York: Cambridge University Press
80. J.L. Plass, P. O’Keefe, M. Biles, J. Frye and B.D. Homer (2014) Motivational and cognitive impact of badges in games for learning. Poster presented at the annual meeting of the American Educational Research Association (AERA), Philadelphia, PA
81. J.L. Plass, P. O’Keefe, B.D. Homer, E.O. Hayward, M. Stein and K. Perlin (2013) Motivational and cognitive outcomes associated with individual, competitive, and collaborative game play. Journal of Educational Psychology 4 1050-1066.
82. J.L. Plass and R.N. Schwartz (2014) Multimedia learning with simulations and microworlds. R.E. Mayer (Eds) Cambridge handbook of multimedia learning 2nd ed. Cambridge, MA: Cambridge University Press 729-761.
83. B. Reeves and C. Nass (1996) How people treat computers, television, and new media like real people and places. New York: CSLI Publications and Cambridge University Press
84. I.J. Roseman (1984) Cognitive determinants of emotion: A structural theory. P. Shaver (Eds) Review of personality and social psychology Emotions, relationships, and health vol. 5 Beverly Hills, CA: Sage 11-36.
85. I.J. Roseman (2011) Emotional behaviors, emotivational goals, emotion strategies: Multiple levels of organization integrate variable and consistent responses. Emotion Review 3(4), 434-443.
86. J.I. Rotgans and H.G. Schmidt (2011) Situational interest and academic achievement in the active-learning classroom. Learning and Instruction 21(1), 58-67.
87. J.A. Russell (2003) Core affect and the psychological construction of emotion. Psychological Review 110(1), 145-172.
88. H.J.V. Rutherford and A.K. Lindell (2011) Thriving and surviving: Approach and avoidance motivation and lateralization. Emotion Review 3(3), 333-343.
89. J.C. Ruthig, R.P. Perry, S. Hladkyj, N.C. Hall, R. Pekrun and J.G. Chipperfield (2008) Perceived control and emotions: Interactive effects on performance in achievement settings. Social Psychology of Education 11(2), 161-180.
90. R.M. Ryan and E.L. Deci (2000) Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist 55(1), 68.
91. J. Sabourin, B. Mott and J.C. Lester (2011) Modeling learner affect with theoretically grounded dynamic Bayesian networks. Affective computing and intelligent interaction Berlin, Heidelberg: Springer 286-295.
92. T. Schmader, M. Johns and C. Forbes (2008) An integrated process model of stereotype threat effects on performance. Psychological Review 115(2), 336.
93. G. Schraw, T. Flowerday and S. Lehman (2001) Increasing situational interest in the classroom. Educational Psychology Review 13(3), 211-224.
94. E. Soloway, S.L. Jackson, J. Klein, C. Quintana, J. Reed, J. Spitulnik, et al. (1996) Learning theory in practice: Case studies of learner-centered design. Proceedings of the SIGCHI conference on Human factors in computing systems. ACM 189-196.
95. S.J. Spencer, C.M. Steele and D.M. Quinn (1999) Stereotype threat and women’s math performance. Journal of Experimental Social Psychology 35(1), 4-28.
96. C.M. Steele and J. Aronson (1995) Stereotype threat and the intellectual test performance of African Americans. Journal of Personality and Social Psychology 69(5), 797.
97. M. Szabo and H. Kanuka (1998) Effects of violating screen design principles of balance, unity, and focus on recall learning, study time, and completion rates. Journal of Educational Multimedia and Hypermedia 8(1), 23e42.
98. J.M. Szczuka, M. Biles, J.L. Plass and N.C. Krämer (2013) “I wish it was real, so I could squeeze it” The emotional response of children towards videogame-characters: A Cross-Cultural comparison of Germany and the USA. Paper presented at the 8th conference of the media psychology division of the German Psychological Society in Würzburg, Germany
99. E. Thelen and L.B. Smith (1994) A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press
100. N. Tractinsky, A.S. Katz and D. Ikar (2000) What is beautiful is usable. Interacting with Computers 13(2), 127-145.
101. D.M. Tucker (2007) Mind from body: Experience from neural structure. New York, NY: Oxford University Press
102. E. Um, J.L. Plass, E.O. Hayward and B.D. Homer (2012) Emotional design in multimedia learning. Journal of Educational Psychology 104 485-498. 10.1037/a0026609
103. P. van Geert (2002) Developmental dynamics, intentional action and fuzzy sets. N. Granott, J. Parziale (Eds) Microdevelopment: Transition processes in development and learning Cambridge, UK: Cambridge University Press 319-343.
104. P. van Geert and H. Steenbeek (2005) Explaining after by before: Basic aspects of a dynamic systems approach to the study of development. Developmental Review 25 408-442.
105. S. Wolfson and G. Case (2000) The effects of sound and colour on responses to a computer game. Interacting with Computers 13(2), 183-192.