Emotional text design in multimedia learning: A mixed-methods study using eye tracking

Computers and Education

Volumn 120, Issue , 2018, Pages 185-196

  Stark, Lisa ^a,b   Brünken, Roland ^a   Park, Babette ^a  

^a SAARLAND UNIVERSITY   (Germany)

^b Department of NDT and Quality Assurance Saar University Campus E3 1   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED INSTRUCTION; E-LEARNING;

COGNITIVE MECHANISMS; EMOTIONAL DESIGN; LEARNING ENVIRONMENTS; LEARNING OUTCOME; METACOGNITIVE PROCESS; MULTI-MEDIA LEARNING; MULTIMEDIA INSTRUCTION; QUALITATIVE DATA;

DESIGN;

EID: 85042023281     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2018.02.003     Document Type: Article

References (60)

1. Altarriba, J., Bauer, L.M., The distinctiveness of emotion concepts: A comparison between emotion, abstract, and concrete words. American Journal of Psychology 117:3 (2004), 389–410.
2. Baddeley, A.D., Working memory, thought, and action. 2007, Oxford University Press, Oxford, UK.
3. Bannert, M., Hildebrand, M., Mengelkamp, C., Effects of a metacognitive support device in learning environments. Computers in Human Behavior 25:4 (2009), 829–835.
4. Bannert, M., Sonnenberg, C., Mengelkamp, C., Pieger, E., Short and long-term effects of students’ self-directed metacognitive prompts on navigation behavior and learning performance. Computers in Human Behavior 52 (2015), 293–306.
5. Briesemeister, B.B., Kuchinke, L., Jacobs, A.M., Discrete emotion norms for nouns: Berlin affective word list (DENN-BAWL). Behavior Research, 2011, 441–448.
6. D'Mello, S., Graesser, A., Dynamics of affective states during complex learning. Learning and Instruction 22 (2012), 145–157.
7. Eger, N., Ball, L.J., Stevens, R., Dodd, J., Cueing retrospective verbal reports in usability testing through eye-movement replay. Proceedings of the 21st British HCI group annual conference on HCI, Vol. 1, 2007, 129–137.
8. Eitel, A., Kühl, T., Scheiter, K., Gerjets, P., Disfluency meets cognitive load in multimedia learning: Does harder-to-read mean better-to-understand?. Applied Cognitive Psychology 28:4 (2014), 488–501.
9. Ericsson, K.A., Simon, H.A., Protocol analysis: Verbal reports as data., 1993, MIT Press, Cambridge, MA.
10. Garner, R., Gillingham, M.G., White, C.S., Effects of “seductive details” on macroprocessing and microprocessing in adults and children. Cognition and Instruction 6:1 (1989), 41–57.
11. Genter, D., Markman, A.B., Structure mapping in analogy and similarity. American Psychologist 52 (1997), 45–56.
12. Gentner, D., Structure-mapping: A theoretical framework for analogy. Cognitive Science 7 (1983), 155–170.
13. Ginns, P., Martin, A.J., Marsh, H.W., Designing instructional text in a conversational style: A meta-analysis. Educational Psychology Review 25:4 (2013), 445–472.
14. Hager, W., Hasselhorn, M., Handbuch deutschsprachiger wortnormen. 1994, Hogrefe, Göttingen.
15. Hansen, J.P., The use of eye mark recordings to support verbal retrospection in software testing. Acta Psychologica 76 (1991), 31–49.
16. Heidig, S., Müller, J., Reichelt, M., Emotional design in multimedia learning: Differentiation on relevant design features and their effects on emotions and learning. Computers in Human Behavior 44 (2015), 81–95.
17. Hyönä J., The use of eye movements in the study of multimedia learning. Learning and Instruction 20 (2010), 172–176.
18. Jarodzka, H., Scheiter, K., Gerjets, P., Van Gog, T., In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction 20:2 (2010), 146–154.
19. Just, M.A., Carpenter, P.A., Eye fixations and cognitive processes. Cognitive Psychology 8 (1976), 441–480.
20. Kissler, J., Herbert, C., Peyk, P., Junghofer, M., Buzzwords early cortical responses to emotional words during reading. Psychological Science 18:6 (2007), 475–480.
21. Knörzer, L., Brünken, R., Park, B., Facilitators or suppressors: Effects of experimentally induced emotions on multimedia learning. Learning and Instruction 44 (2016), 97–107.
22. Kousta, S.T., Vinson, D.P., Vigliocco, G., Emotion words, regardless of polarity, have a processing advantage over neutral words. Cognition 112:3 (2009), 473–481.
23. Lehmann, J., Goussios, C., Seufert, T., Working memory capacity and disfluency effect: An aptitude-treatment-interaction study. Metacognition and Learning 11 (2016), 89–105.
24. Leutner, D., Motivation and emotion as mediators in multimedia learning. Learning and Instruction 29 (2014), 174–175.
25. Mayer, R.E., Learning strategies for making sense out of expository text: The SOI model for guiding three cognitive processes in knowledge construction. Educational Psychology Review 8:4 (1996), 357–371.
26. Mayer, R.E., Cognitive theory of multimedia learning. Mayer, R.E., (eds.) The Cambridge handbook of multimedia learning, 2014, Cambridge University Press, New York, NY US, 31–48.
27. Mayer, E.R., Estrella, G., Benefits of emotional design in multimedia instruction. Learning and Instruction 12 (2014), 12–18.
28. Mayer, R.E., Fennell, S., Farmer, L., Campbell, J., A personalization effect in multimedia learning: Students learn better when words are in conversational style rather than formal style. Journal of Educational Psychology, 96(2), 2004, 389.
29. Mayer, R.E., Moreno, R., Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist 38:1 (2003), 43–52.
30. Mayring, P., Qualitative Inhaltsanalyse: Grundlagen und Techniken (Trans.) Qualitative content analysis: Basics and techniques, 2010, Beltz, Weinheim.
31. Moreno, R., Instructional technology: Promise and pitfalls. Pytlik Zillig, L., Bodvarsson, M., Bruning, R., (eds.) Technology-based education: Bringing researchers and practitioners together, 2005, Information Age Publishing, Greenwich, CT, 1–19.
32. Moreno, R., Does the modality principle hold for different media? A test of the method-affects-learning hypothesis. Journal of Computer Assisted Learning 22 (2006), 149–158.
33. Moreno, R., Mayer, R., Interactive multimodal learning environments. Educational Psychology Review 19:3 (2007), 309–326.
34. Paivio, A., Mental representations: A dual coding approach. 1986, Oxford University Press, New York.
35. Park, B., Flowerday, T., Brünken, R., Cognitive and affective effects of seductive details in multimedia learning. Computers in Human Behavior 44 (2015), 267–278.
36. Park, B., Knörzer, L., Plass, J.L., Brünken, R., Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms. Computers & Education 86 (2015), 30–42.
37. Park, B., Korbach, A., Brünken, R., Do learner characteristics moderate the seductive-details-effect? A cognitive-load-study using eye tracking. Educational Technology & Society, 2015, 1–16.
38. Park, B., Plass, J.L., Brünken, R., Cognitive and affective processes in multimedia learning. Learning and Instruction 29 (2014), 125–127.
39. Pekrun, R., The control-value, theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review 18 (2006), 315–341.
40. Pekrun, R., Perry, R.P., Control-value theory of achievement emotions. International handbook of emotions in education, 2014, 120–141.
41. Plass, J.L., Heidig, S., Hayward, E.O., Homer, B.D., Um, E., Emotional design in multimedia learning: Effects of shape and color on affect and learning. Learning and Instruction 29 (2014), 128–140.
42. Rayner, K., Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124:3 (1998), 372–422.
43. Reichelt, M., Kämmerer, F., Niegemann, H.M., Zander, S., Talk to me personally: Personalization of language style in computer-based learning. Computers in Human Behavior 35 (2014), 199–210.
44. Renkl, A., Learning from worked-out examples: A study on individual differences. Cognitive Science 21:1 (1997), 1–29.
45. Russell, J.A., Core affect and the psychological construction of emotion. Psychological Review 110:1 (2003), 145–172.
46. Sadoski, M., Paivio, A., Imagery and text. A dual coding theory of reading and writing. 2001 (New Jersey: Mahwah).
47. Schallberger, U., Kurzskalen zur Erfassung der Positiven Aktivierung, Negativen Aktivierung und Valenz in Experience Sampling Studien (PANAVA-KS) (Trans.) Short scales for measuring positive activation, negative activation, and valence in experience sampling studien (PANAVA-KS)] Research Report, 2005, Department of Psychology, University of Zurich.
48. Scherer, K.R., (eds.) Enzyklopädie der Psychologie: Psychologie der Emotionen, 1990, Hogrefe, Göttingen.
49. Schmitz, B., Wiese, B.S., New perspectives for the evaluation of training sessions in self-regulated learning: Time-series analyses of diary data. Contemporary Educational Psychology 31:1 (2006), 64–96.
50. Schwarz-Friesel, M., Sprache und Emotion [Language and emotion]. 2013, Francke, Tübingen.
51. Seufert, T., Supporting coherence formation in learning from multiple representations. Learning and Instruction 13 (2003), 227–237.
52. Shuman, V., Scherer, K.R., Concepts and structures of emotions. Pekrun, R., Linnenbrink-Garcia, L., (eds.) International handbook of emotions in education, 2014, Routledge, New York, NY US, 13–35.
53. Song, H., Schwarz, N., If it's difficult to pronounce, it must be risky fluency, familiarity, and risk perception. Psychological Science 20:2 (2009), 135–138.
54. Stark, L., Brünken, R., & Park, B. (accepted). Cued retrospective recall method reveals processes of multimedia learning. In Klopp, E., Schneider, J.F., & Stark, R. (Eds.), Thinking aloud: The mind in action.
55. Sweller, J., Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review 22 (2010), 123–138.
56. Um, E., Plass, J.L., Hayward, E.O., Homer, B.D., Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 2012, 485.
57. Van Gog, T., Paas, F., Van Merrienboer, J.J.G., Witte, P., Uncovering the problem-solving process: Cued retrospective reporting versus concurrent and retrospective reporting. Journal of Experimental Psychology 11 (2005), 237–244.
58. Võ M.L., Conrad, M., Kuchinke, L., Urton, K., Hofmann, M.J., Jacobs, A.M., The Berlin affective word list reloaded (BAWL-R). Behavior Research Methods 41:2 (2009), 534–538.
59. Zimmerman, B.J., Attaining self-regulation. A social cognitive perspective. Boekaerts, M., Pintrich, P.R., Zeidner, M., (eds.) Handbook of self-regulation, 2000, Academic Press, London, UK, 13–39.
60. Zimmerman, B.J., Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal 45:1 (2008), 166–183.