Theoretical and instructional aspects of learning with visualizations

Cognitive Effects of Multimedia Learning

Volumn , Issue , 2008, Pages 67-88

  Scheiter, Katharina ^a   Wiebe, Eric ^b   Holsanova, Jana ^c,d  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

^c LUND UNIVERSITY   (Sweden)

^d Hanse Institute for Advanced Studies   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 69249195934     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60566-158-2.ch005     Document Type: Chapter

References (85)

1. Ainsworth, S. (1999). A functional taxonomy of multiple representations. Computers and Education, 33, 131-152.
2. Ainsworth, S. (2006). DeFT: A conceptual framework for considering learning with multiple representations. Learning and Instruction, 16, 183-198.
3. Alessandrini, K. L. (1987). Computer graphics in learning and instruction. In D. M. Willows & H. A. Houghton (Eds.), The psychology of illustration (Vol. 2, pp. 159-188). New York: Springer.
4. Anglin, G. J., Vaez, H., & Cunningham, K. L. (2004). Visual representations and learning: The role of static and animated graphics. In D. Jonassen (Ed.), Handbook of research on educational communications and technology (pp. 865-916). Mahwah, NJ: Erlbaum.
5. Baggett, P. (1984). Role of temporal overlap of visual and auditory material in forming dual media associations. Journal of Educational Psychology, 76, 408-417.
6. Barthes, R. (1964). Rhétorique de l'image. Communications, 4, 40-51.
7. Bernsen, N. O. (1994). Foundations of multimodal representations: A taxonomy of representational modalities. Interacting with Computers, 6, 347-371.
8. Bertin, J. (1983). Semiology of graphics: Diagrams networks maps (W. J. Berg, Trans.). Madison, WI: University of Wiscons in Press.
9. rd ed.). New York, NY: McGraw-Hill.
10. Bieger, G. R., & Glock, M. D. (1984). The information content of picture-text instructions. The Journal of Experimental Education, 53, 68-76.
11. Bobis, J., Sweller, J., & Cooper, M. (1993). Cognitive load effects in a primary school geometry task. Learning and Instruction, 3, 1-21.
12. Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York: Cambridge University Press.
13. Cook, M. P., Carter, G., & Wiebe, E. N. (2008). The interpretation of cellular transport graphics by students with low and high prior knowledge. International Journal of Science Education 30, 241-263.
14. DeLoache, J. S. (1995). Early understanding and use of symbols: The model model. Current Directions in Psychological Science, 4, 109-113.
15. DeLoache, J. S., Pierroutsakos, S. L., & Uttal, D. H. (2003). The origins of pictorial competence. Current Directions in Psychological Science, 12, 114-118.
16. Eco, U. (1976). A theory of semiotics. Bloomington, IN: Indiana University Press.
17. Gibson, J. J. (1979). The ecological approach to visual perception. Boston, MA: Houghton Mifflin.
18. Gilbert, J. K. (2005). Visualization: A metacognitive skill in science and science education. In J. K. Gilbert (Ed.), Visualization in Science Education (pp. 9-27). Amsterdam: Springer.
19. Goldstone, R. L., & Son, J. Y. (2005). The transfer of scientific principles using concrete and idealized simulations. The Journal of the Learning Sciences, 14, 69-110.
20. Gombrich, E. H. (1969). Art and illusion: A study in the psychology of pictorial representation. Princeton, NJ: Princeton University Press.
21. Goodman, N. (1976). Languages of art: An approach to a theory of symbols (2nd ed.). Indianapolis, IN: Hackett.
22. Hannus, M., & Hyönä, J. (1999). Utilization of illustrations during learning of science textbook passages among low- and high-ability children. Contemporary Educational Psychology, 24, 95-123.
23. Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: A theory of cognitive interest in science learning. Journal of Educational Psychology, 90, 414-434.
24. Hegarty, M., & Sims, V. K. (1994). Individual differences in mental animation during mechanical reasoning. Memory & Cognition, 22, 411-430.
25. Hegarty, M., & Waller, D. A. (2005). Individual Differences in Spatial Abilities. In P. Shah & A. Miyake (Eds.), The Cambridge handbook of visuospatial thinking (pp. 121-169). Cambridge MA: Cambridge University Press.
26. Henderson, J. M. (1992). Visual attention and eye movement control during reading and picture viewing. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 260-283). New York, NY: Springer-Verlag.
27. Hochberg, J. E. (1978). Perception (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
28. Hochberg, J. E., & Brooks, V. (1962). Pictorial recognition as an unlearned ability: A study of one child's performance. American Journal of Psychology, 75, 624-628.
29. Joseph, J. H., & Dwyer, F. M. (1984). The effects of prior knowledge, presentation mode, and visual realism ons tudent achievement. Journal of Experimental Education, 52, 110-121.
30. Knowlton, J. Q. (1966). On the definition of "picture". AV Communication Review, 14, 157-183.
31. Kosslyn, S. M. (1994). Elements of graph design. New York, NY: W.H. Freeman.
32. Kozhevnikov, M., Hegarty, M., & Mayer, R. E. (2002). Revising the visualizer-verbalizer dimension: Evidence for two types of visualizers. Cognition and Instruction, 20, 47-77.
33. Kozhevnikov, M., Kosslyn, S., & Shephard, J. (2005). Spatial versus object visualizers: A new characterization of visual cognitive style. Memory & Cognition, 33, 710-726.
34. Kress, G., & van Leeuwen, T. (1996). Reading images: The grammar of visual design. London: Routledge.
35. Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11, 65-99.
36. Lee, H., Plass, J. L., & Homer, B. D. (2006). Optimizing cognitive load for learning from computer-based science simulations. Journal of Educational Psychology, 98, 902-913.
37. Leutner, D., & Plass, J. L. (1998). Measuring learning styles with questionnaires versus direct observation of preferential choice behavior: Development of the Visualizer/Verbalizer Behavior Observation Scale (VV-BOS). Computers in Human Behavior, 14, 543-557.
38. Levelt, W. J. M. (1981). The speaker's linearization problem. Philosophical Transactions of the Royal Society, Series B, 295, 305-315.
39. Levie, W., & Lentz, R. (1982). Effects of text illustrations: a review of research. Educational Communication and Technology Journal, 30, 195-232.
40. Levin, J. R., Anglin, G. J., & Carney, R. N. (1987). On empirically validating functions of pictures in prose. In D. M. Willows & H. A. Houghton (Eds.), The psychology of illustration (Vol. 1, pp. 51-85). New York: Springer.
41. Logie, R. H. (1995). Visuo-spatial working memory. Hove, UK: Erlbaum.
42. Lohse, G. J., Biolsi, K., Walker, N., & Rueter, H. H. (1994). A classification of visual representations. Communications of the ACM, 37, 36-49.
43. Lowe, R. K. (1999). Extracting information from an animation during complex visual learning. European Journal of Psychology of Education, 14, 225-244.
44. Lowe, R. K. (2003). Animation and learning: Selective processing of information in dynamic graphics. Learning and Instruction, 13, 157-176.
45. MacEachren, A. M. (1995). How maps work: Representation, visualization, and design. New York: Guilford Press.
46. MacEachren, A. M., & Kraak, M.-J. (1997). Exploratory cartographic visualization: Advancing the agenda. Computers and Geosciences, 23, 335-343.
47. Maybury, M. T. (1995). Research in multimedia and multimodal parsing and generation. Artificial Intelligence Review, 9, 103-127.
48. Mayer, R. E. (2005). The Cambridge handbook of multimedia learning. New York, NY: Cambridge University Press.
49. Mayer, R. E., & Massa, L. J. (2003). Three facets of visual and verbal learners: Cognitive ability, cognitive style, and learning preference. Journal of Educational Psychology, 95, 833-846.
50. Mayer, R. E., & Sims, V. K. (1994). For whom is a picture worth ten thousand words? Extensions of a dual-coding theory of multimedia learning. Journal of Educational Psychology, 86, 389-401.
51. Melcher, J. M., & Schooler, J. W. (1996). The misremembrance of wines past: Verbal and perceptual expertise differentially mediate verbal overshadowing of taste memory. Journal of Memory and Language, 35, 231-245.
52. Messaris, P. (1994). Four aspects of visual literacy. In P. Messaris (Ed.), Visual literacy: Image, mind and reality (pp. 1-40). Boulder: Westview Press.
53. Mullet, K., & Sano, D. (1995). Designing visual interfaces. Communication oriented techniques. Englewood Cliffs, NJ: Prentice Hall.
54. Nöth, W. (2003). Press photos and their captions. In H. Lönnroth (Ed.), Från Närpesdialekt till EU-svenska (pp. 169-188). Tampere: Tampere University Press.
55. Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology, 45, 255-287.
56. Palmer, S. E. (1978). Fundamental aspects of cognitive representation. In E. Rosch & B. B. Lloyd (Eds.), Cognition and categorization (pp. 259-303). Hillsdale, NJ: Erlbaum.
57. Patrick, M. D., Carter, G., & Wiebe, E. N. (2006). Visual representations of DNA: A comparison of salient features for experts and novices. Paper presented at the NARST Annual Meeting, San Francisco, CA.
58. Peeck, J. (1987). The role of illustrations in processing and remembering illustrated text. In D. M. Willows & H. A. Houghton (Eds.), The psychology of illustration (Vol. 1, pp. 115-151). New York: Springer.
59. Peirce, C. S. (1960). The icons, index, and symbol (1902): Collected papers. Cambridge, MA: Harvard University Press.
60. Pinker, S. (1990). A theory of graph comprehension. In R. Friedle (Ed.), Artificial intelligence and the future of testing (pp. 73-126). Norwood, NJ: Ablex.
61. Plass, J. L., Chun, D., Mayer, R. E., & Leutner, D. (1998). Supporting visualizer and verbalizer learning preferences in a second language multimedia learning environment. Journal of Educational Psychology, 90, 25-36.
62. Plass, J. L., Chun, D., Mayer, R. E., & Leutner, D. (2003). Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities. Computers in Human Behavior, 19, 211-220.
63. Pozzer, L. L., & Roth, W. M. (2003). Prevalence, function, and structure of photographs in high school biology textbooks. Journal of Research in Science Teaching, 40, 1089-1114.
64. Richardson, A. (1977). Verbalizer-visualizer: A cognitive style dimension. Journal of Mental Imagery, 1, 109-126.
65. Rieber, L. P. (1990). Animation in computer-based instruction. Educational Technology Research & Development, 38, 77-86.
66. Rieber, L. P. (1994). Computers, graphics, and learning. Madison, WI: Brown & Benchmark.
67. Rock, I., & Palmer, S. E. (1990). The legacy of Gestalt psychology. Scientific American, 263(6, Dec.), 84-90.
68. Roth, W.-M., Pozzer-Ardenghi, L., & Han, J. Y. (2005). Critical graphicacy. Understanding visual representation practices in school science. New York: Springer.
69. Salomon, G. (1979). Media and symbol systems as related to cognition and learning. Journal of Educational Psychology, 71, 131-148.
70. Scaife, M., & Rogers, Y. (1996). External cognition: How do graphical representations work? International Journal of Human-Computer Studies, 45, 185-213.
71. Schwartz, D. L. (1995). Reasoning about the referent of a picture versus reasoning about the picture as a referent: An effect of visual realism. Memory & Cognition, 23, 709-722.
72. Shah, P., & Hoeffner, J. (2002). Review of graph comprehension research: Implications for instruction. Educational Psychology Review, 14, 47-69.
73. Shah, P., & Miyake, A. (1996). The separability of working memory resources for spatial thinking and language processing: An individual differences approach. Journal of Experimental Psychology: General, 125, 4-27.
74. Siegler, R. S., & Alibali, M. W. (2005). Children's thinking. Upper Saddle River: Prentice Hall.
75. Stenning, K., & Oberlander, J. (1994). A cognitive theory of graphical and linguistic reasoning: Logic and implementation. Cognitive Science, 19, 96-140.
76. Sweller, J., van Merriënboer, J. J. G., & Paas, F. G. W. C. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251-296.
77. Treisman, A. M., & Gelade, G. (1980). A feature integration theory of attention. Cognitive Psychology, 12, 97-136.
78. Tufte, E. R. (2001). The visual display of quantitative information. Graphics Press.
79. Tversky, B. (2003). Some ways graphics communicate. In K. Nyiri (Ed.), Mobile communication: Essays on cognition and community (pp. 143-156). Wien: Passagen Verlag.
80. Tversky, B., Morrison, J. B., & Betrancourt, M. (2002). Animation: Does it facilitate? International Journal of Human-Computer Studies, 57, 247-262.
81. Twyman, M. (1985). Using pictorial language: A discussion of the dimensions of the problem. In T. M. Duffy & R Waller (Eds.) Designing Usable Texts (pp. 245-312). Orlando, FL: Academic Press.
82. Van Gog, T., Paas, F., & van Merriënboer, J. J. G. (2005). Uncovering expertise-related differences in troubleshooting performance: Combining eye movement and concurrent verbal protocol data. Applied Cognitive Psychology, 19, 205-221.
83. Verdi, M. P., Kulhavy, R. W., Stock, W. A., Rittschof, K., & Johnson, J. T. (1996). Text learning using scientific diagrams: Implications for classroom use. Contemporary Educational Psychology, 21, 487-499.
84. Wickens, C. D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 159-177.
85. Zhang, J. (1997). The nature of external representations in problem solving. Cognitive Science, 21, 179-217.