The evolution of multimedia sound

Computers and Education

Volumn 50, Issue 4, 2008, Pages 1157-1173

  Mann, Bruce L ^a  

^a MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

Author keywords

Attention; Audio; Listening; Media; Modality; Multimedia; Reading; Sound; SSF model

Indexed keywords

AUDIO SYSTEMS; E-LEARNING; MATHEMATICAL MODELS; STUDENTS;

MULTIMEDIA LEARNING ENVIRONMENT; SSF MODEL;

MULTIMEDIA SERVICES;

EID: 41649101819     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2006.11.002     Document Type: Article

References (138)

1. Adams S., Mann B.L., and Schulz H. Can seventh graders learn fractions from a Web-based pedagogical agent? Using comparison groups three times over several weeks. In: Mann B.L. (Ed). Selected styles in web-based educational research (2006), Idea Group Publishing, Hershey, PA 332-346
2. Alessi S., and Trollip S. Computer-based instruction: Methods and development. 4th ed. (1991), Prentice Hall, New Jersey
3. Alkin E.G.M. Sound with vision: Sound techniques for television and film (1973), Butterworth, London
4. Alten S. Audio in media (1981), Wadsworth Publishing, Belmont, CA
5. Andrews, S. E., & Collins, M. A. J. (1993). Computer enhanced learning in biology. In: C. A. Goldman (Ed.). Tested Studies for Laboratory Teaching, Proceedings of the 14th conference of the association for biology laboratory education (Vol. 14, pp. 169-190).
6. Apple Computer (1991). HyperCard 2.0 [Computer software].
7. Asymetrix Corporation (1990). ToolBook 1.0 [Computer software].
8. Baddeley A.D. Working memory (1986), Clarendon, Oxford
9. Baddeley A.D. Working memory. Science 255 (1992) 556-559
10. Baddeley A.D. Is working memory still working?. European Psychologist 7 2 (2002) 85-97
11. Baddeley A.D., and Andrade J. Working memory and the vividness of imagery. Journal of Experimental Psychology: General 129 1 (2000) 126-145
12. Baddeley A.D., and Hitch G. Working memory. In: Bower G.A. (Ed). Recent advances in learning and motivation (1974), Academic Press, New York 47-90
13. Banathy B. Systems design of education: A journey to create the future (1991), Educational Technology Publications, Englewood Cliffs, NJ
14. Barron A., and Kysilka M. The effectiveness of digital audio in computer-based training. Journal of Research on Computing in Education 25 3 (1993) 277-289
15. Bernard R.M., Abrami P.C., Lou Y., Borokhovski E., Wade A., Wozney L., et al. How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Review of Educational Research 74 3 (2004) 379-439
16. Blyth J. Teaching machines and human beings. In: Lumsdaine A., and Glaser R. (Eds). Teaching machines and programmed learning: A sourcebook (1960), Department of Audiovisual Education, National Education Association, Washington, DC 401-415
17. Borich D., and Tombari M. Educational psychology: A contemporary approach (1995), Harper Collins Publishers, NY
18. Boshier R., Mohapi M., Moulton G., Qayyum A., Sadownik L., and Wilson M. Best and worst dressed web courses: strutting into the 21st century in comfort and style. Distance Education 18 2 (1997) 327-349
19. Bordwell D., and Thompson K. Sound in the cinema. Film art: An introduction (1979), Addison-Wesley, Reading, MS
20. Boyd S. Using job aids (2005), ASTD Press
21. Brader L. Tools of the courseware trade: a comparison of ToolBook 1.0 and HyperCard 2.0. TechTrends 35 5 (1990) 10-17
22. Brainerd, C. (1993). Forgetting, reminiscence and aging. Paper presented at The Psychology Department Colloquium, Memorial University, St. John's.
23. Brainerd C., and Reyna V. Gist is the grist: fuzzy trace theory and the new intuitionism. Developmental Review 10 (1990) 3-47
24. Bregman A. Auditory scene analysis: The perceptual organization of sound (1989), The MIT Press, Cambridge, Massachusetts
25. Broadbent D.E., Vines R., and Broadbent M. Recency effects in memory as a function of modality of intervening events. Psychological Research 40 (1978) 5-13
26. Brown A., and Green T. The essentials of instructional design: Connecting fundamental principles with process and practice (2006), Prentice Hall
27. Burkman E. Factors affecting utilization. In: Gange R.M. (Ed). Instructional technology: Foundations (1987), Lawrence Erlbaum, Hillsdale, NJ 429-455
28. Buxton W. Introduction to this special issue on nonspeech audio. Human-Computer Interaction 4 (1989) 1-9
29. Carney R.N., and Levin J.R. Pictorial illustrations still improve students' learning from text. Educational Psychology Review 14 1 (2002) 5-26
30. Case R. Intellectual development: Birth to adulthood (1985), Academic Press, New York
31. Chandler P., and Sweller J. Cognitive load theory and the format of instruction. Cognition and Instruction 8 (1991) 293-332
32. Clark R.E. Reconsidering research on learning from media. Review of Educational Research 43 4 (1983) 445-459
33. Clark, R., (1987). Media and technology: Their present and future roles in education and training. Paper presented at the Symposium for Advances in Instructional Technology, Artificial Intelligence and Information Theory in Education, Concordia University. Montreal.
34. In: Clark R.E. (Ed). Learning from media: Arguments, analysis, and evidence (2001), Information Age Publishing Inc, Greenwich, CT
35. Clark R.E., and Feldon D.F. Five common but questionable principles of multimedia learning. In: Mayer R.E. (Ed). Cambridge handbook of multimedia learning (2005), Cambridge University Press, Cambridge 1-23
36. Christie A. The use of advanced learning technologies in health sciences education. In: Hedberg J.G., and Steele J. (Eds). Educational technology for the clever country: Selected papers from EdTech'92 (1992), AJET Publications, Canberra 49-52. http://www.aset.org.au/confs/edtech92/christie.html
37. Conway J. Information presentation, information processing and the sign vehicle. AV Communication Review 16 4 (1968) 403-414
38. Cowan N., Elliott E., Saults J., Morey C., Mattox S., Hismjatullina A., et al. On the capacity of attention: its estimation and its role in working memory and cognitive aptitudes. Cognitive Psychology 51 (2005) 42-100
39. Crowder N.A. Automatic teaching by intrinsic programming. In: Lumsdaine A.A., and Glaser R. (Eds). Teaching machines and programmed learning: A source book (1960), National Education Association of the United States, Washington, DC 286-298
40. Dale E. Audio-visual methods in teaching (1946), Dryden, New York
41. Daiute C. Writing and computers (1985), Addison Wesley, Reading, MA
42. Dick W., and Carey L. The systematic design of instruction. 4th ed. (1996), Harper Collins, New York
43. Doane M.A. The voice in the cinema: the articulation of body and space. Yale French Studies 60 (1980) 33-50
44. Edmark. Millie's Math House: Computer program (1995), Riverdeep Interactive Learning Limited, San Francisco, CA
45. Goldsmith-Phillips J. Word and context in reading development: a test of the interactive-compensatory hypothesis. Journal of Educational Psychology 81 (1989) 299-305
46. Goswami U. Neuroscience and education. British Journal of Educational Psychology 74 (2004) 1-14
47. Gros B., Elen J., Kerres M., Merriënboer J., and Spector M. Instructional design and the authoring of multimedia and hypermedia systems: Does a marriage make sense?. Educational Technology 37 1 (1997) 48-56
48. Gagné R.M., Briggs L.J., and Wager W.W. Principles of instructional design. 4th ed. (1992), Harcourt Brace Jovanovich College Publishers, Fort Worth, TX
49. Gorbman C. Teaching the soundtrack. Quarterly Review of Film Studies 1 4 (1983) 446-452
50. Hammond N., Gardiner M., Christie B., and Marshall C. The role of cognitive psychology in user-interface design. In: Gardiner M., and Christie B. (Eds). Applying cognitive psychology to user-interface design (1987), Wiley, New York 40-47
51. Hannafin M.J., and Hill J.R. Epistemology and the design of learning environments. In: Reiser R.A., and Dempsey J.V. (Eds). Trends and issues in instructional design and technology. 2nd ed. (2006), Merrill/Prentice Hall, Saddle River, NJ 53-61
52. Hartman F. Single and multiple channel communication: a review of research and a proposed model. AV Communication Review 9 (1961) 245-267
53. Heinich R., Molenda M., Russell J.D., and Smaldino S.E. Instructional media and technologies for learning. 6th ed. (1999), Merrill, Upper Saddle River, NJ
54. Hildyard A., and Olson D.R. On the comprehension of oral vs written discourse. In: Tannen D. (Ed). Spoken and written language: Exploring orality and literacy (1982), Ablex Publishing, Norwood, NJ 19-24
55. Jones J., Morales C., and Knezek G. 3-Dimensional online learning environments: examining attitudes toward information technology between learners in internet-based 3-dimensional and face-to-face classroom instruction. Educational Media International 42 3 (2005) 219-236
56. Kalyuga S. When using sound with a text or picture is not beneficial for learning. Australian Journal of Educational Technology 16 2 (2000) 161-172. http://www.ascilite.org.au/ajet/ajet16/kalyuga.html
57. Kalyuga S., Chandler P., and Sweller J. Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology 1 (1999) 351-371
58. Koroghlanian C., and Klein J. The effect of audio and animation in multimedia instruction. Journal of Educational Multimedia and Hypermedia 13 1 (2004) 23-46
59. Lee S.H., and Boling E. Screen design guidelines for motivation in interactive multimedia instruction: a survey and framework for designers. Educational Technology 39 (1999) 19-26
60. Lepper M.R. Microcomputers in education: motivational and social issues. American Psychologist 40 l (1985) 1-18
61. Levin J.R., Anglin G.J., and Carney R.N. On empirically validating the functions of pictures in prose. In: Willows D.M., and Houghton H.A. (Eds). The psychology of illustration. Basic research Vol. 1 (1987), Springer-Verlag, New York
62. In: Lumsdaine A.A., and Glaser R. (Eds). Teaching machines and programmed learning: A Source Book (1960), National Education Association of the United States, Washington, DC
63. Malone T. Toward a theory of intrinsically motivating instruction. Cognitive Science 4 (1981) 333-369
64. Mann, B. L. (1988). Guidelines for the instructional design of motion picture sound. Masters thesis. Concordia University. Montreal, Canada.
65. Mann, B. L. (1990). Design of the audio channel for computer-based calculus. Research Report No. 1071 lb: To Enhance the quality of selected mathematics courseware by incorporating recent technological advances. Toronto: Department of Measurement, Evaluation and Computer Applications, Ontario Institute for Studies in Education, University of Toronto.
66. Mann B.L. The SSF model: structuring the functions of the sound attribute. Canadian Journal of Educational Communication 21 1 (1992) 45-65
67. Mann, B.L. (1994). Effects of temporal sound on computer-based learning. Doctoral dissertation. University of Toronto, Canada.
68. Mann B.L. Enhancing educational software with audio: assigning structural and functional attributes from the SSF Model. British Journal of Educational Technology 26 1 (1995) 16-29
69. Mann B.L. Focusing attention with temporal sound. Journal of Research on Computing in Education 27 4 (1995) 402-424
70. Mann B.L. Evaluation of presentation modalities in a multimedia system. Computers and Education: An International Journal 28 2 (1997) 133-143
71. Mann B.L. Shifting attention in multimedia: stochastic roles, design principles and the SSF model. Innovations in Education and Training International 34 3 (1997) 174-187
72. Mann B.L. Adding digitized speech to web courses. In: Mann B.L. (Ed). Perspectives in web course management (2000), Canadian Scholar's Press, Toronto, Ont. 135-147
73. Mann B.L. Making your own materials, part II: Multimedia design for learning. International Journal of Instructional Technology and Distance Learning 3 10 (2006)
74. Mann B.L., Newhouse P., Pagram J., Campbell A., and Schulz H. A comparison of temporal speech and text cueing in educational multimedia. Journal of Computer-Assisted Learning 18 3 (2002) 296-308
75. Mann, B.L., Cui, J. & Adams, S. (2002). Learning from Web-based animated pedagogical agents. The 9th International Learning Conference Beijing: China.
76. Matlin M.W. Cognition (1989), Harcourt, Brace, Janovich, New York
77. Mayer R.E., and Moreno R. A split attention effect in multimedia learning: evidence for dual processing systems in working memory. Journal of Educational Psychology 90 2 (1998) 312-320
78. Mayer R.E. Multimedia learning: are we asking the right questions?. Educational Psychologist 32 1 (1997) 1-19
79. Mayer R.E. Multimedia learning (2001), Cambridge University Press, New York
80. Mayer R.E. The promise of multimedia learning: using the same instructional design methods across different media. Learning and Instruction 13 (2003) 125-139
81. MicroSoft Corporation (2006a). Movie Maker 2.1 for Windows [Computer software].
82. MicroSoft Corporation (2006b). Photo Story 3.0 for Windows [Computer software].
83. Moreno R., and Mayer R.E. A coherence effect in multimedia learning: the case for minimizing irrelevant sounds in the design of multimedia instructional messages. Journal of Educational Psychology 97 (2000) 117-125
84. Mousavi S., Low R., and Sweller J. Reducing cognitive load by mixing auditory and visual presentations modes. Journal of Educational Psychology 87 (1995) 319-334
85. Nickerson T. Do children read words better in context or in lists? A classic study revisited. Journal of Educational Psychology 83 (1991) 444-450
86. Norman, D. A., & Shallice, T. (1980). Attention to action: Willed and automatic control of behavior. University of California San Diego, CHIP Report.
87. O'Leary A., and Rhodes G. Cross-modal effects on visual and auditory object perception. Perception and Psychophysics 35 (1984) 565-569
88. Paas F., Renkl A., and Sweller J. Cognitive load theory and instructional implications of the interactions between information structures and cognitive architecture. Instructional Science 32 (2004) 1-8
89. Paine F. Sound design and Walter Murch. University Film Association Journal 33 4 (1981) 15-20
90. Paivio A. Mental representations: A dual coding approach (1986), Oxford University Press, Oxford, UK
91. Pettersson R. Teachers, students and visuals. Journal of Visual Literacy 10 1 (1990) 45-62
92. Piaget, J. (2000). The psychology of the child. New York: Basic Books. (French: Psychologie de l'enfant. Presses. Paris: Presses de Universitaire de France, 1966).
93. Porter D. A report on instructional devices in foreign language teaching. In: Lumsdaine I., and Glaser R. (Eds). Teaching machines and programmed learning: A sourcebook (1960), Department of Audiovisual Education, National Education Association, Washington, DC 186-205
94. Pressley M., and McCormick C. Advanced educational psychology for educators, researchers and policymakers (1995), Harper Collins
95. Prendergast R. Film music: A neglected art (1977), Norton, New York, NY
96. Ragsdale R.G. Permissible computing in education: Values, assumptions and needs (1988), Praeger Books, New York
97. Reinking D. Integrating graphic aids into content area instruction: the graphic information lesson. Journal of Reading 30 2 (1986) 146-151
98. Reinking D. Computers, reading and a new technology of print. In: Reinking D. (Ed). Reading and computers: Issues for theory and practice (1987), Teachers College Press, New York
99. Rieber L.P. Computers, graphics, & learning (1994), Brown & Benchmark, Madison, WI
100. Rieber L., Tzeng S.-C., and Tribble K. Discovery learning, representation and explanation within a computer-based simulation: finding the right mix. Learning and Instruction 14 (2005) 307-323
101. Reigeluth C.M. Instructional design: What is it and why is it?. In: Reigeluth C.M. (Ed). Instructional design models and theories: An overview of their current status Vol. 1 (1983), Lawrence Erlbaum Associates, Hillsdale, NJ 3-36
102. Reigeluth C.M. What is instructional design theory?. In: Reigeluth C.M. (Ed). Instructional design models and theories: A new paradigm of instructional theory Vol. 2 (1999), Lawrence Erlbaum Associates, Hillsdale, NJ 5-29
103. Reiser R.A., and Gagné R.M. Selecting media for instruction (1983), Educational Technology Publiations, Englewood Cliffs, NJ
104. Reyna V. Reasoning, remembering and their social relationship: social, cognitive and developmental issues. In: Howe M., Brainerd C., and Reyna V. (Eds). Development of long term retention (1992), Springer-Verlag, New York 103-132
105. Rossett A., and Schafer L. A handbook of job aids (1991), Pfeiffer & Company Publishing, San Diego
106. Rosenbaum J. Sound thinking. Film Comment 14 (1978) 5
107. Rozier, J. (2000). Hear & There: An augmented reality system of linked audio. Masters thesis. Department of Engineering and Computer Science. Cambridge, MA: MIT.
108. Sadoski M., Paivio A., and Goetz E. Commentary: a critique of schema theory in reading and a dual coding alternative. Reading Research Quarterly 26 (1991) 463-484
109. Salomon G., and Gardner H. The computer as educator: lessons from television research. Educational Researcher (1986) 13-19
110. Schneider W., and Shiffrin R. Controlled and automatic human information processing: detection, search and attention. Psychological Review 84 (1977) 1-66
111. Schramm W. Quality instructional television (1972), University of Hawaii Press, Honolulu, HI
112. Seels B., Fullerton K., Berry L., and Horn L.J. Research on learning from television. In: Jonassen D. (Ed). Handbook of research on educational communications and technology. 2nd ed. (2004), Lawrence Erlbaum Associates, Publishers, Mahwah, NJ 262
113. Seidman S.A. On the contributions of music to media productions. Educational and Communication Technology Journal 29 1 (1986) 49-61
114. Sims R. Beyond instructional design: making learning design a reality. Journal of Learning Design 1 2 (2006) 1-7. http://www.jld.qut.edu.au/
115. Shilling, W. (1991). Kindergarten learners constructing knowledge about literacy using conventional materials and computers. Dissertations Abstracts International, 52(11), SECA, PP3876. (University Microfilms No. ADG92-11460).
116. Sims-Knight J.E. To picture or not to picture: how to decide. Visible Language 26 3 (1992) 325-388
117. Skinner B.F. Teaching machines. Science 128 (1958) 969-977
118. Skinner B.F. Why we need teaching machines. Harvard Educational Review 31 (1961) 377-398
119. Spottiswoode R. A grammar of the film: An analysis of film technique (1950), University of California Press, Berkeley, CA
120. Steelman J. Multimedia makes its mark. Learning and Leading with Technology 33 1 (2005) 16-18
121. Swantes F.M. Children's use of semantic and syntactic information for word recognition and determination of sentence meaningfulness. Journal of Reading Behavior 3 23 (1991) 335-350
122. Sweller J. Cognitive load during problem solving. Cognitive Science 12 (1988) 257-285
123. Sweller J. Instructional design in technical areas (1999), ACER Press, Melbourne, Australia
124. Sweller J., and Chandler J. Why some material is difficult to learn. Cognition and Instruction 12 (1994) 185-233
125. Sweller J., van Merrienboer J., and Paas F. Cognitive architecture and instructional design. Educational Psychology Review 10 3 (1998) 251-296
126. Tannen D. Relative focus on involvement in written and oral discourse. In: Olson D., Torrance N., and Hildyard A. (Eds). Language, literacy and learning: The nature of reading and writing (1985), Cambridge University Press, Cambridge 124-147
127. Tergan S. Misleading theoretical assumptions in hypertext/hypermedia research. Journal of Educational Multimedia and Hypermedia 6 3/4 (1998) 257-283
128. Tom Snyder Productions Inc. (1997). Decisions Decisions: The Environment. [Computer software].
129. Treisman A. Features and objects in visual processing. Scientific American 255 5 (1986) 114B-125B
130. Weiner, R. (1989). Effects of computer-based instruction with and without speech on the acquisition of sight words, Dissertation Abstracts International, 50(12), SECA, PP3921 (University Microfilms No. ADG 90-13582).
131. Weiner R. Computerized speech: a study of its effect on learning. Technological Horizons in Education 2 (1991) 100-102
132. Wild M., and Quinn C. Implications of educational theory for the design on instructional multimedia. British Journal of Educational Technology 29 1 (1998) 73-82
133. Winn W. Perception principles. In: Fleming M., and Levie W.H. (Eds). Instructional message design: Principles from the behavioral and cognitive sciences. 2nd ed. (1993), Educational Technology Publications, Englewood Cliffs, NJ
134. Yang C., Moore D., and Burton J. Managing lessonware production: an instructional theory with a software engineering approach. Educational Technology Research and Development 43 4 (1995) 60-70
135. Yeu H.K., and Goetz E.T. Context effects on word recognition and reading comprehension of poor and good readers: a test of the interactive-compensatory hypothesis. Reading Research Quarterly 29 2 (1994) 178-188
136. Zahn C., Barquero B., and Schwan S. Learning with hyperlinked videos - design criteria and efficient strategies for using audiovisual hypermedia. Learning and Instruction 14 (2004) 275-291
137. Zhang W., Perris K., and Yeung L. Online tutorial support in open and distance learning: learners' perceptions. British Journal of Educational Technology 36 5 (2005) 789-804
138. Zuckerman J. Music in motion pictures: A review of the literature with implications for instructional films (1949), Ennsylvania State College, Instructional Film Research Program, PA