Assessing learning, quality and engagement in learning objects: The Learning Object Evaluation Scale for Students (LOES-S)

Educational Technology Research and Development

Volumn 57, Issue 2, 2009, Pages 147-168

  Kay, Robin H ^a   Knaack, Liesel ^a  

^a UNIVERSITY OF ONTARIO INSTITUTE OF TECHNOLOGY   (Canada)

Author keywords

Assess; Evaluate; Learning object; Middle school; Quality; Scale; Secondary school

Indexed keywords

EID: 67349211487     PISSN: 10421629     EISSN: 15566501     Source Type: Journal    
DOI: 10.1007/s11423-008-9094-5     Document Type: Article

References (92)

1. M. Acovelli M. Gamble 1997 A coaching agent for learners using multimedia simulations Educational Technology 37 2 44 49
2. Adams, A., Lubega, J., Walmsley, S., & Williams, S. (2004). The effectiveness of assessment learning objects produced using pair programming. Electronic Journal of e-Learning, 2(2). Retrieved July 28, 2005 from http://www.ejel.org/volume-2/vol2-issue2/v2-i2-art1-adams.pdf. (Pubitemid 39204435)
3. Y. Akpinar J. R. Hartley 1996 Designing interactive learning environments Journal of Computer Assisted Learning 12 1 33 46 (Pubitemid 126331654)
4. M. A. Albanese S. A. Mitchell 1993 Problem-based learning: A review of the literature on its outcomes and implementation issues Academic Medicine 68 52 81 (Pubitemid 23064441)
5. F. Alonso G. Lopez D. Manrique J. M. Vines 2005 An instructional model for web-based e-learning education with a blended learning process approach British Journal of Educational Technology 36 2 217 235 (Pubitemid 43906595)
6. L. B. Baruque R. N. Melo 2004 Learning theory and instructional design using learning objects Journal of Educational Multimedia and Hypermedia 13 4 343 370
7. M. Baser 2005 Promoting conceptual change through active learning using open source software for physic simulations Australasian Journal of Educational Technology 22 3 336 354
8. K. Bennett P. McGee 2005 Transformative power of the learning object debate Open Learning 20 1 15 30
9. C. Bradley T. Boyle 2004 The design, development, and use of multimedia learning objects Journal of Educational Multimedia and Hypermedia 13 4 371 389
10. Brown, A. L., & Palinscar, A. S. (1989). Guided, cooperative learning and individual knowledge acquisition. In L. B. Resnick (Ed.), Knowing, learning, and instruction (pp. 393-451). Hillsdale, NJ: Erlbaum Associates.
11. Brown, A. R., & Voltz, B. D. (2005). Elements of effective e-learning design. The International Review of Research in Open and Distance Learning, 6(1). Retrieved June 1, 2007 from http://www.irrodl.org/index.php/irrodl/ article/view/217/300. (Pubitemid 40551162)
12. Bruner, J. (1983). Child's talk. Learning to use language. Toronto, Canada: George J. McLeod Ltd.
13. Bruner, J. (1986). Actual minds, possible worlds. Cambridge, MA: Harvard University Press.
14. T. Brush J. Saye 2001 The use of embedded scaffolds with hypermedia-supported student-centered learning Journal of Educational Multimedia and Hypermedia 10 4 333 356
15. N. A. Buzzetto-More K. Pinhey 2006 Guidelines and standards for the development of fully online learning objects Interdisciplinary Journal of Knowledge and Learning Objects 2006 2 96 104
16. R. Cafolla 2006 Project MERLOT: Bringing peer review to web-based educational resources Journal of Technology and Teacher Education 14 2 313 323
17. L. Calvi 1997 Navigation and disorientation: A case study Journal of Educational Multimedia and Hypermedia 6 3/4 305 320
18. Caws, C., Friesen, N., & Beaudoin, M. (2006). A new learning object repository for language learning: Methods and possible outcomes. Interdisciplinary Journal of Knowledge and Learning Objects, 2, 112-124.
19. P. Chandler J. Sweller 1991 Cognitive load theory and the format of instruction Cognition and Instruction 8 293 332
20. R. J. Chenail 2004 When Disney meets the research park: Metaphors and models for engineering an online learning community of tomorrow Internet and Higher Education 7 2 107 121
21. Chi, M. T. H., & Bassok, M. (1989). Learning from examples via self-explanations. In L. B. Resnick (Ed.), Knowing, learning, and instruction (pp. 251-282). Hillsdale, NJ: Erlbaum Associates.
22. Clarke, O., & Bowe, L. (2006a). The learning federation and the Victorian department of education and training trial of online curriculum content with Indigenous students, pp. 1-14.
23. Clarke, O., & Bowe, L. (2006b). The learning federation and the Victorian department of education and training trial of online curriculum content with ESL students, pp. 1-16.
24. Cochrane, T. (2005). Interactive QuickTime: Developing and evaluating multimedia learning objects to enhance both face-to-face and distance e-learning environments. Interdisciplinary Journal of Knowledge and Learning Objects, 1. Retrieved August 3, 2005 from http://ijklo.org/Volume1/v1p033-054Cochrane.pdf.
25. Collins, A., Brown, J. S., & Newman, S. E. (1989). Cognitive apprenticeship: Teaching the crafts of reading, writing, and mathematics. In L. B. Resnick (Ed.), Knowing, learning, and instruction (pp. 453-494). Hillsdale, NJ: Erlbaum Associates.
26. Convertini, V. C., Albanese, D., Marengo, A., Marengo, V., & Scalera, M. (2006). The OSEL taxonomy for the classification of learning objects. Interdisciplinary Journal of Knowledge and Learning Objects, 2, 125-138.
27. C. Docherty D. Hoy H. Topp K. Trinder 2005 E-Learning techniques supporting problem based learning in clinical simulation International Journal of Medical Informatics 74 7-8 527 533 (Pubitemid 41021916)
28. Downes, S. (2003). Design and reusability of learning objects in an academic context: A new economy of education? USDLA, 17(1). Retrieved June 1, 2007 from http://www.usdla.org/html/journal/JAN03-Issue/article01.html.
29. Field, A. (2005). Discovering statistics using SPSS (2nd ed.). Thousand Oaks, CA: SAGE Publications.
30. N. Friesen T. Anderson 2004 Interaction for lifelong learning British Journal of Educational Technology 35 6 679 687
31. G. Gadanidis J. Gadanidis K. Schindler 2003 Factors mediating the use of online applets in the lesson planning of pre-service mathematics teachers Journal of Computers in Mathematics and Science Teaching 22 4 323 344 (Pubitemid 38497741)
32. G. Gadanidis K. Sedig H. Liang 2004 Designing online mathematical investigation Journal of Computers in Mathematics and Science Technology 23 3 275 298 (Pubitemid 39350653)
33. E. Guadagnoli W. Velicer 1988 Relation of sample size to the stability of component patters Psychological Bulletin 103 265 275
34. Hanna, L., Risden, K., Czerwinski, M., & Alexander, K. J. (1999). The Role of usability in designing children's computer products. In A. Druin (Ed.), The design of children's technology. San Francisco: Morgan Kaufmann Publishers, Inc.
35. S. F. Harp R. E. Mayer 1998 How seductive details do their damage: A theory of cognitive interest in science learning Journal of Educational Psychology 90 3 414 434 (Pubitemid 128134079)
36. Haughey, M., & Muirhead, B. (2005). Evaluating learning objects for schools. E-Journal of Instructional Sciences and Technology, 8(1). Retrieved June 1, 2007 from http://www.usq.edu.au/electpub/e-jist/docs/vol8-no1/ fullpapers/eval-learnobjects-school.htm.
37. A. Holzinger 2004 Rapid prototyping for virtual medical campus interface IEEE Software 21 1 92 99
38. Howard-Rose, D., & Harrigan, K. (2003). CLOE learning impact studies lite: Evaluating learning objects in nine Ontario university courses. Retrieved July 3, 2007 from http://cloe.on.ca/documents/merlotconference10.doc.
39. D. Jonassen D. Churchhill 2004 Is there a learning orientation in learning objects? International Journal on E-Learning 3 2 32 41
40. M. G. Jones J. D. Farquhar D. W. Surry 1995 Using metacognitive theories to design user interfaces for computer-based learning Educational Technology 35 4 12 22
41. R. Kay L. Knaack 2005 Developing learning objects for secondary school students: A multi-component model Interdisciplinary Journal of Knowledge and Learning Objects 2005 1 229 254
42. R. H. Kay L. Knaack 2007 Evaluating the learning in learning objects Open Learning 22 1 5 28
43. Kay, R. H., & Knaack, L. (2007b). Teacher evaluation of learning objects in middle and secondary school classrooms. Retrieved November 1, 2007 from http://faculty.uoit.ca/kay/papers/LOES-Teacher-2007.doc.
44. D. M. Kennedy C. McNaught 1997 Design elements for interactive multimedia Australian Journal of Educational Technology 13 1 1 22 (Pubitemid 127150860)
45. R. F. Kenny B. W. Andrews M. V. Vignola M. A. Schilz J. Covert 1999 Towards guidelines for the design of interactive multimedia instruction: Fostering the reflective decision-making of preservice teachers Journal of Technology and Teacher Education 7 1 13 31
46. L. Kester C. Lehnen P. W. M. Van Gerven P. A. Kirschner 2006 Just-in-time schematic supportive information presentation during cognitive skill acquisition Computers in Human Behavior 22 1 93 116
47. Kline, P. (1999). The handbook of psychological testing (2nd ed.). London: Routledge.
48. S. C. Kong L. F. Kwok 2005 A cognitive tool for teaching the addition/subtraction of common fractions: A model of affordances Computers and Education 45 2 245 265
49. A. Koohang J. Du Plessis 2004 Architecting usability properties in the e-learning instructional design process International Journal on E-Learning 3 3 38 44
50. T. Koppi L. Bogle M. Bogle 2005 Learning objects, repositories, sharing and reusability Open Learning 20 1 83 91
51. B. Kramarski O. Zeichner 2001 Using technology to enhance mathematical reasoning: Effects of feedback and self-regulation learning Education Media International 38 (2/3) 77 82 (Pubitemid 33297034)
52. Krauss, F., & Ally, M. (2005). A study of the design and evaluation of a learning object and implications for content development. Interdisciplinary Journal of Knowledge and Learning Objects, 1. Retrieved June 1, 2007 from http://ijklo.org/Volume1/v1p001-022Krauss.pdf.
53. G. Lopez-Morteo G. Lopez 2007 Computer support for learning mathematics: A learning environment based on recreational learning objects Computers and Education 48 4 618 641
54. C. P. Lim S. L. Lee C. Richards 2006 Developing interactive learning objects for a computing mathematics models International Journal on E-Learning 5 2 221 244
55. A. Lin S. Gregor 2006 Designing websites for learning and enjoyment: A study of museum experiences International Review of Research in Open and Distance Learning 7 3 1 21
56. Littlejohn, A. (2003). Issues in Reusing Online Resources. Journal of Interactive Media in Education, 1, Special Issue on Reusing Online Resources. Retrieved July 1, 2005 from www-jime.open.ac.uk/2003/1/.
57. M. Liu S. Bera 2005 An analysis of cognitive tool use patterns in a hypermedia learning environment Educational Technology, Research and Development 53 1 5 21 (Pubitemid 40447882)
58. MacDonald, C. J., Stodel, E., Thompson, T. L., Muirhead, B., Hinton, C., Carson, B., et al. (2005). Addressing the eLearning contradiction: A collaborative approach for developing a conceptual framework learning object. Interdisciplinary Journal of Knowledge and Learning Objects, 1. Retrieved August 2, 2005 from http://ijklo.org/Volume1/v1p079-098McDonald.pdf.
59. Madhumita, & Kumar, K.L., (1995). Twenty-one guidelines for effective instructional design. Educational Technology, 35(3), 58-61.
60. R. Maslowski A. J. Visscher 1999 Formative evaluation in educational computing research and development Journal of Research on Computing in Education 32 2 239 255
61. R. Mayer R. Moreno 2002 Aids to computer-based multimedia learning Learning and Instruction 12 107 119 (Pubitemid 39659598)
62. McGreal, R. (2004). Learning objects: A practical definition. International Journal of Instructional Technology and Distance Learning, 1(9). Retrieved August 5, 2005 from http://www.itdl.org/Journal/Sep-04/article02.htm.
63. McGreal, R., Anderson, T., Babin, G., Downes, S., Friesen, N., Harrigan, K., et al. (2004). EduSource: Canada's learning object repository network. International Journal of Instructional Technology and Distance Learning, 1(3). Retrieved July 24, 2005 from http://www.itdl.org/Journal/Mar-04/article01.htm.
64. J. A. Muzio T. Heins R. Mundell 2002 Experiences with reusable e-learning objects from theory to practice Internet and Higher Education 2002 5 21 34
65. Nesbit, J., & Belfer, K. (2004). Collaborative evaluation of learning objects. In R. McGreal (Ed.), Online education using learning objects (pp. 138-153). New York: RoutledgeFalmer.
66. Nesbit, J., Belfer, K., & Vargo, J. (2002). A convergent participation model for evaluation of learning objects. Canadian Journal of Learning and Technology, 28(3). Retrieved July 1, 2005 from http://www.cjlt.ca/ content/vol28.3/nesbit-etal.html.
67. Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill.
68. Nurmi, S., & Jaakkola, T. (2005). Problems underlying the learning object approach. International Journal of Instructional Technology and Distance Learning, 2(11). Retrieved April 9, 2007 at http://www.itdl.org/Journal/Nov-05/ article07.htm.
69. S. Nurmi T. Jaakkola 2006 Effectiveness of learning objects in various instructional settings Learning, Media, and Technology 31 3 233 247
70. S. Nurmi T. Jaakkola 2006 Promises and pitfall of learning objects Learning, Media, and Technology 31 3 269 285
71. T. M. Ohl 2001 An interaction-centric learning model Journal of Educational Multimedia and Hypermedia 10 4 311 332
72. R. Oliver C. McLoughlin 1999 Curriculum and learning-resources issues arising from the use of web-based course support systems International Journal of Educational Telecommunications 5 4 419 435
73. P. E. Parrish 2004 The trouble with learning objects Educational Technology Research & Development 52 1 49 67 (Pubitemid 38614431)
74. K. Scheiter P. Gerjets 2007 Learner control in hypermedia environments Educational Psychology Review 19 3 285 307
75. G. P. Schell M. Burns 2002 A repository of e-learning objects for higher education e-Service Journal 1 2 53 64
76. V. Schoner D. Buzza K. Harrigan K. Strampel 2005 Learning objects in use: 'Lite' assessment for field studies Journal of Online Learning and Teaching 1 1 1 18
77. K Sedig H Liang 2006 Interactivity of visual mathematical representations: Factors affecting learning and cognitive processes Journal of Interactive Learning Research. 17 2 179 212
78. S. W. M. Siqueira R. N. Melo M. H. L. B. Braz 2004 Increasing the semantics of learning objects International Journal of Computer Processing of Oriental Languages 17 1 27 39
79. M Sosteric S. Hesemeier 2002 When is a learning object not an object: A first step towards a theory of learning objects International Review of Research in Open and Distance Learning 3 2 1 16 (Pubitemid 38831046)
80. Stevens, J. P. (1992). Applied multivariate statistics for the social science applications (2nd ed.). Hillsdale, NJ: Erlbaum.
81. J. Sweller 1988 Cognitive load during problem solving: effects on learning Cognitive Science 12 257 285
82. J. Sweller J. J. G. van Merriënboer F. Paas 1998 Cognitive architecture and instructional design Educational Psychology Review 10 251 296 (Pubitemid 128116160)
83. H. Vacik B. Wolfslehner J. Spork E. Kortschak 2006 The use of COCOON in teaching silviculture Computers and Education 47 3 245 259 (Pubitemid 44208684)
84. J. Vargo J. C. Nesbit K. Belfer A. Archambault 2003 Learning object evaluation: Computer mediated collaboration and inter-rater reliability International Journal of Computers and Applications 25 3 1 8
85. P. W. M Van Gerven F. Paas H. K. Tabbers 2006 Cognitive aging and computer-based instructional design: Where do we go from here? Educational Psychology Review 18 2 141 157
86. J. J. G. Van Merriënboer P. Ayres 2005 Research on cognitive load theory and its design implications for e-learning Education Theory, Research and Development 53 3 1042 1629
87. Vygotsky, L. S. (1978). Mind in society. Cambridge, MA: Harvard University Press.
88. E. Van Zele P. Vandaele D. Botteldooren J. Lenaerts 2003 Implementation and evaluation of a course concept based on reusable learning objects Journal of Educational Computing and Research 28 4 355 372 (Pubitemid 37291591)
89. D. Wiley S. Waters D. Dawson B. Lambert M. Barclay D. Wade 2004 Overcoming the limitations of learning objects Journal of Educational Multimedia and Hypermedia 13 4 507 521
90. Williams, D. D. (2000). Evaluation of learning objects and instruction using learning objects. In D. A. Wiley (Ed.), The instructional use of learning objects: Online version. Retrieved July 1, 2005 from http://reusability.org/ read/chapters/williams.doc.
91. M. Windschitl T. Andre 1998 Using computer simulations to enhance conceptual change: The roles of constructivist instruction and student epistemological beliefs Journal of Research in Science Teaching 35 2 145 160 (Pubitemid 128459009)
92. K. Zammit 2000 Computer icons: A picture says a thousand words. Or does it? Journal of Educational Computing Research 23 2 217 231 (Pubitemid 33208174)