Multi-dimensional students' evaluation of e-learning systems in the higher education context: An empirical investigation

Computers and Education

Volumn 53, Issue 4, 2009, Pages 1285-1296

  Ozkan, Sevgi ^a   Koseler, Refika ^a  

^a MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

Author keywords

e Learning evaluation; e Learning evaluation survey; e Learning information systems; Learning management systems; Statistical analysis; Students' satisfaction

Indexed keywords

E-LEARNING EVALUATION; E-LEARNING EVALUATION SURVEY; LEARNING MANAGEMENT SYSTEMS; STATISTICAL ANALYSIS; STUDENTS' SATISFACTION;

EDUCATION COMPUTING; INFORMATION SYSTEMS; MANAGEMENT; MANAGEMENT INFORMATION SYSTEMS; MULTI AGENT SYSTEMS; MULTIMEDIA SYSTEMS; STUDENTS; SURVEYS; TEACHING;

E-LEARNING;

EID: 69949101389     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2009.06.011     Document Type: Article

References (71)

1. Agarwal R., and Venkatesh V. Assessing a firm's web presence: A heuristic evaluation procedure for the measurement of usability. Information Systems Research 13 2 (2002) 168-186
2. Arbaugh J.B. Managing the on-line classroom: A study of technological and behavioral characteristics of web-based MBA courses. Journal of High Technology Management Research 3 (2002) 203-223
3. Arbaugh J.B., and Duray R. Technological and structural characteristics, student learning and satisfaction with web-based course: An exploratory study of two on-line MBA programs. Management Learning 33 3 (2002) 331-347
4. Arbaugh J.B., and Fich R.B. The importance of participant interaction in online environments. Decision Support Systems 43 2 (2007) 853-865
5. Berge Z.L. Evaluation web-based training programs. In: Khan B.H. (Ed). Web-based training (2000), Educational Technology Publication, Englewood Cliffs, NJ 515-522
6. Bowdish, B., Chauvin, S., & Vigh, S. (1998). Comparing student learning outcomes in hypermedia and analog assisted lectures. In Paper presented at the American Educational Research Association. San Diego, California.
7. Carmines E.G., and Zeller R.A. Reliability and validity assessment. In: Lewis-Beck M. (Ed). Basic measurement (1994), Sage, London 1-58
8. Clouse S.F., and Evans G.E. Graduate business students performance with synchronous and asynchronous interaction e-learning methods. Decision Sciences Journal of Innovative Education 1 2 (2003) 181-202
9. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. (1988), Erlbaum, Hillsdale NJ
10. Collis B. Anticipating the impact of multimedia in education: Lessons from the literature. Computers in Adult Education and Training 2 2 (1995) 136-149
11. Davis F.D., Bagozzi R.P., and Warshaw P.R. User acceptance of computer technology: A comparison of two theoretical models. Management Science 35 8 (1989) 982-1003
12. DeLone W.H., and McLean E.R. The delone and mclean model of information systems success: A ten-year update. Journal of Management Information System 19 4 (2003) 9-30
13. Dillon, C. L.,& Gunawardena, C. N. (1995). A framework for the evaluation of telecommunications-based distance education. In Selected Papers from the 17th Congress of the International Council for Distance Education (Vol. 2, pp. 348-351). Milton Keynes: Open University..
14. Douglas E., and Van Der Vyver G. Effectiveness of e-learning course materials for learning database management systems: An experimental investigation. Journal of Computer Information System 41 4 (2004) 41-48
15. Eccles R.G. The performance measurement manifesto. Harvard Business Review 69 1 (1991) 131-137
16. Fowler F.J. Survey research methods (1993), Sage Publication, Newbury Park, CA
17. García P., Schiaffino S., and Amandi A. An enhanced Bayesian model to detect students' learning styles in web-based courses. Journal of Computer Assisted Learning 24 4 (2008) 305-315
18. Gelderman M. The relation between user satisfaction, usage of information systems and performance. Information Management 34 1 (1998) 11-18
19. Gilbert J. E-learning: The student experience. British Journal of Educational Technology 38 4 (2007) 560-573
20. Granic A. Experience with usability evaluation of e-learning systems. Universal Access in the Information Society 7 4 (2008) 209-221
21. Hayashi A., Chen C., Ryan T., and Wu J. The role of social presence and moderating role of computer self efficacy in predicting the continuance usage of e-learning systems. Journal of Information Systems Education 15 2 (2004) 139-154
22. Haynes R.M., Pouraghabagher R., and Seu A. Interactive distance education alliance (IDEA): Collaborative model delivers on demand. The Journal: Technological Horizons in Education 24 8 (1997) 60-63
23. Hiltz H.R., and Johnson K. User satisfaction with computer-mediated communication systems. Management Science 36 6 (1990) 739-764
24. Hiltz R.S. The virtual classroom: Learning without limits via computer networks (1993), Ablex Corporation Publishing, Norwood, NJ
25. Holsapple C.W., and Lee-Post A. Defining, assessing, and promoting e-learning success: An information systems perspective. Decision Sciences Journal of Innovative Education 4 1 (2006) 67-85
26. Hong K.S., Lai K.W., and Holton D. Students' satisfaction and perceived learning with web-based course. Educational Technology and Society 6 1 (2003) 116-124
27. Islas E., Pérez M., Rodriguez G., Paredes I., Ávila I., and Mendoza M. E-learning tools evaluation and roadmap development for an electrical utility. Journal of Theoretical and Applied Electronic Commerce Research (JTAER) 2 1 (2007) 63-75
28. Jiang M., and Ting E. Course design, instruction, and students' online behaviors: A study of instructional variables and student perceptions of online learning (1998), American Educational Research Association, April. San Diego, CA
29. Johnson R.D., Hornik S., and Salas E. An empirical examination of factors contributing to the creation of successful e-learning environment. International Journal of. Human-Computer Studies 66 5 (2008) 356-369
30. Kaiser H.F. An index of factorial simplicity. Psychometrika 39 1 (1974) 31-36
31. Kaplan-Leiserson, E. (2000). e-Learning glossary. Retrieved April 2008.
32. Khan B. Managing e-learning strategies: Design, delivery, implementation and evaluation (2005), Information Science Publishing, Hershey, London, Melbourne, Singapore
33. Kim S.W., and Lee M.G. Validation of an evaluation model for learning management systems. Journal of Computer Assisted Learning 24 4 (2007) 284-294
34. Konradt U., and Sulz K. The experience of flow in interacting with a hypermedia learning environment. Journal of Educational Multimedia and Hypermedia 10 1 (2001) 69-84
35. Laudon K.C., and Laudon J.P. Management information systems (2000), Prentice Hall International Inc, New Jersey
36. Leidner D.E., and Jarvenpaa S.L. The information age confronts education: Case studies on electronic classroom. Information Systems Research 4 1 (1993) 24-54
37. Levy Y. Assessing the value of e-learning systems (2006), Information Science Publishing, Hersley, London, Melbourne, Singapore
38. Levy Y. Comparing dropouts and persistence in e-learning courses. Computers Education 48 2 (2007) 185-204
39. Liaw S.S., Huang H.M., and Chen G.D. Surveying instructor and learner attitudes toward e-learning. Computers Education 49 4 (2007) 1066-1080
40. Littlejohn A., Falconera I., and Mcgillb L. Characterising effective eLearning resources. Computers & Education 50 3 (2008) 757-771
41. Liu N.K., and Cheng X. An evaluation of the learning of undergraduates using e-learning in a tertiary institution in China. International Journal on E-Learning 7 3 (2008) 427-447
42. Martinez-Torres M.R., Toral Mari{dotless}́nb S.L., Garciab F.B., Vaizquezb S.G., Oliva M.A., and Torres T. A technological acceptance of e-learning tools used in practical and laboratory teaching, according to the European higher education area. Behaviour Information Technology 27 6 (2008) 495-505
43. Mason R., and Rennie F. Using Web 2.0 for learning in the community. Internet and Higher Education 10 3 (2007) 196-203
44. Namc K., Leeb S.G., and Lima H. Validating E-learning factors affecting training effectiveness. International Journal of Information Management 27 1 (2007) 22-35
45. Ozkan S., Koseler R., and Baykal N. Evaluating learning management systems: Adoption of hexagonal e-learning assessment model in higher education. Transforming Government: People, Process and Policy 3 2 (2009) 111-130
46. Papp, R. (2000). Critical success factors for distance learning. In Paper presented at the Americas conference on information system. Long Beach, CA, USA.
47. Passerini K., and Granger M.J. A developmental model for distance learning using the Internet. Computers Education 34 1 (2000) 1-15
48. Pawlowski J. Reusable models of pedagogical concepts - A framework for pedagogical and content design. In: Rebelsky P.B. (Ed). Proceedings of world conference on educational multimedia, hypermedia and telecommunications (2002), AACE, Chesapeake, VA 1563-1568
49. Piccoli G., Ahmad R., and Ives B. Web-based virtual learning environments: a research framework and a preliminary assessment of effectiveness in basic IT skills training. MIS Quarterly 25 4 (2001) 401-426
50. Rosenberg M.J. Beyond e-learning: Approaches and technologies to enhance organizational knowledge, learning and performance (2006), Pfeiffer, San Francisco
51. Safran C., Helic D., and Gütl C. E-learning practices and Web 2.0. ICL2007 (2007), Villach, Austria
52. Seddon P.B. A respecification and extension of the DeLone and McLean Model of IS success. Information Systems Research 8 3 (1997) 240-253
53. Selim H.M. Critical success factors for e-learning acceptance: Confirmatory factor models. International Journal of Technology Marketing 2 2 (2007) 157-182
54. Sethy S.S. Distance education in the age of globalization: An overwhelming desire towards blended learning. Turkish Online Journal of Distance Education-TOJDE 9 3 (2008) 1302-6488
55. Shee D.Y., and Wang Y.S. Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers Education 50 3 (2008) 894-905
56. Shumarova, E. & Swatman, P. A. (2007). eValue and Value-driven user responses to information technology. Electronic Markets, 17(1), 5-9.
57. Ssemugabi, S., & De Villiers, M. R. (2007). Usability and learning: A framework for evaluation of web-based e-learning applications. In World conference on educational multimedia, hypermedia and telecommunication (pp. 906-913).
58. Ssemugabi, S., Villiers, R. (2007). A comparative study of two usability evaluation methods using a web-based e-learning application. In ACM International Conference Proceeding Series (vol. 226, pp. 132-142). Port Elizabeth, South Africa: South African institute of computer scientists and information technologists on IT research in developing countries.
59. Sun P.C., Tsai R.S., Finger G., Chen Y.Y., and Yeh D. What drives a successful e-learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers Education 50 4 (2008) 1183-1202
60. Tabachnick B.G., and Fidell L.S. Using multivariate statistics. 5th ed. (2007), Allyn and Bacon, Boston
61. Thurmond V.A., Wambach K., and Connors H.R. Evaluation of student satisfaction: Determining the impact of a web-based environment by controlling for student characteristics. The American Journal of Distance Education 16 3 (2002) 169-189
62. Torkzadeha G., and Van Dykeb T.P. Computers in Human Behavior 18 5 (2002) 479-494
63. Ullrich, C., Borau, K., Luo, H., Tan, X., Shen, L., & Shen, R. (2008). Why Web 2.0 is good for learning and for research: Principles and prototypes. In WWW 2008 (pp. 705-714). Beijing, China.
64. Volery T., and Lord D. Critical success factors in online education. The International Journal of Educational Management 14 5 (2000) 216-223
65. Wang S., Liaw S., and Wang Y.S. Assessment of learner satisfaction with asynchronous electronic learning systems. Information Management Journal 41 1 (2003) 75-86
66. Wang Y.S., Wang H.Y., and Shee D.Y. Measuring e-learning systems success in an organizational context: Scale development and validation. Computers in Human Behavior 23 1 (2007) 1792-1808
67. Webster J., and Hackley P. Teaching effectiveness in technology-mediated distance learning. Academy of Management Journal 40 6 (1997) 1282-1309
68. Weller, M. (2006). VLE 2.0 and future directions in learning environments. In Proceedings of The First International LAMS Conference 2006 (pp. 99-106).
69. Wu J.H., Tennyson R.D., and Hsia T.L. Analysis of E-learning innovation and core capability using a hypercube model. Computers in Human Behavior 24 5 (2008) 1851-1866
70. Zaharias P., and Poulymenakou A. Identifying training needs for ict skills enhancement in south-eastern Europe: Implications for designing web-based training courses. Educational Technology and Society 6 1 (2003) 27-39
71. Zoltan E., and Chapanis A. What do professional persons think about computers?. Behavior and Information Technology 1 1 (1982) 55-68