UseLearn: A novel checklist and usability evaluation method for eLearning systems by criticality metric analysis

International Journal of Industrial Ergonomics

Volumn 40, Issue 4, 2010, Pages 455-469

  Oztekin, Asil ^a   Kong, Zhenyu James ^a   Uysal, Ozgur ^b  

^a Oklahoma State University   (United States)

^b FATIH UNIVERSITY   (Turkey)

Author keywords

Criticality metric analysis; ELearning (web based learning distance learning); Structural equation modeling; Usability evaluation checklist

Indexed keywords

ADAPTIVE SELECTION; CRITICALITY METRIC ANALYSIS; DESIGN STAGE; E-LEARNING PLATFORMS; END-USERS; METRIC ANALYSIS; QUANTITATIVE METHODOLOGY; STRUCTURAL EQUATION MODELING; USABILITY EVALUATION; USABILITY EVALUATION METHODS; USABILITY PROBLEMS; WEB BASED;

CRITICALITY (NUCLEAR FISSION); DESIGN; STRUCTURAL ANALYSIS; USABILITY ENGINEERING;

QUALITY CONTROL;

ARTICLE; CHECKLIST; COMPUTER PROGRAM; EDUCATIONAL TECHNOLOGY; HUMAN COMPUTER INTERACTION; INSTRUMENT VALIDATION; LEARNING ENVIRONMENT; LEARNING STYLE; MATHEMATICAL MODEL; ONLINE SYSTEM; PRIORITY JOURNAL; PROCESS DESIGN; QUALITY CONTROL; STRUCTURAL EQUATION MODELING; STUDENT SATISFACTION; TEACHING; TOTAL QUALITY MANAGEMENT;

EID: 77953082824     PISSN: 01698141     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ergon.2010.04.001     Document Type: Article

References (56)

1. Ardito C., Marsico M.D., Lanzilotti R., Levialdi S., Roselli T., Rossano V., Tersigni M. Usability of eLearning tools. Proceedings of the working conference on Advanced visual interfaces 2004, 80-84. ACM Press.
2. Babiker E.M., Fujihara H., Boyle C.D.B. A metric for hypertext usability. Proceedings of 11th Annual International Conference on Systems documentation 1991, 95-104. ACM Press.
3. Barcellini F., Françoise D., Burkhardt J.-M. Participation in online interaction spaces: design-use mediation in an open source software community. International Journal of Industrial Ergonomics 2009, 39(3):533-540.
4. Beebe M.A. Quality assessment rubric for eLearning design Available from:. http://cvs.uwc.ac.za/kewl_documentation/manuals/Doucuments%2520for%2520training/Rubric4eLearningDesign.pdf.
5. Bentler P.M. EQS Structural Equations Program Manual 1995, Multivariate Software, Encino, CA.
6. Bevan N. Measuring usability as quality of use. Journal of Software Quality 1995, 4:115-140.
7. Bevan N. Quality in use: meeting user needs for quality. Journal of Systems and Software 1999, 49(1):89-96.
8. Brooke J. SUS: a " quick and dirty" usability scale. Usability Evaluation in Industry 1996, 189-194. Taylor and Francis, London. P. Jordan, B. Thomas, B. Weerdmeester (Eds.).
9. Chin J.P., Diehl V.A., Norman K.L. Development of an instrument measuring user satisfaction of the human-computer interface. Proceedings of CHI'88 1988, 213-218. ACM Press, Washington, D.C.
10. Chiu C.M., Hsu M.H., Sun S.Y., Lin T.C., Sun P.C. Usability, quality, value and e-learning continuance decisions. Computers & Education 2005, 45:399-416.
11. Delice E.K., Güngör Z. The usability analysis with heuristic evaluation and analytic hierarchy process. International Journal of Industrial Ergonomics 2009, 39(6):934-939.
12. Downey S., Wentling R.M., Wentling T., Wadsworth A. The relationship between national culture and the usability of an E-learning system. Human Resource Development International 2005, 8:47-64.
13. Dringus, L.P., Cohen, M.S., 2005. An adaptable Heuristic Checklist for Online Courses, Frontiers in Education Proceedings 35th ASEE/IEEE Annual Conference, T2H-6-11.
14. Folmer E., Bosch J. Architecting for usability: a survey. Journal of Systems and Software 2004, 70(1-2):61-78.
15. Frokjaer, E., Hertzum, M., Hornbaek, K., 2000. Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: Proceedings of the ACM CHI 2000 Conference on Human Factors in Computing Systems 2(1), pp. 345-352.
16. Hair J.F., Black B., Babin B., Anderson R., Tatham R. Multivariate Data Analysis 2005, Prentice Hall, New Jersey, USA. sixth ed.
17. Hope A., Guiton P. Strategies for Sustainable Open and Distance Learning 2006, Routledge Taylor and Francis Group, Madison Ave., New York.
18. Hornbaek K. Current practice in measuring usability: challenges to studies and research. International Journal of Human-Computer Studies 2006, 64(2):79-102.
19. Hsu C.M., Yeh Y.C., Yen J. Development of design criteria and evaluation scale for web-based learning platforms. International Journal of Industrial Ergonomics 2009, 39(1):90-95.
20. Hu L.T., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6(1):1-55.
21. IEEE, 1998. IEEE Standard 161: Standard for a Software Quality Metrics Methodology.
22. ISO/IEC, 1991. ISO 9126: Information Technology - Software Quality Characteristics and Metrics.
23. ISO/IEC, 1999. ISO 14598-1, 99: Software Product Evaluation - General Overview.
24. ISO, 1998. ISO 9241-11, 98: Ergonomic Requirements for Office Work With Visual Display Terminals (VDTs)-Part 11: Guidance on Usability.
25. ISO, 1999. ISO 13407, 99: Human-centered design processes for interactive systems.
26. Jöreskog K.G. A general method for analysis of covariance structure. Biometrika 1970, 57(2):239-251.
27. Jöreskog K., Sorbom D. LISREL 8.8: User's Reference Guide 2008, Scientific Software International, Inc., Chicago.
28. Juristo N., Moreno A.M., Sanchez-Segura M.I. Analyzing the impact of usability on software design. Journal of Systems and Software 2007, 80(9):1506-1516.
29. Keevil B. Measuring the usability index of your web site. Proceedings of the 16th Annual International Conference on Computer Documentation 1998, 271-277. SIGDOC - ACM Press.
30. Kirakowski J. The Software Usability Measurement Inventory (SUMI): Background and usage. Usability Evaluation in Industry 1996, 169-178. Taylor and Francis, London. P. Jordan, B. Thomas, B. Weerdmeester (Eds.).
31. Kline R.B. Principles and Practice of Structural Equation Modeling 2005, The Guilford Press, New York, USA. second ed.
32. Likert R. A technique for the measurement of attitudes. Archives of Psychology 1932, 140:1-55.
33. Macleod M., Rengger R. The Development of DRUM: A Software Tool for Video-assisted Usability Evaluation, People and Computers VII 1993, Cambridge University Press.
34. Matera M., Costabile M.F., Garzotto F., Paolini P. SUE inspection: an effective method for systematic usability evaluation of hypermedia. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 2002, 32(1):93-103.
35. McGee M. Master usability scaling: magnitude estimation and master scaling applied to usability measurement. Proceedings of CHI 2004 2004, 335-342. ACM Press, Washington, D.C.
36. McIntosh A.R., Gonzalez-Lima F. Structural equation modeling and its application to network analysis in functional brain imaging. Human Brain Mapping 1994, 2(1-2):2-22.
37. McNamara P. Usability and eLearning, final coursework essay: certificate in online education and training, institute of education, University of London Available from:. http://nte.unifr.ch/IMG/pdf/PMcNamaraUsabilityElearning.pdf.
38. Miller M.J. Usability in eLearning, ASTD's Source for eLearning, Learning Circuit Available from:. http://www.astd.org/LC/2005/0105_miller.htm.
39. Molich R., Nielsen J. Improving a human-computer dialogue. Communications of the ACM 1990, 33:338-348.
40. Moodle. A Free Open Source Course Management System for Online Learning. and http://moodle.fatih.edu.tr.
41. Nielsen J. Usability Engineering 1993, Academic Press Professional, Boston, MA.
42. Nielsen J., Mack R.L. Usability Inspection Methods 1994, John Wiley&Sons, New York.
43. Nikov, A., 2007. Neuro-fuzzy methods and systems for evaluation and design in ergonomics and human-computer interaction, Shaker, Aachen, Germany.
44. Nunnally J.C. Psychometric Theory 1978, McGraw-Hill, New York, NY. second ed.
45. Oztekin A., Nikov A., Zaim S. UWIS: an assessment methodology for usability of web-based information systems. Journal of Systems and Software 2009, 82(12):2038-2050.
46. Parlangeli O., Marchigiani E., Bagnara S. Multimedia systems in distance education: effects of usability on learning. Interacting with Computers 1999, 12:37-49.
47. Payne A.M., Stephenson J.E., Morris W.B., Tempest H.G., Mileham A., Griffin D.K. The use of an e-learning constructivist solution in workplace learning. International Journal of Industrial Ergonomics 2009, 39(3):548-553.
48. Rengger R., Macleod M., Bowden R., Drynan A., Blaney M. MUSiC Performance Measurement Handbook 1993, National Physical Laboratory, DITC, Teddington, UK.
49. Satorra A., Bentler P.M. Corrections to test statistics and standard errors in covariance structure analysis. Latent Variables Analysis: Applications for Developmental Research 1994, Sage, Newsbury Park, CA. A. von Eye, C.C. Clogg (Eds.).
50. Sauro J., Kindlund E. A Method to Standardize Usability Metrics into a Single Score, CHI Papers: Methods & Usability 2005, ACM Press, Portland, Oregon.
51. Schneidermen B. Designing the User Interface: Strategies for Effective Human-Computer Interaction 1998, Addison Wesley, Menlo Park, CA. third ed.
52. Schumacker R.E., Lomax R.G. A Beginner's Guide to Structural Equation Modeling 1996, Lawrence Erlbaum Associates, Mahwah, NJ, USA.
53. Seffah A., Mohamed T., Habieb-Mammar H., Abran A. Reconciling usability and interactive system architecture using patterns. Journal of Systems and Software 2008, 81(11):1845-1852.
54. Squires D., Preece J. Predicting quality in educational software: evaluating for learning, usability, and the synergy between them. Interacting with Computers 1999, 11:467-483.
55. Storey M.A., Phillips B., Maczewski M., Wang M. Evaluating the usability of web-based learning tools. Educational Technology & Society 2002, 5:91-103.
56. Villiers R.D. Usability evaluation of an E-Learning tutorial: criteria, questions and case study. ACM International Conference Proceeding Series 2004, vol. 75. pp. 284-291.