A comparative study of two usability evaluation methods using a web-based e-learning application

ACM International Conference Proceeding Series

Volumn 226, Issue , 2007, Pages 132-142

  Ssemugabi, Samuel ^a   De Villiers, Ruth ^b  

^a WALTER SISULU UNIVERSITY   (South Africa)

^b UNIVERSITY OF SOUTH AFRICA   (South Africa)

Author keywords

E learning; Evaluation criteria; Heuristic evaluation; Human computer interaction; Questionnaire survey; Usability evaluation; Usability evaluation methods; Web based learning

Indexed keywords

HEURISTIC ALGORITHMS; HUMAN COMPUTER INTERACTION; PROBLEM SOLVING; USABILITY ENGINEERING; WEB SERVICES;

EVALUATION CRITERIA; HEURISTIC EVALUATION; QUESTIONNAIRE SURVEY; USABILITY EVALUATION; USABILITY EVALUATION METHODS; WEB BASED LEARNING;

E-LEARNING;

EID: 41149143555     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1292491.1292507     Document Type: Conference Paper

References (43)

1. Albion, P.R. 1999. Heuristic Evaluation of Multimedia: From Theory to Practice. http://www.usq.edu.au/users/albion/papers/ascilite99.html.
2. Ardito, C., Costabile, M.F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T. & Rossano, V. 2006. An Approach to Usability Evaluation of E-Learning Applications. Universal Access in the Information Society, 4(3): 270-283.
3. Avouris, N., Tselios, N., Fida, C. & Papachristos, E. 2003. Website Evaluation: A usability-Based Perspective. In: Y. Manolopoulos, S. Evripidou & A.C. Kakas. (Eds), Lecture Notes in Computer Science. Vol 2563: Advances in Informatics, 8th Panhellenic Conference on Informatics: 217-232. Berlin: Springer-Verlag.
4. Belkhiter, N., Boulet, M., Baffoun, S. & Dupuis, C. 2003. Usability Inspection of the ECONOF System's User Interface Visualization Component. In: C. Ghaoui. (Ed.), Usability Evaluation of Online Learning Programs. Hershey, P.A.: Information Science Publishing.
5. Blandford, A., Keith, S., Connell, I. & Edwards, H. 2004. Analytical Usability Evaluation for Digital Libraries: A Case Study. In: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries 2004: 27-36. Tucson: ACM Press.
6. Brinck & Wood. 2002. Usability for the Web: Designing Web Sites that Work. San Francisco: Morgan Kaufmann Publishers, (2002).
7. Costabile, M.F, De Marsico, M., Lanzilotti, R., Plantamura, V.L. & Roselli, T. 2005. On the Usability Evaluation of E-Learning Applications. In: Proceedings of the 38th Hawaii International Conference on System Science: 1-10. Washington: IEEE Computer Society.
8. De Villiers, R. 2006. Multi-Method Evaluations: Case Studies of an Interactive Tutorial and Practice System. In: Proceedings of In SITE 2006 Conference. Manchester, United Kingdom.
9. Dix, A.J., Finlay, J.E., Abowd, G.D. & Beale, R. 2004. Human-Computer Interaction. 3rd Ed. Harlow Assex: Pearson Education Limited.
10. Fitzpatrick, R. 1999. Strategies for Evaluation of Software Usability. http://www.comp.dit.ie/rfitzpatrick/papers/chi99%20strategies.pdf
11. Gillham, B. 2000. Case Study Research Methods. London: Bill Gillham.
12. Gillham, B. 2000. Developing a Questionnaire. London: Bill Gillham.
13. Gray, W.D. & Salzman, M.C. 1998. Repairing Damaged Merchandise: A Rejoinder. Human-Computer Interaction 13 (3): 325-335.
14. Hartson, H.R., Andre, T.S. & Williges, R.C. 2003. Criteria for Evaluating Usability Evaluation Methods. International Journal of Human-Computer Interaction, 15(1): 145-181.
15. Hosie, P. & Schibeci, R. 2001. Evaluating Courseware: A need for more context bound evaluations? Australian Educational Computing, 16(2):18-26.
16. ISO. 1998. ISO-9241: Guidance on Usability Standards. http://www.iso.ch/iso/en/CatalogueListPage.CatalogueList?ICS1=13&ICS2=180.
17. Jackson,R.H. 2004. Weblearning Resources. hhttp://www. knowledgeability.biz/webleaming/default.htm.
18. Jones, A., Scanlon, E., Tosunoglu, C., Morris, E., Ross, S., Butcher, P. & Greenberg, J. 1999. Contexts for Evaluating Educational Software. Interacting with Computers, 11(5): 499-516.
19. Karoulis, A. & Pombortsis, A. 2003. Heuristic Evaluation of Web-Based ODL Programs. In: C. Ghaoui. (Ed.), Usability Evaluation of Online Learning Programs. Hershey, P.A.: Information Science Publishing.
20. Kjeldskov, J., Skov, M.B. & Stage, J. 2004. Instant Data Analysis: Conducting Usability Evaluations in a Day. In: Proceedings of the third Nordic Conference on Human-Computer Interaction: 233-240. Tampere: ACM International Conference Proceeding Series.
21. Law, L.C. & Hvannberg, E.T. 2002. Complementarity and Convergence of Heuristic Evaluation and Usability Test: A Case Study of Universal Brokerage Platform. Proceedings of the Second Nordic Conference on Human-computer Interaction: 71-80. Arhus: ACM International Conference Proceeding Series.
22. Law, L.C. & Hvannberg, E.T. 2004. Analysis of combinatorical user effect in international usability tests. Proceedings of CHI2004: 9-16.
23. Levi, M.D. & Conrad, F.G. 1996. A Heuristic Evaluation of a World Wide Web Prototype. Interactions, 3(4): 50-61.
24. Lindgaard, G. 2004. Are the Notions of Thoroughness, Efficiency, and Validity Valid in HCI Practice?. http://www.carleton.ca/hotlab/hottopics/ Articles/Gitte_usability.html.
25. Masemola, S.S. & De Villiers, M.R. 2006. Towards a Framework for Usability Testing of Interactive E-Learning Applications in Cognitive Domains, Illustrated by a Case Study. In: J. Bishop & D. Kourie. Service-Oriented Software and Systems. Proceeding of SAICSIT 2006: 187-197. ACM International Conference Proceedings Series.
26. Nielsen, J. 1992. Finding Usability Problems through Heuristic Evaluation. In: Proceedings of the SIGCHI Conference on Human factors in Computing Systems: 373-380. Monterey: ACM Press.
27. Nielsen, J. 1994. Heuristic Evaluations. In: J. Nielsen & R.L. Mack. (Eds), Usability Inspection Methods. New York: John Wiley & Sons.
28. Nielsen, J. & Molich, R. 1990. Heuristic Evaluation of User Interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Empowering People: 249-256. Seattle: ACM Press.
29. Olivier, M.S. 2003. Information Technology Research. Johannesburg: Van Schaik.
30. Parlangeli, O., Marchingiani, E. & Bagnara, S. 1999. Multimedia in Distance Education: Effects of Usability on Learning. Interacting with Computers, 12(1): 37-49.
31. Peng, L.K., Ramaiach, C.K, & Foo, S. 2004. Heuristic-Based User Interface Evaluation at Nanyang Technological University in Singapore. Program: Electronic Library and Information Systems, 38 (1): 42-59.
32. Pierotti, D. 1996. Usability Techniques: Heuristic Evaluation Activities. http://www.stcsig.org/usability/topics/articles/he-activities. html.
33. Preece, J., Rogers, Y. & Sharp, H. 2002. Interaction Design: Beyond Human-Computer Interaction. New York: John Wiley & Sons.
34. Reeves, T.C. & Reeves, P.M. 1997. Effective Dimensions of Interactive Learning on the World Wide Web. In: B.H. Khan. (Ed.), Web-Based Instruction. New Jersey: Educational Technology Publications.
35. Shneiderman, B. & Plaisant, C. 2005. Designing the User Interface: Strategies for Effective Human-Computer Interaction. 4rd Ed. New York: Addison-Wesley.
36. Squires, D. & Preece, J. 1999. Predicting Quality in Educational Software: Evaluating for Learning, Usability and the Synergy Between them. Interacting with Computers, 11(5): 467-483.
37. Ssemugabi, S. 2006. Usability Evaluation of a Web-Based E-Learning Application: A Study of Two Evaluation Methods. MSc Dissertation, University of South Africa.
38. Ssemugabi, S. & De Villiers, M.R. 2007. Usability and Learning: A Framework for Evaluation of Web-Based E-Leaming Applications. In: Proceedings of the ED-MEDIA 2007 - World Conference on Educational Multimedia, Hypermedia & Telecommunications: 906-913. Vancouver, Canada.
39. Storey, M.A, Phillips, B., Maczewski, M. & Wang, M. 2002. Evaluating the Usability of Web-Based Learning Tools. Educational Technology & Society, 5(3):91-100.
40. Van Greunen, D. And Wesson, J L. 2002. Formal usability testing of interactive educational software: A case study. World Computer Congress (WCC): Stream 9: Usability. Montreal, Canada, August 2002.
41. Vrasidas, C. 2004. Issues of Pedagogy and Design in E-learning System. In: ACMSymposium on Online Learning: 911-915. Nicosia: ACM Press.
42. Wesson, J.L. & Cowley, N. L. 2003. The Challenge of Measuring E-Learning Quality: Some Ideas from HCI. IFIP TC3/WG3.6 Working Conference on Quality Education @ a Distance: 231-238. Geelong, Australia.
43. Zaharias, P. 2006. A Usability Evaluation Method for E-Learning: Focus on Motivation to Learn. In: CHI '06 Extended Abstracts on Human Factors in Computing Systems: 1571-1576. Montreal: ACM Press.