Usability in the context of e-learning: A framework augmenting 'traditional' usability constructs with instructional design and motivation to learn

International Journal of Technology and Human Interaction

Volumn 5, Issue 4, 2009, Pages 37-59

  Zaharias, Panagiotis ^a  

^a NONE

Author keywords

Affective learning; E learning applications; Instructional design; Motivation to learn; Usability design and evaluation

Indexed keywords

ADULT LEARNERS; AFFECTIVE FACTORS; AFFECTIVE LEARNING; ARCS MODEL; E-LEARNING APPLICATION; E-LEARNING APPLICATIONS; END USERS; INSTRUCTIONAL DESIGN; INSTRUCTIONAL DESIGNS; LEARNING EFFECTIVENESS; USABILITY DESIGN AND EVALUATION; USABILITY EVALUATION METHODS; WEB USABILITY;

DESIGN; E-LEARNING; MOTIVATION; MULTIMEDIA SYSTEMS;

EDUCATION;

EID: 70350070454     PISSN: 15483908     EISSN: 15483916     Source Type: Journal    
DOI: 10.4018/jthi.2009062503     Document Type: Article

References (110)

1. Al-Hunaiyyan, A., Hewitt, J., Jones, S., & Messer, D. (2001). The Evaluation of Multimedia Encyclopedia "Encarta 97". In Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications, (1), 27-28.
2. Alexander, S., McKenzie, J., & Geissinger, H. (1998). An evaluation of information technology projects for university learning. Online archive available at: [http://services.canberra.edu.au/CUTSD/announce/ExSumm.html].
3. ASTD (2001). The ASTD Institute E-learning Courseware Certification (ECC) Standards. Online archive available at: [http://www.astd.org/astd/Marketplace/ ecc/standards.htm]
4. Bates, A. W. (1995). Technology, Open Learning and Distance Education. London: Routeledge.
5. Bolman, C., Tattersall, C., Waterink, W., Janssen, J., van den Berg, B., van Es, R., & Koper, R. (2007). Learners' evaluation of a navigation support tool in distance education. Journal of Computer Assisted Learning, 23(5), 384-392. doi:10.1111/j.1365-2729.2007.00223.x
6. Bonk, C. J. (2002). Online training in an online world. Bloomington, IN: CourseShare.com.
7. Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32-41.
8. Cercone, K. (2008). Characteristics of adult learners with implications for online learning design. AACE Journal, 16(2), 137-159.
9. Chua, J. (2002). Quality Criteria for E-Learning Courseware. Online archive available at: [http://www.ecc.org.sg/cocoon/ecc/website/qualitycriteria. pdf].
10. Clark, R. C., & Mayer, R. E. (2003). E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. San Francisco, CA: Jossey-Bass/Pfeiffer.
11. Clark, R. E. (2002). Applying Cognitive Strategies to Instructional Design. Performance Improvement, 41(7), 8-14. doi:10.1002/pfi.4140410704
12. Csikszentmihaly, M. (1975). Beyond boredom and anxiety. San Francisco, CA: Jossey-Bass.
13. Davis, S., & Wiedenbeck, S. (2001). The mediating effects of intrinsic motivation, ease of use and usefulness perceptions on performance in first-time and subsequent computer users. Interacting with Computers, 13, 549-580. doi:10.1016/S0953-5438(01)00034-0 (Pubitemid 32509336)
14. Diaz, D. P. (2002, May/June). Online Drop Rates Revisited. The Technology Source. archive available at: [http://ts.mivu.org/default.asp?show= article&id=981]
15. th ed.). New York: Harper Collins College Publishers.
16. Dillenbourg, P. (1999). Introduction: What do you mean by "collaborative learning"? In P. Dillenbourg (Ed.), Collaborative learning. Cognitive and computational approaches. Advances in Learning and Instruction Series (pp. 1-19). Amsterdam: Pergamon.
17. Dringus, L. (1995b). Interface Issues Associated with Using the Internet As a Link to Online Courses. Journal of Interactive Instruction Development (pp. 16-20).
18. nd ed.). San Francisco, CA: Jossey-Bass/Pfeiffer.
19. Evans, C., & Edwards, M. (1999). Navigational interface design for multimedia courses. Journal of Computers in Mathematics and Science Teaching, 8(2), 151-174.
20. Feldstein, M. (2002, September). What is "usable" e-learning? ACM eLearn Magazine, 9.
21. Ford, N., & Chen, S. Y. (2000). Individual differences, hypermedia navigation and learning: An empirical study. Journal of Educational Multimedia and Hypermedia, 9(4), 281-312.
22. Ganzel, R. (2001, May). Associated Learning, Online Learning Magazine. Online archive available at: [http://www.onlinelearningmag.com/training/search/ search-display.jsp?vnu-content-id=1041602]
23. Goleman, D. P. (1995). Emotional Intelligence: Why It Can Matter More Than IQ for Character, Health and Lifelong Achievement. New York: Bantam Books.
24. Govindasamy, T. (2002). Successful implementation of e-learning: pedagogical considerations. The Internet and Higher Education, 4, 287-299. doi:10.1016/S1096-7516(01)00071-9
25. Granic, A., & Ćukušić, M. (2007). Universal Design Within the Context of e-Learning. Universal Access in Human-Computer Interaction. Applications and Services (pp. 617-626).
26. Guillemette, R. A. (1995). The evaluation of usability in interactive information systems. In J. M. Carey (Ed.), Human factors in information systems: Emerging theoretical bases (pp. 207-221). Norwood, NJ: Ablex.
27. Heller, S. R., & Martin, D. C. (1999). Using a Taxonomy to Rationalize Multimedia Development. In. Proceedings of the IEEE International Conference on Multimedia Computing and Systems, 2, 661-665. doi:10.1109/MMCS. 1999.778562
28. Henderson, L. (2007). Theorizing a multiple cultures instructional design model fore-learning and e-teaching. In A. Edmundson (Ed.), Globalized elearning cultural challenges (pp. 130-153). Hershey: Information Science Publishing.
29. Hiltz, S. R., & Turoff, M. (2002). What makes learning networks effective? Communications of the ACM, 45(4), 56-58. doi:10.1145/505248.505273
30. Horton, W. (2000). Designing Web-Based Training. John Wiley & Sons.
31. Hudlicka, E. (2003). To feel or not to feel: the role of affect in human-computer interaction. International Journal of Human-Computer Studies, 59, 1-32. doi:10.1016/S1071-5819(03)00047-8
32. Hutchins, E.,L., Hollan, J. D., & Norman, D.,A. (1985). Direct manipulation interfaces. Human-Computer Interaction, 1(4), 311-338. doi:10.1207/s15327051hci0104-2
33. IBM. (2000). Ease of Use Web Design Guidelines. Online archive available at: http://www-3.ibm.com/ibm/easy/eou-ext.nsf/Publish/572.
34. Ihamäki, H., & Vilpola, I. (2004, February). Usability of a Virtual Learning Environment Concerning Safety at Work. Electronic Journal on e-Learning, 2(1), 103-112. Online archive available at: http://www.ejel.org/ volume-2/vol2-issue1/issue1-art18-ihamaki-vilpoloa.pdf.
35. ISO. (1997). ISO 9241-11: Ergonomic requirements for office work with visual display terminals (VDTs). Part 11-guidelines for specifying and measuring usability. Geneva: International Standards Organisation. Also available from the British Standards Institute, London.
36. Johnson, S., & Aragon, S. (2002). An Instructional Strategy Framework for Online Learning Environments. In Proceedings of World Conference on E-Learning in Corp., Govt., Health., & Higher Ed., (1), 529-536.
37. Jonassen, D. (1994). Thinking technology. Toward a Constructivist Design Model. Educational Technology, 34-37.
38. nd ed.). Mahwah, NJ: Lawrence Erlbaum.
39. Jones, M. G., & Farquhar, J. D. (1997). User Interface Design for Web Based Instruction. In B. Khan (Ed.), Web-Based Instruction (pp. 239-244). Educational Technology Publications.
40. Jones, P., Packham, G., Miller, C., Davies, I., & Jones, A. (2003). e-Retention: An Initial Evaluation of Student Withdrawals within a Virtual Learning Environment. In R. Williams (Ed.), Proceedings of the 2nd European Confrence on eLearning (pp. 239-248). Reading: Academic Conferences International.
41. Kayler, M., & Weller, K. (2007). Pedagogy, Self- Assessment, and Online Discussion Groups. Educational Technology & Society, 10(1), 136-147.
42. Keeker, K. (1997). Improving Web site Usability and Appeal. Online archive available at: [http://msdn.microsoft.com/workshop/management/planning/ improvingsiteusa.asp].
43. Keller, J. M. (1983). Motivational design of instruction. In C.M. Reigeluth (Ed.), Instructional design theories and models: An overview of their current status. Hillsdale, NJ: Erlbaum.
44. Kent, T. (2003). Supporting staff using WebCT at the University of Birmingham in the UK. Electronic Journal of e-Learning, 1(1), 1-10.
45. Kiili, K. (2007). Foundation for Problem-Based Gaming. British Journal of Educational Technology, 38(3), 394-404. doi:10.1111/j.1467-8535.2007.00704.x
46. Kinzie, M. B. (1990). Requirements and benefits of effective interactive instruction, learner control, self-regulation, and continuing motivation. Educational Technology Research and Development, 38(1), 5-21. doi:10.1007/BF02298244
47. Kirakowski, J., & Corbett, M. (1990). Effective Methodology for the Study of HCI. Elsevier.
48. Lanzilotti, R., Costabile, M., Ardito, C., & De Angeli, A. (2006). eLSE Methodology: a Systematic Approach to the e-Learning Systems Evaluation. Educational Technology & Society, 9(4), 42-53. (Pubitemid 44877470)
49. Laurillard, D. (1995). Multimedia and the changing experience of the learner. British Journal of Educational Technology, 26(3). doi:10.1111/j.1467- 8535.1995.tb00340.x
50. Levy, Y. (2007). Comparing dropouts and persistence in e-learning courses. Computers & Education, 48, 185-204. doi:10.1016/j.compedu.2004.12. 004
51. Lindgaard, G. (1994). Usability testing and system evaluation. London: Chapman & Hall
52. Lohr, L. (2000). Designing the instructional interface. Computers in Human Behavior, 16, 161-182. doi:10.1016/S0747-5632(99)00057-6
53. Lohr, L., & Eikleberry, C. (2001). Learner-Centered Usability: Tools for Creating a Learner-Friendly Instructional Environment. Online archive available at: [http://www.coe.unco.edu/LindaLohr/home/et695/Unit4/article.htm]
54. Lynch, P.J., & Horton, S. (1999). Interface design for WWW Web Style Guide. Yale Style Manual. Online archive available at: [http://info.med.yale. edu/caim/manual/interface.html].
55. Maguire, M. (2001). Context of Use within usability activities. International Journal of Human-Computer Studies, 55, 453-483. doi:10.1006/ijhc.2001.0486
56. Malone, T. W., & Lepper, M. R. (1987). Making learning fun: A taxonomy of intrinsic motivations for learning. In R.E. Snow & M.J. Farr (Eds.), Aptitude, Learning and Instruction. Lawrence Erlbaum Associates (pp. 223-253), Hillsdale, NJ.
57. Martens, R. L., Gulikers, J., & Bastiaens, T. (2004). The impact of intrinsic motivation on e-learning in authentic computer tasks. Journal of Computer Assisted Learning, 20, 368-376. doi:10.1111/j.1365-2729.2004.00096.x
58. Massy, J. (2002). Quality and eLearning in Europe: Summary report 2002. BizMedia 2002. Online archive available at: [www.elearningage.co.uk]
59. Mayes, J. T., & Fowler, C. J. (1999). Learning Technology and Usability: A Framework for Understanding Courseware. Interacting with Computers, 11(5), 485-498. doi:10.1016/S0953-5438(98)00065-4
60. Mechlenbacher, B. (2000). Internationality as one of the many neglected dimensions. ACM Journal of Computer Documentation, 24(1), 25-30. doi:10.1145/330409.330413
61. Merrill, M., Zhongmin, L., & Jones, M. K. (1992). Instructional Transaction Shells: Responsibilities, Methods, and Parameters. Educational Technology, 32(2), 5-27.
62. Morkes, J., & Nielsen, J. (1998). Applying Writing guidelines to Web pages. Online archive available at: [http://www.useit.com].
63. Nielsen, J. (1993). Usability Engineering. Boston, MA: Academic Press.
64. Nielsen, J. (1994). Heuristic evaluation. In J. Nielsen & R.L. Mack (Eds.), Usability inspection methods. New York: John Wiley & Sons.
65. Nielsen, J. (2000). Designing web usability: The practice of simplicity. Indianapolis, IN: New Riders Publishing.
66. Notess, M. (2001). Usability, User Experience, and Learner Experience. ACM eLearn Magazine. Online archive available at: http://www.elearnmag.org/
67. O'Regan, K. (2003). Emotion and E-Learning. Journal of Asynchronous Learning Networks, 7(3), 78-92.
68. nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
69. Parlangeli, O., Marchigianni, E., & Bagnara, S. (1999). Multimedia System in Distance Education: Effects on Usability. Interacting with Computers, 12, 37-49. doi:10.1016/S0953-5438(98)00054-X (Pubitemid 129592052)
70. Phillips, D. C. (1995). The good, the bad, the ugly: The many faces of constructivism. Educational Researcher, 24(7), 5-12.
71. Porter, L. W., & Lawler, E. E. (1968). Managerial attitudes and performance. Homewood, IL: Dorsey Press.
72. Powell, T. A. (2000). Web Design: the Complete Reference. California: McGraw Hill.
73. Preece, J., Rogers, Y., & Sharp, H. (2007). Interaction Design: Beyond Human-Computer Interaction. New York, NY: John Wiley & Sons.
74. Quinn, C., Boesen, M., Kedziar, D., Kelmenson, D., & Moser, R. (1993). Designing Multimedia Environements for Thinking Skill Practice. Journal of Educational Multimedia and Hypermedia, 2(4), 405-416.
75. Quinn, C. N. (1996). Pragmatic evaluation: lessons from usability. In Proceedings of 13th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education.
76. Reeves, T. C., Benson, L., Elliott, D., Grant, M., Holschuh, D., Kim, B., et al. (2002). Usability and Instructional Design Heuristics for E Learning Evaluation. In Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications, (1), 1615-1621.
77. Rentroia-Bonito, M. A., Jorge, J. A., & Ghaoui, C. (2006). Motivation to e-learn within organizational settings: An exploratory factor structure. International Journal of Distance Education Technologies, 4(3), 24-35.
78. Reushle, S., Dorman, M., Evans, P., Kirkwood, J., McDonald, J., & Worden, J. (1999). Critical elements: Designing for online teaching. In Proceedings of ASCILITE99 Responding to Diversity: 16th Annual Conference (pp. 5-8), QUT, Brisbane.
79. Roschelle, J., & Teasley, S. (1995). The construction of shared knowledge in collaborative problem solving. In C.E. O'Malley (Ed.), Computer-Supported Collaborative Learning. Springer-Verlag, Berlin.
80. Schunk, D. H. (1991). Self-efficacy and academic motivation. Educational Psychologist, 26, 201-231. doi:10.1207/s15326985ep2603&4-2
81. rd ed.). Englewood Cliff, NJ: Prentice Hall.
82. Selwyn, N. (2007). The use of computer technology in university teaching and learning: a critical perspective. Journal of Computer Assisted Learning, 23, 83-94. doi:10.1111/j.1365-2729.2006.00204.x
83. Shiratuddin, N., & Hassan, S. (2001). Web Sites Usability Evaluation Guidelines for Teachers: A Case of CikguNet On-line Environment. In Proceedings of Society for Information Technology and Teacher Education International Conference 2001, (1), 3074-3079. Online archive available at: [http://dl.aace.org/4154].
84. Shiratuddin, N., Hassan, S., & Landoni, M. (2003). A Usability Study for Promoting eContent in Higher Education. [Online archive available at]. Educational Technology & Society, 6(4), 112-124.
85. Shirley, H. (1999). Effective Electronic Training. Designing Electronic Materials: Articles and Papers. Online archive available at: [http://www.rockley.com/designin.htm].
86. st ed.). Addison Wesley.
87. SIG-CHI (2001). Notes from E-learning Special Interest Group (SIG) - Discussion at CHI 2001. Online archive available at: [http://www.elearnmag.org/]
88. Silius, K., Tervakari, A.-M., & Pohjolainen, S. (2003). A Multidisciplinary Tool for the Evaluation of Usability, Pedagogical Usability, Accessibility and Informational Quality of Web-based Courses. In Proceedings of PEG2003- The Eleventh International PEG Conference: Powerful ICT for Teaching and Learning.
89. nd ed.). New York: John Wiley & Sons, Inc.
90. Smulders, D. (2002). Designing for Learners, Designing for Users. ACM eLearn Magazine. Online archive available at: http://www.elearnmag.org/
91. Soloway, E., Guzdial, M., & Hay, K. (1994). Learner-Centered Design. The Challenge For HCI In The 21st Century. Interaction, 1(2), 36-48. doi:10.1145/174809.174813
92. Spitzer, D. R. (1996). Motivation: The neglected factor in instructional design. Educational Technology, 36(3), 45-49.
93. Squires, D. (1999). Usability and Educational Software Design: Special Issue of Interacting with Computers. Interacting with Computers, 11(5), 463-466. doi:10.1016/S0953-5438(98)00062-9
94. Squires, D., & Preece, J. (1999). Predicting quality in educational software: Evaluating for learning, usability and the synergy between them. Interacting with Computers, 11(5), 467-483. doi:10.1016/S0953-5438(98)00063-0
95. Stanton, N. A., Taylor, R. G., & Tweedie, L. A. (1992). Maps as navigational aids in hypertext environments: An empirical evaluation. Journal of Educational Multimedia and Hypermedia, 1(4), 431-444.
96. Stoney, S., & Wild, M. (1998). Motivation and interface design: maximizing learning opportunities. Journal of Computer Assisted Learning, 14, 40-50. doi:10.1046/j.1365-2729.1998.1410040.x (Pubitemid 128030017)
97. Tam, M. (2000). Constructivism, Instructional Design, and Technology: Implications for Transforming Distance Learning. [Online archive available at]. Educational Technology & Society, 3(2), 2000.
98. Triacca, L., Bolchini, D., Botturi, L., & Inversini, A. (2004). MiLE: Systematic Usability Evaluation for E-learning Web Applications. In L. Cantoni & C. McLoughlin (Eds.), Proc. ED-MEDIA 2004 World Conference on Educational Multimedia, Hypermedia & Telecommunications, Lugano, Switzerland. Online archive available at: http://edukalibre.org/documentation/mile.pdf.
99. Twomey, E. (1996). Is there a role for computer-based assessment? Online archive available at: http://science.universe.edu.au/mirror/CUBE96/twomey.html.
100. Vassilopoulou, K. (2001). A Usability Evaluation Technique for Retail Sites. Unpublished PhD Thesis, Department of Computation, University of Manchester Institute of Science and Technology, Manchester, England.
101. Venkatesh, V. (1999). Creation of favorable user perceptions: exploring the role of intrinsic motivation . MIS Quarterly, 23, 239-260. doi:10.2307/249753
102. Vroom, V. H. (1964). Work and motivation. New York: Wiley.
103. Wade, R. C. (1994). Teacher education student's views on class discussion: implications for fostering critical reflection. Teaching and Teacher Education, 10, 231-243. doi:10.1016/0742-051X(94)90015-9
104. Weston, C., Gandell, T., McApline, L., & Filkenstein, A. (1999). Designing Instruction for the Context of Online Learning. The Internet and Higher Education, 2(1), 35-44. doi:10.1016/S1096-7516(99)00005-6 (Pubitemid 129588349)
105. Wild, M., & Quinn, C. (1998). Implications of educational theory for the design on instructional multimedia. British Journal of Educational Technology, 29(1), 73-82. doi:10.1111/1467-8535.00047 (Pubitemid 128527668)
106. Zaharias, P. (2005). E-Learning Design Quality: A Holistic conceptual framework. In Howard et al. (Eds.), Encyclopedia of Distance Learning. New York.
107. Zaharias, P. (2006). A Usability Evaluation Method for e-learning: Focus on Motivation to Learn. In Extended Abstracts of Conference on Human Factors in Computing Systems - CHI 2006.
108. Zaharias, P., & Poulymenakou, A. (2007). Towards a set of design guidelines for asynchronous e-learning applications. To appear in T. Kidd (Ed.), Handbook of Research on Instructional Systems and Technology. Hershey, PA, USA: IGI Global.
109. Zaharias, P., & Poulymenakou, A. (2009). Developing a usability evaluation method for e-learning applications: beyond functional usability. International Journal of Human-Computer Interaction.
110. Zhang, D., Zhou, L., Briggs, O. R., & Nunamaker, F. J. (2006). Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & Management, 43(1), 15-27. doi:10.1016/j.im.2005.01.004