Improving the quality of e-learning: Lessons from the eMM

Journal of Computer Assisted Learning

Volumn 28, Issue 1, 2012, Pages 65-78

  Marshall, S ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

Author keywords

E learning maturity model; EMM; Quality

Indexed keywords

EID: 84856003497     PISSN: 02664909     EISSN: 13652729     Source Type: Journal    
DOI: 10.1111/j.1365-2729.2011.00443.x     Document Type: Article

References (63)

1. Allen I.E. & Seaman J. (2010) Class Differences: Online Education in the United States, 2010. Available at: (last accessed 31 January 2011).
2. Anderson T. & Elloumi F., eds (2004) Theory and Practice of Online Learning. Athabasca University, Athabasca, AB.
3. Bacsich P. (2008) Benchmarking Phase 2 Overview Report. Available at: (last accessed 25 February 2009).
4. Ball C. (1991) Quality and qualities: an overview. In The Future of Higher Education (ed. T. Schuller ), pp. 100-105. SRHE/Open University Press, Buckingham, UK.
5. Barnett R. (1992) Improving Higher Education: Total Quality Care. SRHE and The Open University Press, London.
6. Bates T. (2010) How Well Has Your Institution Integrated Technology? Available at: (last accessed 18 July 2010).
7. Bradley D., Noonan P., Nugent H. & Scales B. (2008) Review of Australian Higher Education: Final Report. Commonwealth of Australia, Canberra.
8. Chalmers D. (2007) A Review of Australian and International Quality Systems and Indicators of Learning and Teaching. Carrick Institute for Learning and Teaching in Higher Education Ltd., Chippendale, NSW, Australia.
9. Conole G., Oliver M., Isroff K. & Ravenscroft A. (2004) Addressing methodological issues in e-learning research. Proceedings of the Networked Learning Conference 2004, Lancaster University, UK. Available at: (last accessed 30 January 2011).
10. de Freitas S. (2006) Think Piece for Becta on the 'e-Mature Learner.' (last accessed 25 February 2009).
11. Duderstadt J.J., Atkins D.E. & Van Houweling D. (2003) The development of institutional strategies. Educause Review 38, 48-58.
12. Ehlers U.-D. & Pawlowski J.M. (2006) Quality in European e-learning: an introduction. In Handbook on Quality and Standardisation in E-Learning (eds U.-D. Ehlers & J.M. Pawlowski ), pp. 1-13. Springer, Berlin.
13. El Emam K., Drouin J.-N. & Melo W. (1998) SPICE: The Theory and Practice of Software Process Improvement and Capability Determination. IEEE Computer Society, Los Alamitos, CA.
14. Gibbs G. (2010) Dimensions of Quality. Higher Education Academy, York, UK.
15. Giertz B. (2000) The quality concept in higher education. Sinergie. Rapporti di Ricerca N.9 - Luglio 2000, pp. 295-396. Conference Proceedings, TQM for Higher Education Institutions 11, Verona, 30-31 August, 1999.
16. Gray K. & Radloff A. (2010) What's it all about? Making sense of Australian university learning and teaching plans. Higher Education Research & Development 29, 291-305.
17. Gunn R. & Williams W. (2007) Strategic tools: an empirical investigation into strategy in practice in the UK. Strategic Change 16, 201-216.
18. Harvey L. (2005) A history and critique of quality evaluation in the UK. Quality Assurance in Education 13, 263-276.
19. Hénard F. (2010) Learning Our Lesson: Review of Quality Teaching in Higher Education. Organisation for Economic Co-operation and Development, Paris, France.
20. Higgins A. & Prebble T. (2009) Taking the Lead: Strategic Management for E-Learning. Ako Aotearoa and the New Zealand Ministry of Education, Wellington.
21. Hrabe D.P., Gazda R.B. & Berg B.C. (2005) Igniting the SPARK: supporting the technology needs of online learners. Distance Learning 2, 13-17.
22. Inglis A. (2007) Approaches taken by Australian universities to documenting institutional e-learning strategies. In ICT: Providing Choices for Learners and Learning. Proceedings ACILITE Singapore 2007 (eds R.J. Atkinson, C. McBeath, S.K.A. Soong & C. Cheers ), pp. 419-427. Centre for Educational Development, Nanyang Technological University, Singapore.
23. Joint Information Systems Committee (JISC) (2009) Effective Practice in a Digital Age. HEFCE, Bristol, UK.
24. Jochems W., van Merrienboer J. & Koper R. (2004) An introduction to integrated e-learning. In Integrated E-Learning: Implications for Pedagogy, Technology and Organization (eds W. Jochems, J. van Merrienboer & R. Koper ), pp. 1-12. RoutledgeFalmer, London.
25. Johnson L., Smith R., Levine A. & Haywood K. (2010) The Horizon Report: 2010 Australia-New Zealand Edition. The New Media Consortium, Austin, TX.
26. Katz R.N. (2008) The Tower and the Cloud: Higher Education in the Age of Cloud Computing. Educause, Boulder, CO.
27. Keegan D., Lõssenko J., Mázár I., Michels P.F., Paulsen M.F., Rekkedal T., Toska J.A. & Zarka D. (2007) E-Learning Initiatives That Did Not Reach Targeted Goals. NKI Publishing House, Bekkestua, Norway.
28. Kenny J. (2001) Where academia meets management: a model for the effective development of quality learning materials using new technologies. In Meeting at the Crossroads. Proceedings of the 18th Annual Conference of the Australian Society for Computers in Learning in Tertiary Education (eds G. Kennedy, M. Keppell, C. McNaught & T. Petrovic ), pp. 327-334. Biomedical Multimedia Unit, The University of Melbourne, Melbourne.
29. Kurzweil R. (2005) The Singularity is Near. Penguin, New York.
30. Laurillard D. (2002) Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies, 2nd edition. Routledge, London.
31. Law D.C.S. (2010) Quality assurance in post-secondary education: some common approaches. Quality Assurance in Education 18, 64-77.
32. Marshall S. (2005) Determination of New Zealand Tertiary Institution e-Learning Capability: An Application of an e-Learning Maturity Model. Report to the New Zealand Ministry of Education. Available at: (last accessed 10 January 2006).
33. Marshall S. (2006a) New Zealand Tertiary Institution e-Learning Capability: Informing and Guiding e-Learning Architectural Change and Development. Report to the New Zealand Ministry of Education. Available at: (last accessed 19 September 2006).
34. Marshall S. (2006b) eMM Version Two Process Guide. Victoria University of Wellington, Wellington. Available at: (last accessed 9 October 2009).
35. Marshall S. (2010) A quality framework for continuous improvement of e-learning: the e-learning maturity model. Journal of Distance Education 24, 143-166. Available at: (last accessed 24 June 2010).
36. Marshall S.J. (2008) What are the key factors that lead to effective adoption and support of e-learning by institutions? HERDSA 2008 Conference, HERDSA, Rotorua.
37. Marshall S. & Mitchell G. (2002) An e-learning maturity model? 19th ASCILITE Conference, Unitec, Auckland. Available at: (last accessed 10 January 2006).
38. Marshall S., Udas K. & May J. (2008) Assessing online learning process maturity: the e-learning maturity model. 14th Annual Sloan-C International Conference on Online Learning, Sloan, Orlando.
39. Marshall S., Mitchell G. & Beames S. (2009) Report on the ACODE eMM Project. Available at: (last accessed 17 July 2010).
40. MED (2008) Digital Strategy 2.0. Ministry of Economic Development, Wellington, New Zealand. Available at: (last accessed 17 July 2010).
41. Neal T. & Marshall S. (2008) Report on the Distance and Flexible Education Capability Assessment of the New Zealand ITP Sector. Confidential Report to the New Zealand Tertiary Education Committee and Institutes of Technology and Polytechnics Distance and Flexible Education Steering Group.
42. Neuhauser C. (2004) A maturity model: does it provide a path for online course design? The Journal of Interactive Online Learning 3, 1-17. Available at: (last accessed 25 February 2009).
43. Paulk M.C., Curtis B., Chrissis M.B. & Weber C.V. (1993) Capability maturity model, version 1.1. IEEE Software 10, 18-27.
44. Radloff A. (2001) Getting online: the challenges for academic staff and institutional leaders. In Meeting at the Crossroads: Proceedings of the 18th Annual Conference of the Australian Society for Computers in Learning in Tertiary Education (eds G. Kennedy, M. Keppell, C. McNaught & T. Petrovic ), pp. 11-13. Biomedical Multimedia Unit, The University of Melbourne, Melbourne.
45. Ramsden P. (2003) Learning to Teach in Higher Education, 2nd edition. RoutledgeFalmer, London; New York.
46. Rowlands I., Nicholas D., Williams P., Huntington P., Fieldhouse M., Gunter B., Withey R., Jamali H.R., Dobrowolski T. & Tenopir C. (2008) The Google generation: the information behaviour of the researcher of the future. Aslib Proceedings: New Information Perspectives 60, 290-310.
47. Salmon G. (2000) E-Moderating: The Key to Teaching and Learning Online. Kogan Page, London.
48. Sero. (2007) Baseline Study of E-activity in Scotland's Colleges. Available at: (last accessed 25 February 2008).
49. Software Process Improvement and Capability dEtermination (SPICE) (2005) Software Process Assessment Version 1.00. Available at: (last accessed 18 December 2002).
50. Southern Regional Education Board (SREB) (2003) Principles of Good Practice: The Foundation for Quality of the Electronic Campus of the Southern Regional Education Board. SREB, Atlanta, GA.
51. Taylor J. (2001a) 29 Steps to Heaven? Strategies for Transforming University Teaching and Learning Using Multimedia and Educational Technology. The Open University, Milton Keynes.
52. Taylor J. (2001b) Fifth generation distance education. Keynote Address presented at the 20th ICDE World Conference, Düsseldorf, Germany, 1-5 April 2001.
53. Thair A., Garnett P. & King S. (2006) Quality assurance and change in higher education. In The Realities of Change in Higher Education: Interventions to Promote Learning and Teaching (eds L. Hunt, A. Bromage & B. Tomkinson ), pp. 52-63. Routledge, London.
54. University of London (2008) Benchmarking eLearning at the University of London: Report from the Steering Group. University of London, London. Available at: (last accessed 17 July 2008).
55. United States Department of Education (USDE) (2009) Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. USDE, Office of Planning, Evaluation, and Policy Development, Washington, DC.
56. Usoro A. & Abid A. (2008) Conceptualising quality e-learning in higher education. E-Learning 5, 75-88.
57. van Vught F. (1997) To innovate for quality. In Quality Assurance As Support for Processes of Innovation: The Swedish Model in Comparative Perspective (ed. L. Niklasson ), pp. 80-108. Høgskoleverkets Skriftserie, Stockholm.
58. Vonderwell S. & Zacharia S. (2005) Factors that influence participation in online learning. Journal of Research on Technology in Education 38, 213-230.
59. Watty K. (2002) Quality in Higher Education: the Missing Academic Perspective. Paper presented at the 2002 Australasian Association for Institutional Research Forum. Available at: (last accessed 17 July 2010).
60. Weedon E., Jorna K. & Broumley L. (2004) Closing the gaps in institutional development of networked learning: how do policy and strategy inform practice to sustain innovation? In Proceedings of the Networked Learning Conference 2004, Lancaster University, UK. 1-7 April, 2004 (eds S. Banks, P. Goodyear, V. Hodgson, C. Jones, V. Lally, D. McConnell, C. Steeples & P. Watland ). Available at: (last accessed 25 February 2008).
61. Weller M. (2004) Learning objects and the e-learning cost dilemma. Open Learning 19, 293-302.
62. Wiley D.A. (2000) Connecting learning objects to instructional design theory: a definition, a metaphor, and a taxonomy. In The Instructional Use of Learning Objects: Online Version (ed. D.A. Wiley ), pp. 1-35. Agency for Instructional Technology, Bloomington, IL. Available at: (last accessed 22 July 2010).
63. Wills S. (2006) Strategic planning for blended elearning. In Proceedings of the 7th International Conference on Information Technology Based Higher Education and Training, Sydney, July 2006 (ed. S. Housego ). Available at: (last accessed 22 July 2010).