Adapting a quality assurance framework for creating educational metadata in an agricultural learning repository

Electronic Library

Volumn 29, Issue 2, 2011, Pages 181-199

  Zschocke, Thomas ^a   Beniest, Jan ^b  

^a UNITED NATIONS UNIVERSITY   (Germany)

^b WORLD AGROFORESTRY CENTRE ICRAF   (Kenya)

Author keywords

Developing countries; Education sector; Metadata; Organizational processes; Quality control; Standards

Indexed keywords

EID: 79955703226     PISSN: 02640473     EISSN: None     Source Type: Journal    
DOI: 10.1108/02640471111125159     Document Type: Article

References (79)

1. Abdullah, F. (2005), "HEdPERF versus SERVPERF. The quest for ideal measuring instrument of service quality in higher education sector", Quality Assurance in Education, Vol. 13 No. 4, pp. 305-28. (Pubitemid 41644733)
2. Altbach, P.G., Reisberg, L. and Rumbley, L.E. (2009), "Trends in global higher education: Tracking an academic revolution", paper presented at UNESCO 2009 World Conference on Higher Education, United Nations Educational, Scientific and Cultural Organization (UNESCO), Paris, available at: Http://unesdoc.unesco.org/images/0018/001832/183219e.pdf (accessed 1 February 2010).
3. Barton, J., Currier, S. and Hey, J.M.N. (2003), "Building quality assurance into metadata creation: An analysis based on the learning objects and e-prints communities of practice", International Conference on Dublin Core and Metadata Applications (DC 2003), Seattle, WA, 28 September - 2 October 2003, Dublin Core Metadata Initiative (DCMI), National Library Board, Singapore, available at: Http://dcpapers.dublincore.org/ojs/pubs/article/ view/732 (accessed 1 February 2010).
4. Beniest, J. and Zschocke, T. (2005), "Developing a learning object repository for international agricultural research", ED-MEDIA 2005 World Conference on Educational Multimedia, Hypermedia and Telecommunications, Montreal, Canada, 27 June - 2 July 2005, Association for the Advancement of Computing in Education (AACE), Chesapeake, VA, pp. 4553-5.
5. Borlund, P. (2003), "The concept of relevance in IR", Journal of the American Society for Information Science and Technology, Vol. 54 No. 10, pp. 913-25.
6. Bruce, T.R. and Hillmann, D.I. (2004), "The continuum of metadata quality: Defining, expressing, exploiting", in Hillmann, D.I. and Westbrooks, E.L. (Eds), Metadata in Practice, American Library Association, Chicago, IL, pp. 238-56.
7. Cardinaels, K., Meire, M. and Duval, E. (2005), "Automating metadata generation: The simple indexing interface", 14th International World Wide Web Conference (WWW 2005), Chiba, Japan, 10-14 May 2005, International World Wide Web Conference Committee (IW3C2), Geneva, Switzerland, pp. 548-56, available at: Www2005.org/cdrom/docs/p548.pdf (accessed 1 February 2010).
8. CGIAR Science Council (2006), "Evaluation and impact of training in the CGIAR", Science Council Secretariat, Rome, Italy, available at: Www.sciencecouncil.cgiar.org/fileadmin/ user-upload/sciencecouncil/Reports/ Evaluation-and-Impact-of-Training.pdf (accessed 1 February 2010).
9. Currier, S., Barton, J., O'Beirne, R. and Ryan, B. (2004), "Quality assurance for digital learning object repositories: Issues for the metadata creation process", ALT-J, Research in Learning Technology, Vol. 12 No. 1, pp. 5-20, available at: Http://repository.alt.ac.uk/616/1/ALT-J- Vol12-No1-2004-Quality assurance for digital.pdf (accessed 1 February 2010).
10. Downes, S. (2001), "Learning objects: Resources for distance education worldwide", International Review of Research in Open and Distance Learning, Vol. 2 No. 1, pp. 1-35, available at: Www.irrodl.org/index.php/ irrodl/article/view/32 (accessed 1 February 2010).
11. Duval, E. (2004), "Learning technology standardization: Making sense of it all", Computer Science and Information Systems, Vol. 1 No. 1, pp. 33-43, available at: Www.comsis.org/ComSIS/ Volume01/InvitedPapers/ErikDuval.pdf (accessed 1 February 2010).
12. Duval, E. and Hodgins, W. (2003), "A Lom research agenda", 12th International Conference on the World Wide Web, Budapest, Hungary, 20-24 May 2003, International World Wide Web Committee (IW3CS), Geneva, available at: Www2003.org/cdrom/papers/alternate/ P659/p659-duval.html.html (accessed 1 February 2010).
13. Duval, E. and Hodgins, W. (2006), "Standardized uniqueness: Oxymoron or vision of the future?", IEEE Computer, Vol. 39 No. 3, pp. 96-8.
14. Duval, E. and Verbert, K. (2008), "On the role of technical standards for learning technologies", IEEE Transactions on Learning Technologies, Vol. 1 No. 4, pp. 229-34, available at: Www. computer.org/portal/ web/csdl/transactions/tlt#4 (accessed 1 February 2010).
15. Duval, E., Smith, N. and Van Coillie, M. (2006), "Application profiles for learning", Sixth International Conference on Advanced Learning Technologies (ICALT 2006), Kerkrade, Netherlands, 5-7 July 5-7 2006, IEEE Press, New York, NY, pp. 242-6. (Pubitemid 46591602)
16. Duval, E., Forte, E., Cardinaels, K., Verhoeven, B., Van Durm, R., Hendrikx, K., Wentland Forte, M., Ebel, N., Macowicz, M., Warkentyne, K. and Haenni, F. (2001), "The ARIADNE knowledge pool system", Communications of the ACM, Vol. 44 No. 5, pp. 73-8. (Pubitemid 33627333)
17. Ehlers, U.-D. (in press), "Open ECBCheck - quality for eCapacity building in Africa and beyond. Community based, low cost certification for e-learning", International Review of Research in Open and Distance Learning, (submitted for publication), available at: Http://science. without-borders.org/ulfehlers/?q=bibliography/publications/download/108/86 (accessed 1 February 2010).
18. Elvers, E. and Rosén, B. (1997), "Quality concepts for official statistics", in Kotz, S., Balakrishnan, N., Read, C.B. and Vidakovic, B. (Eds), Encyclopedia of Statistical Sciences, Vol. 3, Wiley, New York, NY, pp. 621-9, available at: Http://dsbb.imf.org/vgn/images/pdfs/ Encyc.pdf (accessed 1 February 2010).
19. Green, D. (1994), "What is quality in higher education?", Society for Research into Higher Education (SRHE) and Open University Press, Buckingham, available at: Www.eric.ed. gov/ERICDocs/data/ericdocs2sql/content- storage-01/0000019b/80/15/28/e5.pdf (accessed 1 February 2010).
20. Greenberg, J. (2002), "Metadata generation: Processes, people and tools", Bulletin of the American Society for Information Science and Technology, Vol. 29 No. 2, pp. 16-19.
21. Greenberg, J., Sutton, S. and D, G. (2003), "Campbell Metadata: A fundamental component of the semantic web", Bulletin of the American Society for Information Science and Technology, Vol. 29 No. 4, pp. 16-18.
22. Guy, M., Powell, A, and Day, M. (2004), "Improving the quality of metadata in eprint archives", Ariadne, Vol. 38, January, available at: Www.araidne.ac.uk/issue38/guy/ (accessed 1 February 2010).
23. Harvey, L. and Green, D. (1993), "Defining quality", Assessment & Evaluation in Higher Education, Vol. 18 No. 1, pp. 9-35.
24. Heery, R. and Patel, M. (2000), "Application profiles: Mixing and matching metadata schemas", Ariadne, Vol. 25, September, available at: Www.ariadne.ac.uk/issue25/app-profiles/ (accessed 1 February 2010).
25. Hillmann, D. and Phipps, J. (2007), "Application profiles: Exposing and enforcing metadata quality", International Conference on Dublin Core and Metadata Applications (DC 2007), Singapore, 27-31 August 2007, Dublin Core Metadata Initiative (DCMI), National Library Board, Singapore, pp. 53-62, available at: Http://dcpapers.dublincore.org/ojs/pubs/article/ view/866 (accessed 1 February 2010).
26. Hillmann, D., Dushay, N. and Phipps, J. (2004), "Improving metadata quality: Augmentation and recombination", International Conference on Dublin Core and Metadata Applications (DC 2004), Shanghai, China, 11-14 October 2004, Dublin Core Metadata Initiative (DCMI), National Library Board, Singapore, pp. 1-8, available at: Http://dcpapers.dublincore.org/ ojs/pubs/article/view/ 770 (accessed 1 February 2010).
27. IEEE Computer Society (2002), 1484.12.1-2002 IEEE Standard for Learning Object Metadata, Institute of Electrical and Electronics Engineers (IEEE), New York, NY.
28. ISO/IEC (2005), ISO/IEC 19796-1:2005. Information Technology - Learning, Education and Training - Quality Management, Assurance and Metrics - Part 1: General Approach, International Organization for Standardization (ISO) and International Electrotechnical Commission (IEC), Geneva.
29. Kahn, B.K., Strong, D.M. and Wang, R.Y. (2002), "Information quality benchmarks: Product and service performance", Communications of the ACM, Vol. 45 No. 4, pp. 184-92.
30. Kelly, B., Closier, A. and Hiom, D. (2005), "Gateway standardization: A quality assurance framework for metadata", Library Trends, Vol. 53 No. 4, pp. 637-50. (Pubitemid 40937880)
31. Lee, Y.W., Strong, D.M., Kahn, B.K. and Wang, R.Y. (2002), "AIMQ: A methodology for information quality assessment", Information & Management, Vol. 40 No. 2, pp. 133-46.
32. Li, J., Zhang, G. and Song, H. (2008), "Research and establishment of enterprise quality metadata standard", Frontiers of Mechanical Engineering in China, Vol. 3 No. 1, pp. 106-10.
33. Lytras, M.D. and Sicilia, M.-A. (2007), "Where is the value in metadata?", International Journal of Metadata, Semantics and Ontologies, Vol. 2 No. 4, pp. 235-41.
34. Madnick, S.E., Wang, R.Y., Lee, Y.W. and Zhu, H. (2009), "Overview and framework for data and information quality research", ACM Journal of Data and Information Quality, Vol. 1 No. 1 Art 2, pp. 2-22.
35. Manouselis, N. and Costopoulou, C. (2006), "Quality in metadata: A schema for e-commerce", Online Information Review, Vol. 30 No. 3, pp. 217-37. (Pubitemid 43926624)
36. Manouselis, N., Salokhe, G. and Keizer, J. (2009), "Comparing different metadata application profiles for agricultural learning repositories", in Sicilia, M.-A. and Lytras, M.D. (Eds), Metadata and Semantics, Springer Science+Business Media, New York, NY, pp. 469-79, available at: Ftp://ftp.fao.org/docrep/fao/012/al002e/al002e00.pdf (accessed 1 February 2010).
37. Manouselis, N., Rudgard, S., Keizer, J. and Salokhe, G. (2009), "Towards a harmonization of metadata application profiles for agricultural learning repositories", Agricultural Information Worldwide, Vol. 2 No. 1, pp. 25-30, available at: Ftp://ftp.fao.org/docrep/fao/ 010/ai261e/ai261e00.pdf (accessed 1 February 2010).
38. Manouselis, N., Kastrantas, K., Salokhe, G., Najjar, J., Stracke, C.M. and Duval, E. (2008), "Results from a study of the implementation of Metadata application profiles in agricultural learning repositories", 4th International Conference on Information and Communication Technologies in Bio and Earth Sciences (HAICTA 2008), Hellenic Association of Information and Communication Technologies in Agriculture, Food and Environment (HAICTA), Athens, Greece, 18-20 September 2008, Athens, pp. 549-57, available at: Ftp:// ftp.fao.org/docrep/fao/011/ai264e/ai264e00.pdf (accessed 1 February 2010).
39. Manouselis, N., Najjar, J., Kastrantas, K., Salokhe, G., Stracke, C.M. and Duval, E. (2010), "Metadata interoperability in agricultural learning repositories: An analysis", Computers and Electronics in Agriculture, Vol. 70 No. 2, pp. 302-20.
40. Margaritopoulos, T., Margaritopoulos, M., Mavridis, I. and Manitsaris, A. (2008), "A conceptual framework for metadata quality assessment", International Conference on Dublin Core and Metadata Applications (DC-2008), 22-26 September 2008, Berlin, Germany, Dublin Core Metadata Initiative (DCMI), National Library Board, Singapore, available at: Http:// dcpapers.dublincore. org/ojs/pubs/article/view/923/919/ (accessed 1 February 2010).
41. Moen, W.E., Stewart, E.L. and McClure, C.R. (1998), "Assessing metadata quality: Findings and methodological considerations from an evaluation of the US Government Information Locator Service (GILS)", IEEE International Forum on Research and Technology Advances in Digital Libraries, 22-24 April 1998, IEEE Computer Society, Washington, DC, pp. 246-55.
42. Murphrey, T.P., Lindner, J.R., Elbert, C., Malagamba, P. and Piñ a, M. Jr (2002), "Assessment of readiness to utilize e-learning at the International Potato Center, Lima, Peru", 18th Annual Conference of the Association for International Agricultural and Extension Education (AIAEE 2002), Durban, South Africa, 26-30 May 2002, Texas A&M University, College Station, TX, pp. 509-14.
43. Najjar, J. and Duval, E. (2006), "Actual use of learning objects and metadata: An empirical analysis", IEEE Technical Committee on Digital Libraries (TCDL) Bulletin, Vol. 2 No. 2, available at: Www.ieee-tcdl.org/ Bulletin/v2n2/najjar/najjar.html (accessed 1 February 2010).
44. Najjar, J., Duval, E., Ternier, S. and Neven, F. (2003), "Towards interoperable learning object repositories: The ARIADNE experience", IADIS International Conference on WWW/Internet 2003, Algarve, Portugal, 5-8 November 2003, International Association for Development of the Information Society (IADIS), Vol. I, pp. 219-26.
45. Ochoa, X. and Duval, E. (2006), "Quality metrics for learning object metadata", ED-MEDIA 2006 World Conference on Educational Multimedia, Hypermedia and Telecommunications 2006, Orlando, FL, 26-30 June 2006, Association for the Advancement of Computing in Education (AACE), Chesapeake, VA, pp. 1004-11.
46. Ochoa, X. and Duval, E. (2008), "Relevance ranking metrics for learning objects", IEEE Transactions on Learning Technologies, Vol. 1 No. 1, pp. 34-48, available at: Www. computer.org/portal/web/csdl/transactions/tlt#4 (accessed 1 February 2010).
47. Ochoa, X. and Duval, E. (2009a), "Automatic evaluation of metadata quality in digital repositories", International Journal on Digital Libraries, Vol. 10 Nos 2-3, pp. 67-91, available at: Https://lirias.kuleuven.be/ bitstream/123456789/255807/2/xavuxavier-pre.pdf (accessed 1 February 2010)
48. Ochoa, X. and Duval, E. (2009b), "Quantitative analysis of learning object repositories", IEEE Transactions on Learning Technologies, Vol. 2 No. 3, pp. 226-38.
49. Pawlowski, J.M. (2006), "Adopting quality standards for education and e-learning", in Ehlers, U.D. and Pawlowski, J.M. (Eds), Handbook on Quality and Standardisation in E-learning, Springer, Berlin, pp. 65-77.
50. Pawlowski, J.M. (2007), "The quality adaptation model: Adaptation and adoption of the quality standard ISO/IEC 19796-1 for learning, education, and training", Educational Technology & Society, Vol. 10 No. 2, pp. 3-16, available at: Www.ifets.info/journals/10-2/2.pdf (accessed 1 February 2010).
51. Robertson, R.J. (2005), "Metadata quality: Implications for library and information science professionals", Library Review, Vol. 54 No. 5, pp. 295-300. (Pubitemid 40815191)
52. Sahney, S., Banwet, D.K. and Karunes, S. (2006), "An integrated framework for quality in education application of quality function deployment, interpretive structural modelling and path analysis", Total Quality Management, Vol. 17 No. 2, pp. 265-85. (Pubitemid 43315950)
53. Saracevic, T. (2007), "Relevance: A review of the literature and a framework for thinking on the notion in information science. Part II: Nature and manifestations of relevance", Journal of the American Society for Information Science and Technology, Vol. 58 No. 13, pp. 1915-33. (Pubitemid 350229698)
54. Schmidt, P., Rojas-Briales, E., Pelkonen, P. and Villa, A. (Eds) (2007), "Quality assurance and curriculum development in forestry and agriculture related sciences", SILVA Conference, Valencia, Spain, 2-5 November 2006, University Press, University of Joensuu, Joensuu, Finland, available at: Www.silva-network.uni-freiburg.de/content/publications/2006- Proceedings-Valencia-Silva-Publications-4-2007.doc.pdf (accessed 1 February 2010).
55. Schweik, C.M., Stepanov, A. and Grove, J.M. (2005), "The open research system: A web-based metadata and data repository for collaborative research", Computers and Electronics in Agriculture, Vol. 47 No. 3, pp. 221-42. (Pubitemid 40678681)
56. Shankaranarayanan, G. and Even, A. (2006), "The metadata enigma", Communications of the ACM, Vol. 49 No. 2, pp. 88-94.
57. Shankaranarayanan, G., Ziad, M. and Wang, R.Y. (2003), "Managing data quality in dynamic decision-making environments: An information product approach", Journal of Database Management, Vol. 14 No. 4, pp. 14-32.
58. Sicilia, M.-A. (2006), "Metadata, semantics and ontology: Providing meaning to information resources", International Journal of Metadata, Semantics and Ontologies, Vol. 1 No. 1, pp. 83-6.
59. Sicilia, M.-A., García, E., Pagés, C., Martínez, J.-J. and Gutiérrez, J.-M. (2005), "Complete metadata records in learning object repositories: Some evidence and requirements", International Journal of Learning Technology, Vol. 1 No. 4, pp. 411-24.
60. Statistics Canada (2002), Statistics Canada's Quality Assurance Framework 2002, Ministry of Industry, Ottawa, available at: Www.statcan.gc.ca/pub/12-586- x/12-586-x2002001-eng.pdf (accessed 1 February 2010).
61. Stephens, R.T. (2004), "Utilizing metadata as a knowledge communication tool", International Professional Communication Conference, Twin City, MN, 29 September - 1 October 2004, pp. 55-60.
62. Stracke, C.M. (2006), "Process-oriented quality management", in Ehlers, U.-D. and Pawlowski, J.M. (Eds), Handbook on Quality and Standardisation in e-learning, Springer, Berlin, pp. 79-96.
63. Stracke, C.M. and Hildebrandt, B. (2007), "Quality development and quality standards in e-learning: Adoption, implementation, adaptation", World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA 2007), 25-29 June 2007, Vancouver, BC, Canada, Association for the Advancement of Computing in Education (AACE), Chespeake, VA, pp. 4158-65.
64. Strong, D.M., Lee, Y.W. and Wang, R.Y. (1997), "Data quality in context", Communications of the ACM, Vol. 50 No. 5, pp. 103-10. (Pubitemid 127442929)
65. Sturdy, D. (2001), "Squirrels and nuts: Metadata and knowledge management", Business Information Review, Vol. 18 No. 4, pp. 34-42.
66. Stvilia, B. and Gasser, L. (2008), "Value-based metadata quality assessment", Library & Information Science Research, Vol. 30 No. 1, pp. 67-74.
67. Stvilia, B., Al-Faraj, A. and Yi, Y.J. (2009), "Issues of cross-contextual information quality evaluation - the case of Arabic, English, and Korean wikipedias", Library and Information Science Research, Vol. 31 No. 4, pp. 232-9.
68. Stvilia, B., Gasser, L., Twidale, M.B. and Smith, L.C. (2007), "A framework for information quality assessment", Journal of the American Society for Information Science and Technology, Vol. 58 No. 12, pp. 1720-33. (Pubitemid 47573429)
69. Stvilia, B., Twidale, M.B., Smith, L.C. and Gasser, L. (2008), "Information quality work organization in wikipedia", Journal of the American Society for Information Science and Technology, Vol. 59 No. 6, pp. 983-1001. (Pubitemid 351548476)
70. Svenonius, E. (2000), The Intellectual Foundation of Information Organization, MIT Press, Cambridge, MA.
71. Thomson, J., Adams, D., Cowley, P.J. and Walker, K. (2003), "Metadata's role in a scientific archive", Computer, Vol. 36 No. 12, pp. 27-34.
72. UNESCO (2004), "Education for all: The quality imperative", EFA Global Monitoring Report 2005, United Nations Educational, Scientific and Cultural Organization (UNESCO), Paris.
73. UNESCO (2009), "Communiqué (8 July 2009)", 2009 World Conference on Higher Education: The New Dynamics of Higher Education and Research for Societal Change and Development, Paris, France, 5-8 July 2009.
74. Van Damme, D. (2004), "Standards and indicators in institutional and programme accreditation in higher education: A conceptual framework and a proposal", in Vlasceanu, L. and Barrows, L.C. (Eds), Indicators for Institutional and Programme Accreditation in Higher/Tertiary Education, UNESCO European Centre for Higher Education (CEPES), Bucharest, pp. 127-59, available at: Www.cepes.ro/publications/pdf/Indicators.pdf (accessed 1 February 2010).
75. Vlasceanu, L., Grünberg, L. and Pârlea, D. (Eds) (2007), Quality Assurance and Accreditation: A Glossary of Basic Terms and Definitions, 2nd ed., UNESCO European Centre for Higher Education (CEPES), Bucharest, Romania, available at: Www.cepes.ro/publications/pdf/ Glossary-2nd.pdf (accessed 1 February 2010).
76. Wang, R.Y. and Strong, D.M. (1996), "Beyond accuracy: What data quality means to data consumers", Journal of Management Information Systems, Vol. 12 No. 4, pp. 5-34. (Pubitemid 126704853)
77. Zschocke, T. and Beniest, J. (2007), "On-line learning resources for international agriculture and natural resources management", XXVII International Horticultural Congress (IHC2006): International Symposium on Horticultural Plants in Urban and Peri-Urban Life ISHS (Acta Horticulturae 762), Seoul, Korea, 13-18 August 2006, International Society for Horticultural Science (ISHS), Leuven, pp. 393-400.
78. Zschocke, T., Beniest, J. and Nelles, W. (2009b), Quality Matters. A Brief Guide to Quality Assurance in Agricultural Education and Training, World Agroforestry Centre, Nairobi.
79. Zschocke, T., Beniest, J., Paisley, C., Najjar, J. and Duval, E. (2009a), "The LOM application profile for agricultural learning resources of the CGIAR", International Journal of Metadata, Semantics and Ontologies, Vol. 4 Nos 1/2, pp. 13-23.