Applying metrics to the evaluation of educational hypermedia applications

Journal of Universal Computer Science

Volumn 4, Issue 4, 1998, Pages 382-403

  Mendes, Emilia ^a   Hall, Wendy ^a   Harrison, Rachel ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Evaluation; Hypermedia; Hypermedia authoring; Maintainability; Metrics; Reusability

Indexed keywords

EID: 0013205946     PISSN: 0958695X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (61)

1. [Adams and Jr 97] Adams, W. J., Jr, Curtis A. Carver: "The Effects of Structure on Hypertext Design"; Proceedings of ED-MEDIA'97, Calgary (1997).
2. [Andrews et al. 1995a] Andrews, Keith, Nedoumov, Andrew, and Scherbakov, Nick: "Embedding Courseware into the Internet: Problems and Solutions"; Proceedings of ED-MEDIA 95, Graz (1995), 69-74.
3. [Andrews et al. 95b] Andrews, Keith, Kappe, Frank, Maurer, Hermann, and Schmaranz, Klaus: "On Second Generation Network Hypermedia Systems"; Proceedings of ED-MEDIA 95, Graz (1995), 75-80.
4. [Balasubramanian et al. 94] Balasubramanian, P., Isakowitz, Tomás, and Stohr, Edward A.: "Designing Hypermedia Applications"; Proceedings of the Twenty-Seventh Annual Hawaii International Conference on System Sciences, Hawaii (1994), 354-365.
5. [Basili and Rombach 88] Basili, V. R. and Rombach, H. D.: "Towards a Comprehensive Framework for Reuse: A Reuse-Enabling Software Evolution Environment"; Technical Report CS-TR-2158, Dept. of Computer Science, University of Maryland, College Park, MD 20742 (December, 1988).
6. [Basili et al. 94] Basili, V., Caldiera G., and Rombach, D.: "The Goal Question Metric Approach", Encyclopedia of Software Engineering, Wiley (1994).
7. [Berners-Lee et al. 94] Berners-Eee, T., Cailliau, R., Luotonen, A., Nielsen, H. Frystyk, and Secret, A.: "The World Wide Web"; Communications of the ACM, 37, 8 (August, 1994), 76-82.
8. [Bernstein et al. 91] Bernstein, Mark, Brown, Peter J., Fisse, Mark, Glushko, Robert, Landow, George, Zellweger, Polle: "Structure, Navigation, and Hypertext: The Status of the Navigation Problem"; Proceedings of Hypertext'91, ACM Press, San Antonio (1991), 363-367.
9. [Botafogo et al. 92] Botafogo, Rodrigo A., Rivlin, Ehud, and Shneiderman, Ben: "Structural Analysis of Hypertexts: Identifying Hierarchies and Useful Metrics", ACM TOIS, 10, 2 (1992), 143-179.
10. [Briand et al. 96] Briand, L., Bunse, C, Daly, J, Differding, C.: "An experimental comparison of the maintainability of OO and structured design documents"; Proceedings of EASE (1996).
11. [Briand et al. 97] Briand, L., Devandu, P. and Melo, M.: "An Investigation into Coupling Measures for C++"; Proceedings of ICSE'97, Boston (1997), 412-421.
12. [Calvi and DeBra 97] Calvi, Licia and DeBra, Paul: "Using Dynamic Hypertext to Create Multi-Purpose Textbooks"; Proceedings of ED-MEDIA'97, Calgary (1997).
13. [Carvalho and Dias 97] Carvalho, Ana Amélia Amorim and Dias, Paulo: "Hypermedia Environment using a Case-Based Approach to Foster the Acquisition of Complex Knowledge"; Proceedings of ED-MEDIA'97, Calgary (1997).
14. [Catlin and Garrett 91] Catlin, Karen Smith, and Garrett, L. Nancy: "Hypermedia Templates: An Author's Tool"; Proceedings of Hypertext'91, ACM Press, San Antonio (1991), 147-160.
15. [Daly 96] Daly, J.: "Replication and a Multi-Method Approach to Empitical Software Engineering Research", PhD thesis, Department of Compyter Science, University of Strathclyde, Glasgow, (1996).
16. [Davis et al. 92] Davis, Hugh, Hall, Wendy, Heath, Ian, Hill, Gary, and Wilkings, Rob: "Towards an Integrated Information Environment With Open Hypermedia Systems"; Proceedings of the ACM Conference on Hypertext, ACM Press, Milan (1992), 181-190.
17. [Duval and Olivié 95] Duval, Erik, and Olivié, Henk: "A Home for Networked Hypermedia"; Proceedings of ED-MEDIA 95, Graz (1995), 193-198.
18. [Fenton and Pfleeger 96] Fenton, Norman E., and Pfleeger, Shari Lawrence: "Software Metrics, A Rigorous & Practical Approach", Second Edition, PWS Publishing Company and International Thomson Computer Press (1996).
19. [Frakes and Terry 95] Frakes, William and Terry, Carol: "Software Reuse and Reusability Metrics and Models"; Technical report TR-95-07, Virginia Polytechnic Inst. and State University (1995).
20. [Frakes and Terry 96] Frakes, William and Terry, Carol: "Software Reuse: Metrics and Models"; ACM Computing Surveys, 28, 2 (1996), 415-435.
21. [Garzotto et al. 91] Garzotto, Franca, Paolini, Paolo, and Schwabe, Daniel: "HDM - A Model for thé Design of Hypertext Applications"; Proceedings of Hypertext'91, ACM Press, San Antonio (1991), 313-328.
22. [Garzotto et al. 94] Garzotto, Franca, Mainetti, Luca, and Paolini, Paolo: "Analysing the Quality of Hypermedia Applications: A Design-Oriented Framework", Workshop on hypermedia design and development, Edinburgh (1994).
23. [Garzotto et al. 95] Garzotto, Franca, Mainetti, Luca, and Paolini, Paolo: "Hypermedia Design, Analysis, and Evaluation Issues", Communications of the ACM, Special Issue on Hypermedia Design, August (1995).
24. [Garzotto et al. 96] Garzotto, Franca, Mainetti, Luca, and Paolini, Paolo: "Information Reuse in Hypermedia Applications"; Proceedings of the ACM Conference on Hypertext'96, ACM Press, Washington DC (1996), 93-101.
25. [Goldberg et al. 96] Goldberg, M. W., Salari, S., and Swoboda, P.: "World Wide Web - Course Tool: An environment for building WWW-based courses"; Proceedings of the Fifth International World Wide Web Conference, Paris (1996), 1219-1232.
26. [Harrison et al. 95] Harrison, R., Samaraweera, L. G., Dobie, M. R., and Lewis, P. H.: "Estimating the quality of functional programs: an empirical investigation", Inf. Softw. Technol., 37, 12 (1995), 701-707.
27. [Hatzimanikatis et al. 95] Hatzimanikatis, A. E., Tsalidis, C. T., and Christodoulakis, D.: "Measuring the Readability and Maintainability of Hyperdocuments"; J. of Software Maintenance, Research and Practice, 7 (1995), 77-90.
28. [Healey 93] Healey, J. F.: "Statistics, a tool for social research"; Wadsworth Publ. (1993).
29. [Hill et al. 95] Hill, Gary, Hall, Wendy, De Roure, D., and Carr, L.: "Applying Open Hypertext Principles to the WWW", Proceedings of the International Workshop on Hypermedia Design '95, Montpelier (1995).
30. [ISO/IEC 91] ISO/IEC: "International Standard: Information Technology - Software product evaluation - Quality characteristics and guidelines for their use"; ISO/IEC 9126 (1991).
31. [Jacobson 97] Jacobson, Michael J.: "The Evolution Thematic Investigator: Research and the Design of Hypermedia Learning Environments", Proceedings of ED-MEDIA'97, Calgary (1997).
32. [Jacobson and Spiro 95a] Jacobson, Michael J., and Rand J. Spiro: "Hypertext Learning Environments, Cognitive Flexibility, and the Transfer of Complex Knowledge: An Empirical Investigation", J. Educational Computing Research, 12,4 (1995), 301-333.
33. [Jacobson and Spiro 95b] Jacobson, M. J., and Rand J. Spiro: "Hypertext learning environments and epistemic beliefs: A preliminary investigation"; Technology-based learning environments: Psychological and educational foundations, S. Vosniadou, E. DeCorte, & Mandl (Eds.), Springer-Verlag, (1995), 290-295.
34. [Jacobson and Archodidou 97] Jacobson, M. J., and Archodidou, A.: "Case-based hypermedia and learning neo-Darwinian evoluationary biology: Promoting conceptual change of complex scientific knowledge", Manuscript submitted for publication (1997), http://lpsl.coe.uga.edu/Jacobson/papers/JacobsonEvo97.pdf.
35. [Jacobson et al. 96] Jacobson, M. J., Mishra, Maouri, C. P., and Kolar, C.: "Learning with hypertext learning environments:Theory, design, and research"; Journal of Educational Multimedia and Hypermedia, 5, 3/4, (1996), 239-281.
36. [Jordan et al. 89] Jordan, Daniel S., Russell, Daniel M., Jensen, Anne-Marie S., and Rogers, Russell A.: "Facilitating the Development of representations in Hypertext with IDE"; Proceedings of Hypertext'89, ACM Press, Pittsburgh (1989), 93-104.
37. [Karunanithi and Bieman 93] Karunanithi, Santhi and Bieman, James M.: "Measuring Software Reuse in Object Oriented Systems and Ada Software"; Technical Report CS-93-125, Colorado State University (1993).
38. [Kitchenham 96] Kitchenham, Barbara Ann: "Evaluating Software Engineering Methods and Tool, Part 1: The Evaluation Context and Evaluation Methods"; Software Engineering Notes, 21, 1 (Jan. 1996), 11-15.
39. [Kitchenham 93] Kitchenham, Barbara: "DESMET METHODOLOGY: Guidelines for Evaluation Method Selection", DESMET Project Deliverable D2.3.1, The National Computing Centre Ltd. (1993).
40. [Landow 87] Landow, George P.: "Relationally Encoded Links and the Rhetoric of Hypertext"; Proceedings of Hypertext'87, ACM Press, (1987), 331-343.
41. [Marmann et al. 92] Marmann, Michael, and Schlageter, Gunter: "Towards a Better Support for the Hypermedia Structuring: The HYDESIGN Model"; Proceedings of the ACM European Conference on Hypertext, ACM Press, Milano (1992), 11-22.
42. [Marshall et al. 91] Marshall, Catherine C., Halasz, Frank G., Rogers, Russell A., and Jr., William C. Janssen: "Aquanet: a hypertext tool to hlod your knowledge in place"; Proceedings of Hypertext'91, ACM Press, San Antonio (1991), 261-275.
43. [Marshall et al. 95] Marshall, Catherine C., and Shipman III, Frank M.: "Spatial Hypertext: designing for Change"; Communications of the ACM, Special Issue on Hypermedia Design, August (1995).
44. [MacDonell 91] MacDonell, S. G.: "Rigor in Sofware Complexity Measurement Experimentation"; J. Systems Software, 16 (1991), 141-149.
45. [Mendes 97] Mendes, M. E. X.: "SHAPE - Southampton Hypermedia Authoring Paradigm for Education", transfer Thesis from MPhil to Ph.D., Department of Electronics and Computer Science, University of Southampton (1997).
46. [Mendes and Hall 97a] Mendes, M. Emilia X. and Hall, Wendy: "An empirical study of hypermedia authoring for education"; Proceedings of the CAE97 Conference, Exeter (1997).
47. [Mendes and Hall 97b] Mendes, M. Emilia X. and Hall, Wendy: "The SHAPE of Hypermedia Authoring for Education"; Proceedings of ED-MEDIA & ED-TELECOM 97, Calgary (1997).
48. [Meyrowitz 86] Meyrowitz, N.: "Intermedia: The Architecture and Construction of an Object-oriented Hypermedia System and Applications framework"; Proceedings of the OOPSLA'86, (1986), 186-201.
49. [Moreira 96] Moreira, A. A. de F. G.: "Desenvolvimento da flexibilidade cognitiva dos alunosfuturos-professores: uma experiencia em Didatica do Ingles"; PhD thesis (1996), University of Aveiro, Portugal.
50. [Nanard and Nanard 95] Nanard, Jocelyne, and Nanard, Marc: "Hypertext Design Environments and the Hypertext Design Process"; Communications of the ACM, Special Issue on Hypermedia Design, August (1995), 49-56.
51. [Prieto-Díaz 93] Prieto-Díaz, R.: "Status Report: Software Reusability"; IEEE Software, 10, 3 (1993), 61-66.
52. [Rana and Bieber 97] Rana, Ajaz R., Bieber, Michael: "Towards a Collaborative Hypermedia Educational Framework"; Proceedings of Thirtieth Annual Hawaii International Conference on System Science, Maui (1997), 610-619.
53. [Rivlin et al. 94] Rivlin, Ehud, Botafogo, Rodrigo, and Schneiderman, Ben: "Navigating in Hyperspace: designing a structure-based toolbox"; Communications of the ACM, 37, 2 (1994), 87-96.
54. [Rossi et al. 95] Rossi, G., Schwabe, D., C. Lucena, J. P., and Cowan, D. D.: "An Object-Oriented Model for Designing Human-Computer Interface of Hypermedia Applications"; Proceedings of the IWHD'95, Montpellier (1995), 131-152.
55. [Schuler and Thüring 94] Schuler, Wolfgang, and Thüring, Manfred: "Pragmatical Hypertext Design (PHD)", Technical Report, GMD Institute, Germany (1994), 3-58.
56. [Spiro et al. 95] Spiro, Rand J., Feltovich, Paul J., Jacobson, Michael J., and Coulson, Richard L.: "Cognitive Flexibility, Constructivism, and Hypertext: Random Access Instruction for Advanced Knowledge Acquisition in Ill-Structured Domains"; Constructivism, L. Steffe & J. Gale (Eds.), Hillsdale, N.J.:Erlbaum (1995).
57. [Thimbleby 96] Thimbleby, Harold: "Systematic web authoring", The British HCI Symposium The Missing Link: Hypermedia Usability Research & The Web, UK (1996), http://www.cs.mdx.ac.uk/harold/webpaper/.
58. [Thüring 94] Thüring, Manfred A: "Conceptual Framework for Hypermedia Design Methodologies"; Workshop on Hypermedia Design and development, Edinburgh (1994).
59. [Turing et al. 95] Turing, Manfred, Hannemann, Jörg, and Haake, Jörg: "Hypermedia and Cognition: Designing for Compreension", Communications of the ACM, Special Issue on Hypermedia Design, August (1995).
60. [Vocht 94] Vocht, J. W.: "Experiments for the Characterization of Hypertext-structures"; Master's Thesis, Eindhoven University Technology, Department of Mathematics and Computing Science (1994).
61. [Yamada et al. 95] Yamada, Shoji, Hong, Jung-Kook, and Sugita, Shigeharu: "Development and Evaluation of Hypermedia for Museum Education: Validation of Metrics"; ACM Transactions on Computer-Human Interaction, 2, 4 (December, 1995), 284-307.