A meta-study of algorithm visualization effectiveness

Journal of Visual Languages and Computing

Volumn 13, Issue 3, 2002, Pages 259-290

  Hundhausen, Christopher D ^a   Douglas, Sarah A ^b   Stasko, John T ^c  

^a UNIVERSITY OF HAWAII   (United States)

^b UNIVERSITY OF OREGON   (United States)

^c Georgia Institute of Technology   (United States)

Author keywords

Algorithm visualization; Empirical studies of effectiveness; Literature reviews; Meta analysis; Sofware visualization

Indexed keywords

EID: 0036623872     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1006/jvlc.2002.0237     Document Type: Article

References (60)

1. R. Baecker (1975) Two systems which produce animated representations of the execution of computer programs. SIGCSE Bulletin, 7, 158-167.
2. M.H. Brown (1998) Algorithm Animation. The MIT Press, Cambridge, MA.
3. J.T. Stasko (1990) TANGO: a framework and system for algorithm animation. IEEE Computer 23, 27-39.
4. J.T. Stasko (1997) Using student-built animations as learning aids. In: Proceedings of the ACM Technical Symposium on Computer Science Education. ACM Press, New York, pp. 25-29.
5. C.D. Hundhausen (1999) Toward effective algorithm visualization artifacts: designing for participation and communication in an undergraduate algorithms course. Unpublished Ph.D. dissertation, Department of Computer and Information Science, University of Oregon.
6. P. Gloor (1998) Animated algorithms. In: Software Visualization: Programming as a Multimedia Experience (M. Brown, J. Domingue, B. Price & J. Stasko, eds) The MIT Press, Cambridge, MA, pp. 409-416.
7. J.S. Gurka, & W. Citrin (1996) Testing effectiveness of algorithm animation. In: Proceedings of the 1996 IEEE Symposium on Visual Languages. IEEE Computer Society Press, Los Alamitos, CA, pp. 182-189.
8. T. Naps (1990) Algorithm visualization in computer science laboratories. In: Proceedings of the 21st SIGCSE Technical Symposium on Computer Science Education. ACM Press, New York, pp. 105-110.
9. R. Baecker (1998) Sorting out sorting: a case study of software visualization for teaching computer science. In: Software visualization: Programming as a Multimedia experience (M. Brown, J. Domingue, B. Price & J. Stasko, eds) The MIT Press, Cambridge, MA, pp. 369-381.
10. R. Duisberg (1987) Visual programming of program visualizations. In: Proceedings of the IEEE 1987 Visual Language Workshop. IEEE Computer Society Press, Los Alamitos, CA.
11. E. Helttula, A. Hyrskykari & K.J. Raiha (1989) Graphical specification of algorithm animations with ALLADDIN. In: Proceedings of the 22nd Annual Conference on Systems Sciences. IEEE Computer Society Press, Los Alanitos, CA, pp. 892-901.
12. J.T. Stasko (1991) Using Direct Manipulation to Build Algorithm Animations by Demonstration. In: Proceedings of ACM CHI '91 Conference on Human Factors in Computing Systems. ACM Press, New York, pp. 307-314.
13. A.W. Lawrence, A.N. Badre & J.T. Stasko (1994) Empirically evaluating the use of animations to teach algorithms. In: Proceedings of the 1994 IEEE Symposium on Visual Languages. IEEE Computer Society Press, Los Alamitos, CA, pp.48-54.
14. S.R. Hansen, N.H. Narayanan & D. Schrimpsher (2000) Helping learners visualize and comprehend algorithms. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning 1.
15. J. Stasko, A. Badren & C. Lewis (1993) Do algorithm animations assist learning? An empirical study and analysis. In: Proceedings of ACM INTERCHI'93 Conference on Human Factors in Computing Systems. ACM Press, New York, pp. 61-66.
16. A.W. Lawrence (1993) Empirical studies of the value of algorithm animation in algorithm understanding. Unpublished Ph.D. dissertation, Department of Computer Science, Georgia Institute of Technology.
17. M.D. Byrne, R. Catrambone & J.T. Stasko (1999) Evaluating animations as student aids in learning computer algorithms. Computers & Education 33, 253-278.
18. B.A. Price, R.M. Baecker & I.S. Small (1993) A principled taxonomy of software visualization. Journal of Visual Languages and Computing 4, 211-266.
19. J. Bazik, R. Tamassia, S. Reiss & A. van Dam (1998) Software visualization in teaching at Brown University. In: Software Visualization: Programming as a Multimedia Experience (M. Brown, J. Domingue, B. Price & J. Stasko, eds). The MIT Press, Cambridge, MA, pp. 383-398.
20. J.S. Gurka (1996) Pedagogic Aspects of Algorithm Animation. Unpublished Ph.D. dissertation, Computer Science, University of Colorado.
21. D.R. Goldenson & B.J. Wang (1991) Use of structure editing tools by novice programmers. In: Empirical Studies of Programmer: Fourth Workshop. Aldex Publishing, Norwood, NJ, pp. 99-120.
22. K.C. Cox & G.C. Roman (1994) An evaluation of the Pavane visualization system. Technical Report WUCS-94-09, Department of Computer Science, Washington University of St. Louis, St. Louis, MO, April 1994.
23. J. Nielsen (1992) Finding usability problems through heuristic evaluation. In: Proceedings of ACM CHI '92 Conference on Human Factors in Computing Systems. ACM Press, New York, pp. 373-380.
24. P.G. Polson, C. Lewis, J. Rieman & C. Wharton (1992) Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. International Journal of Man-Machine Studies 36, 741-773.
25. D.J. Gilmore (1990) Methodological issues in the study of programming. In: Psychology of Programming (J.-M. Hoc, T.R.G. Green, R. Samurcay & D.J. Gilmore, eds). Academic Press, San Diego, pp. 83-98.
26. B. Price (1990) A framework for the automatic animation of concurrent programs. Unpublished M.S. thesis, Department of Computer Science, University of Toronto.
27. P. Mulholland (1998) A principled approach to the evaluation of SV: a case study in Prolog. In: Software visualization: Programming as a Multimedia Experience (M. Brown, J. Domingue, B. Price & J. Stasko, eds). The MIT Press, Cambridge, MA, pp. 439-452.
28. M.E. Crosby & J. Stelovsky (1995) From multimedia instruction to multimedia evaluation. Journal of Educational Multimedia and Hypermedia 4, 147-162.
29. L.V. Hedges & I. Olkin (1985). Statistical Methods for Meta-Analysis. Academic Press, Orlando.
30. C. Chen & Y. Yu (2000) Empirical studies of information visualization: a meta-analysis. International Journal of Human-Computer studies 53, 851-866.
31. C.D. Hundhausen, & S.A. Douglas (2000) Using visualizations to learn algorithms: should students construct their own, or view an expert's? In: Proceedings 2000 IEEE International Symposium on Visual Languages. IEEE Computer Society Press, Los Alamitos, pp. 21-28.
32. D.J. Jarc, M.B. Feldman & R.S. Heller (2000) Assessing the benefits of interactive prediction using web-based algorithm animation courseware. In: Proceedings SIGCSE 2000. ACM Press, New York, pp. 377-381.
33. C. Kann, R.W. Lindeman, & R. Heller (1997) Integrating algorithm animation into a learning environment. Computers & Education 28, 223-228.
34. E. Wenger (1987) Artificial Intelligence and Tutoring Systems. Morgan Kaufmann, Los Altos, CA.
35. J. Roschelle (1990) Designing for conversations. Presented at AAAI Symposium on Knowledge-Based Environments for Learning and Teaching, Stanford, CA, 1990.
36. A. Newell & H.A. Simon (1972) Human Problem Solving. Prentice-Hall, Englewood Cliffs, NJ.
37. R.E. Mayer & R.B. Anderson (1991) Animations need narrations: an experimental test of a dual-coding hypothesis. Journal of Educational Psychology 83, 484-490.
38. A. Paivio (1983) The empirical case for dual coding. In: Imagery, Memory, and Cognition: Essays in Honor of Allan Paivio (J.C. Yuille, ed). Lawrence Erlbaum Associates, Hillsdale, NJ.
39. C. Cooper (1997) Individual differences. Oxford Illustrated Press, Oxford.
40. . R. Riding & S. Rayner (1998) Cognitive Styles and Learning Strategies. David Fulton Publishers, London.
41. L.B. Resnick (1989) Introduction. In: Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser (L.B. Resnick, ed.). Erlbaum, Hillsdale, NJ, pp. 1-24.
42. C. Kehoe, J. T. Stasko & A. Taylor (2001) Rethinking the evaluation of algorithm animations as learning aids: an observational study. International Journal of Human-Computer Studies 54, 265-284.
43. L. a. Suchman (1987) Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, New York.
44. J. Lave & E. Wenger (1991) Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, New York, 138pp.
45. S. A. Douglas, C. D. Hundhausen & D. McKeown (1996) Exploring human visualization of computer algorithms. In: Proceedings 1996 Graphics Interface Conference. Canadian Graphics Society, Toronto, CA, pp. 9-16.
46. J. Rubin (1994) Handbook of Usability Testing: John Wiley and Sons, New York.
47. R. Sanjek (1995) Ethnography. In: Encylopedia Dictionary of Social and Cultural anthropology (A. Barnard & J. Spencer, eds). Routledge, London.
48. W. Foddy (1994) Constructing Questions for Interviews and Questionnaires: Theory and Practice in Social Research. Cambridge University Press, Cambridge.
49. D. Lavery & G. Cockton (1995) A pilot study of early usability evaluation methods for software visualisations. FIDE Technical Report FIDE/95/141[, University of Glasgow, Glasgow, Scotland.
50. A. Badre, M. Baranek, J. M. Morris & J. T. Stasko (1992) Assessing program visualization systems as instructional aids: In: Computer Assisted Learning, ICCAL '92 (I. Tomek, ed.). Springer-Verlag, New York, pp. 87-99.
51. D. Kimelman, B. Rosenburg & T. Roth (1994) Strata-Various: Multi-layer visualization of dynamics in software system behavior. In: Proceedings Visualization '94 IEEE Computer Society Press, Los Alamitos, CA, pp. 172-178.
52. M. J. Baker & S. G. Eick (1995) Space-filling software visualization. Journal of Visual Languages and Computing 6, 119-133.
53. T. Shimomura & S. Isoda (1991) Linked-list visualization for debugging. IEEE Software 8, 44-51.
54. B. A. Myers (1990) Taxonomies of visual programming and program visualization. Journal of Visual Languages and Computing 1, 97-123.
55. N. C. Shu (1988) Visual programming. Van Nostrand Reinhold, New York.
56. M. H. Brown (1988) Perspectives on algorithm animation. In: Proceedings of the ACM SIGCHI '88 Conference on Human Factors in Computing Systems. ACM Press, New York, pp. 33-38.
57. J. T. Stasko & C. Patterson (1992) Understanding and characterizing software visualization systems: In: Proceedings of the 1992 IEEE Symposium on Visual Languages. IEEE Computer Society Press, Los Alamitos, CA, pp. 3-10.
58. G. Singh & M. H. Chignell (1992) Components of the visual computer: a review of relevant technologies. Visual Computer 9, 115-142.
59. E. Kraemer & J. T. Stasko (1993) The visualization of parallel systems: an overview. Journal of Parallel and Distributed Computing 18, 105-117.
60. G. C. Roman & K. C. Cox (1993) A taxonomy of program visualization systems. IEEE Computer 26, 11-24.