Are visual programming languages better? The role of imagery in program comprehension

International Journal of Human Computer Studies

Volumn 54, Issue 6, 2001, Pages 799-829

  Navarro Prieto, Raquel ^a   Cañas, Jose J ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

C; Imagery; Mental model; Program comprehension; Spreadsheets; Visual programming language

Indexed keywords

C (PROGRAMMING LANGUAGE); COMPUTER AIDED INSTRUCTION; DATA FLOW ANALYSIS; HUMAN COMPUTER INTERACTION; IMAGE PROCESSING; SPREADSHEETS;

IMAGERY; MENTAL MODEL; PROGRAM COMPREHENSION; VISUAL PROGRAMMING LANGUAGES;

COMPUTER PROGRAMMING LANGUAGES;

EID: 0035384435     PISSN: 10715819     EISSN: None     Source Type: Journal    
DOI: 10.1006/ijhc.2000.0465     Document Type: Article

References (97)

1. Alexandrini, K. L. (1984). Pictures and adult learning. Instructional Science, 13, 63-77.
2. Alexandrini, K. L. (1987). Computer graphics in learning and instruction. In H. A. Houghton & Willows, Eds. The Psychology of Illustration, Chapter 6, pp. 160-188. New York: Springer-Verlag.
3. Bajo, M. T. (1988). Semantic facilitation with pictures and words. Journal of Experimental Psychology: Learning, Memory and Cognition, 4, 579-589.
4. Blankenberger, S. & Hahn, K. (1991). Effects of icon design on human-computer interaction. International Journal of Man-Machine Studies, 5, 363-377.
5. Brooke, J. B. & Duncan, K. D. (1980). Experimental studies of flowchart use at different stage of program debugging. Ergonomics, 23, 1057-1091.
6. Burkhardt, J. M., Détienne, F. & Wiedenbeck, S. (1997). Mental representations constructed by experts and novice in object-oriented program comprehension. INTERACT'97. Sydney, Australia, July 14-18.
7. Cañas, J. J., Bajo, M. T. & Gonzalvo, P. (1994). Mental models and computer programming. International Journal of Human-Computer Studies, 40, 795-811.
8. Corritore, C. L. & Wiedenbeck, S. (1991). What do novices learn during program comprehension? International Journal of Human-Computer Interaction, 3, 199-222.
9. Corritore, C. L. & Wiedenbeck, S. (1999). Mental representations of expert procedural and object-oriented programmers in a software maintenance task. International Journal of Human-Computer Studies, 50, 61-84.
10. Cunnif, N. & Taylor, R. P. (1987). Graphical vs. textual representations: an empirical study of novices' program comprehension. In F. M. Olson, C. Sheppard & E. Soloway, Eds. Empirical Studies of Programmers: Second Workshop, pp. 114-129. Norwood, NJ: Ablex.
11. Curtis, B., Sheppard, S. B. Kruesi-Bailey, E., Baley, J. & Boehm-Davies, D. A. (1989). Experimental evaluation of software documentation formats. Journal of Systems and Software, 9, 167-207.
12. Davies, S. P. (1991). The role of notation and knowledge representation in the determination of programming strategy: a framework of integrating models of programming behaviour. Cognitive Science, 15, 547-572.
13. Davies, S. P. (1994). Knowledge restructuring and the acquisition of programming expertise. International Journal of Man-Machine Studies, 40, 703-726.
14. DeGroot, A. D. (1965). Thought and Choice in Chess. Paris: Mounton.
15. Détienne, F. (1996). What model(s) for program understanding? Proceedings of the Conference on Using Complex Information Systems (UCIS'96), Poitiers, France, September 4-6.
16. DiSessa, A. (1982). Unlearning Aristotelian Physics: a study of knowledge-based learning. Cognitive Science, 6, 37-75.
17. Gilmore, D. J. & Green, T. R. G. (1984). Comprehension of miniature programs. International Journal of Man-Machine Studies, 21, 31-48.
18. Gilmore, D. J. & Green, T. R. G. (1988). Programming plans and programming expertise. The Quarterly Journal of Experimental Psychology, 40A, 423-442.
19. Glaser, E. R. & Glaser, M. O. (1989). Contex effects in stroop-like word and picture processing. Journal of Experimental Psychology: General, 118, 13-42.
20. Glaser, W. R. (1992). Picture naming. Cognition, 42, 61-105.
21. Golin, E. J. (1991). Theory of visual languages. Journal of Visual Languages and Computing, 2, 309-310.
22. Green, T. R. G. (1989). Cognitive dimensions of notation. In R. Winder & A. Sutcliffe, Eds. People and Computers V. Cambridge: Cambridge University Press.
23. Green, T. R. G. & Navarro, R. (1995). Programming plans, imagery and visual programming. In K. Nordy, P. H. Helmersen, D. J. Gilmore & S. A. Arnesen, Eds. INTERACT-95, pp. 139-144. London: Chapman & Hall.
24. Green, T. R. G. & Petre, M. (1992). When visual programs are harder to read then textual programs. Proceedings of the 6th Conference on Cognitive Ergonomics ECCE6, pp. 167-180.
25. Green, T. R. G. & Petre, M. (1996). Usability analysis of visual programming environments: a 'cognitive dimensions' framework. Journal of Visual Languages and Computing, 7, 131-174.
26. Halgren, S. L. & Cooke, N. J. (1993). Towards ecological validity in menu research. International Journal of Man-Machine Studies, 39, 51-70.
27. Hegarty, M. & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32, 717-742.
28. Hendry, D. G. & Green, T. R. G. (1994). Creating, comprehending, and explaining spreadsheets: a cognitive interpretation of what discretionary users think of the spreadsheet model. International Journal Human-Computer Studies, 40, 1033-1065.
29. Igbaria, M. (1992). An examination of microcomputer use in Taiwan. Information and Management, 22, 19-28.
30. Kay, A. (1986). Computer software. Scientific American, September.
31. Kieras, D. (1992). Diagrammatic displays for engineered systems: effects on human performance in interacting with malfunctioning systems. International Journal of Man-Machine Studies, 36, 861-895.
32. Kieras, D. E. & Bovair, S. (1984). The role of mental model in learning to operate a device. Cognitive Science, 8, 255-273.
33. Kipper, J. D., Howard, E. & Ames, C. (1997). Criteria for evaluation of visual programming languages. Journal of Visual Languages and Computing, 8, 175-192.
34. Levie, W. H., Anglin, G. J. & Carney, R. N. (1987). On empirical validating functions of pictures in prose. In H. A. Houghton & D. A. Willows, Eds. The Psychology of Illustration, Chapter 2, pp. 51-86. New York: Springer-Verlag.
35. Levie, W. H. & Lentz, R. (1981). Effects of text illustration: a review of research. Educational Communication Technology, 30, 195-232.
36. Mayer, R. E. (1976). Some conditions of meaningful learning for computer programming: advance organisers and subject control of frame order. Journal of Educational Psychology, 68, 143-150.
37. Mayer, R. E. (1980). Elaboration techniques of technical text: an experimental test of the learning strategy hypothesis. Journal of Educational Psychology, 72, 770-784.
38. Mayer, R. E. (1989). Systematic thinking fostered in illustration in scientific text. Journal of Experimental Psychology, 81, 240-246.
39. Mayer, R. E. (1994). Visual aids to knowledge construction: building mental representations from picture and words. In W. Schnotz & R. Kulhavy, Eds. Comprehension of Graphics, pp. 125-138. Amsterdam: North-Holland.
40. Mayer, R. E. & Bromage, B. (1980). Different recall protocols for technical text due to advance organisers. Journal of Educational Psychology, 72, 209-225.
41. Mayer, R. E. & Gallini, J. K. (1990). When is an illustration worth ten thousand words? Journal of Experimental Psychology, 4, 715-726.
42. McDonald-Ross, M. (1978). Graphics in text. Review o Research in Education, 5, 47-83.
43. Moher, T. G. Mak, D. C., Blumenthatl, B. & Leventhal, L. M. (1993). Comparing the comprehensibility of textual and graphical programs: the case of Petri nets. In C. R. Cook, J. C. Scholtz & J. C. Spohrer, Eds. Empirical Studies of Programmers: Fifth Workshop, pp. 137-161. Norwood, NJ: Ablex.
44. Moran, T. P. (1981). A applied psychology of the user. Computing Surveys, 13, 1-11.
45. Myers, B. A. (1990). Taxonomies of visual programming and program visualization. Journal of Visual Languages and Computing, 1, 97-123.
46. Nardi, B. A. & Miller, J. R. (1990). The spreadsheet interface: a basis for end user programming. INTERACT'90, pp. 977-983. Amsterdam: Elsevier.
47. Nardi, B. A. & Miller, J. R. (1991). Twinkling lights and nested loops: distributed problem solving and spreadsheets development. International Journal of Man-Machine Studies, 34, 161-184.
48. Navarro-Prieto, R. (1996) El Efecto de la Ayudas Pictóricas en la Interacción con el Ordenador. Unpublished Master Dissertation.
49. Navarro-Prieto, R., Cañas, J. J. & Bajo, M. T. (1996) Pictorial aids in computer use. In T. R. G. Green, J. J Cañas & C. Warren, Eds. Proceedings of the 8th European Conference on Cognitive Ergonomics, pp. 77-82, Granada.
50. Nelson, D. L., Reed, V. S. & McEvoy, C. L. (1977). Learning to order pictures and words: a model of sensory and semantic encoding. Journal of Experimental Psychology: Human Learning and Memory, 3, 485-497.
51. Norman, D. A. (1983). Some observations on mental models. In D. Getner & L. A. Stevens, Eds. Mental Models. Hillsdale, NJ: LEA.
52. Norman, D. A. (1986). Cognitive engineering. In D. A. Norman & S. W. Draper, Eds. User-Centred Systems Design, pp. 31-61. Hillsdale, NJ: Lawrence Erlbaum.
53. Paivio, A. (1977). Images, propositions and knowledge. In J. M. Nicholas, Ed. Images, Perception, and Knowledge. The Western Ontario Series in the Philosophy of Science. Dordrecht: Riedel.
54. Paivio, A. (1991). Dual coding theory: retrospect and current status. Canadian Journal of Psychology, 45, 255-287.
55. Panko, R. (1988). Object-oriented spreadsheets: the analytic spreadsheet package. Proceedings of OOPSLA'86, pp. 385-390.
56. Park, O. & Gittelman, S. S. (1992). Selective use of animation and feedback in computer-based instruction. Educational Technology Research and Development, 40, 1042-1629.
57. Petre, M. (1995). Why looking isn't always seeing: readership skills and graphical programming. Communications of the ACM, 38, 33-44.
58. Petre, M. & Blackwell, A. F. (1999). Mental imagery in program design and visual programming. International Journal of Human Computer Studies, 51, 7-30.
59. Pennington, N. (1987a). Stimulus structures and mental representation in expert comprehension of computer programs. Cognitive Psychology, 19, 295-341.
60. Pennington, N. (1987b). Comprehension strategies in programming. In F. M. Olson, C. Sheppard & E. Soloway, Eds. Empirical Studies of Programmers: Second Workshop. Norwood, NJ: Ablex.
61. Potter, M. C. & Falconer, B. A. (1975). Time to understand pictures and words. Nature, 253, 437-438.
62. Raymond, D. (1991). Characterising visual languages. The 1991 IEEE Workshop on Visual Languages. Silver Spring, MD: IEEE Computer Society Press.
63. Reed, S. (1985). Effect of computer graphics on improving estimates to algebra word problems. Journal of Educational Psychology, 77, 285-298.
64. Rieber, L. P. (1989). Animation in computer-based instruction. Educational Technology Research and Development, 38, 77-86.
65. Rieber, L. P. (1990a). Using computer animated graphics in science instruction with children. Journal of Educational Psychology, 82, 135-140.
66. Rieber, L. P. (1990b). The effects of computer animation on adult learning and retrieval tasks. Journal of Computer-Based Instruction, 17, 46-52.
67. Rist, R. S., Plans in programming: definition, demonstration and development. Empirical Studies of Programmers, pp. 28-46.
68. Robertson, S. P., Davies, E. F., Okabe, K. & Fitz-Randolf, D. (1990). Program comprehension beyond the line. In. D. Diaper et al., Eds. Human-Computer Interaction. INTERACT'90. Amsterdam: Elsevier Science Publishers B. V, North-Holland.
69. Robertson, S. P. & Yu, C. C. (1990). Common cognitive representations of program code across task and languages. International Journal of Man-Machine Studies, 33, 343-360.
70. Rogers, Y. (1989). Icons at the interface: their usefulness. Interacting with Computers, 1, 105-117.
71. Rumelhart, D. E. (1980). A reply to Black and Wilensky. Cognitive Science, 4, 313-316.
72. Rumelhart, D. E. & Norman, D. A. (1978). Accretion, tuning and restructuring: three models of learning. In J. W. Cotton & R. Klatsky, Eds. Semantic Factors in Cognition. NJ: Erlbaum.
73. Saarilouma, P. & Sajaniemi, J. (1989). Visual information chunking in spreadsheet calculation. International Journal of Man-Machine Studies, 30, 475-488.
74. Saarilouma, P. & Sajaniemi, J. (1991). Extracting implicit tree structures in spreadsheet calculation. Ergonomics, 34, 1027-1046.
75. Saarilouma, P. & Sajaniemi, J. (1994). Transforming verbal descriptions into mathematical formulas in spreadsheet calculation. International Journal of Human-Computer Studies, 41, 915-948.
76. Sajaniemi, J. & Niiranen, T. (1996). GEE user's manual. Technical Report A-1996-1, Department of Computer Science, University of Joensuu.
77. Scalan, D. A. (1989). Structured flowcharts outperform pseudocode: an empirical comparison. IEEE Software, 6, 28-36.
78. Schvaneveldt, R. W. (1990) PathFinder Associative Networks: Studies in Knowledge organization. Norwood. N.J.: Ablex Publishing Corporation.
79. Schank, R. C. & Abelson, R. P. (1977). Scripts, Plans, Goals, and Understanding. Hillsdale, NJ: Lawrence Erlbaum Associates.
80. Schmalhofer, F. & Glavanov, D. (1986). Three components of understanding a programmer's manual: verbatim, propositional, and situational representations. Journal of Memory and Language, 25, 279-294.
81. Shih, Y.-F. & Alessi, S. M. (1994). Mental model and transfer of learning in computer programming. Journal of Research in Computing Education, 26, 154-175.
82. Shneiderman, B. (1976). Exploratory experiments in programmer behaviour. International Journal of Computer and Information Sciences, 5, 124-143.
83. Shneiderman, B., Mayer, R., MsKay, D. & Heller, P. (1977). Experimental investigations of the utility of detailed flowcharts in programming. Communications of the ACM, 20, 373-381.
84. Snodgrass, J. G. & McCullough, B. (1986). The role of visual similarity in picture categorization. Journal of Experimental Psychology: Learning, Memory and Cognition, 12, 147-154.
85. Spence, R. & Parr, M. (1991). Cognitive assessment of alternatives. Interacting with Computers, 3, 270-282.
86. Soloway, E. & Ehrlich, K. (1984). Empirical studies of programming knowledge. IEEE Transactions on Software Engineering, 5, 595-609.
87. Soloway, S., Ehrlich, K. & Black, J. B. (1983). Beyond numbers: don't ask "how many" as "why". Proceedings of the Conference of Human Factors in Computer Systems, Boston, MA.
88. Soloway, S., Ehrlich, K. & Bonar, J. (1982). Tapping into tacit programming knowledge. Proceedings of the Conference on Human Factors in Computer Systems, Gaithersburg, MD.
89. Stein, B. S., Brock, K. F., Ballard, D. N. & Vye, N. J. (1987). Constraints on effective pictorial and verbal elaboration. Memory and Cognition, 15, 281-290.
90. Van Dijk, T. A. & Kintsch, W. (1983). Tapping into tacit programming knowledge. IEEE Transactions on Software Engineering, SE-10, 595-609.
91. Vessey, I. & Weber, R. (1984). Research on structured programming: an empiricist's evaluation. IEEE Transactions of Software Engineering, SE-10, 397-407.
92. Vicente, K. J. (1992). Memory recall in a process control system: memory measure of expertise and display effectiveness. Memory and Cognition, 20, 356-373.
93. Wandmacher, J. & Müller, U. (1987). On the usability of verbal and iconic command representations. Zeitschift für Psychologie, 9 (Suppl), 35-45.
94. Wiedenbeck, S. & Ramalingam, V. (1999). Novice comprehension of small programs written in the procedural and object-oriented styles. International Journal of Human Computer Studies, 51, 71-88.
95. Widowsky, D. & Eyferth, K. (1986). Comprehending and recalling computer programs of different structural and semantic complexity by experts and novices. In H. P. Willumeit, Ed. Human Decision Making and Manual Control, pp. 267-275. Amsterdam: Elsevier Science Publishers B. V., North-Holland.
96. White, B. (1984). Design computer games to help physic students understand Newton's laws of motion. Cognition and Instruction, 1, 69-108.
97. Whitley, K. N. (1997). Visual programming languages and the empirical evidence for and against. Journal of Visual Languages and Computing, 8, 109-142.