Pictorial Representation and Metaphor in Visual Language Design

Journal of Visual Languages and Computing

Volumn 12, Issue 3, 2001, Pages 223-252

  Blackwell, Alan F ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Metaphor; learning; usability; cognitive ergonomics.

Indexed keywords

EID: 0000193023     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1006/jvlc.2001.0207     Document Type: Article

References (82)

1. Blackwell A. F. Metacognitive theories of visual programming: what do we think we are doing? Proceedings IEEE Symposium on Visual Languages. 1996b;IEEE Computer Society Press, Los Alamitos. p. 240-246.
2. Whitley K. N. Visual programming languages and the empirical evidence for and against. Journal of Visual Languages and Computing. 8:1997;9-142.
3. Witty R. W. Dimensional flowcharting. Software Practice and Experience. 7:1977;553-584.
4. Green T. R. G., Petre M., Bellamy R. K. E. Comprehensibility of visual and textual programs: a test of superlativism against the 'match-mismatch' conjecture. Koenemann-Belliveau J., Moher T. G., Robertson S. P. Empirical Studies of Programmers: Fourth Workshop. 1991;121-146 Ablex, Norwood.
5. Green T. R. G., Petre M. Usability analysis of visual programming environments: a 'cognitive dimensions' approach. Journal of Visual Languages and Computing. 7:1996;131-174.
6. Bremer M. Widget Workshop. 1998;Maxis Kids, Walnut Creek.
7. Baum D. Baum's Definitive Guide to LEGO Mindstorms. 1999;Springer-Verlag, Berlin.
8. Kahn K. Seeing systolic computations in a video game world. Proceedings IEEE Symposium on Visual Languages. 1996;IEEE Computer Society Press, Los Alamitos. p. 95-101.
9. Strothotte C., Strothotte T. Seeing between the Pixels: Pictures in Interactive Systems. 1997;Springer Verlag, Berlin.
10. Dale E. Audiovisual Methods in Teaching 3rd edn. 1969;Holt, Rhinehart & Winston, New York.
11. Glasgow J., Narayanan N. H., Chandrasekaran B. Diagrammatic Reasoning: Cognitive and Computational Perspectives. 1995;AAAI Press, Menlo Park.
12. Blackwell A. F. Thinking with diagrams discussion papers. First Conference on Thinking with Diagrams. 1997;Portsmouth, England.
13. Blackwell A. F., Whitley K. N., Good J., Petre M. Cognitive factors in programming with diagrams. Artificial Intelligence Review. 15:2001;95-113.
14. Smith D. C. PYGMALION: A Computer Program to Model and Stimulate Creative Thinking. 1977;Birkhäuser, Basel.
15. W. Kuhn, B. Blumenthal, 1996, Spatialization: Spatial Metaphors for User Interfaces.
16. A. Marcus, 1997, Metaphor design in user interfaces: How to manage expectation, surprise, comprehension, and delight effectively.
17. Smyth M., Anderson B., Alty J. L. Metaphor reflections and a tool for thought. Kirby M. A. R., Dix A. J., Finlay J. E. People and Computers X. 1995;137-150 Cambridge University Press, Cambridge.
18. Faulkner C. The Essence of Human-Computer Interaction. 1998;Prentice-Hall, Hemel Hempstead.
19. Dix A., Finlay J., Abowd G. L., Beale R. Human Computer Interaction. 1998;Prentice-Hall, Hemel Hempstead.
20. Macintosh Human Interface Guidelines. 1992;Addison-Wesley, Reading.
21. S. A. Douglas, T. P. Moran, 1983, Learning text editor semantics by analogy, Proceedings of CHI '83, 207, 211.
22. Mayer R. E. Different problem-solving competencies established in learning computer programming with and without meaningful models. Journal of Educational Psychology. 67:1975;725-734.
23. Nolder R. Mixing metaphor and mathematics in the secondary classroom. Durkin K., Shire B. Language in Mathematical Education: Research and Practice. 1991;105-114 Open University Press, Buckingham.
24. Spiro R. J., Feltovich P. J., Coulson R. L., Anderson D. K. Multiple analogies for complex concepts: antidotes for analogy-induced misconception in advanced knowledge acquisition. Vosniadou S., Ortony A. Similarity and Analogical Reasoning. 1989;498-531 Cambridge, Cambridge University Press.
25. Carroll J. M., Mack R. L., Kellogg W. A. Interface metaphors and user interface design. Helander M. Handbook of Human-Computer Interaction. 1988;67-86 Elsevier, Amsterdam.
26. Carroll J. M., Thomas J. C. Metaphor and the cognitive representation of computing systems. IEEE Transactions on Systems, Man and Cybernetics. 12:1982;107-116.
27. Gentner D. Structure-mapping: a theoretical framework for analogy. Cognitive Science. 7:1983;155-170.
28. Benbasat I., Todd P. An experimental investigation of interface design alternatives: icon vs. text and direct manipulation vs. menus. International Journal of Man-Machine Studies. 38:1993;369-402.
29. Davis S. A., Bostrom R. P. Training end users: an experimental investigation of the roles of the computer interface and training methods. MIS Quarterly. 17:1993;61-85.
30. Shneiderman B. Direct manipulation: a step beyond programming languages. IEEE Computer. 16:1983;57-69.
31. A. F. Blackwell, 1997, Diagrams about thoughts about thoughts about diagrams, Reasoning with Diagrammatic Representations II: Papers from the AAAI 1997 Fall Symposium, M. Anderson, FS-97-02, AAAI Press, Menlo Park, CA, 77, 84.
32. Petre M., Blackwell A. F. Mental imagery in program design and visual programming. International Journal of Human-Computer Studies. 51:1999;7-30.
33. Greeno J. G. Situations mental models and generative knowledge. Klahr D., Kotovsky K. Complex Information Processing: The Impact of Herbert A. Simon. 1989;285-318 Lawrence Erlbaum Associates, Hillsdale.
34. Fuchs A., Goschke T., Gude D. On the role of imagery in linear syllogistic reasoning. Psychological Research. 50:1988;43-49.
35. Liu C. H., Kennedy J. M. Symbolic forms can be mnemonics for recall. Psychonomic Bulletin and Review. 1:1994;494-498.
36. Matsuno T. Cognitive style and representational strategies in categorical syllogistic reasoning. Tohoku Psychologica Folia. 46:1987;97-102.
37. Shaver P., Pierson L., Lang S. Converging evidence for the functional significance of imagery in problem solving. Cognition. 3:1974/75;359-375.
38. Huttenlocher J. Constructing spatial images: a strategy in reasoning. Psychological Review. 75:1968;550-560.
39. Mani K., Johnson-Laird P. N. The mental representations of spatial descriptions. Memory and Cognition. 10:1982;181-187.
40. Lindsay R. K. Images and inference. Cognition. 29:1988;229-250.
41. Koedinger K. R., Anderson J. R. Abstract planning and perceptual chunks: elements of expertise in geometry. Cognitive Science. 14:1990;511-550.
42. Novak G. S. Jr. Diagrams for solving physical problems. Glasgow J., Narayanan N. H., Chandrasekaran B. Diagrammatic Reasoning: Cognitive and Computational Perspectives. 1995;753-774 AAAI Press, Menlo Park.
43. Buckingham-Shum S. J., MacLean A., Bellotti V. M. E., Hammond N. V. Graphical argumentation and design cognition. Human-Computer Interaction. 12:1997;267-300.
44. Gilmore D. J., Green T. R. G. Comprehension and recall of miniature programs. International Journal of Man-Machine Studies. 21:1984;31-48.
45. Green T. R. G., Navarro R. Programming plans imagery and visual programming. Proceedings Interact '95. 1995;139-144.
46. Rohr G. How people comprehend unknown system structures: conceptual primitives in systems' surface representations. Gorny P., Tauber M. J. Visualization in Programming. 282:1987;89-105 Springer-Verlag, Berlin.
47. Saariluoma P., Sajaniemi J. Transforming verbal descriptions into mathematical formulas in spreadsheet calculation. International Journal of Human Computer Studies. 41:1994;915-948.
48. Ferguson E. S. Engineering and the Mind's Eye. 1992;MIT Press, Cambridge.
49. Goel V. Sketches of Thought. 1995;MIT Press, Cambridge.
50. Goldschmidt G. The dialectics of sketching. Creativity Research Journal. 4:1991;123-143.
51. Suwa M., Tversky B. What do architects and students perceive in their design sketches? A protocol analysis. Design Studies. 18:1997;385-403.
52. Fish J., Scrivener S. Amplifying the mind's eye: sketching and visual cognition. Leonardo. 23:1990;117-126.
53. Dreistadt R. An analysis of the use of analogies and metaphors in science. The Journal of Psychology. 68:1968;97-116.
54. Nersessian N. J. Capturing the dynamics of conceptual change in science. Glasgow J., Narayanan N. H., Chandrasekaran B. Diagrammatic Reasoning: Cognitive and Computational Perspectives. 1995;137-181 AAAI Press, Menlo Park.
55. Qin Y., Simon H. Imagery and mental models. Glasgow J., Narayanan N. H., Chandrasekaran B. Diagrammatic Reasoning: Cognitive and Computational Perspectives. 1995;403-434 AAAI Press, Menlo Park.
56. Johnson-Laird P. N. Freedom & constraint in creativity. Sternberg R. J. The Nature of Creativity: Contemporary Psychological Perspectives. 1988;202-219 Cambridge University Press, Cambridge.
57. Koestler A. The Act of Creation. 1964;Hutchinson, London.
58. Shepard R. N. Externalization of mental images and the act of creation. Randhawa B. S., Coffman W. E. Visual Learning, Thinking and Communication. 1978;133-189 Academic Press, New York.
59. Kaufmann G. Visual Imagery and its Relation to Problem Solving. 1979;Universitetsforlaget, Oslo.
60. Paivio A. Imagery and Verbal Processes. 1971;Holt, Rinehart and Winston, New York.
61. Schwartz D. L. Reasoning about the referent of a picture versus reasoning about the picture as the referent: an effect of visual realism. Memory & Cognition. 23:1995;709-722.
62. Paivio A. The empirical case for dual coding. Yuille J. C. Imagery, Memory & Cognition: Essays in honor of Allan Paivio. 1983;307-332 Erlbaum, Hillsdale.
63. Marschark M., Hunt R. R. On memory for metaphor. Memory & Cognition. 13:1985;413-424.
64. Glenberg A. M., Langston W. E. Comprehension of illustrated text: pictures help to build mental models. Journal of Memory and Language. 31:1992;129-151.
65. Payne S. J. Metaphorical instruction and the early learning of an abbreviated-command computer system. Acta Psychologica. 69:1988;207-230.
66. Simpson H. K., Pellegrino J. W. Descriptive models in learning command languages. Journal of Educational Psychology. 85:1993;539-550.
67. Bower G. H., Karlin M. B., Dueck A. Comprehension and memory for pictures. Memory & Cognition. 3:1975;216-220.
68. Bartlett F. C. Remembering: A Study in Experimental and Social Psychology. 1932;Cambridge University Press, Cambridge.
69. Nelson T. O., Metzler J., Reed D. A. Role of details in the long-term recognition of pictures and verbal descriptions. Journal of Experimental Psychology. 102:1974;184-186.
70. Ryan T. A., Schwartz C. B. Speed of perception as a function of mode of representation. American Journal of Psychology. 69:1956;60-69.
71. Green A. J. K., Barnard P. J. Iconic interfacing: the role of icon distinctiveness and fixed or variable screen locations. Diaper D., Gilmore D., Cockton G., Shackel B. Human-Computer Interaction - Interact '90. 1990;457-462 Elsevier, Amsterdam.
72. Jackendoff R. Semantics and Cognition. 1983;MIT Press, Cambridge.
73. Hoc J.-M., Green T. R. G., Samurçay R., Gilmore D. J. Psychology of Programming. 1990;Academic Press, London.
74. Horton W. The Icon Book. 1994;Wiley, New York.
75. Dreyfuss H. Symbol Sourcebook. 1972;McGraw-Hill, New York.
76. Pilton B. The intelligent ball bearing. Manifold-9. 1971;Mathematics InstituteUniversity of Warwick. p. 17-20.
77. Blackwell A. F. Metaphor or analogy: how should we see programming abstractions? Vanneste P., Bertels K., De Decker B., Jaques J. -M. Proceedings of the 8th Annual Workshop of the Psychology of Programming Interest Group. 1996a;105-113.
78. Hayes J. R., Simon H. A. Psychological differences between problem isomorphs. Castellan N. J., Pisoni D. B., Potts G. R. Cognitive Theory. 1977;Erlbaum, London.
79. Johnson-Laird P. N. Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness. 1983;Cambridge University Press, Cambridge.
80. Pimm D. Symbols and Meanings in School Mathematics. 1995;Routledge, London.
81. Potosnak K. Do icons make user interfaces easier to use? IEEE Software. 5:1988;97-99.
82. A. F. Blackwell, 1998, Metaphor in diagrams, Cambridge University, http://www.cl.cam.ac.uk/~afb21/publications/thesis/.