Measuring effectiveness of graph visualizations: A cognitive load perspective

Information Visualization

Volumn 8, Issue 3, 2009, Pages 139-152

  Huang, Weidong ^a   Eades, Peter ^b   Hong, Seok Hee ^b  

^a Australian Council for Educational Research   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Cognitive load; Evaluation; Graph visualization; Visualization effectiveness; Visualization efficiency

Indexed keywords

COGNITIVE LOAD; COGNITIVE LOADS; EVALUATION; GRAPH VISUALIZATION; HUMAN MEMORY; INDIVIDUAL PERFORMANCE; INFORMATION PROCESSING SYSTEMS; MENTAL EFFORT; PERFORMANCE MEASURE; RESPONSE TIME; TASK PERFORMANCE; USER STUDY;

DATA PROCESSING; INDUSTRIAL RESEARCH;

VISUALIZATION;

EID: 69249124601     PISSN: 14738716     EISSN: 14738724     Source Type: Journal    
DOI: 10.1057/ivs.2009.10     Document Type: Article

References (46)

1. Tory, M. and Moller, T. (2004) Human factors in visualization research. IEEE Transactions on Visualization and Computer Graphics 10(1): 72-84.
2. Card, S., Mackinlay, J. and Shneiderman, B. (1999) Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufmann Publishers.
3. Lohse, G.L. (1997) The role of working memory on graphical information processing. Behavior & Information Technology 16(6): 297-308.
4. Baddeley, A. (1986) Working Memory. Oxford, UK: Oxford University Press.
5. Zhang, J., Johnson, K.A., Malin, J. and Smith, J.W. (2002). Humancentered information visualization. International Workshop on Dynamic Visualization and Learning; 18-19 July, Tubingen, Germany.
6. Purchase, H. (1998) Performance of layout algorithms: Comprehension, not computation. Journal of Visual Languages and Computing 9: 647-657.
7. Purchase, H. (2005). Graph drawing empirical studies: Lessons learned. Dagstuhl Seminar 05191 on Graph Drawing: Wadern, Germany.
8. Robertson, G. (2000). Keynote lecture: Leveraging human capabilities in information perceptualization. Proceedings of the Fourth International Conference on Information Visualisation (IV' 00). Los Alamitos, CA: IEEE Computer Society, pp. 3.
9. Ware, C., Purchase, H., Colpoys, L. and McGill, M. (2002) Cognitive measurements of graph aesthetics. Information Visualization 1(2): 103-110.
10. Herman, I., Melancon, G. and Marshall, M. (2000) Graph visualization and navigation in information visualization: A survey. IEEE Transactions on Visualization and Computer Graphics 6(1): 24-43.
11. Ghoniem, M., Fekete, J.-D. and Castagliola, P. (2004). A Comparison of the readability of graphs using node-link and matrix-based representations. Proceedings of the 10th IEEE Symposium on Information Visualization (InfoVis' 04); 10-12 October, Washington, DC: IEEE Computer Society, pp. 17-24.
12. Lohse, J. (1991). A cognitive model for the perception and understanding of graphs. In: S.P. Robertson, G.M. Olson and J.S. Olson (Eds.) Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Reaching Through Technology (CHI' 91); 27 April-2 May, New Orleans, Louisiana, New York: ACM, pp. 137-144.
13. Plaisant, C. (2004). The challenge of information visualization evaluation. Proceedings of the Working Conference on Advanced Visual Interfaces (AVI' 04), 25-28 May, Gallipoli, Italy. New York: ACM, pp. 109-116.
14. Paas, F., Tuovinen, J., Tabbers, H. and van Gerven, P. (2003) Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist 38(1): 63-71. (Pubitemid 36400005)
15. Van Merrienboer, J. and Sweller, J. (2005) Cognitive load theory and complex learning: Recent development and future directions. Educational Psychology Review 17(2): 147-177.
16. Atkinson, R.C. and Shiffrin, R.M. (1968). Human memory: A proposed system and its control processes. In: K.W. Spence and J.T. Spence (eds.) The Psychology of Learning and Motivation: Advances in Research and Theory. Vol.2. New York: Academic Press.
17. Miller, G. (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review 63(2): 81-97.
18. Peterson, L. and Peterson, M. (1959) Short-term retention of individual verbal items. Journal of Experimental Psychology 72: 221-231.
19. Paas, F., Tuovinen, J., Van Merrienboer, J. and Darabi, A. (2005) A motivational perspective on the relation between mental effort and performance: Optimizing learner involvement in instruction. Educational Technology Research and Development 53(3): 25-34.
20. Wickens, C. and Hollands, J. (1999) Engineering Psychology and Human Performance. 3rd edn. Upper Saddle River, NJ: Prentice-Hall.
21. De Waard, D. (1996). The measurement of drivers' mental workload. PhD thesis, University of Groningen, Haren, The Netherlands.
22. Gopher, D. and Braune, R. (1984) On the psychophysics of workload: Why bother with subjective measures? Human Factors 26: 519-532.
23. Hendy, K.C., Hamilton, K.M. and Landry, L.N. (1993) Measuring subjective workload: When is a one scale better than many? Human Factors 35(4): 579-601.
24. Paas, F. (1992) Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive load approach. Journal of Educational Psychology 84: 429-434.
25. Marcus, N., Cooper, M. and Sweller, J. (1996) Understanding instructions. Journal of Educational Psychology 88(1): 49-63.
26. Tuovinen, J. and Paas, F. (2004) Exploring multidimensional approaches to the efficiency of instructional conditions. Instructional Science 32: 133-152.
27. Paas, F. and Van Merrienboer, J. (1993) The efficiency of instructional condition: An approach to combine mental effort and performance measures. Human Factors 35: 734-743.
28. Paas, F. and Van Merrienboer, J. (1994) Instructional control of cognitive load in the training of complex cognitive tasks. Educational Psychology Review 6(4): 351-371.
29. Kerick, S., and Allender, L. (2004). Effects of cognitive workload on decision accuracy, shooting performance, and cortical activity of soldiers, -http://handle.dtic.mil/100.2/ADA433487-
30. Batagelj, V. and Mrvar, A. (2003). Pajek: Analysis and visualization of large networks. In: M. Junger and P. Mutzel (eds.) Graph Drawing Software, Berlin, Heidelberg: Springer-Verlag, pp. 77-103.
31. Wood, R. (1986) Task complexity: Definition of the construct. Organizational Behavior and Human Decision Processes 37(1): 60-82.
32. Kalyuga, S. (2000) When using sound with a text or picture is not beneficial for learning. Australian Journal of Educational Technology 16(2): 161-172.
33. Yost, B., and North, C. (2005). Single complex glyphs versus multiple simple glyphs. Proceedings of (CHI' 05) Extended Abstracts on Human Factors in Computing Systems (CHI' 05); 2-7 April, Portland, OR: New York: ACM, pp. 1889-1892.
34. Tohill, J. and Holyoak, K. (2000) The impact of anxiety on analogical reasoning. Thinking and Reasoning 6: 27-40.
35. Eysenck, M. (1979) Anxiety, learning, and memory: A reconceptualization. Journal of Research in Personality 13: 363-385.
36. Fischer, S., Lowe, R. and Schwan, S. (2008) Effects of presentation speed of a dynamic visualization on the understanding of a mechanical system. Applied Cognitive Psychology 22: 1126-1141.
37. Yost, B. and North, C. (2006) The Perceptual scalability of visualization. IEEE Transactions on Visualization and Computer Graphics 12(5): 837-844.
38. Purchase, H., Hoggan, E. and Gorg, C. (2007). How Important is the 'Mental Map'? - An Empirical Investigation of a Dynamic Graph Layout Algorithm. Proceedings of 14th International Symposium on Graph Drawing (GD' 06), Lecture Notes in Computer Science, Vol.4372, Berlin, Heidelberg: Springer-Verlag, pp. 184-195.
39. Jankun-Kelly, T.J. (2008). Using visualization process graphs to improve visualization exploration. In: J. Freire, D. Koop and L. Moreau (eds.) Provenance and Annotation of Data and Processes: Second International Provenance and Annotation Workshop (IPAW 2008); 17-18 June, Salt Lake City, UT. Revised Selected Papers. Lecture Notes in Computer Science, Vol.5272. Berlin, Heidelberg: Springer-Verlag, pp. 78-91.
40. Henry, N., Elmqvist, N. and Fekete, J.-D. (2008). A methodological note on setting up logging and replay mechanisms in infovis systems. Position paper presented in BEyond time and errors: Novel evaLuation methods for Information Visualization (BELIV'08); April 2008.
41. Shrinivasan, Y. and van Wijk, J. (2008). Supporting the analytical reasoning process in information visualization. Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (CHI' 08); 5-10 April, Florence, Italy. New York: ACM, pp. 1237-1246.
42. Ziemkiewicz, C. and Kosara, R. (2008) The shaping of information by visual metaphors. IEEE Transactions on Visualization and Computer Graphics 14(6): 1269-1276.
43. Amar, R. and Stasko, J. (2005) Knowledge Precepts for Design and Evaluation of Information Visualizations. IEEE Transactions on Visualization and Computer Graphics 11(4): 432-442.
44. North, C. (2006) Visualization viewpoints: Toward measuring visualization insight. IEEE Computer Graphics & Applications 26(3): 6-9.
45. Chen, C. and Czerwinski, M. (2000) Empirical evaluation of information visualization: An introduction. International Journal of Human-computer Studies 53(5): 631-635. (Pubitemid 32032814)
46. Kerren, A., Ebert, A., and Meyer, J. (eds.) (2006). Human-Centered Visualization Environments. Dagstuhl Castle, Germany: GI-Dagstuhl Research Seminar, LNCS 4417, Springer-Verlag.