Grounded evaluation of information visualizations

Proceedings of the 2008 Conference on BEyond Time and Errors: Novel EvaLuation Methods for Information Visualization 2008, BELIV'08

Volumn , Issue , 2008, Pages

  Isenberg, Petra ^a,b   Zuk, Torre ^a,b   Collins, Christopher ^a,b   Carpendale, Sheelagh ^a,b  

^a UNIVERSITY OF CALGARY   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Evaluation; Information visualization

Indexed keywords

ERRORS; INFORMATION ANALYSIS; INFORMATION SCIENCE; INFORMATION SYSTEMS; LIFE CYCLE;

CASE STUDIES; EVALUATION; HOLISTIC APPROACHES; INFORMATION VISUALIZATION; INFORMATION VISUALIZATIONS; MEDICAL DIAGNOSTICS; VISUAL ANALYTICS;

VISUALIZATION;

EID: 57349099156     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1377966.1377974     Document Type: Conference Paper

References (34)

1. F. Auerbach. Qualitative Data: An Introduction to Coding and Analysis. New York University Press, New York, 2003.
2. R. E. Boyatzis. Transforming Qualitative Information: Thematic Analysis and Code Development. Sage Publications, London, 1998.
3. S. Card, J. D. Mackinlay, and B. Shneiderman, editors. Readings In Information Visualization: Using Vision To Think. Morgan Kauffman Publishers, San Francisco, USA, 1999.
4. J. W. Creswell. Qualitative Inquiry and Research Design: Choosing Among Five Traditions. Sage Publications, London, 1998.
5. Dey. Grounding Grounded Theory: Guidelines for Qualitative Inquiry. Academic Press, San Diego, London, 1999.
6. G. Ellis and A. Dix. An explorative analysis of user evaluation studies in information visualization. In Proc. of the workshop on BEyond time and errors: NovelEvaluation Methods for Information Visualization (BELIV), 2006.
7. González and A. Kobsa. A workplace study of the adoption of information visualization systems. In Proceedings of the International Conference on Knowledge Management, pages 92-102, 2003.
8. S. Gorard. Combining Methods in Educational Research. McGraw-Hill Education, New York, USA, 2004.
9. J. C. Greene, V. J. Caracelli, and W. F. Graham. Toward a conceptual framework for mixed-method evaluation design. Educational Evaluation and Policy Analysis, 11(3):255-274, 1989.
10. P. Isenberg and S. Carpendale. Interactive tree comparison for co-located collaborative information visualization. IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE Conference on Information Visualization), 12(5), Nov/Dec 2007.
11. P. Isenberg, A. Tang, and S. Carpendale. An exploratory study of visual information analysis. In Proceedings of the Conference on Human Factors in Computing Systems (CHI), New York, NY, USA, 2008. ACM Press. To appear.
12. A. Kobsa. User experiments with tree visualization systems. In Proceedings of the IEEE Symposium on Information Visualization, pages 9-26, 2004.
13. R. Kruger, S. Carpendale, S. D. Scott, and A. Tang. Fluid integration of rotation and translation. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pages 601-610, New York, USA, 2005. ACM Press.
14. Lewin, editor. Research Methods in the Social Sciences. Sage Publications, London, 2004.
15. G. Mark, K. Carpenter, and A. Kobsa. A model of synchronous collaborative information visualization. In Proceedings of the Conference on Information Visualization (IV), pages 373-381, Los Alamitos, USA, 2003. IEEE Press.
16. G. Mark, A. Kobsa, and V. Gonzalez. Do four eyes see better than two? Collaborative versus individual discovery in data visualization systems. In Proceedings of the Conference on Information Visualization (IV), pages 249-255, Los Alamitos, USA, July 2002. IEEE Press.
17. R. Mazza and A. Berrè. Focus group methodology for evaluating information visualization techniques and tools. In Proceedings of the Conference on Information Visualization (IV), 2007.
18. W. L. Neuman. Social Research Methods: Qualitative and Quantitative Approaches. Allyn & Bacon, third edition, 1997.
19. J. Nielsen and R. L. Mack. Usability Inspection Methods. John Wiley & Sons, 1994.
20. North. Toward measuring visualization insight. IEEE Computer Graphics and Applications, 26(3):6-9, 2006.
21. E. S. Patterson, D. Tinapple, E. M. Roth, J. M. Finley, and G. G. Kuperman. Aiding the intelligence analyst in situations of data overload: From problem definition to design concept exploration. Technical Report ERGO-CSEL 01-TR-01, Institute for Ergonomics/Cognitive Systems Engineering Laboratory Report, 2001.
22. Q. Patton. Qualitative Research and Evaluation Methods. Sage Publications, London, third edition, 2001.
23. Plaisant. The challenge of information visualization evaluation. In M. F. Costabile, editor, Proceedings of the Working Conference on Advanced Visual Interfaces (AVI), pages 109-116, New York, USA, 2004. ACM Press.
24. M. Russell, M. J. Stefik, P. Pirolli, and S. K. Card. The cost structure of sensemaking. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pages 269-276, New York, USA, 1993. ACM Press.
25. P. Saraiya, C. North, and K. Duca. An insight-based methodology for evaluating bioinformatics visualizations. IEEE Transactions on Visualization and Computer Graphics (Proceedings of the IEEE Symposium on Information Visualization), 11(4):443-156, 2005.
26. S. D. Scott, M. S. T. Carpendale, and K. M. Inkpen. Territoriality in collaborative tabletop workspaces. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW), pages 294-303, New York, USA, 2004. ACM Press.
27. B. Shneiderman and C. Plaisant. Strategies for evaluating information visualization tools: Multi-dimensional in-depth long-term case studies. In Proc. of the workshop on BEyond time and errors: NovelEvaluation Methods for Information Visualization (BELIV), 2006.
28. T. A. Slocum, D. C. Cliburn, J. J. Feddema, and J. R. Miller. Evaluating the usability of a tool for visualizing the uncertainty of the future global water balance. Cartography and Geographic Information Science, 30(4):299-317, 2003.
29. A. Strauss and J. Corbin. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Sage Publications, London, 1998.
30. Tang and S. Carpendale. An observational study on information flow during nurses' shift change. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pages 219-228, New York, USA, 2007. ACM.
31. J. C. Tang. Findings from observational studies of collaborative work. International Journal of Man-Machine Studies, 34(2):143-160, February 1991.
32. Tory and T. Möller. Evaluating visualizations: Do expert reviews work? IEEE Computer Graphics and Applications, 25(5):8-11, Sept./Oct. 2005.
33. W. Willett, J. Heer, and M. Agrawala. Scented widgets: Improving navigation cues with embedded visualizations. IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE Conference on Information Visualization), 12(5), Nov/Dec 2007.
34. T. D. Zuk. Visualizing Uncertainty. PhD thesis, University of Calgary, Calgary, Alberta, 2008.