Evaluation methodology for comparing memory and communication of analytic processes in visual analytics

ACM International Conference Proceeding Series

Volumn 10-November-2015, Issue , 2014, Pages 27-34

  Ragan, Eric D ^a   Goodall, John R ^a  

^a OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Analytic provenance; Evaluation; Process memory; Visual history

Indexed keywords

COMPUTER PROGRAMMING;

ANALYTIC PROVENANCE; EVALUATION; EVALUATION METHODOLOGIES; EVALUATION METHODS; OBJECTIVE EVALUATION; POTENTIAL BENEFITS; QUANTITATIVE AND QUALITATIVE ANALYSIS; VISUAL ANALYTICS;

VISUALIZATION;

EID: 84955443531     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2669557.2669563     Document Type: Conference Paper

References (23)

1. Amar, R., Eagan, J. and Stasko, J. Low-level components of analytic activity in information visualization. IEEE Symposium on Information Visualization (2005), 111-117.
2. Andrews, C., Endert, A. and North, C. Space to think: Large high-resolution displays for sensemaking. Proceedings of the 28th international conference on Human factors in computing systems (2010), 55-64.
3. Andrews, K. Evaluating information visualisations. Proceedings of the 2006 AVI BELIV workshop (2006), 1-5.
4. Bavoil, L., Callahan, S. P., Crossno, P. J., Freire, J., Scheidegger, C. E., Silva, C. T. and Vo, H. T. Vistrails: Enabling interactive multiple-view visualizations. IEEE Visualization (2005), 135-142.
5. Boren, T. and Ramey, J. Thinking aloud: Reconciling theory and practice. IEEE Transactions on Professional Communication, 43, 3 (2000), 261-278.
6. Callahan, S. P., Freire, J., Santos, E., Scheidegger, C. E., Silva, C. T. and Vo, H. T. VisTrails: Visualization meets data management. Proceedings of the 2006 ACM SIGMOD international conference on management of data (2006), 745-747.
7. Czerwinski, M. and Horvitz, E. An investigation of memory for daily computing events. People and Computers XVIMemorable Yet Invisible (2002), 229-245.
8. Del Rio, N. and da Silva, P. P. Identifying and explaining map imperfections through knowledge provenance visualization. University of Texas at El Paso, 2007.
9. Dou, W., Jeong, D. H., Stukes, F., Ribarsky, W., Lipford, H. R. and Chang, R. Recovering reasoning processes from user interactions. IEEE Computer Graphics and Applications, 29, 3 (2009), 52-61.
10. Dunne, C., Henry Riche, N., Lee, B., Metoyer, R. and Robertson, G. GraphTrail: Analyzing large multivariate, heterogeneous networks while supporting exploration history. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2012), 1663-1672.
11. Freire, J., Koop, D., Santos, E. and Silva, C. T. Provenance for computational tasks: A survey. Computing in Science & Engineering, 10, 3 (2008), 11-21.
12. Gotz, D. and Zhou, M. X. Characterizing users' visual analytic activity for insight provenance. Information Visualization, 8, 1 (2009), 42-55.
13. Griffin, A. L., MacEachren, A. M., Hardisty, F., Steiner, E. and Li, B. A comparison of animated maps with static smallmultiple maps for visually identifying space-time clusters. Annals of the Association of American Geographers, 96, 4 (2006), 740-753.
14. Gwet, K. Handbook of inter-rater reliability. Gaithersburg, MD: STATAXIS Publishing Company (2001), 223-246.
15. Heer, J., Mackinlay, J., Stolte, C. and Agrawala, M. Graphical histories for visualization: Supporting analysis, communication, and evaluation. Visualization and Computer Graphics, IEEE Transactions on, 14, 6 (2008), 1189-1196.
16. Heer, J. and Shneiderman, B. Interactive dynamics for visual analysis. Queue, 10, 2 (2012), 30.
17. Horvitz, E., Dumais, S. and Koch, P. Learning predictive models of memory landmarks. Proceedings of the CogSci (2004.
18. Isenberg, P., Zuk, T., Collins, C. and Carpendale, S. Grounded evaluation of information visualizations. Proceedings of the 2008 Workshop on BEyond time and errors: Novel evaLuation methods for Information Visualization (2008), 6.
19. Kadivar, N., Chen, V., Dunsmuir, D., Lee, E., Qian, C., Dill, J., Shaw, C. and Woodbury, R. Capturing and supporting the analysis process. IEEE Symposium on Visual Analytics Science and Technology (2009), 131-138.
20. Park, Y. and Furuta, R. Keeping narratives of a desktop to enhance continuity of on-going tasks. Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries (2008), 393-396.
21. Plaisant, C. The challenge of information visualization evaluation. Proceedings of the working conference on Advanced Visual Interfaces (AVI) (2004), 109-116.
22. Saraiya, P., North, C. and Duca, K. An insight-based methodology for evaluating bioinformatics visualizations. Visualization and Computer Graphics, IEEE Transactions on, 11, 4 (2005), 443-456.
23. Shrout, P. E. and Fleiss, J. L. Intraclass correlations: Uses in assessing rater reliability. Psychological bulletin, 86, 2 (1979), 420.