Comparing benchmark task and insight evaluation methods on timeseries graph visualizations

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2010, Pages 55-62

  Saraiya, Purvi ^a   North, Chris ^a   Duca, Karen ^b  

^a Virginia Polytechnic Institute and State University   (United States)

^b VIRGINIA BIOINFORMATICS INSTITUTE   (United States)

Author keywords

Empirical evaluation; Graph visualization; Timeseries data analysis

Indexed keywords

BIOINFORMATICS SOFTWARE; EMPIRICAL DATA; EMPIRICAL EVALUATIONS; EMPIRICAL RESEARCH METHOD; EVALUATION METHOD; GRAPH VERTEX; GRAPH VISUALIZATION; INDIVIDUAL DIFFERENCES; TIME-SERIES DATA; TIMESERIES DATA ANALYSIS; VISUALIZATION TOOLS;

BIOINFORMATICS; ERRORS; INFORMATION ANALYSIS; INFORMATION SYSTEMS; VISUALIZATION;

DATA VISUALIZATION;

EID: 84857589626     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2110192.2110201     Document Type: Conference Paper

References (24)

1. C. Plaisant, "The Challenge of Information Visualization Evaluation", Proc. of Advanced Visual Interfaces -AVI 2004.
2. C. Chen and M. Czerwinski, "Empirical evaluation of information visualizations: an introduction", IJHCS, vol 53, pp 631-635, 2000. (Pubitemid 32032814)
3. C. North, "Toward Measuring Visualization Insight", IEEE Computer Graphics & Applications, 26(3): 6-9, May/June 2006. (Pubitemid 46404978)
4. P. Saraiya, C. North, and K. Duca, "An insight-based methodology for evaluating bioinformatics visualization", IEEE Transactions on Visualization and Computer Graphics, Vol 11, No.4, 2005.
5. Duggan, D., Bittner, B., Chen, Y., Meltzer, P., Trent, J. "Expression profiling using cDNA microarrays", Nat. Gen., vol 21, 11-19, 1999.
6. P. Saraiya, C. North, and K. Duca, "Visualization for Biological Pathways: Requirements Analysis, Systems Evaluation and Research Agenda," Information Visualization, vol. 4, no. 3, 2005.
7. P. Saraiya, P. Lee, C. North, "Visualization of Graphs with Associated Timeseries data", Proceedings of Infovis 2005.
8. Shneiderman, B. and Plaisant, C. "Strategies for evaluating information visualization tools: multi-dimensional in-depth longterm case studies." Proc. of AVI BELIV 2006, pg. 1-7.
9. G. Golovchinsky, and N.J Belkin, "Innovation and Evaluation of Information Exploration Interfaces: A CHI98 Workshop." SIGCHI Bulletin 31(1):22-25, 1999.
10. C. Chen, Y. Yu, "Empirical studies of information visualization: a meta-analysis", IJHCS, vol 53, pp 851-866, 2000. (Pubitemid 32032824)
11. R. Kosara, C. G. Healey, V. Interrante, D. Laidlaw, C. Ware, "Thoughts on User Studies: Why, How, and When", IEEE CG&A, vol. 23, no. 4, pp. 20-25, July/August 2003.
12. D. House, V. Interrante, D. Laidlaw, R. Taylor, C. Ware, "Design and Evaluation in Visualization Research", Panel, IEEE Vis, 2005.
13. M. Tory and T. Möller, "Evaluating Visualizations: Do Expert Reviews Work?", IEEE CG&A,.25(5), pp.8-11, Sept./Oct. 2005. (Pubitemid 41555420)
14. Steves, M.P., Morse, E., Gutwin, C., Greenberg, S., "A Comparison of Usage Evaluation and Inspection Methods for Assessing Groupware Usability", 2001 ACM Conf on Supporting Group Work.
15. A.J. Brush, M. Ames, J. Davis. "A Comparison of Synchronous Remote and Local Usability Studies for an Expert Interface". Extended Abstracts, CHI 2004.
16. Ester Baauw and Mathilde M. Bekker, "A comparison of two analytical evaluation methods for children's computer games" Interact 2005 Workshop on Child Computer Interaction.
17. Jeffries, R., Desurvire, H. "Usability Testing vs. Heuristic Evaluation: Was there a Contest?", SIGCHI Bulletin, 24(4):39-41, 1992.
18. H R Hartson, and T S Andre, "Criteria for evaluating usability methods", IJHCI, 2001, Vol. 13, No. 4, Pages 373-410.
19. John, B., Marks, S. "Tracking the effectiveness of usability evaluation methods", BIT, 16, 4/5, 188-202, 1997. (Pubitemid 127623939)
20. A. Doubleday, M. Ryan, M. Springett, A. Sutcliffe, "A Comparison of Usability Techniques for Evaluating Design", DIS 1997, 101-110.
21. P.Saraiya, C.North, V.Lam, K.Duca, "An Insight-based Longitudinal Study of Visual Analytics", IEEE TVCG, 12(6): 1511-1522, 2006. (Pubitemid 44523094)
22. STKE database, www.stke.org
23. R. Amar, J. Eagan, and J. Stasko, "Low-Level Components of Analytic Activity in Information Visualization", Infovis 2005.
24. J. Seo, B. Shneiderman, "Knowledge Discovery in High Dimensional Data: Case Studies and a User Survey for the Rank-by-Feature Framework", IEEE TVCG, Vol. 12, No. 3, 2006.