An insight- and task-based methodology for evaluating spatiotemporal visual analytics

2014 IEEE Conference on Visual Analytics Science and Technology, VAST 2014 - Proceedings

Volumn , Issue , 2015, Pages 63-72

  Gomez, Steven R ^a   Guo, Hua ^a   Ziemkiewicz, Caroline ^b   Laidlaw, David H ^a  

^a BROWN UNIVERSITY   (United States)

^b APTIMA INC   (United States)

Author keywords

Evaluation methodology; information visualization; insight based evaluation; network visualization; visual analytics

Indexed keywords

GRAPHICAL USER INTERFACES; INFORMATION SYSTEMS; PETROLEUM RESERVOIR EVALUATION;

EVALUATION METHODOLOGIES; INFORMATION VISUALIZATION; INSIGHT-BASED EVALUATION; NETWORK VISUALIZATION; VISUAL ANALYTICS;

VISUALIZATION;

EID: 84929456793     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VAST.2014.7042482     Document Type: Conference Paper

References (31)

1. IEEE VAST Challenge 2011. http://hcil.cs.umd.edu/ localphp/hcil/vast11/. Accessed: 2014-03-22.
2. R. Amar, J. Eagan, and J. Stasko. Low-level components of analytic activity in information visualization. In Information Visualization, 2005. INFOVIS 2005. IEEE Symposium on, pages 111-117, Oct 2005.
3. N. Andrienko and G. Andrienko. A visual analytics framework for spatiotemporal analysis and modelling. Data Min. Knowl. Discov., 27(1):55-83, July 2013.
4. N. Andrienko, G. Andrienko, and P. Gatalsky. Exploratory spatiotemporal visualization: an analytical review. Journal of Visual Languages &Computing, 14(6):503-541, 2003.
5. M. Bostock, V. Ogievetsky, and J. Heer. D3: Data-driven documents. Visualization and Computer Graphics, IEEE Transactions on, 17(12):2301-2309, Dec 2011.
6. M. Brehmer and T. Munzner. A multi-level typology of abstract visualization tasks. Visualization and Computer Graphics, IEEE Transactions on, 19(12):2376-2385, Dec 2013.
7. M. Cammarano, X. Dong, B. Chan, J. Klingner, J. Talbot, A. Halevy, and P. Hanrahan. Visualization of heterogeneous data. Visualization and Computer Graphics, IEEE Transactions on, 13(6):1200-1207, 2007.
8. N. Cao, D. H. Gotz, and J. Sun. Multi-faceted visualization of rich text corpora, Aug. 31 2010. US Patent App. 12/872,794.
9. S. Card, J. Mackinlay, and B. Shneiderman. Readings in Information Visualization-Using Vision to Think. Morgan Kaufmann, San Francisco, CA, USA, 1999.
10. S. Carpendale. Evaluating information visualizations. In A. Kerren, J. T. Stasko, J.-D. Fekete, and C. North, editors, Information Visualization, pages 19-45. Springer-Verlag, Berlin, Heidelberg, 2008.
11. D. Charney, L. Reder, and G. Kusbit. Goal setting and procedure selection in acquiring computer skills: A comparison of tutorials, problem solving, and learner exploration. Cognition and Instruction, 7(4):323-342, 1990.
12. S. Haroz and D. Whitney. How capacity limits of attention influence information visualization effectiveness. Visualization and Computer Graphics, IEEE Transactions on, 18(12):2402-2410, Dec 2012.
13. T. Isenberg, P. Isenberg, J. Chen, M. Sedlmair, and T. Moller. A systematic review on the practice of evaluating visualization. Visualization and Computer Graphics, IEEE Transactions on, 19(12):2818-2827, Dec 2013.
14. R. Jianu and D. Laidlaw. An evaluation of how small user interface changes can improve scientists' analytic strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, pages 2953-2962, New York, NY, USA, 2012. ACM.
15. D. Keim, J. Kohlhammer, G. Ellis, and F. Mansmann, editors. Mastering the Information Age: Solving Problems with Visual Analytics. Eurographics Association, Goslar, Germany, 2010.
16. H. Lam, E. Bertini, P. Isenberg, C. Plaisant, and S. Carpendale. Empirical studies in information visualization: Seven scenarios. Visualization and Computer Graphics, IEEE Transactions on, 18(9):1520-1536, Sept 2012.
17. C. North. Toward measuring visualization insight. Computer Graphics and Applications, IEEE, 26(3):6-9, May 2006.
18. C. North, P. Saraiya, and K. Duca. A comparison of benchmark task and insight evaluation methods for information visualization. Information Visualization, 10(3):162-181, July 2011.
19. T. O'Brien, A. Ritz, B. Raphael, and D. Laidlaw. Gremlin: An interactive visualization model for analyzing genomic rearrangements. Visualization and Computer Graphics, IEEE Transactions on, 16(6):918-926, Nov 2010.
20. A. Perer and B. Shneiderman. Integrating statistics and visualization for exploratory power: From long-term case studies to design guidelines. Computer Graphics and Applications, IEEE, 29(3):39-51, May 2009.
21. D. J. Peuquet. It's about time: a conceptual framework for represetation of temporal dynamics in geographic information systems. Annals of the Association of American Geographers, 84(3):441-461, 1994.
22. C. Plaisant. The challenge of information visualization evaluation. In Proceedings of the Working Conference on Advanced Visual Interfaces, AVI '04, pages 109-116, New York, NY, USA, 2004. ACM.
23. C. Plaisant, J.-D. Fekete, and G. Grinstein. Promoting insight-based evaluation of visualizations: from contest to benchmark repository. Visualization and Computer Graphics, IEEE Transactions on, 14(1):120-134, Jan 2008.
24. J. Rieman. A field study of exploratory learning strategies. ACM Trans. Comput.-Hum. Interact., 3(3):189-218, Sept. 1996.
25. J. Rieman, R. M. Young, and A. Howes. A dual-space model of iteratively deepening exploratory learning. Int. J. Hum.-Comput. Stud., 44(6):743-775, June 1996.
26. P. Saraiya, C. North, and K. Duca. An insight-based methodology for evaluating bioinformatics visualizations. Visualization and Computer Graphics, IEEE Transactions on, 11(4):443-456, July 2005.
27. P. Saraiya, C. North, V. Lam, and K. Duca. An insight-based longitudinal study of visual analytics. Visualization and Computer Graphics, IEEE Transactions on, 12(6):1511-1522, Nov 2006.
28. H.-J. Schulz, T. Nocke, M. Heitzler, and H. Schumann. A design space of visualization tasks. Visualization and Computer Graphics, IEEE Transactions on, 19(12):2366-2375, Dec 2013.
29. Z. Shen, K.-L. Ma, and T. Eliassi-Rad. Visual analysis of large heterogeneous social networks by semantic and structural abstraction. Visualization and Computer Graphics, IEEE Transactions on, 12(6):1427-1439, 2006.
30. B. Shneiderman and C. Plaisant. Strategies for evaluating information visualization tools: Multi-dimensional in-depth long-term case studies. In Proceedings of the 2006 AVI Workshop on BEyond Time and Errors: Novel Evaluation Methods for Information Visualization, BELIV '06, pages 1-7, New York, NY, USA, 2006. ACM.
31. A. Slingsby, J. Dykes, and J. Wood. Configuring hierarchical layouts to address research questions. Visualization and Computer Graphics, IEEE Transactions on, 15(6):977-984, Nov 2009.