Advancing user-centered evaluation of visual analytic environments through contests

Information Visualization

Volumn 8, Issue 3, 2009, Pages 230-238

  Costello, Loura ^a   Grinstein, Georges ^a   Plaisant, Catherine ^b   Scholtz, Jean ^c  

^a UNIVERSITY OF MASSACHUSETTS LOWELL   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

Metrics; Synthetic data; User centered evaluation; Visual analytics

Indexed keywords

END USERS; FUTURE DIRECTIONS; LESSONS LEARNED; METRICS; SCIENCE AND TECHNOLOGY; SYNTHETIC DATA; TIME CONSTRAINTS; USER-CENTERED; USER-CENTERED EVALUATION; VISUAL ANALYTICS;

EID: 69249117836     PISSN: 14738716     EISSN: 14738724     Source Type: Journal    
DOI: 10.1057/ivs.2009.16     Document Type: Article

References (10)

1. Thomas, J. and Cook, K. (eds.) (2005) Illuminating the Path: The Research and Development Agenda for Visual Analytics. Los Alamitos, CA: IEEE Computer Society Press, http://nvac.pnl.gov/agenda.stm, accessed 29 February 2009.
2. Redish, J. (2007) Expanding usability testing to evaluate complex systems. Journal of Usability Studies 2(3): 102-111.
3. Plaisant, C., Fekete, J. and Grinstein, G. (2008) Promoting insight based evaluation of visualizations: From contest to benchmark repository promoting insight based evaluation of visualizations: From contest to benchmark repository. ACM Transactions on Visualization and Computer Graphics 14(1): 120-134.
4. Whiting, M.A., Haack, J. and Varley, C. (2008) Creating Realistic, Scenario-based Synthetic Data for Test and Evaluation of Information Analytics Software. In: Proceedings of the 2008 Conference on Beyond Time and Errors: Novel Evaluation Methods for Information Visualization, BELIV'08; 5 April, Florence, Italy. New York: ACM, pp. 1-9.
5. Grinstein, G., O'Connell, T., Laskowski, S., Plaisant, C., Scholtz, J. and Whiting, M. (2006) VAST 2006 Contest? A tale of Alderwood. Vast 2006 IEEE Symposium on Visual Analytics Science and Technology, 2006. Los Alamitos, CA: IEEE Computer Society, pp. 215-216.
6. Plaisant, C. et al (2008) Evaluating visual analytics: The 2007 visual analytics science and technology symposium contest. IEEE Computer Graphics and Applications 28(2): 12-21.
7. Grinstein, G., Plaisant, C., O'Connell, T., Laskowski, S., Scholtz, J. and Whiting, M. (2007) VAST 2007 Contest - Blue Iguanodon. Vast 2007 IEEE Symposium on Visual Analytics Science and Technology, 2007. Los Alamitos, CA: IEEE Computer Society, pp. 231-232.
8. Grinstein, G, Plaisant, C., O'Connell, T., Laskowski, S., Scholtz, J. and Whiting, M. (2008) VAST 2008 Challenge: Introducing Minichallenges. Visual Analytics Science and Technology, 2008. VAST '08 IEEE Symposium on Visual Analytics Science and Technology; October 2008. Los Alamitos, CA: IEEE Computer Society, pp. 195 -196, 19-24.
9. Voorhees, E. (2007) TREC: Continuing information retrieval's tradition of experimentation. Communications of the ACM 50(11): 51-54.
10. Keim, D., Andrienko, A., Fekete, J.-D., Görg, C., Kohlhammer, J. and Melançon, G. (2008) Visual analytics: Definition, process, and challenges. In: A. Kerren, J. Stasko, J.-D. Fekete, & C. North (eds.), Information Visualization: Human-Centered Issues and Perspectives of LNCS State-of-the-Art Survey: Vol.4950, Berlin, Heidelberg: Springer-Verlag.