Creating realistic, scenario-based synthetic data for test and evaluation of information analytics software

Proceedings of the 2008 Conference on BEyond Time and Errors: Novel EvaLuation Methods for Information Visualization 2008, BELIV'08

Volumn , Issue , 2008, Pages

  Whiting, Mark A ^a   Haack, Jereme ^a   Varley, Carrie ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

Data generator; Evaluation; Information visualization; Visual analytics

Indexed keywords

APPLICATIONS.; AUTOMATED METHODS; DATA GENERATOR; DATA SETS; DEVELOPMENT TIMES; EVALUATION; GROUND TRUTHS; INFORMATION ANALYSTS; INFORMATION VISUALIZATION; LARGE DATABASES; REAL DATUMS; SCENARIO DEVELOPMENTS; STREAM GENERATORS; SYNTHETIC DATUMS; SYNTHETIC TESTS; TEST AND EVALUATIONS; TEST DATUMS; TOOLSET; VISUAL ANALYTICS;

DATA ACQUISITION; ERRORS; INFORMATION ANALYSIS; INFORMATION SCIENCE; INFORMATION SYSTEMS; PLANNING; STATISTICAL TESTS; STRATEGIC PLANNING; TEST FACILITIES; TESTING; VISUALIZATION;

DATA VISUALIZATION;

EID: 57349099368     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1377966.1377977     Document Type: Conference Paper

References (18)

1. Amar, R. and Stasko, J. A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations. In Infovis'04, IEEE Computer Society Press, (2004), 143-150.
2. Barbosa, D., Mendelzon, A., Keenleyside, J., and Lyons, K. ToXgene: a template-based data generator for XML. In Fifth International Workshop on the Web and Databases, (2002).
3. Chinchor, N., and Hirschman, L. Evaluating message understanding systems: an analysis of the third message understanding conference (MUC-3), Computational Linguistics (1993), 409 - 449.
4. Cooper, J. Curing Analytic Pathologies, Center for the Study of Intelligence, (2005).
5. Gray, J., Sundaresan, P., Englert, S., Baclawski, K., and Weinberger, P. J. Quickly generating billion-record synthetic databases. In Proc SIGMOD, ACM Press, (1994), 243-252.
6. Grinstein, G., O'Connell, T., Laskowski, S., Plaisant, C., Scholtz, J., and Whiting, M. VAST 2006 Contest: A Tale of Alderwood, In Proc. VAST 2006, IEEE Computer Society Press (2006), 215-216.
7. Grinstein, G., Cvek, U., Derthick, M., Trutschl, M. IEEE InfoVis 2005 Contest, Technology Data in the US, http://ivpr.cs.uml.edu/infovis05.
8. GS Data Generator. http://www.GSApps.com.
9. Plaisant, C. The challenge of information visualization evaluation. In AVI '04, ACM Press, (2004), 109-116.
10. Risch, J., Rex, D., Dowson, S., Walters, T., May, R., and Moon, B. The STARLIGHT information visualization system, in IV'97, IEEE Press (1997), 42.
11. Scholtz, J., Morse, E., and Hewett, T. In depth observational studies of professional intelligence analysts. International Conference on Intelligence Analysis, Proceedings available at https://analysis.mitre.org/ (2005) {accessed 9/19/2007}.
12. Scholtz, J. Metrics for evaluating human information interaction systems. Interact. Comput. 18, 4 (2006). 507-527.
13. Text REtrieval Conference (TREC), http://trec.nist.gov/.
14. Theodoridis, Y., Silva, J. and Nascimento, M. On the Generation of Spatiotemporal Datasets, Proc. Symp. Large Spatial Databases (SSD), (1999), 147-164.
15. Thomas, J. and Cook, K., eds. Illuminating the Path: The Research and Development Agenda for Visual Analytics, IEEE CS Press, 2005; http://nvac.pnl.gov/agenda.stm.
16. VAST 2006 Contest Results, http://www.cs.umd.edu/hcil/VASTcontest06/ results.html.
17. ™. In Proc. Doc Eng 2005, ACM Press (2005), 23-25.
18. Wong, P., Hetzler, B., Posse, C., Whiting, M., Havre, S., Cramer, N., Shah, A., Singhal, M., Turner, A., and Thomas, J. IN-SPIRE Info Vis 2004 Contest Entry, In Proc INFOVIS'04, IEEE Computer Society Press (2004), 216.