Data-driven Evaluation of Visual Quality Measures

Computer Graphics Forum

Volumn 34, Issue 3, 2015, Pages 201-210

  Sedlmair, M ^a   Aupetit, M ^b  

^a UNIVERSITY OF VIENNA   (Austria)

^b QATAR COMPUTING RESEARCH INSTITUTE   (Qatar)

Author keywords

H.5.0 Information Interfaces and Presentation : General

Indexed keywords

ALGORITHMS; DATA VISUALIZATION;

CLASS SEPARABILITY; CLASS SEPARATION; GROUND TRUTH DATA; HUMAN JUDGMENTS; INFORMATION INTERFACES AND PRESENTATIONS; PREDICTIVE PERFORMANCE; STATE OF THE ART; VISUAL QUALITIES;

QUALITY CONTROL;

EID: 84937938684     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/cgf.12632     Document Type: Article

References (36)

1. Albuquerque G., Eisemann M., Magnor M.,: Perception-based visual quality measures. In Proc. IEEE Conf. Visual Analytics Science and Technology (VAST) (2011), pp. 11-18. 2
2. Aupetit M.,: Sanity check for class-coloring-based evaluation of dimension reduction techniques. In Proc. VIS Wk-shp. BEyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV) (2014), ACM, pp. 134-141. 9
3. Baker F., Hubert L.,: Measuring the power of hierarchical cluster analysis. Journal of the American Statistical Association 70, 349 (1975), 31-38. 6
4. Bishop C.M.,: Pattern recognition and machine learning. Springer, 2006. 4
5. Bertini E., Tatu A., Keim D.A.,: Quality metrics in high-dimensional data visualization: An overview and systematization. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis) 17, 12 (2011), 2203-2212. 1
6. Carpendale S.,: Evaluating information visualizations. In Information Visualization. Springer, 2008, pp. 19-45. 2
7. Caliński T., Harabasz J.,: A dendrite method for cluster analysis. Communications in Statistics Simulation and Computation 3, 1 (1974), 1-27. 6
8. Dasgupta A., Kosara R.,: Pargnostics: Screen-space metrics for parallel coordinates. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis) 16, 6 (2010), 1017-26. 2
9. Dunn J.C.,: Well-separated clusters and optimal fuzzy partitions. Journal of Cybernetics 4, 1 (1974), 95-104. 6
10. Efron B., Tibshirani R.,: An Introduction to the Bootstrap. Macmillan Publishers Limited, 1993. 5
11. Fawcett T.,: An introduction to ROC analysis. Pattern Recognition Letters 27, 8 (2006), 861-874. 4
12. Friedman J.H., Tukey J.W.,: A projection pursuit algorithm for exploratory data analysis. IEEE Trans. on Computers 100, 9 (1974), 881-890. 2
13. Fukunaga K.,: Introduction to statistical pattern recognition, second ed. Computer Science and Scientific Computing. Academic Press, 1990. 6
14. Gilad-Bachrach R., Navot A., Tishby N.,: Margin based feature selection-theory and algorithms. In Proc. 21st Int. Conf. on Machine Learning (ICML) (2004), Brodley C.E., (Ed.), ACM, pp. 43-50. 6
15. Heer J., Bostock M.,: Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proc. ACM Conf. Human Factors in Computing Systems (CHI) (2010), pp. 203-212. 9
16. Haroz S., Whitney D.,: How capacity limits of attention influence information visualization effectiveness. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis) 18, 12 (2012), 2402-2410. 9
17. Harrison L., Yang F., Franconeri S., Chang R.,: Ranking visualizations of correlation using Weber's law. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis) 20, 12 (2014), 1943-1952. 8
18. Isenberg T., Isenberg P., Chen J., Sedlmair M., Möller T.,: A systematic review on the practice of evaluating visualization. IEEE Trans. Visualization and Computer Graphics (Proc. SciVis) 19, 12 (2013), 2818-2827. 1, 2
19. Johansson J., Cooper M.,: A screen space quality method for data abstraction. Computer Graphics Forum (Proc. EuroVis) 27, 3 (2008), 1039-1046. 2
20. Kindlmann G., Scheidegger C.,: An algebraic process for visualization design. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis) 20, 12 (2014), 2181-2190. 9
21. Lewis J.M., Ackerman M., de Sa V.,: Human cluster evaluation and formal quality measures: A comparative study. In Proc. 34th Conf. of the Cognitive Science Society (CogSci) (2012), pp. 1870-1875. 2, 6, 9
22. Lam H., Bertini E., Isenberg P., Plaisant C., Carpendale S.,: Empirical studies in information visualization: Seven scenarios. IEEE Trans. Visualization and Computer Graphics (TVCG) 18, 9 (2012), 1520-1536. 2
23. Lewis J.M., van der Maaten L., de Sa V.,: A behavioral investigation of dimensionality reduction. In Proc. 34th Conf. of the Cognitive Science Society (CogSci) (2012), pp. 671-676. 9
24. Motta R., Minghim R., de Andrade Lopes A., Oliveira M. C. F.,: Graph-based measures to assist user assessment of multidimensional projections. Neurocomputing (2015), 583-598. preprint. 2, 6
25. O'Connell A.A.,: Logistic regression models for ordinal response variables. Sage Publications, 2006. 9
26. Pretorius A.J., Van Wijk J.J.,: What does the user want to see? What do the data want to be? Information Visualization 8, 3 (2009), 153-166. 8
27. Rensink R., Baldridge G.,: The perception of correlation in scatterplots. Computer Graphics Forum (Proc. EuroVis) 29, 3 (2010), 1203-1210. 8
28. Rousseeuw P.,: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics 20, 1 (1987), 53-65. 6
29. Sedlmair M., Munzner T., Tory M.,: Empirical guidance on scatterplot and dimension reduction technique choices. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis) 19, 12 (2013), 2634-2643. 4, 5, 6, 7, 8, 9
30. Sips M., Neubert B., Lewis J.P., Hanrahan P.,: Selecting good views of high-dimensional data using class consistency. Computer Graphics Forum (Proc. EuroVis) 28, 3 (2009), 831-838. 1, 2, 6, 8, 9
31. Strehl A.,: Relationship-based Clustering and Cluster Ensembles for High-dimensional Data Mining. PhD thesis, University of Texas at Austin, 2002. 6
32. Sedlmair M., Tatu A., Tory M., Munzner T.,: A taxonomy of visual cluster separation factors. Computer Graphics Forum (Proc. EuroVis) 31, 3 (2012), 1335-1344. 1, 2, 4, 7, 8, 9
33. Tatu A., Albuquerque G., Eisemann M., Schneidewind J., Theisel H., Magnor M., Keim D.,: Combining automated analysis and visualization techniques for effective exploration of high-dimensional data. In Proc. IEEE Symp. Visual Analytics Science and Technology (VAST) (2009), pp. 59-66. 1, 2, 6, 8
34. Tatu A., Bak P., Bertini E., Keim D., Schneidewind J.,: Visual quality metrics and human perception: An initial study on 2D projections of large multidimensional data. In Proc. Int. Conf. Advanced Visual Interfaces (AVI) (2010), ACM, pp. 49-56. 1, 2, 6, 7, 8, 9
35. Wilkinson L., Anand A.,: Graph-theoretic scagnostics. Proc. IEEE Symp. Information Visualization (InfoVis) (2005), 157-164. 1, 2
36. Wilkinson L., Wills G.,: Scagnostics Distribution. Journal of Computational and Graphical Statistics 17, 2 (2008), 473-491. 2