Towards Perceptual Optimization of the Visual Design of Scatterplots

IEEE Transactions on Visualization and Computer Graphics

Volumn 23, Issue 6, 2017, Pages 1588-1599

  Micallef, Luana ^a   Palmas, Gregorio ^b   Oulasvirta, Antti ^a   Weinkauf, Tino ^b  

^a AALTO UNIVERSITY   (Finland)

^b ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

crowdsourcing; optimization; perception; Scatterplot

Indexed keywords

ASPECT RATIO; COST FUNCTIONS; CROWDSOURCING; DATA HANDLING; OPTIMIZATION; SENSORY PERCEPTION;

CLASS SEPARATION; CORRELATION ESTIMATION; HUMAN VISUAL SYSTEM; LINEAR CORRELATION; OUTLIER DETECTION; PERCEPTUAL OPTIMIZATION; SCATTER PLOTS; USER INTERVENTION;

COST BENEFIT ANALYSIS;

EID: 85009453141     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2017.2674978     Document Type: Article

References (49)

1. M. Brehmer, M. Sedlmair, S. Ingram, and T. Munzner, "Visualizing dimensionally-reduced data: Interviews with analysts and a characterization of task sequences, " in Proc. 5th Workshop Beyond Time Errors Novel Eval. Methods Vis., 2014, pp. 1-8.
2. M. Sedlmair, A. Tatu, T. Munzner, and M. Tory, "A taxonomy of visual cluster separation factors, " Comput. Graph. Forum, vol. 31, no. 3pt4, pp. 1335-1344, 2012.
3. M. Tory and T. Moller, "Human factors in visualization research, " IEEE Trans. Vis. Comput. Graph., vol. 10, no. 1, pp. 72-84, Jan. /Feb. 2004.
4. H. Wickham, "A layered grammar of graphics, " J. Comput. Graph. Statist., vol. 19, no. 1, pp. 3-28, 2010.
5. L. Wilkinson, A. Anand, and R. L. Grossman, "Graph-theoretic scagnostics, " in Proc. IEEE Symp. Inf. Vis., 2005, pp. 157-164.
6. E. Bertini, A. Tatu, and D. Keim, "Quality metrics in high-dimensional data visualization: An overview and systematization, " IEEE Trans. Vis. Comput. Graph., vol. 17, no. 12, pp. 2203-2212, Dec. 2011.
7. T. Munzner, Visualization Analysis and Design. Boca Raton, FL, USA: CRC Press, 2014.
8. J. Meyer, M. Taieb, and I. Flascher, "Correlation estimates as perceptual judgments, " J. Exp. Psychology Appl., vol. 3, no. 1, 1997, Art. no. 3.
9. W. S. Cleveland, P. Diaconis, and R. McGill, "Variables on scatterplots look more highly correlated when the scales are increased, " Sci., vol. 216, no. 4550, pp. 1138-1141, 1982.
10. J. Li, J.-B. Martens, and J. J. van Wijk, "Judging correlation from scatterplots and parallel coordinate plots, " Inf. Vis., vol. 9, no. 1, pp. 13-30, 2010.
11. L. Harrison, F. Yang, S. Franconeri, and R. Chang, "Ranking visualizations of correlation using weber's law, " IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 1943-1952, Dec. 2014.
12. R. A. Rensink and G. Baldridge, "The perception of correlation in scatterplots, " Comput. Graph. Forum, vol. 29, no. 3, pp. 1203-1210, 2010.
13. M. Kay and J. Heer, "Beyond weber's law: A second look at ranking visualizations of correlation, " IEEE Trans. Vis. Comput. Graph., vol. 22, no. 1, pp. 469-478, Jan. 2016.
14. M. Last and A. Kandel, "Automated detection of outliers in realworld data, " in Proc. Intell. Technol., 2001, pp. 292-301.
15. S. K. Rahman, M. M. Sathik, and K. S. Kannan, "Multiple linear regression models in outlier detection, " Int. J. Res. Comput. Sci., vol. 2, no. 2, 2012, Art. no. 23.
16. V. J. Hodge and J. Austin, "A survey of outlier detection methodologies, " Artif. Intell. Rev., vol. 22, no. 2, pp. 85-126, 2004.
17. M. Sedlmair, T. Munzner, and M. Tory, "Empirical guidance on scatterplot and dimension reduction technique choices, " IEEE Trans. Vis. Comput. Graph., vol. 19, no. 12, pp. 2634-2643, Dec. 2013.
18. M. Gleicher, M. Correll, C. Nothelfer, and S. Franconeri, "Perception of average value in multiclass scatterplots, " IEEE Trans. Vis. Comput. Graph., vol. 19, no. 12, pp. 2316-2325, Dec. 2013.
19. J. M. Lewis, M. Ackerman, and V. De Sa, "Human cluster evaluation and formal quality measures: A comparative study, " in Proc. Cogn. Sci. Soc., 2012, pp. 1870-1875.
20. M. Sedlmair and M. Aupetit, "Data-driven evaluation of visual quality measures, " Comput. Graph. Forum, vol. 34, no. 3, pp. 201-210, 2015.
21. M. Aupetit and M. Sedlmair, "SepMe: 2002 new visual separation measures, " in Proc. IEEE Pacific Vis. Symp., 2016, pp. 1-8.
22. J. Schneidewind, M. Sips, and D. A. Keim, "Pixnostics: Towards measuring the value of visualization, " in Proc. IEEE Symp. Visual Anal. Sci. Technol., 2006, pp. 199-206.
23. R. Etemadpour, et al., "Perception-based evaluation of projection methods for multidimensional data visualization, " IEEE Trans. Vis. Comput. Graph., vol. 21, no. 1, pp. 81-94, Jan. 2015.
24. H. Chen, et al., "Visual abstraction and exploration of multi-class scatterplots, " IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 1683-1692, Dec. 2014.
25. A. Mayorga and M. Gleicher, "Splatterplots: Overcoming overdraw in scatter plots, " IEEE Trans. Vis. Comput. Graph., vol. 19, no. 9, pp. 1526-1538, Sep. 2013.
26. S. Johansson and J. Johansson, "Interactive dimensionality reduction through user-defined combinations of quality metrics, " IEEE Trans. Vis. Comput. Graph., vol. 15, no. 6, pp. 993-1000, Nov. /Dec. 2009.
27. A. Tatu, et al., "Combining automated analysis and visualization techniques for effective exploration of high-dimensional data, " in Proc. IEEE Symp. Visual Anal. Sci. Technol., 2009, pp. 59-66.
28. J. Matejka, F. Anderson, and G. Fitzmaurice, "Dynamic opacity optimization for scatter plots, " in Proc. ACM Human Factors Comput. Syst., 2015, pp. 2707-2710.
29. J. Heer and M. Bostock, "Crowdsourcing graphical perception: Using mechanical turk to assess visualization design, " in Proc. ACMSIGCHI Conf. Human Factors Comput. Syst., 2010, pp. 203-212.
30. A. Oulasvirta, "User interface design with combinatorial optimization, " Comput., vol. 50, no. 1, pp. 40-47, 2017.
31. G. Bailly, A. Oulasvirta, T. Kotzing, and S. Hoppe, "MenuOptimizer: Interactive optimization of menu systems, " in Proc. 26th Annu. ACM Symp. User Interface Softw. Technol., 2013, pp. 331-342.
32. P. O'Donovan, A. Agarwala, and A. Hertzmann, "Learning layouts for single-pagegraphic designs, " IEEE Trans. Vis. Comput. Graph., vol. 20, no. 8, pp. 1200-1213, Aug. 2014.
33. M. Reddy, "Perceptually optimized 3D graphics, " IEEE Comput. Graph. Appl., vol. 21, no. 5, pp. 68-75, Sep. /Oct. 2001.
34. P. J. Kellman and T. F. Shipley, "A theory of visual interpolation in object perception, " Cogn. Psychology, vol. 23, no. 2, pp. 141-221, 1991.
35. J. Canny, "A computational approach to edge detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679-698, Nov. 1986.
36. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity, " IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
37. G. Zapfel, M. Bogl, and R. Braune, Metaheuristic Search Concepts. Berlin, Germany: Springer, 2010.
38. M. Dorigo, G. Di Caro, and L. M. Gambardella, "Ant algorithms for discrete optimization, " Artif. Life, vol. 5, no. 2, pp. 137-172, 1999.
39. P. C. Mahalanobis, "On the generalized distance in statistics, " Proc. Nat. Inst. Sci., vol. 2, pp. 49-55, 1936.
40. S. van der Walt, et al., "scikit-image: Image processing in Python, " PeerJ, vol. 2, Jun. 2014, Art. no. e453.
41. R. T. Marler and J. S. Arora, "The weighted sum method for multiobjective optimization: New insights, " Structural Multidisciplinary Optimization, vol. 41, no. 6, pp. 853-862, 2010.
42. E. Peer, S. Samat, L. Brandimarte, and A. Acquisti, "Beyond the turk: An empirical comparison of alternative platforms for online behavioral research, " pp. 1-30, 2015.
43. XmdvTool homepage. [Online]. Available: http://davis. wpi. edu/ xmdv/datasets. html
44. Statistical Software Information, University of Massachusetts Amherst. [Online]. Available: http://www. umass. edu/statdata/ statdata/data/
45. Data canvas homepage. [Online]. Available: http://map. datacanvas. org/#!/data
46. UC Irvine machine learning repository. [Online]. Available: http://mlr. cs. umass. edu/ml/index. html
47. C. Jacob, "The earth is round (p<. 05), " Amer. Psychologist, vol. 49, pp. 997-1003, 1994.
48. P. Dragicevic, "Fair statistical communication in HCI, " in Modern Statistical Methods for HCI. Berlin, Germany: Springer, 2016, pp. 291-330.
49. IEEE visualization contest 2004. [Online]. Available: http://vis. computer. org/vis2004contest/