Perception-based evaluation of projection methods for multidimensional data visualization

IEEE Transactions on Visualization and Computer Graphics

Volumn 21, Issue 1, 2015, Pages 81-94

  Etemadpour, Ronak ^a   Motta, Robson ^c   Paiva, Jose Gustavo De Souza ^b   Minghim, Rosane ^c   De Oliveira, Maria Cristina Ferreira ^c   Linsen, Lars ^a  

^a JACOBS UNIVERSITY BREMEN   (Germany)

^b FEDERAL UNIVERSITY OF UBERLÂNDIA   (Brazil)

^c UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

dimension reduction; multidimensional data; perception based evaluation; Projections

Indexed keywords

CLUSTERING ALGORITHMS; VISUALIZATION;

DIMENSION REDUCTION; DIMENSION REDUCTION TECHNIQUES; HIGH DIMENSIONAL DATA; MULTI-DIMENSIONAL DATA VISUALIZATION; MULTIDIMENSIONAL DATA; PERCEPTION-BASED; PROJECTION TECHNIQUES; PROJECTIONS;

DATA VISUALIZATION;

EID: 84915747137     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2014.2330617     Document Type: Article

References (45)

1. J. A. Lee and M. Verleysen, Nonlinear Dimensionality Reduction, 1st ed. New York, NY, USA: Springer, 2007.
2. L. J. P. V. der Maaten, E. O. Postma, and H. J. V. D. Herik, "Dimensionality reduction: A comparative review," J. Mach. Learn. Res., vol. 10, pp. 1-41, 2009.
3. I. T. Jolliffe, Pincipal Component Analysis, New York, NY, USA: Springer-Verlag, 1986.
4. I. Borg, and P. J. F. Groenen, Modern Multidimensional Scaling Theory and Applications, 2nd ed., Springer Series in Statistics. New York, NY, USA: Springer, 2010.
5. W. Torgerson, "Multidimensional scaling: I. theory and method," Psychometrika, vol. 17, no. 4, pp. 401-419, 1952.
6. P. A. Eades, "A heuristic for graph drawing," Congressus Numerantium, vol. 42, pp. 149-160, 1984.
7. A. M. Cuadros, F. V. Paulovich, R. Minghim, and G. P. Telles, "Point placement by phylogenetic trees and its application to visual analysis of document collections," in Proc. IEEE Symp. Vis. Anal. Sci. Technol., 2007, pp. 99-106.
8. J. G. S. Paiva, L F. C., H. Pedrini, G. P. Telles, and R. Minghim, "Improved similarity trees and their application to visual data classification," IEEE Trans. Vis. Comput. Graph., vol. 17, no. 12, pp. 2459-2468, Dec. 2011.
9. P.-N. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining. Boston, MA, USA: Addison-Wesley, 2005.
10. F. V. Paulovich, L. G. Nonato, R. Minghim, and H. Levkowitz, "Least square projection: A fast high-precision multidimensional projection technique and its application to document mapping," IEEE Trans. Vis. Comput. Graph., vol. 14, no. 3, pp. 564-575, May/ Jun. 2008.
11. X. Geng, D. C. Zhan, and Z. H. Zhou, "Supervised nonlinear dimensionality reduction for visualization and classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 6, pp. 1098-1107, Dec. 2005.
12. J. A. Lee and M. Verleysen, "Quality assessment of dimensionality reduction: Rank-based criteria," Neurocomputing, vol. 72, no. 7, pp. 1431-1443, 2009.
13. S. Kaski, J. Nikkilä, M. Oja, J. Venna, P. Törönen, and E. Castrén, "Trustworthiness and metrics in visualizing similarity of gene expression," BMC Bioinformatics, vol. 4, no. 1, p. 48, 2003.
14. J. A. Lee and M. Verleysen, "Scale-independent quality criteria for dimensionality reduction," Pattern Recognit. Lett., vol. 31, no. 14, pp. 2248-2257, 2010.
15. J. Venna, J. Peltonen, K. Nybo, H. Aidos, and S. Kaski, "Information retrieval perspective to nonlinear dimensionality reduction for data visualization," J. Mach. Learn. Res., vol. 11, pp. 451-490, 2010.
16. M. Aupetit, "Visualizing distortions and recovering topology in continuous projection techniques," Neurocomputing, vol. 70, no. 7, pp. 1304-1330, 2007.
17. S. Lespinats and M. Aupetit, "Checkviz: Sanity check and topological clues for linear and non-linear mappings," Comput. Graph. Forum, vol. 30, no. 1, pp. 113-125, 2011.
18. E. Bertini, A. Tatu, and D. Keim, "Quality metrics in high-dimensional data visualization: An overview and systematization," IEEE Trans. Vis. Comput. Graph., vol. 17, no. 12, pp. 2203-2212, Dec. 2011.
19. A. Tatu, P. Bak, E. Bertini, D. A. Keim, and J. Schneidewind, "Visual quality metrics and human perception: An initial study on 2D projections of large multidimensional data," in Proc. Working Conf. Adv. Vis. Interfaces, 2010, pp. 49-56.
20. M. Sips, B. Neubert, J. P. Lewis, and P. Hanrahan, "Selecting good views of high-dimensional data using class consistency," Computer Graphics Forum, vol. 28, no. 3, pp. 831-838, 2009.
21. A. Tatu, G. Albuquerque, M. Eisemann, J. Schneidewind, H. Theisel, M. Magnor, and D. A. Keim, "Combining automated analysis and visualization techniques for effective exploration of highdimensional data," in Proc. IEEE Symp. Vis. Analytic Sci. Technol., 2009, pp. 59-66.
22. J. M. Lewis, L. van der Maaten, and V. R. de Sa, "A behavioral investigation of dimensionality reduction," Proc. 34th Annu. Conf. Cognit. Sci. Soc., 2012, pp. 671-676.
23. M. Sedlmair, A. Tatu, T. Munzner, and M. Tory, "A taxonomy of visual cluster separation factors," Comput. Graph. Forum, vol. 31, no. 3, pp. 1335-1344, 2012.
24. J. M. Lewis, M. Ackerman, and V. de Sa, "Human cluster evaluation and formal quality measures: A comparative study," in Proc. 34th Annu. Conf. Cognit. Sci. Soc., 2012, pp. 1870-1875.
25. G. Albuquerque, M. Eisemann, and M. Magnor, "Perceptionbased visual quality measures," in Proc. IEEE Symp. Vis. Analytic Sci. Technol., Oct. 2011, pp. 13-20.
26. R. Rensink and G. Baldridge, "The perception of correlation in scatterplots," Comput. Graph. Forum, vol. 29, pp. 1203-1210, 2010.
27. R. Rensink and G. Baldridge. (2010). The visual perception of correlation in scatterplots J. Vision [Online]. 10(7), p. 975. Available: http://www.journalofvision.org/content/10/7/975.abstract
28. R. Rensink. (2011). The rapid perception of correlation in scatterplots J. Vision [Online]. 11(11), p. 1085 Available: http://www. journalofvision.org/content/11/11/1085.abstract
29. J. B. Tenembaum, V. de Silva, and J. C. Langford, "A global geometric faramework for nonlinear dimensionality reduction," Science, vol. 290, pp. 2319-2323, 2000.
30. S. Ingram, T. Munzner, and M. Olano, "Glimmer: Multilevel MDS on the GPU," IEEE Trans. Vis. Comput. Graph., vol. 15, no. 2, pp. 249-261, Mar. 2009.
31. N. Andrienko, and G. Andrienko, Exploratory Analysis of Spatial and Temporal Data: A Systematic Approach. Secaucus, NJ, USA: Springer-Verlag, 2005.
32. M. Sedlmair, M. Brehmer, S. Ingram, and T. Munzner, "Dimensionality reduction in the wild: Gaps and guidance," Dept. Comput. Sci., Univ. British Columbia, Vancouver, BC, Canada, Tech. Rep. TR-2012-03, 2012.
33. D. Klein, S. D. Kamvar, and C. D. Manning, "From instance-level constraints to space-level constraints: Making the most of prior knowledge in data clustering," in Proc. 19th Int. Conf. Mach. Learn., 2002, pp. 307-314.
34. K. Wagstaff and C. Cardie, "Clustering with instance-level constraints," in Proc. 17th Int. Conf. Mach. Learn., 2000, pp. 1103-1110.
35. D. Pelleg and A. W. Moore, "X-means: Extending k-means with efficient estimation of the number of clusters," in Proc. 17th. Int. Conf. Mach. Learn., 2000, pp. 727-734.
36. P.-N. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining. Reading, MA, USA: Addison-Wesley, 2006.
37. F. E. Grubbs, "Procedures for detecting outlying observations in samples," Technometrics, vol. 11, pp. 1-21, 1969.
38. S. Ramaswamy, R. Rastogi, and K. Shim, "Efficient algorithms for mining outliers from large data sets," in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2000, pp. 427-438.
39. H. Lukashevich, S. Nowak, and P. Dunker. (2009). Using one-class SVM outliers detection for verification of collaboratively tagged image training sets," Proc. IEEE Int. Conf. Multimedia Expo, pp. 682-685 [Online]. Available: http://dl.acm.org/citation.cfm? id=1698924.1699092
40. M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise," in Proc. 2nd Int. Conf. Knowl. Discovery Data Mining, 1996, pp. 226-231.
41. M. Breunig, H.-P. Kriegel, R. T. Ng, and J. Sander, "Lof: Identifying density-based local outliers," in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2000, pp. 93-104.
42. M. Rosenblatt, "Remarks on some nonparametric estimates of a density function," Ann. Math. Stat., vol. 27, no. 3, pp. 832-837, Sep. 1956.
43. C. R. Loader, "Local likelihood density estimation," Ann. Statist., vol. 24, no. 4, pp. 1602-1618, 1996.
44. D. W. Scott, and S. R. Sain, Multi-Dimensional Density Estimation. Amsterdam, The Netherlands: Elsevier, 2004, pp. 229-263.
45. M. Sedlmair, T. Munzner, and M. Tory, "Empirical guidance on scatterplot and dimension reduction technique choices," IEEE Trans. Vis. Comput. Graph., vol. 19, no. 12, pp. 2634-2643, Dec. 2013.