A Perception-Driven Approach to Supervised Dimensionality Reduction for Visualization

IEEE Transactions on Visualization and Computer Graphics

Volumn 24, Issue 5, 2018, Pages 1828-1840

  Wang, Yunhai ^a   Feng, Kang ^a   Chu, Xiaowei ^a   Zhang, Jian ^c   Fu, Chi Wing ^b   Sedlmair, Michael ^d   Yu, Xiaohui ^a   Chen, Baoquan ^a  

^a SHANDONG UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^d UNIVERSITY OF VIENNA   (Austria)

Author keywords

Dimensionality reduction; high dimensional data; supervised; visual class separation

Indexed keywords

CLUSTERING ALGORITHMS; SEPARATION; SIMULATED ANNEALING; SPATIAL DISTRIBUTION;

CLASS SEPARATION; DIMENSIONALITY REDUCTION; HIGH DIMENSIONAL DATA; LINEAR DIMENSIONALITY REDUCTION; LOW-DIMENSIONAL REPRESENTATION; QUANTITATIVE MEASURES; SIMULATED ANNEALING ALGORITHMS; SUPERVISED;

DATA REDUCTION;

EID: 85039071327     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2017.2701829     Document Type: Article

References (49)

1. M. Sedlmair, T. Munzner, and M. Tory, "Empirical guidance on scatterplot and dimension reduction technique choices, " IEEE Trans. Vis. Comput. Graph., vol. 19, no. 12, pp. 2634-2643, Dec. 2013.
2. J. P. Cunningham and Z. Ghahramani, "Linear dimensionality reduction: Survey, insights, and generalizations, " J. Mach. Learn. Res., vol. 16, pp. 2859-2900, 2015.
3. M. Brehmer, M. Sedlmair, S. Ingram, and T. Munzner, "Visualizing dimensionally-reduced data: Interviews with analysts and a characterization of task sequences, " in Proc. 5th Workshop Beyond Time Errors: Novel Eval. Methods Vis., 2014, pp. 1-8.
4. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
5. I. Jolliffe, Principal Component Analysis. Hoboken, NJ, USA: Wiley, 2005.
6. J. B. Kruskal and M. Wish, Multidimensional Scaling, vol. 11. Newbury Park, CA, USA: Sage, 1978.
7. T. Cacoullos, Discriminant Analysis and Applications. New York, NY, USA: Academic, 2014.
8. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach, " Neural Comput., vol. 12, no. 10, pp. 2385-2404, 2000.
9. M. Sedlmair and M. Aupetit, "Data-driven evaluation of visual quality measures, " Comput. Graph. Forum, vol. 34, no. 3, pp. 201-210, 2015.
10. M. Sips, B. Neubert, J. P. Lewis, and P. Hanrahan, "Selecting good views of high-dimensional data using class consistency, " Comput. Graph. Forum, vol. 28, no. 3, pp. 831-838, 2009.
11. M. Aupetit and M. Sedlmair, "SepMe: 2002 new visual separation measures, " in Proc. IEEE Pacific Vis. Symp., 2016, pp. 1-8.
12. A. Anand, L. Wilkinson, and T. N. Dang, "Visual pattern discovery using random projections, " in Proc. IEEE Symp. Visual Anal. Sci. Technol., 2012, pp. 43-52.
13. E. Aarts and J. Korst, Simulated Annealing and Boltzmann Machines: A Stochastic Approach to Combinatorial Optimization and Neural Computing. New York, NY, USA: Wiley, 1988.
14. O. Arbelaitz, I. Gurrutxaga, J. Muguerza, J. M. PeRez, and I. Perona, "An extensive comparative study of cluster validity indices, " Pattern Recognit., vol. 46, no. 1, pp. 243-256, 2013.
15. J. Goldberger, G. E. Hinton, S. T. Roweis, and R. Salakhutdinov, "Neighbourhood components analysis, " in Proc. Annu. Conf. Neural Inf. Process. Syst., 2004, pp. 513-520.
16. L. Van der Maaten and G Hinton, "Visualizing data using t-SNE, " J. Mach. Learn. Res., vol. 9, pp. 2579-2605, 2008.
17. J. H. Friedman and J. W. Tukey, "A projection pursuit algorithm for exploratory data analysis, " IEEE Trans. Comput., vol. C-100, no. 9, pp. 881-890, Sep. 1974.
18. E. Bertini, A. Tatu, and D. Keim, "Quality metrics in high-dimensional data visualization: An overview and systemat-ization, " IEEE Trans. Vis. Comput. Graph., vol. 17, no. 12, pp. 2203-2212, Dec. 2011.
19. M. Sedlmair, A. Tatu, T. Munzner, and M. Tory, "A taxonomy of visual cluster separation factors, " Comput. Graph. Forum, vol. 31, no. 3pt4, pp. 1335-1344, 2012.
20. A. Tatu, et al., "Combining automated analysis and visualization techniques for effective exploration of high-dimensional data, " in Proc. IEEE Symp. Visual Anal. Sci. Technol., 2009, pp. 59-66.
21. J. C. Dunn, "Well-separated clusters and optimal fuzzy parti-tions, " J. Cybern., vol. 4, no. 1, pp. 95-104, 1974.
22. P. J. Rousseeuw, "Silhouettes: A graphical aid to the interpretation and validation of cluster analysis, " J. Comput. Appl. Math., vol. 20, pp. 53-65, 1987.
23. J. Choo, S. Bohn, and H. Park, "Two-stage framework for visualization of clustered high dimensional data, " in Proc. IEEE Symp. Visual Anal. Sci. Technol., 2009, pp. 67-74.
24. J. Choo, H. Lee, J. Kihm, and H. Park, "iVisClassifier: An interac-tive visual analytics system for classification based on supervised dimension reduction, " in Proc. IEEE Symp. Visual Anal. Sci. Tech-nol., 2010, pp. 27-34.
25. X. He and P. Niyogi, "Locality preserving projections, " in Proc. Neural Inf. Process. Syst., 2004, vol. 16, Art. no. 153.
26. S. Ingram, T. Munzner, and M. Olano, "Glimmer: Multilevel MDS on the GPU, " IEEE Trans. Vis. Comput. Graph., vol. 15, no. 2, pp. 249-261, Mar./Apr. 2009.
27. J. B. Tenenbaum, V. De Silva, and J. C. Langford, "A global geo-metric framework for nonlinear dimensionality reduction, " Sci-ence, vol. 290, no. 5500, pp. 2319-2323, 2000.
28. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding, " Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
29. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering, " in Proc. Annu. Conf. Neural Inf. Process. Syst., 2001, vol. 14, pp. 585-591.
30. J. M. Lewis, L. Van Der Maaten, and V. de Sa, "A behavioral investigation of dimensionality reduction, " in Proc. 34th Conf. Cognitive Sci. Soc, 2012, pp. 671-676.
31. R. Etemadpour, R. Motta, J. G de Souza Paiva, R. Minghim, M. C. F. de Oliveira, and L. Linsen, "Perception-based evaluation of projection methods for multidimensional data visualization, " IEEE Trans. Vis. Comput. Graph., vol. 21, no. 1, pp. 81-94, Jan. 2015.
32. C. M. Bender and S. A. Orszag, Advanced Mathematical Methods for Scientists and Engineers I. Berlin, Germany: Springer, 1999.
33. D. Pham and D. Karaboga, Intelligent Optimisation Techniques: Genetic Algorithms, Tabu Search, Simulated Annealing and Neural Networks. Berlin, Germany: Springer, 2012.
34. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, "Equation of state calculations by fast computing machines, " J. Chemical Phys., vol. 21, no. 6, pp. 1087-1092, 1953.
35. S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, "Optimization by simulated annealing, " Science, vol. 220, no. 4598, pp. 671-680, 1983.
36. S. Bochkanov and V. Bystritsky, "ALGLIB-a cross-platform numerical analysis and data processing library, " ALGLIB Project. Novgorod, Russia, (2011). [Online]. Available: http://www. alglib.net/
37. L. Van Der Maaten, "Accelerating t-SNE using tree-based algorithms, " J. Mach. Learn. Res., vol. 15, no. 1, pp. 3221-3245, 2014.
38. M. Lichman, "UCI machine learning repository, " 2013. [Online]. Available: http://archive.ics.uci.edu/ml
39. I. Borg and P. J. Groenen, Modern Multidimensional Scaling: Theory and Applications. Berlin, Germany: Springer, 2005.
40. F. V. Paulovich, L. G. Nonato, R. Minghim, and H. Levkowitz, "Least square projection: A fast high-precision multidimensional projection technique and its application to document mapping, " IEEE Trans. Vis. Comput. Graph., vol. 14, no. 3, pp. 564-575, May/Jun. 2008.
41. B. Johnson, R. Tateishi, and Z. Xie, "Using geographically weighted variables for image classification, " Remote Sens. Lett., vol. 3, no. 6, pp. 491-499, 2012.
42. R. Garland, "The mid-point on a rating scale: Is it desirable, " Marketing Bulletin, vol. 2, no. 1, pp. 66-70, 1991.
43. K. Krippendorff, Content Analysis: An Introduction to Its Methodology. Newbury Park, CA. USA: Sage, 2004.
44. B. Scholkopft and K.-R. Mullert, "Fisher discriminant analysis with kernels, " in Proc. IEEE Workshop Neural Netw. Signal Process., 1999, vol. 1, no. 1, Art. no. 1.
45. N. V. Chawla, N. Japkowicz, and A. Kotcz, "Editorial: Special issue on learning from imbalanced data sets, " ACM SIGKDD Explorations Newslett., vol. 6, no. 1, pp. 1-6, 2004.
46. D. Sacha, et al., "Visual interaction with dimensionality reduction: A structured literature analysis, " IEEE Trans. Vis. Comput. Graph., vol. 23, no. 1, pp. 241-250, Jan. 2017.
47. A. Endert, P. Fiaux, and C. North, "Semantic interaction for sense-making: Inferring analytical reasoning for model steering, " IEEE Trans. Vis. Comput. Graph., vol. 18, no. 12, pp. 2879-2888, Dec. 2012.
48. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York, NY, USA: Academic, 1990.
49. D. Sacha, et al., "Human-centered machine learning through interactive visualization: Review and open challenges, " in Proc. Eur. Symp. Artif. Neural Netw. Comput. Intell. Mach. Learn., 2016, pp. 641-646.