Approximated and user steerable tSNE for progressive visual analytics

IEEE Transactions on Visualization and Computer Graphics

Volumn 23, Issue 7, 2017, Pages 1739-1752

  Pezzotti, Nicola ^a   Lelieveldt, Boudewijn P F ^a,b   Van Der Maaten, Laurens ^a   Höllt, Thomas ^a   Eisemann, Elmar ^a   Vilanova, Anna ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

Approximate computation; Dimensionality reduction; High dimensional data; Progressive visual analytics

Indexed keywords

CLUSTERING ALGORITHMS; DATA HANDLING; DATA VISUALIZATION; INFORMATION ANALYSIS; STOCHASTIC SYSTEMS;

APPROXIMATE COMPUTATION; DIMENSIONALITY REDUCTION; HIGH DIMENSIONAL DATA; INTERACTIVE DATA ANALYSIS; INTERACTIVE DATA EXPLORATION; REAL TIME VISUALIZATION; STOCHASTIC NEIGHBOR EMBEDDING; VISUAL ANALYTICS;

VISUALIZATION;

EID: 85012255964     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2016.2570755     Document Type: Article

References (48)

1. A. Inselberg and B. Dimsdale, "Parallel coordinates," in Human-Machine Interactive Systems. New York, NY, USA: Springer, 1991, pp. 199-233.
2. J. A. Hartigan, "Printer graphics for clustering," J. Statist. Comput. Simul., vol. 4, pp. 187-213, 1975.
3. L. van der Maaten, E. O. Postma, and H. J. van den Herik, "Dimensionality reduction: A comparative review," J. Mach. Learn. Res., vol. 10, pp. 66-71, 2008.
4. L. van der Maaten and G. Hinton, "Visualizing data using t-SNE," J. Mach. Learn. Res., vol. 9, pp. 2579-2605, 2008.
5. L. van der Maaten, "Accelerating t-sne using tree-based algorithms," J. Mach. Learn. Res., vol. 15, pp. 3221-3245, 2014.
6. E.-a. D. Amir, K. L. Davis, M. D. Tadmor, E. F. Simonds, J. H. Levine, S. C. Bendall, D. K. Shenfeld, S. Krishnaswamy, G. P. Nolan, and D. Pe'er, "viSNE enables visualization of high dimensional single-cell data and reveals phenotypic heterogeneity of leukemia," Nature Biotechnol., vol. 31, no. 6, pp. 545-552, 2013.
7. B. Becher, A. Schlitzer, J. Chen, F. Mair, H. R. Sumatoh, K. W. W. Teng, D. Low, C. Ruedl, P. Riccardi-Castagnoli, and M. Poidinger, "High-dimensional analysis of the murine myeloid cell system," Nature Immunol., vol. 15, no. 12, pp. 1181-1189, 2014.
8. A. Mahfouz, M. van de Giessen, L. van der Maaten, S. Huisman, M. Reinders, M. J. Hawrylycz, and B. P. Lelieveldt, "Visualizing the spatial gene expression organization in the brain through non-linear similarity embeddings," Methods, vol. 73, pp. 79-89, 2015.
9. K. Shekhar, P. Brodin, M. M. Davis, and A. K. Chakraborty, "Automatic classification of cellular expression by nonlinear stochastic embedding (ACCENSE)," Proc. Nat. Acad. Sci., vol. 111, no. 1, pp. 202-207, 2014.
10. C. Stolper, A. Perer, and D. Gotz, "Progressive visual analytics: User-driven visual exploration of in-progress analytics," IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 1653-1662, Dec. 2014.
11. T. Mühlbacher, H. Piringer, S. Gratzl, M. Sedlmair, and M. Streit, "Opening the black box: Strategies for increased user involvement in existing algorithm implementations," IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 1643-1652, Dec. 2014.
12. J. Choo, H. Kim, C. Lee, and H. Park, "PIVE: A per-iteration visualization environment for supporting real-time interactions with computational methods," in Proc. IEEE Symp. Vis. Analytics Sci. Technol., 2014, pp. 241-242.
13. P. Bruneau, P. Pinheiro, B. Broeksema, and B. Otjacques, "Cluster sculptor, an interactive visual clustering system," Neurocomputing, vol. 150, pp. 627-644, 2015.
14. A. Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, T. Mikolov, et al., "DeViSE: A deep visual-semantic embedding model," in Proc. Adv. Neural Inf. Process. Syst., 2013, pp. 2121-2129.
15. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 580-587.
16. V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis, "Human-level control through deep reinforcement learning," Nature, vol. 518, no. 7540, pp. 529-533, Feb. 2015.
17. M. Brehmer, M. Sedlmair, S. Ingram, and T. Munzner, "Visualizing dimensionally-reduced data: Interviews with analysts and a characterization of task sequences," in Proc. 5th Workshop Beyond Time Errors: Novel Eval. Methods Vis., 2014, pp. 1-8.
18. Z. Yang, J. Peltonen, and S. Kaski, "Scalable optimization of neighbor embedding for visualization," in Proc. 30th Int. Conf. Mach. Learn., 2013, pp. 127-135.
19. J.-D. Fekete, "Visual analytics infrastructures: From data management to exploration," Computer, vol. 46, no. 7, pp. 22-29, Jul. 2013.
20. D. Fisher, I. Popov, S. Drucker, and M. Schraefel, "Trust me, i'm partially right: Incremental visualization lets analysts explore large datasets faster," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2012, pp. 1673-1682.
21. J. D. Mulder, J. J. van Wijk, and R. van Liere, "A survey of computational steering environments," Future Gener. Comput. Syst., vol. 15, no. 1, pp. 119-129, 1999.
22. J. H. Friedman, J. L. Bentley, and R. A. Finkel, "An algorithm for finding best matches in logarithmic expected time," ACM Trans. Math. Softw., vol. 3, no. 3, pp. 209-226, 1977.
23. P. N. Yianilos, "Data structures and algorithms for nearest neighbor search in general metric spaces," in Proc. 4th Annu. ACMSIAM Symp. Discr. Algorithms, 1993, pp. 311-321.
24. M. Williams and T. Munzner, "Steerable, progressive multidimensional scaling," in Proc. IEEE Symp. Inf. Vis., 2004, pp. 57-64.
25. T. Yang, J. Liu, L. McMillan, and W. Wang, "A fast approximation to multidimensional scaling," in Proc. ECCV Workshop Comput. Intensive Methods Comput. Vis., 2006, pp. 354-359.
26. P. Joia, F. Paulovich, D. Coimbra, J. Cuminato, and L. Nonato, "Local affine multidimensional projection," IEEE Trans. Vis. Comput. Graph., vol. 17, no. 12, pp. 2563-2571, 2011.
27. F. V. Paulovich, C. T. Silva, and L. G. Nonato, "Two-phase mapping for projecting massive data sets," IEEE Trans. Vis. Comput. Graph., vol. 16, no. 6, pp. 1281-1290, Nov./Dec. 2010.
28. F. V. Paulovich, L. G. Nonato, R. Minghim, and H. Levkowitz, "Least square projection: A fast high-precision multidimensional projection technique and its application to document mapping," IEEE Trans. Vis. Comput. Graph., vol. 14, no. 3, pp. 564-575, May/Jun. 2008.
29. S. Ingram and T. Munzner, "Dimensionality reduction for documents with nearest neighbor queries," Neurocomputing, vol. 150, pp. 557-569, 2015.
30. O. Lampe and H. Hauser, "Interactive visualization of streaming data with kernel density estimation," in Proc. IEEE Pacific Vis. Symp., 2011, pp. 171-178.
31. J. Choo, H. Lee, J. Kihm, and H. Park, "iVisClassifier: An interactive visual analytics system for classification based on supervised dimension reduction," in Proc. IEEE Symp. Vis. Analytics Sci. Technol., 2010, pp. 27-34.
32. S. J. Aarseth, Gravitational N-Body Simulations. Cambridge, U.K.: Cambridge Univ. Press, 2003.
33. J. Barnes and P. Hut, "A hierarchical O(N log N) force-calculation algorithm," Nature, vol. 324, no. 4, pp. 446-449, 1986.
34. Y. LeCun, C. Cortes, and C. J. Burges. (1999). The mnist database of handwritten digits. [Online]. Available: http://yann.lecun. com/exdb/mnist/
35. T. M. Fruchterman and E. M. Reingold, "Graph drawing by forcedirected placement," Softw.: Practice Experience, vol. 21, no. 11, pp. 1129-1164, 1991.
36. M. Muja and D. G. Lowe, "Fast approximate nearest neighbors with automatic algorithm configuration," in Proc. Int. Conf. Comput. Vis. Theory Appl., 2009, pp. 331-340.
37. M. Muja and D. Lowe, "Scalable nearest neighbor algorithms for high dimensional data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 11, pp. 2227-2240, Nov. 2014.
38. C. Silpa-Anan and R. Hartley, "Optimised kd-trees for fast image descriptor matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
39. Y. LeCun, F. J. Huang, and L. Bottou, "Learning methods for generic object recognition with invariance to pose and lighting," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2004, vol. 2, pp. 97-104.
40. A. Krizhevsky and G. Hinton, "Learning multiple layers of features from tiny images," Comput. Sci. Dept., University of Toronto, Toronto, Canada, 2009.
41. F. Sha and L. K. Saul, "Large margin gaussian mixture modeling for phonetic classification and recognition," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2006, vol. 1, pp. I-I.
42. B. W. Silverman, Density Estimation for Statistics and Data Analysis. Boca Raton, FL, USA: CRC Press, 1986, vol. 26.
43. R. M. Martins, D. B. Coimbra, R. Minghim, and A. Telea, "Visual analysis of dimensionality reduction quality for parameterized projections," Comput. Graph., vol. 41, pp. 26-42, 2014.
44. C. Tominski, S. Gladisch, U. Kister, R. Dachselt, and H. Schumann, "A survey on interactive lenses in visualization," in Proc. EuroVis State-of-the-Art Rep., 2014, pp. 43-62.
45. E. S. Lein, et al., "Genome-wide atlas of gene expression in the adult mouse brain," Nature, vol. 445, no. 7124, pp. 168-176, 2007.
46. A. Reiss and D. Stricker, "Creating and benchmarking a new dataset for physical activity monitoring," in Proc. 5th Int. Conf. PErvasive Technol. Related Assistive Environ, 2012, pp. 40:1-40:8.
47. Z. Liu and J. Heer, "The effects of interactive latency on exploratory visual analysis," IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 2122-2131, Dec. 2014.
48. N. Pezzotti, T. Höllt, B. Lelieveldt, E. Eisemann, and A. Vilanova, "Hierarchical stochastic neighbor embedding," Comput. Graph. Forum (Proc. EuroVis), vol. 35, 2016.