Visualizing the Hidden Activity of Artificial Neural Networks

IEEE Transactions on Visualization and Computer Graphics

Volumn 23, Issue 1, 2017, Pages 101-110

  Rauber, Paulo E ^a,b   Fadel, Samuel G ^c   Falcão, Alexandre X ^b   Telea, Alexandru C ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITY OF CAMPINAS   (Brazil)

^c UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

algorithm understanding; Artificial neural networks; dimensionality reduction

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); IMAGE CLASSIFICATION; LEARNING SYSTEMS;

ARTIFICIAL NEURONS; BENCHMARK DATASETS; BLACK BOXES; DIMENSIONALITY REDUCTION; HIGH-DIMENSIONAL; NETWORK DESIGNER; STATE OF THE ART;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; NERVE CELL;

EID: 84998953869     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2016.2598838     Document Type: Article

References (50)

1. M. Aubry and B. Russell. Understanding deep features with computer-generated imagery. In International Conference on Computer Vision (ICCV), 2015.
2. M. Aupetit. Visualizing distortions and recovering topology in continu-ous projection techniques. Neurocomputing, 70(7):1304-1330, 2007.
3. F. Bastien, P. Lamblin, R. Pascanu, J. Bergstra, I. J. Goodfellow, A. Berg-eron, N. Bouchard, D. Warde-Farley, and Y. Bengio. Theano: new fea-tures and speed improvements. arXiv preprint arXiv:1211.5590, 2012.
4. Y. Bengio. Learning deep architectures for AI. Foundations and trends in Machine Learning, 2(1):1-127, 2009.
5. Y. Bengio. Practical recommendations for gradient-based training of deep architectures. In Neural Networks: Tricks of the Trade, pages 437-478. Springer, 2012.
6. I. Borg and P. J. Groenen. Modern multidimensional scaling: Theory and applications. Springer Science & Business Media, 2005.
7. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. arXiv preprint arXiv:1310.1531, 2013.
8. D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, and S. Bengio. Why does unsupervised pre-training help deep learning? Jour-nal of Machine Learning Research, 11:625-660, 2010.
9. D. Erhan, Y. Bengio, A. Courville, and P. Vincent. Visualizing higher-layer features of a deep network. Dept. IRO, Université de Montréal, Tech. Rep. 4323, 2009.
10. F. J. García Fernández, M. Verleysen, J. A. Lee, and I. Díaz Blanco. Stability comparison of dimensionality reduction techniques attending to data and parameter variations. In Eurographics Conference on Visualization. The Eurographics Association, 2013.
11. P. Geurts, D. Ernst, and L. Wehenkel. Extremely randomized trees. Ma-chine learning, 63(1):3-42, 2006.
12. I. J. Goodfellow, D.Warde-Farley, M. Mirza, A. Courville, and Y. Bengio. Maxout networks. arXiv preprint arXiv:1302.4389, 2013.
13. J. C. Gower and G. B. Dijksterhuis. Procrustes Problems. Oxford Statis-tical Science Series 30, 2004.
14. A. Graves. Supervised Sequence Labelling with Recurrent Neural Net-works, volume 385 of Studies in Computational Intelligence. Springer, 2012.
15. A. Graves. Generating sequences with recurrent neural networks. arXiv preprint arXiv:1308.0850, 2013.
16. P. Hamel and D. Eck. Learning features from music audio with deep belief networks. In Proc. International Society for Music Information Retrieval, pages 339-344, 2010.
17. C. Hurtr, O. Ersoy, S. Fabrikant, T. Klein, and A. Telea. Bundled visual-ization of dynamic graph and trail data. IEEE Transactions on Visualization and Computer Graphics, 20(8):1141-1154, 2014.
18. D. Jäckle, F. Fischer, T. Schreck, and D. A. Keim. Temporal MDS plots for analysis of multivariate data. IEEE Transactions on Visualization and Computer Graphics, 22(1):141-150, 2016.
19. P. Joia, F. Paulovich, D. Coimbra, J. Cuminato, and L. Nonato. Local affine multidimensional projection. IEEE Transactions on Visualization and Computer Graphics, 17(12):2563-2571, 2011.
20. A. Krizhevsky and G. Hinton. Learning multiple layers of fea-tures from tiny images, 2009. www.cs.toronto.edu/~kriz/learning-features-2009-TR.pdf.
21. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Proc. Neural Information Processing Systems, pages 1097-1105. 2012.
22. Y. LeCun, C. Cortes, and C. J. Burges. The MNIST database of hand-written digits, 1998. http://yann.lecun.com/exdb/mnist/.
23. C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu. Deeply-supervised nets. arXiv preprint arXiv:1409.5185, 2014.
24. J. A. Lee and M. Verleysen. Nonlinear dimensionality reduction of data manifolds with essential loops. Neurocomputing, 67:29-53, 2005.
25. S. Liu, D. Maljovec, B.Wang, P.-T. Bremer, and V. Pascucci. Visualizing high-dimensional data: Advances in the past decade. In Proc. EuroVis-STARs, 2015.
26. S. Liu, B. Wang, P.-T. Bremer, and V. Pascucci. Distortion-guided structure-driven interactive exploration of high-dimensional data. Com-puter Graphics Forum, 33(3):101-110, 2014.
27. A. Mahendran and A. Vedaldi. Understanding deep image representations by inverting them. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 5188-5196, June 2015.
28. R. M. Martins, D. B. Coimbra, R. Minghim, and A. Telea. Visual analysis of dimensionality reduction quality for parameterized projections. Com-puters & Graphics, 41:26-42, 2014.
29. V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D.Wierstra, S. Legg, and D. Hassabis. Human-level control through deep reinforcement learning. Nature, 518(7540):529-533, 02 2015.
30. T. Mühlbacher, H. Piringer, S. Gratzl, M. Sedlmair, and M. Streit. Open-ing the black box: Strategies for increased user involvement in existing al-gorithm implementations. IEEE Transactions on Visualization and Com-puter Graphics, 20(12):1643-1652, Dec 2014.
31. Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Y. Ng. Read-ing digits in natural images with unsupervised feature learning. In Proc. Neural Information Processing Systems, volume 2011, page 5, 2011.
32. G. B. Orr and K.-R. Müller. Neural networks: tricks of the trade. Springer, 2003.
33. F. V. Paulovich, L. G. Nonato, R. Minghim, and H. Levkowitz. Least square projection: A fast high-precision multidimensional projection technique and its application to document mapping. IEEE Transactions on Visualization and Computer Graphics, 14(3):564-575, 2008.
34. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Van-derplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duch-esnay. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825-2830, 2011.
35. L. Prechelt. Early stopping-but when? In Neural Networks: Tricks of the trade, pages 55-69. Springer, 1998.
36. A. r. Mohamed, G. Hinton, and G. Penn. Understanding how deep be-lief networks perform acoustic modelling. In 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 4273-4276, March 2012.
37. P. E. Rauber, R. R. O. Silva, S. Feringa, M. E. Celebi, A. X. Falcão, and A. C. Telea. Interactive Image Feature Selection Aided by Dimensionality Reduction. In EuroVis Workshop on Visual Analytics (EuroVA), 2015.
38. G. Robertson, R. Fernandez, D. Fisher, B. Lee, and J. Stasko. Effective-ness of animation in trend visualization. IEEE Transactions on Visualization and Computer Graphics, 14(6):1325-1332, Nov 2008.
39. J. Schmidhuber. Deep learning in neural networks: An overview. Neural Networks, 61:85-117, 2015.
40. J. Snoek, H. Larochelle, and R. P. Adams. Practical bayesian optimization of machine learning algorithms. In Advances in neural information processing systems, pages 2951-2959, 2012.
41. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdi-nov. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15(1):1929-1958, 2014.
42. C. Turkay, P. Filzmoser, and H. Hauser. Brushing dimensions-a dual visual analysis model for high-dimensional data. IEEE Transactions on Visualization and Computer Graphics, 17(12):2591-2599, 2011.
43. L. Van Der Maaten. Accelerating t-SNE using tree-based algorithms. Journal of Machine Learning Research, 15(1):3221-3245, 2014.
44. L. Van der Maaten and G. Hinton. Visualizing data using t-SNE. Journal of Machine Learning Research, 9(2579-2605):85, 2008.
45. S. Van Der Walt, S. C. Colbert, and G. Varoquaux. The numpy array: a structure for efficient numerical computation. Computing in Science & Engineering, 13(2):22-30, 2011.
46. M. van der Zwan, V. Codreanu, and A. Telea. CUBu: Universal real-time bundling for large graphs. IEEE Transactions on Visualization and Computer Graphics, 2016. doi:10.1109/TVCG.2016.2515611.
47. L. Wan, M. Zeiler, S. Zhang, Y. L. Cun, and R. Fergus. Regularization of neural networks using dropconnect. In Proc. International Conference on Machine Learning, pages 1058-1066, 2013.
48. J. Yosinski, J. Clune, A. Nguyen, T. Fuchs, and H. Lipson. Understanding neural networks through deep visualization. In Deep Learning Workshop, International Conference on Machine Learning (ICML), 2015.
49. X. Yuan, D. Ren, Z. Wang, and C. Guo. Dimension projection ma-trix/tree: Interactive subspace visual exploration and analysis of high dimensional data. IEEE Transactions on Visualization and Computer Graphics, 19(12):2625-2633, 2013.
50. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In Proc. European Conference on Computer Vision, pages 818-833. Springer, 2014.