Towards Better Analysis of Deep Convolutional Neural Networks

IEEE Transactions on Visualization and Computer Graphics

Volumn 23, Issue 1, 2017, Pages 91-100

  Liu, Mengchen ^a   Shi, Jiaxin ^b   Li, Zhen ^a   Li, Chongxuan ^b   Zhu, Jun ^b   Liu, Shixia ^a  

^a TSINGHUA UNIVERSITY   (China)

^b TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

Author keywords

biclustering; Deep convolutional neural networks; edge bundling; matrix reordering; rectangle packing

Indexed keywords

CONVOLUTION; DIRECTED GRAPHS; IMAGE CLASSIFICATION; NEURONS; PATTERN RECOGNITION; VISUALIZATION;

BI-CLUSTERING; CONVOLUTIONAL NEURAL NETWORK; EDGE BUNDLING; MATRIX REORDERING; RECTANGLE PACKING;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; CONVOLUTIONAL NEURAL NETWORK; DIRECTED ACYCLIC GRAPH; HUMAN; HUMAN EXPERIMENT; NERVE CELL;

EID: 84999288596     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2016.2598831     Document Type: Article

References (60)

1. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467, 2016.
2. R. Agrawal and R. Srikant. Fast algorithms for mining association rules in large databases. In VLDB, pages 487-499, 1994.
3. S. Amershi, J. Fogarty, A. Kapoor, and D. Tan. Examining multiple potential models in end-user interactive concept learning. In CHI, pages 1357-1360. ACM, 2010.
4. Y. Bengio. Learning deep architectures for ai. Foundations and Trends in Machine Learning, 2(1):1-127, 2009.
5. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. IEEE PAMI, 35(8):1798-1828, 2013.
6. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio. Theano: a CPU and GPU math expression compiler. In SciPy, 2010.
7. L. Bottou. Stochastic gradient learning in neural networks. Neuro-Nimes, 91(8), 1991.
8. M. Chen and H. Jaenicke. An information-theoretic framework for visual-ization. IEEE TVCG, 16(6):1206-1215, 2010.
9. M. Chen, S. Walton, K. Berger, J. Thiyagalingam, B. Duffy, H. Fang, C. Holloway, and A. E. Trefethen. Visual multiplexing. CGF, 33(3):241-250, 2014.
10. R. Collobert, S. Bengio, and J. Mariéthoz. Torch: a modular machine learning software library. Technical report, IDIAP, 2002.
11. D. Comaniciu and P. Meer. Mean shift: a robust approach toward feature space analysis. IEEE PAMI, 24(5):603-619, 2002.
12. W. Cui, S. Liu, L. Tan, C. Shi, Y. Song, Z. J. Gao, H. Qu, and X. Tong. Textflow: Towards better understanding of evolving topics in text. IEEE TVCG, 17(12):2412-2421, 2011.
13. W. Cui, S. Liu, Z. Wu, and H. Wei. How hierarchical topics evolve in large text corpora. IEEE TVCG, 20(12):2281-2290, 2014.
14. W. Cui, H. Zhou, H. Qu, P. C. Wong, and X. Li. Geometry-based edge clustering for graph visualization. IEEE TVCG, 14(6):1277-1284, 2008.
15. A. Dosovitskiy and T. Brox. Inverting visual representations with convo-lutional networks. arXiv preprint arXiv:1506.02753, 2015.
16. N. Elmqvist and J.-D. Fekete. Hierarchical aggregation for information visualization: Overview, techniques, and design guidelines. IEEE TVCG, 16(3):439-454, 2010.
17. D. Erhan, Y. Bengio, A. Courville, and P. Vincent. Visualizing higher-layer features of a deep network. Technical report, University of Montreal, 2009.
18. S. Gad, W. Javed, S. Ghani, N. Elmqvist, T. Ewing, K. N. Hampton, and N. Ramakrishnan. Themedelta: Dynamic segmentations over temporal topic models. IEEE TVCG, 21(5):672-685, 2015.
19. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, pages 580-587, 2014.
20. X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In AISTATS, pages 249-256, 2010.
21. A. W. Harley. An interactive node-link visualization of convolutional neural networks. In ISVC, pages 867-877, 2015.
22. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In CVPR, 2016. To appear.
23. M. Held and R. M. Karp. A dynamic programming approach to sequencing problems. SIAM, 10(1):196-210, 1962.
24. N. Henry, J.-D. Fekete, and M. J. McGuffin. Nodetrix: a hybrid visualiza-tion of social networks. IEEE TVCG, 13(6):1302-1309, 2007.
25. D. Holten and J. J. Van Wijk. Force-directed edge bundling for graph visualization. CGF, 28(3):983-990, 2009.
26. E. Huang and R. E. Korf. Optimal rectangle packing: An absolute place-ment approach. JAIR, 46:47-87, 2012.
27. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In ICML, pages 448-456, 2015.
28. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
29. B. Johnson and B. Shneiderman. Tree-maps: A space-filling approach to the visualization of hierarchical information structures. In Visualization, pages 284-291, 1991.
30. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, pages 1725-1732, 2014.
31. R. E. Korf, M. D. Moffitt, and M. E. Pollack. Optimal rectangle packing. Annals of Operations Research, 179(1):261-295, 2010.
32. A. Krizhevsky. Learning multiple layers of features from tiny images. Technical report, University of Montreal, 2009.
33. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097-1105, 2012.
34. Y. LeCun, Y. Bengio, and G. Hinton. Deep learning. Nature, 521(7553):436-444, 2015.
35. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. IEEE, 86(11):2278-2324, 1998.
36. C. Li, J. Zhu, T. Shi, and B. Zhang. Max-margin deep generative models. In NIPS, pages 1828-1836, 2015.
37. H. Li, T. Jiang, and K. Zhang. Efficient and robust feature extraction by maximum margin criterion. Neural Networks, 17(1):157-165, 2006.
38. M. Liu, S. Liu, X. Zhu, Q. Liao, F. Wei, and S. Pan. An uncertainty-aware approach for exploratory microblog retrieval. IEEE TVCG, 22(1):250-259, 2016.
39. S. Liu, W. Cui, Y. Wu, and M. Liu. A survey on information visualization: recent advances and challenges. The Visual Computer, 30(12):1373-1393, 2014.
40. S. Liu, J. Yin, X.Wang,W. Cui, K. Cao, and J. Pei. Online visual analytics of text streams. To appear in IEEE TVCG, 2015.
41. A. Mahendran and A. Vedaldi. Understanding deep image representations by inverting them. In CVPR, pages 5188-5196, 2015.
42. S. Marsland. Machine learning: an algorithmic perspective. CRC press, 2015.
43. V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, et al. Human-level control through deep reinforcement learning. Nature, 518(7540):529-533, 2015.
44. T. Munzner. Visualization Analysis and Design. CRC Press, 2014.
45. V. Nair and G. E. Hinton. Rectified linear units improve restricted boltz-mann machines. In ICML, pages 807-814, 2010.
46. M. E. Newman. Fast algorithm for detecting community structure in networks. Physical review E, 69(6):066133, 2004.
47. J. G. S. Paiva, W. R. Schwartz, H. Pedrini, and R. Minghim. An approach to supporting incremental visual data classification. IEEE TVCG, 21(1):4-17, 2015.
48. D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. van den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, et al. Mastering the game of go with deep neural networks and tree search. Nature, 529(7587):484-489, 2016.
49. K. Simonyan, A. Vedaldi, and A. Zisserman. Deep inside convolutional networks: Visualising image classification models and saliency maps. In ICLR Workshop, 2013.
50. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556, 2014.
51. G. Sun, Y. Wu, R. Liang, and S. Liu. A survey of visual analytics tech-niques and applications: State-of-the-art research and future challenges. JCST, 28(5):852-867, 2013.
52. G. Sun, Y. Wu, S. Liu, T. Q. Peng, J. J. H. Zhu, and R. Liang. Evoriver: Visual analysis of topic coopetition on social media. IEEE TVCG, 20(12):1753-1762, 2014.
53. M. Sun, P. Mi, C. North, and N. Ramakrishnan. Biset: Semantic edge bundling with biclusters for sensemaking. IEEE TVCG, 22(1):310-319, 2016.
54. S. Sun, W. Chen, L. Wang, X. Liu, and T.-Y. Liu. On the depth of deep neural networks: A theoretical view. In AAAI, pages 2066-2072, 2016.
55. Y. Tanahashi, C. H. Hsueh, and K. L. Ma. An efficient framework for generating storyline visualizations from streaming data. IEEE TVCG, 21(6):730-742, 2015.
56. F. Y. Tzeng and K. L. Ma. Opening the black box-data driven visualization of neural networks. In IEEE VIS, pages 383-390, 2005.
57. Y. Wu, N. Pitipornvivat, J. Zhao, S. Yang, G. Huang, and H. Qu. egoslider: Visual analysis of egocentric network evolution. IEEE TVCG, 22(1):260-269, 2016.
58. J. Yosinski, J. Clune, A. Nguyen, T. Fuchs, and H. Lipson. Understanding neural networks through deep visualization. In ICML Workshop on Deep Learning, 2015.
59. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV, pages 818-833, 2014.
60. M. D. Zeiler, G. W. Taylor, and R. Fergus. Adaptive deconvolutional networks for mid and high level feature learning. In ICCV, pages 2018-2025, 2011.