Synthesizing the preferred inputs for neurons in neural networks via deep generator networks

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 3395-3403

  Nguyen, Anh ^a   Dosovitskiy, Alexey ^a   Yosinski, Jason ^a   Brox, Thomas ^a   Clune, Jeff ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

CHEMICAL ACTIVATION; NETWORK ARCHITECTURE; NEURAL NETWORKS; NEURONS; PATTERN RECOGNITION;

BASIC SCIENCE; GENERATIVE METHODS; HIGH QUALITY; HUMAN BRAIN; NETWORK FUNCTIONS; QUALITATIVE STATE; STATE OF THE ART; SYNTHETIC IMAGES;

DEEP NEURAL NETWORKS;

EID: 85019234593     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. R. Q. Quiroga, L. Reddy, G. Kreiman, C. Koch, and I. Fried. Invariant visual representation by single neurons in the human brain. Nature, 435(7045): 1102-1107, 2005.
2. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In Computer Vision-ECCV 2014, pages 818-833. Springer, 2014.
3. A. Nguyen, J. Yosinski, and J. Clune. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In Computer Vision and Pattern Recognition (CVPR), 2015.
4. D. Erhan, Y. Bengio, A. Courville, and P. Vincent. Visualizing higher-layer features of a deep network. Dept. IRO, Université de Montréal, Tech. Rep, 4323, 2009.
5. K. Simonyan, A. Vedaldi, and A. Zisserman. Deep inside convolutional networks: Visualising image classification models and saliency maps. ICLR workshop, 2014.
6. A. Mahendran and A. Vedaldi. Visualizing deep convolutional neural networks using natural pre-images. In Computer Vision and Pattern Recognition (CVPR), 2016.
7. J. Yosinski, J. Clune, A. Nguyen, T. Fuchs, and H. Lipson. Understanding neural networks through deep visualization. In Deep Learning Workshop, ICML conference, 2015.
8. D. Wei, B. Zhou, A. Torrabla, and W. Freeman. Understanding intra-class knowledge inside cnn. arXiv preprint arXiv: 1507.02379, 2015.
9. A. Nguyen, J. Yosinski, and J. Clune. Multifaceted feature visualization: Uncovering the different types of features learned by each neuron in deep neural networks. In Visualization for Deep Learning Workshop, ICML conference, 2016.
10. A. Mordvintsev, C. Olah, and M. Tyka. Inceptionism: Going deeper into neural networks. Google Research Blog. Retrieved June, 20, 2015.
11. A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks. In NIPS, 2016.
12. L. Theis, A. van den Oord, and M. Bethge. A note on the evaluation of generative models. In ICLR, 2016.
13. Y. Bengio, I. J. Goodfellow, and A. Courville. Deep learning. MIT Press, 2015.
14. D. P. Kingma and M. Welling. Auto-encoding variational bayes. In ICLR, 2014.
15. A. Dosovitskiy, J. Tobias Springenberg, and T. Brox. Learning to generate chairs with convolutional neural networks. In Computer Vision and Pattern Recognition (CVPR), 2015.
16. A. Radford, L. Metz, and S. Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. In ICLR, 2016.
17. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS, 2014.
18. G. Alain and Y. Bengio. What regularized auto-encoders learn from the data-generating distribution. The Journal of Machine Learning Research, 15(1): 3563-3593, 2014.
19. O. Russakovsky et al. Imagenet large scale visual recognition challenge. IJCV, 115(3): 211-252, 2015.
20. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv: 1408.5093, 2014.
21. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Computer Vision and Pattern Recognition (CVPR), 2015.
22. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
23. J. Deng et al. Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
24. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105, 2012.
25. A. Dosovitskiy and T. Brox. Inverting visual representations with convolutional networks. In CVPR, 2016.
26. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning deep features for scene recognition using places database. In Advances in neural information processing systems, 2014.
27. J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, et al. Long-term recurrent convolutional networks for visual recognition and description. In Computer Vision and Pattern Recognition, 2015.
28. B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba. Object detectors emerge in deep scene cnns. In International Conference on Learning Representations (ICLR), 2015.