Analyzing Classifiers: Fisher Vectors and Deep Neural Networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 2912-2920

  Lapuschkin, Sebastian ^a   Binder, Alexander ^b   Montavon, Gregoire ^c   Muller, Klaus Robert ^c,d   Samek, Wojciech ^a  

^a FRAUNHOFER HEINRICH HERTZ INSTITUTE   (Germany)

^b SINGAPORE UNIVERSITY OF TECHNOLOGY AND DESIGN   (Singapore)

^c TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^d Korea University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; COMPUTER VISION; LINEAR TRANSFORMATIONS; MATHEMATICAL TRANSFORMATIONS;

ANALYSIS TOOLS; BAG OF FEATURES; BLACK BOXES; DEEP NEURAL NETWORKS; FISHER VECTORS; IMAGE REGIONS; NON-LINEAR TRANSFORMATIONS; NONLINEAR CLASSIFICATION;

PATTERN RECOGNITION;

EID: 84986268738     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.318     Document Type: Conference Paper

References (32)

1. S. Bach, A. Binder, G. Montavon, F. Klauschen, K.-R. Müller, and W. Samek. On pixel-wise explanations for nonlinear classifier decisions by layer-wise relevance propagation. PLOS ONE, 10(7):e0130140, 2015.
2. D. Baehrens, T. Schroeter, S. Harmeling, M. Kawanabe, K. Hansen, and K.-R. Müller. How to explain individual classification decisions. JMLR, 11:1803-1831, 2010.
3. K. Chatfield, V. S. Lempitsky, A. Vedaldi, and A. Zisserman. The devil is in the details: an evaluation of recent feature encoding methods. In BMVC, page 8, 2011.
4. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman. Return of the devil in the details: Delving deep into convolutional nets. In BMVC, 2014.
5. C. Cortes and V. Vapnik. Support-vector networks. Machine learning, 20(3):273-297, 1995.
6. M. Everingham, S. M. A. Eslami, L. V. Gool, C. K. I. Williams, J. M. Winn, and A. Zisserman. The pascal visual object classes challenge: A retrospective. IJCV, 111(1):98-136, 2015.
7. M. Everingham, L. Van Gool, C. K. I.Williams, J.Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2010 (VOC2010) Results.
8. R. B. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, pages 580-587, 2014.
9. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Comput., 9(8):1735-1780, 1997.
10. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. B. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In Proc. of the ACM Int. Conf. on Multimedia, pages 675-678, 2014.
11. A. Karpathy, A. Joulin, and F. Li. Deep fragment embeddings for bidirectional image sentence mapping. In Adv. in NIPS, pages 1889-1897, 2014.
12. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and F. Li. Large-scale video classification with convolutional neural networks. In CVPR, pages 1725-1732, 2014.
13. J. Koutnk, G. Cuccu, J. Schmidhuber, and F. J. Gomez. Evolving large-scale neural networks for vision-based reinforcement learning. In GECCO, pages 1061-1068, 2013.
14. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Adv. in NIPS, pages 1106-1114, 2012.
15. K. Lenc and A. Vedaldi. Understanding image representations by measuring their equivariance and equivalence. In CVPR, pages 991-999, 2015.
16. L. Liu and L. Wang. What has my classifier learned? visualizing the classification rules of bag-of-feature model by support region detection. In CVPR, pages 3586-3593. IEEE, 2012.
17. A. Mahendran and A. Vedaldi. Understanding deep image representations by inverting them. In CVPR, pages 5188-5196, 2015.
18. G. Montavon, S. Bach, A. Binder, W. Samek, and K.-R. Müller. Explaining nonlinear classification decisions with deep taylor decomposition. arXiv preprint arXiv:1512.02479, 2015.
19. D. Novotný, D. Larlus, F. Perronnin, and A. Vedaldi. Understanding the fisher vector: a multimodal part model. CoRR, abs/1504.04763, 2015.
20. M. Oquab, L. Bottou, I. Laptev, and J. Sivic. Learning and transferring mid-level image representations using convolutional neural networks. In CVPR, pages 1717-1724, 2014.
21. F. Perronnin, J. Sánchez, and T. Mensink. Improving the fisher kernel for large-scale image classification. In Computer Vision-ECCV 2010, pages 143-156. Springer, 2010.
22. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. IJCV, pages 1-42, April 2015.
23. W. Samek, A. Binder, G. Montavon, S. Bach, and K. Müller. Evaluating the visualization of what a deep neural network has learned. CoRR, abs/1509.06321, 2015.
24. J. Sánchez, F. Perronnin, T. Mensink, and J. Verbeek. Image classification with the fisher vector: Theory and practice. IJCV, 105(3):222-245, 2013.
25. K. Simonyan, A. Vedaldi, and A. Zisserman. Deep inside convolutional networks: Visualising image classification models and saliency maps. In ICLR Workshop, 2014.
26. I. Sutskever, O. Vinyals, and Q. V. Le. Sequence to sequence learning with neural networks. In Av. in NIPS, pages 3104-3112, 2014.
27. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In CVPR, pages 1-9, 2015.
28. J. Uijlings, A. Smeulders, and R. Scha. The visual extent of an object. IJCV, 2012.
29. J. Xiao, J. Hays, K. Ehinger, A. Oliva, A. Torralba, et al. Sun database: Large-scale scene recognition from abbey to zoo. In CVPR, pages 3485-3492, 2010.
30. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV, pages 818-833, 2014.
31. N. Zhang, J. Donahue, R. B. Girshick, and T. Darrell. Partbased r-cnns for fine-grained category detection. In Computer Vision-ECCV, pages 834-849, 2014.
32. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning deep features for scene recognition using places database. In Adv. in NIPS, pages 487-495, 2014.