Explaining predictions of non-linear classifiers in nlp

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2016, Pages 1-7

  Arras, Leila ^a   Horn, Franziska ^b   Montavon, Gregoire ^b   Muller, Klaus Robert ^b,c   Samek, Wojciech ^a  

^a FRAUNHOFER HEINRICH HERTZ INSTITUTE   (Germany)

^b TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^c Korea University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; SENSITIVITY ANALYSIS;

CONVOLUTIONAL NEURAL NETWORK; IMAGES CLASSIFICATION; INPUT VARIABLES; LANGUAGE PROCESSING; LAYER-WISE; NATURAL LANGUAGES; NEURAL NETWORK PREDICTIONS; NONLINEAR CLASSIFIERS; PCA ANALYSIS;

FORECASTING;

EID: 85121212264     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. S. Bach, A. Binder, G. Montavon, F. Klauschen, K.-R. Müller, and W. Samek. 2015. On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLoS ONE, 10(7):e0130140.
2. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin. 2003. A Neural Probabilistic Language Model. JMLR, 3:1137-1155.
3. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa. 2011. Natural Language Processing (Almost) from Scratch. JMLR, 12:2493-2537.
4. M. Denil, A. Demiraj, and N. de Freitas. 2014. Extraction of Salient Sentences from Labelled Documents. Technical report, University of Oxford.
5. Y. Dimopoulos, P. Bourret, and S. Lek. 1995. Use of some sensitivity criteria for choosing networks with good generalization ability. Neural Processing Letters, 2(6):1-4.
6. D. Erhan, A. Courville, and Y. Bengio. 2010. Understanding Representations Learned in Deep Architectures. Technical report, University of Montreal.
7. M. Gevrey, I. Dimopoulos, and S. Lek. 2003. Review and comparison of methods to study the contribution of variables in artificial neural network models. Ecological Modelling, 160(3):249-264.
8. Y. Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proc. of EMNLP, pages 1746-1751.
9. R. Krishnan, G. Sivakumar, and P. Bhattacharya. 1999. Extracting decision trees from trained neural networks. Pattern Recognition, 32(12):1999-2009.
10. W. Landecker, M. Thomure, L. Bettencourt, M. Mitchell, G. Kenyon, and S. Brumby. 2013. Interpreting Individual Classifications of Hierarchical Networks. In IEEE Symposium on Computational Intelligence and Data Mining (CIDM), pages 32-38.
11. S. Lapuschkin, A. Binder, G. Montavon, K.-R. Müller, and W. Samek. 2016a. Analyzing Classifiers: Fisher Vectors and Deep Neural Networks. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
12. S. Lapuschkin, A. Binder, G. Montavon, K.-R. Müller, and W. Samek. 2016b. The Layer-wise Relevance Propagation Toolbox for Artificial Neural Networks. JMLR. in press.
13. J. Li, X. Chen, E. Hovy, and D. Jurafsky. 2015. Visualizing and Understanding Neural Models in NLP. arXiv, (1506.01066).
14. M. Mikolov, K. Chen, G. Corrado, and J. Dean. 2013. Efficient Estimation of Word Representations in Vector Space. In Workshop Proc. ICLR.
15. G. Montavon, S. Bach, A. Binder, W. Samek, and K.-R. Müller. 2015. Explaining NonLinear Classification Decisions with Deep Taylor Decomposition. arXiv, (1512.02479).
16. H.S. Paskov, R. West, J.C. Mitchell, and T. Hastie. 2013. Compressive Feature Learning. In Adv. in NIPS.
17. W. Samek, A. Binder, G. Montavon, S. Bach, and K.-R. Müller. 2015. Evaluating the visualization of what a Deep Neural Network has learned. arXiv, (1509.06321).
18. K. Simonyan, A. Vedaldi, and A. Zisserman. 2014. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. In Workshop Proc. ICLR.
19. M. D. Zeiler and R. Fergus. 2014. Visualizing and Understanding Convolutional Networks. In ECCV, pages 818-833.