How to explain individual classification decisions

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 1803-1831

  Baehrens, David ^a   Schroeter, Timon ^a   Harmeling, Stefan ^b   Kawanabe, Motoaki ^c   Hansen, Katja ^a   Müller, Klaus Robert ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c FRAUNHOFER FOKUS   (Germany)

Author keywords

Ames mutagenicity; Black box model; Explaining; Kernel methods; Nonlinear

Indexed keywords

BLACK BOXES; BLACK-BOX MODEL; CLASSIFICATION DECISION; CLASSIFICATION METHODS; DATA POINTS; KERNEL METHODS; MACHINE-LEARNING; MODERN TOOLS; MUTAGENICITY;

HAND TOOLS; LABELS;

DECISION TREES;

LABELS; MATHEMATICAL MODELS; NONLINEAR PROGRAMING; TOOLS;

EID: 77954665728     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (40)

1. B. N. Ames, E. G. Gurney, J. A. Miller, and H. Bartsch. Carcinogens as frameshift mutagens: Metabolites and derivatives of 2-acetylaminofluorene and other aromatic amine carcinogens. Proceedings of the National Academy of Sciences of the United States of America, 69(11): 3128-3132, 1972.
2. C.M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, 1995.
3. L. Devroye, L. Györfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Number 31 in Applications of Mathematics. Springer, New York, 1996.
4. R.A. Fisher. The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7: 179-188, 1936.
5. R. Fraud and F. Clrot. A methodology to explain neural network classification. Neural Networks, 15(2): 237-246, 2002. doi: 10.1016/S0893- 6080(01)00127-7.
6. H. Glatt, R. Jung, and F. Oesch. Bacterial mutagenicity investigation of epoxides: drugs, drug metabolites, steroids and pesticides. Mutation Research/Fundamental and Molecular Mechanisms of Mutagenesis, 111(2): 99-118, 1983. doi: 10.1016/0027-5107(83)90056-8.
7. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. The Journal of Machine Learning Research, 3: 1157-1182, 2003.
8. F. R. Hampel, E. M. Ronchetti, P. J. Rousseeuw, and W. A. Stahel. Robust Statistics: The Approach Based on Influence Functions. Wiley, New York, 1986.
9. K. Hansen, S. Mika, T. Schroeter, A. Sutter, A. Ter Laak, T. Steger-Hartmann, N. Heinrich, and K.-R. Müller. A benchmark data set for in silico prediction of ames mutagenicity. Journal of Chemical Information and Modelling, 49(9): 2077-2081, 2009.
10. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer, 2001.
11. E. J. Horvitz, J. S. Breese, and M. Henrion. Decision theory in expert systems and artificial inteligence. Journal of Approximation Reasoning, 2: 247-302, 1988. Special Issue on Uncertainty in Artificial Intelligence.
12. D. H. Johnson and S. Sinanovic. Symmetrizing the Kullback-Leibler distance. Technical report, IEEE Transactions on Information Theory, 2000.
13. J. Kazius, R. McGuire, and R. Bursi. Derivation and validation of toxicophores for mutagenicity prediction. J. Med. Chem., 48: 312-320, 2005.
14. W. Kienzle, M. O. Franz, B. Schölkopf, and F. A. Wichmann. Center-surround patterns emerge as optimal predictors for human saccade targets. Journal of Vision, 9(5): 1-15, 2009.
15. M. Kuss and C. E. Ramussen. Assesing approximate inference for binary gaussian process classification. Journal of Machine Learning Research, 6: 1679-1704, 2005.
16. Y. LeCun, L. Bottou, G.B. Orr, and K.-R Müller. Efficient backprop. In G.B. Orr and K.-R Müller, editors, Neural Networks: Tricks of the Trade, pages 9-53. Springer, 1998.
17. V. Lemaire and R. Feraud. Une méthode d'interprétation de scores. In EGC, pages 191-192, 2007.
18. K.-R. Müller, S. Mika, G. Ratsch, K. Tsuda, and B. Schölkopf. An introduction to kernel-based learning algorithms. Neural Networks, IEEE Transactions on, 12(2): 181-201, 2001.
19. Olga Obrezanova and Matthew D. Segall. Gaussian processes for classification: QSAR modeling of ADMET and target activity. Journal of Chemical Information and Modeling, April 2010. ISSN 1549-9596. doi: doi:10.1021/ ci900406x. URL http://dx.doi.org/10.1021/ci900406x.
20. O. Obrezanova, G. Csányi, J. M. R. Gola, and M. D. Segall. Gaussian processes: A method for automatic QSAR modelling of adme properties. J. Chem. Inf Model.
21. O. Obrezanova, J. M. R. Gola, E. J. Champness, and M. D. Segall. Automatic QSAR modeling of adme properties: blood-brain barrier penetration and aqueous solubility. J. Comput. -Aided Mol. Des., 22: 431-440, 2008.
22. J. C. Platt. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Advances in Large Margin Classifiers, pages 61-74. MIT Press, 1999.
23. J. Quionero-Candela, M. Sugiyama, A. Schwaighofer, and N. D. Lawrence. Dataset Shift in Machine Learning. The MIT Press, 2009.
24. C. E. Rasmussen and C. K. I. Williams. Gaussian Processes for Machine Learning. Springer, 2006.
25. M. Robnik-Sikonja and I. Kononenko. Explaining classifications for individual instances. IEEE TKDE, 20(5): 589-600, 2008.
26. B. Schölkopf and A. Smola. Learning with Kernels. MIT, 2002.
27. T. Schroeter, A. Schwaighofer, S. Mika, A. Ter Laak, D. Suelzle, U. Ganzer, N. Heinrich, and K.-R. Müller. Estimating the domain of applicability for machine learning QSAR models: A study on aqueous solubility of drug discovery molecules. Journal of Computer Aided Molecular Design, 21(9): 485-498, 2007a.
28. T. Schroeter, A. Schwaighofer, S. Mika, A. Ter Laak, D. Suelzle, U. Ganzer, N. Heinrich, and K.-R. Müller. Machine learning models for lipophilicity and their domain of applicability. Mol. Pharm., 4(4): 524-538, 2007b.
29. T. Schroeter, A. Schwaighofer, S. Mika, A. Ter Laak, D. Sülzle, U. Ganzer, N. Heinrich, and K.-R. Müller. Predicting lipophilicity of drug discovery molecules using gaussian process models. ChemMedChem, 2(9): 1265-1267, 2007c.
30. A. Schwaighofer. SVM Toolbox for Matlab, Jan 2002. URL http://ida.first.fraunhofer. de/-anton/software.html.
31. A. Schwaighofer, T. Schroeter, S. Mika, J. Laub, A. Ter Laak, D. Sülzle, U. Ganzer, N. Heinrich, and K.-R. Müller. Accurate solubility prediction with error bars for electrolytes: A machine learning approach. Journal of Chemical Information and Modelling, 47(2): 407-424, 2007.
32. A. Schwaighofer, T. Schroeter, S. Mika, K. Hansen, A. Ter Laak, P. Lienau, A. Reichel, N. Heinrich, and K.-R. Müller. A probabilistic approach to classifying metabolic stability. Journal of Chemical Information and Modelling, 48(4): 785-796, 2008.
33. S. Sonnenburg, A. Zien, P. Philips, and G. Ratsch. POIMs: positional oligomer importance matrices - understanding support vector machine based signal detectors. Bioinformatics, 2008.
34. E. Strumbelj and I. Kononenko. Towards a model independent method for explaining classification for individual instances. In I.-Y. Song, J. Eder, and T.M. Nguyen, editors, Data Warehousing and Knowledge Discovery, volume 5182 of Lecture Notes in Computer Science, pages 273-282. Springer, 2008.
35. H. Suermondt. Explanation in Bayesian Belief Networks. PhD thesis, Department of Computer Science and Medicine, Stanford University, Stanford, CA, 1992.
36. M. Sugiyama, M. Krauledat, and K.-R. Müller. Covariate shift adaptation by importance weighted cross validation. Journal of Machine Learning Research, 8: 985-1005, May 2007a.
37. M. Sugiyama, S. Nakajima, H. Kashima, P. von Buenau, and M. Kawanabe. Direct importance estimation with model selection and its application to covariate shift adaptation. In Advances in Neural Information Processing Systems 20. MIT Press, 2007b.
38. R. Todeschini, V. Consonni, A. Mauri, and M. Pavan. DRAGON for Windows and Linux 2006. http://www.talete.mi.it/help/dragon-help/ (accessed 27 March 2009), 2006.
39. V. Vapnik. The Nature of Statistical Learning Theory. Springer, 1995.
40. P. von Bünau, F. C. Meinecke, F. J. Király, and K.-R. Müller. Finding stationary subspaces in multivariate time series. Physical Review Letters, 103(21): 214101, 2009.