Regularization and improved interpretation of linear data mappings and adaptive distance measures

Proceedings of the 2013 IEEE Symposium on Computational Intelligence and Data Mining, CIDM 2013 - 2013 IEEE Symposium Series on Computational Intelligence, SSCI 2013

Volumn , Issue , 2013, Pages 10-17

  Strickert, Marc ^a   Hammer, Barbara ^b   Villmann, Thomas ^c   Biehl, Michael ^d  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

^b BIELEFELD UNIVERSITY   (Germany)

^c UNIVERSITY OF APPLIED SCIENCES MITTWEIDA   (Germany)

^d UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE DISTANCE MEASURE; DATA TRANSFORMATION; HIGH DIMENSIONAL DATA; INTERPRETABILITY; LINEAR MAPPING; REGULARIZATION MECHANISM; TRAINING DATA; UNDER-DETERMINED;

ARTIFICIAL INTELLIGENCE; DATA MINING; LEARNING ALGORITHMS; LEARNING SYSTEMS; LINEAR TRANSFORMATIONS; MAPPING;

MATHEMATICAL TRANSFORMATIONS;

EID: 84885659918     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIDM.2013.6597211     Document Type: Conference Paper

References (29)

1. J. Wu and J. Wang, "PCA-based SVM for automatic recognition of gait patterns," J Appl Biomech, vol. 24, no. 1, pp. 83-7, 2008.
2. L. van der Maaten, E. Postma, and H. van den Herik, "Dimensionality reduction: A comparative review," Tilburg University Technical Report, TiCC-TR 2009-005, Tech. Rep., 2009.
3. A. Hyvarinen and E. Oja, "Independent component analysis: algorithms and applications," Neural Netw., vol. 13, no. 4-5, pp. 411-430, 2000.
4. L. Wiskott and T. Sejnowski, "Slow Feature Analysis: Unsupervised Learning of Invariances." Neural Computation, vol. 14, no. 4, pp. 715-770, 2002.
5. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," Journal of Machine Learning Research, vol. 3, pp. 1157-1182, 2003.
6. B. Hammer and T. Villmann, "Generalized relevance learning vector quantization," Neural Networks, vol. 15, no. 8-9, pp. 1059-1068, 2002.
7. P. Schneider, M. Biehl, and B. Hammer, "Adaptive relevance matrices in learning vector quantization," Neural Computation, vol. 21, pp. 3532-3561, 2009.
8. K. Weinberger and L. Saul, "Distance metric learning for large margin nearest neighbor classification," The Journal of Machine Learning Research, vol. 10, pp. 207-244, 2009.
9. K. Weinberger, F. Sha, and L. Saul, "Convex optimizations for distance metric learning and pattern classification," Signal Processing Magazine, vol. 27, pp. 146-158, 2010.
10. J. A. Lee and M. Verleysen, Nonlinear dimensionality reduction. Springer, 2007.
11. M. Biehl, K. Bunte, F.-M. Schleif, P. Schneider, and T. Villmann, "Large margin discriminative visualization by matrix relevance learning," in Proc. IEEE World Congress on Computational Intelligence, WCCI 2012.
12. D. Hardin, I. Tsamardinos, and C. F. Aliferis, "A theoretical characterization of linear SVM-based feature selection," in Proceedings of the twenty-first international conference on Machine learning, ser. ICML '04. New York, NY, USA: ACM, 2004, pp. 48-55.
13. W. Arlt, M. Biehl, A. Taylor, S. Hahner, R. Libe, B. Hughes, P. Schneider, D. Smith, H. Stiekema, N. Krone, E. Porfiri, G. Opocher, J. Bertherat, F. Mantero, B. Allolio, M. Terzolo, P. Nightingale, C. Shackleton, X. Bertagna, M. Fassnacht, and P. Stewart, "Urine steroid metabolomics as a biomarker tool for detecting malignancy in adrenal tumors," J Clinical Endocrinology and Metabolism, vol. 96, pp. 3775-3784, 2011.
14. K. Bunte, P. Schneider, B. Hammer, F.-M. Schleif, T. Villmann, and M. Biehl, "Limited rank matrix learning, discriminative dimension reduction, and visualization," Neural Networks, vol. 26, pp. 159-173, 2012.
15. M. Ward, G. Grinstein, and D. A. Keim, Interactive Data Visualization: Foundations, Techniques, and Application. A. K. Peters, Ltd, 2010.
16. A. Vellido, J. Martin-Guerroro, and P. Lisboa, "Making machine learning models interpretable," in ESANN'12, 2012.
17. S. Ruping, "Learning interpretable models," Ph.D. dissertation, Dortmund University, 2006.
18. M. Strickert and M. Seifert, "Posterior regularization and attribute assessment of under-determined linear mappings," in European Symposium on Artificial Neural Networks (ESANN), M. Verleysen, Ed. D-facto Publications, 2012, pp. 67-72.
19. R. Tibshirani, "Regression shrinkage and selection via the lasso," Journal of the Royal Statistical Society, vol. 58, pp. 267-288, 1996.
20. A. Gisbrecht and B. Hammer, "Relevance learning in generative topographic mapping," Neurocomputing, vol. 74, no. 9, pp. 1359-1371, 2011.
21. B. Arnonkijpanich, A. Hasenfuss, and B. Hammer, "Local matrix adaptation in topographic neural maps," Neurocomputing, vol. 74, no. 4, pp. 522-539, 2011.
22. J. Ye, Z. Zhao, and H. Liu, "Adaptive distance metric learning for clustering," in IEEE Conf. on Computer Vision and Pattern Recog., 2007.
23. R. Jin, S. Wang, and Y. Zhou, "Regularized distance metric learning: Theory and algorithm," in Advances in Neural Information Processing Systems 22, 2009.
24. P. Schneider, K. Bunte, H. Stiekema, B. Hammer, T. Villmann, and M. Biehl, "Regularization in matrix relevance learning," IEEE Transactions on Neural Networks, vol. 21, pp. 831-840, 2010.
25. P. Schneider, M. Biehl, and B. Hammer, "Distance learning in discriminative vector quantization," Neural Computation, vol. 21, pp. 2942-2969, 2009.
26. M. Biehl, P. Schneider, D. Smith, H. Stiekema, A. Taylor, B. Hughes, C. Shackleton, P. Stewart, and W. Arlt, "Matrix relevance LVQ in steroid metabolomics based classification of adrenal tumors," in 20th European Symposium on Artificial Neural Networks (ESANN 2012), M. Verleysen, Ed. d-side publishing, 2012, pp. 423-428.
27. UCL, "Spectral Wine Database," Provided by Prof. Marc Meurens, Universit́e Catholique de Louvain, http://www.ucl.ac.be/mlg/, 2007.
28. C. Krier, D. François, F. Rossi, and M. Verleysen, "Feature clustering and mutual information for the selection of variables in spectral data," in European Symposium on Artificial Neural Networks (ESANN). D-side Publications, 2007, pp. 157-162.
29. A. Soto, R. Cecchini, G. Vazquez, and I. Ponzoni, "Multi-Objective Feature Selection in QSAR Using a Machine Learning Approach," QSAR &Combinatorial Science, vol. 28, no. 11-12, pp. 1509-1523, 2009.