Parsimonious Mahalanobis kernel for the classification of high dimensional data

Pattern Recognition

Volumn 46, Issue 3, 2013, Pages 845-854

  Fauvel, M ^a   Chanussot, J ^b   Benediktsson, J A ^c   Villa, A ^d,e  

^a UMR 1201 Dynafor   (France)

^b GIPSA LAB   (France)

^c UNIVERSITY OF ICELAND   (Iceland)

^d Aresys   (Italy)

^e POLITECNICO DI MILANO   (Italy)

Author keywords

High dimensional data; High dimensional discriminant analysis; Hyperspectral imagery; Kernel methods; Parsimonious Mahalanobis kernel; SVM

Indexed keywords

HIGH DIMENSIONAL DATA; HIGH-DIMENSIONAL; HYPERSPECTRAL IMAGERY; KERNEL METHODS; MAHALANOBIS; SVM;

DISCRIMINANT ANALYSIS; REMOTE SENSING; SPECTROSCOPY;

COVARIANCE MATRIX;

EID: 84870246773     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.09.009     Document Type: Article

References (47)

1. H.-P. Kriegel, P. Kröger, and A. Zimek Clustering high-dimensional data: a survey on sub space clustering, pattern-based clustering, and correlation clustering. in: Proceedings of the ACM Transactions on Knowledge Discovery Data 3 1 2009 1:1 1:58 10.1145/1497577.1497578
2. D.L. Donoho, High-dimensional data analysis: the curses and blessing of dimensionality, in: AMS Mathematical Challenges of the 21st Century, 2000.
3. A. Plaza, P. Martinez, R. Perez, and J. Plaza A new approach to mixed pixel classification of hyperspectral imagery based on extended morphological profiles Pattern Recognition 37 6 2004 1097 1116
4. M.G. Kendall A Course in the Geometry of n-Dimensions 1961 Dover Publication New York
5. L. Jimenez, and D.A. Landgrebe Supervised classification in high dimensional space geometrical, statistical and asymptotical properties of multivariate data IEEE Transactions on Systems, Man, and Cybernetics B 28 1 1998 39 54
6. J. Herault, A. Guerin-Dugue, P. Villemain, Searching for the embedded manifolds in high dimensional data, problems and unsolved questions, in: European Symposium on Artificial Neural Networks, 2002, pp. 1-12.
7. C. Aggarwal, A. Hinneburg, D. Keim, On the surprising behavior of distance metrics in high dimensional space, in: Database Theory - ICDT 2001, Lecture Notes in Computer Science, vol. 1973, Springer Berlin/Heidelberg, 2001, pp. 420-434.
8. D. Francois, V. Wertz, and M. Verleysen The concentration of fractional distances IEEE Transactions on Knowledge on Data Engineering 19 2007 873 886 ISSN 1041-4347
9. L. Yang Distance-preserving projection of high-dimensional data for nonlinear dimensionality reduction IEEE Transactions on Pattern Analysis and Machine Intelligence 26 9 2004 1243 1246
10. M. Verleysen, D. Francois, G. Simon, V. Wertz, On the effects of dimensionality on data analysis with neural networks, in: Artificial Neural Nets Problem Solving Methods, Lecture Notes in Computer Science, vol. 2687, Springer Berlin/Heidelberg, 2003, pp. 1044-1044.
11. M. Verleysen, Learning high dimensional data, in: V. Piuri (ed.), IOS Press, Amsterdam, The Netherlands, 2003.
12. R.E. Bellman Adaptive Control Processes - A Guided Tour 1961 Princeton New Jersey, U.S.A
13. D.A. Landgrebe Signal Theory Methods in Multispectral Remote Sensing 2003 John Wiley and Sons New Jersey
14. C.J.C. Burges Dimension reduction: a guided tour Foundations and Trends in Machine Learning 2 4 2010 275 365
15. J.A. Lee, and M. Verleysen Nonlinear Dimensionality Reduction 2007 Springer USA
16. I. Guyon, and A. Elisseeff An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
17. L. Parsons, E. Haque, and H. Liu Subspace clustering for high dimensional data a review SIGKDD Explorations Newsletter 6 2004 90 105
18. M.E. Tipping, and C.M. Bishop Probabilistic principal component analysis Journal of the Royal Statistical Society Series B (Statistical Methodology) 61 3 1999 611 622
19. M.E. Tipping, and C.M. Bishop Mixtures of probabilistic principal component analyzers Neural Computation 11 2 1999 443 482
20. J. Baek, G.J. McLachlan, and L.K. Flack Mixtures of factor analyzers with common factor loadings: applications to the clustering and visualization of high-dimensional data IEEE Transactions on Pattern Analysis and Machine Intelligence 32 7 2010 1298 1309
21. C. Bouveyron, S. Girard, and C. Schmid High-dimensional discriminant analysis Communication in Statistics - Theory and Methods/Communications in Statistics Theory and Methods 36 2007 2607 2623
22. C. Bouveyron, S. Girard, and C. Schmid High-dimensional data clustering Computational Statistics and Data Analysis 52 1 2007 502 519
23. T. Hofmann, B. Schölkopf, and A.J. Smola Kernel methods in machine learning Annals of Statistics 36 3 2008 1171 1220
24. Y. Bengio, O. Delalleau, N. Le Roux, The Curse of Highly Variable Functions for Local Kernel Machines, in: Y. Weiss, B. Sch ö lkopf, J. Platt (Eds.), Advances in Neural Information Processing Systems 18 (NIPS?05), MIT Press, 2006, pp. 107-114.
25. G. Camps-Valls, A. Rodrigo-Gonzalez, J. Muoz-Mari, L. Gomez-Chova, J. Calpe-Maravilla, Hyperspectral image classification with M ahalanobis relevance vector machines, in: Geoscience and Remote Sensing Symposium, 2007. IGARSS 2007. IEEE International, 2007, pp. 3802-3805.
26. S. Abe, Training of support vector machines with Mahalanobis kernels, in: Artificial Neural Networks: Formal Models and Their Applications - ICANN 2005, Lecture Notes in Computer Science, Springer Berlin/Heidelberg, 2005, pp. 571-576.
27. Y. Kamada, S. Abe, Support Vector Regression Using Mahalanobis Kernels, in: F. Schwenker, S. Marinai (Eds.), Artificial Neural Networks in Pattern Recognition, Lecture Notes in Computer Science, vol. 4087, Springer Berlin/Heidelberg, 2006, pp. 144-152.
28. D. Wang, D. Yeung, and E. Tsang Weighted Mahalanobis distance kernels for support vector machines IEEE Transactions on Neural Networks 18 5 2007 1453 1462
29. M. Filippone, F. Camastra, F. Masulli, and S. Rovetta A survey of kernel and spectral methods for clustering Pattern Recognition 41 1 2008 176 190
30. B. Scholkopf, C. Burges, A. Smola, Geometry and invariance in kernel based methods, in: Advances in Kernel Methods - Support Vector Learning, MIT Press, 1998.
31. P. Williams, S. Li, J. Feng, and S. Wu A geometrical method to improve performance of the vector machine IEEE Transactions on Neural Network 18 3 2007 942 947
32. C.J. Burges A tutorial on support vector machines for pattern recognition Data Mining and Knowledge Discovery 2 1998 121 167
33. S.-K. Kim, Y.J. Park, K.-A. Toh, and S. Lee SVM-based feature extraction for face recognition Pattern Recognition 43 8 2010 2871 2881
34. M. Fauvel, J. Chanussot, J. A. Benediktsson, A spatial-spectral kernel-based approach for the classification of remote-sensing images, Pattern Recognition 45 (1) (2012) 381-392, ISSN 0031-3203.
35. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-based Learning Methods 2000 Cambridge University Press
36. V. Vapnik The Nature of Statistical Learning Theory second edition 1999 Springer New York
37. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee Choosing multiple parameters for support vector machines Machine Learning 46 2002 131 159
38. S.S. Keerthi Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms IEEE Transactions on Neural Network 13 5 2002 1225 1229
39. C.-W. H., C.-J. L., A comparison of methods for multiclass support vector machines, IEEE Transactions on Neural Network 13 (2) (2002) 415 -425.
40. O. Chapelle, Selection of kernel parameters 〈 http://olivier. chapelle.cc/ams/ 〉, 2002.
41. R.B. Cattell The scree test for the number of factors Multivariate Behavioral Research 1 2 1966 245 276
42. N. Keshava, and J. Mustard Spectral unmixing IEEE Signal Processing Magazine 19 1 2002 44 57
43. ENVI User's Guide, Research Systems Inc. (RSI), Boulder, CO.
44. M. Fauvel, A. Villa, J. Chanussot, J. Benediktsson, Mahalanobis kernel for the classification of hyperspectral images, in: Geoscience and Remote Sensing Symposium (IGARSS), 2010 IEEE International, 2010, pp. 3724 -3727.
45. G. Schwarz Estimating the dimension of a model The Annals of Statistics 6 2 1978 461 464
46. C.H. Chen, and P.-G.P. Ho Statistical pattern recognition in remote sensing Pattern Recognition 41 9 2008 2731 2741
47. C. Bouveyron, G. Celeux, and S. Girard Intrinsic dimension estimation by maximum likelihood in isotropic probabilistic PCA Pattern Recognition Letters 32 14 2011 1706 1713