Kernel-based methods for hyperspectral image classification

IEEE Transactions on Geoscience and Remote Sensing

Volumn 43, Issue 6, 2005, Pages 1351-1362

  Camps Valls, Gustavo ^a   Bruzzone, Lorenzo ^b  

^a UNIVERSITY OF VALENCIA   (Spain)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

AdaBoost; Feature space; Hyperspectral classification; Kernel Fisher discriminant analysis; Kernel based methods; Radial basis function neural networks; Regularization; Support vector machines

Indexed keywords

ALGORITHMS; DATA REDUCTION; ERROR ANALYSIS; OPTIMIZATION; PROBABILITY; RADIAL BASIS FUNCTION NETWORKS;

ADABOOST; FEATURE SPACE; HYPERSPECTRAL CLASSIFICATION; KERNEL FISHER DISCRIMINANT ANALYSIS; KERNEL-BASED METHODS; RADIAL BASIS FUNCTION NEURAL NETWORKS; SUPPORT VECTOR MACHINES;

IMAGE PROCESSING;

EID: 20444432773     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2005.846154     Document Type: Article

References (52)

1. G. F. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Trans. Inf. Theory, vol. IT-14, no. 1, pp. 55-63, 1968.
2. P. Swain, "Fundamentals of pattern recognition in remote sensing," in Remote Sensing: The Quantitative Approach. New York: McGraw-Hill, 1978, pp. 136-188.
3. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs. NJ: Prentice- Hall, 1999.
4. D. L. Civco, "Artificial neural networks for land-cover classification and mapping," Int. J. Geophys. Inf. Syst., vol. 7. no. 2, pp. 173-186, 1993.
5. P. Dreyer, "Classification of land cover using optimized neural nets on SPOT data," Photogramm. Eng. Remote Sens., vol. 59, no. 5, pp. 617-621, 1993.
6. H. Bischof and A. Leona, "Finding optimal neural networks for land use classification," IEEE Trans. Geosci. Remote Sens., vol. 36, no. 1, pp. 337-341, Jan. 1998.
7. H. Yang, F. van der Meer, W. Bakker, and Z. J. Tan, "A back-propagation neural network for mineralogical mapping from AVIRIS data," Int. J. Remote Sens., vol. 20, no. 1, pp. 97-110, 1999.
8. L. Bruzzone and D. Fernández-Prieto, "A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 2, pp. 1179-1184, Mar. 1999.
9. G. Giacinto and L. Bruzzone, "Combination of neural and statistical algorithms for supervised classification of remote-sensing images," Pattern Recognit. Lett., vol. 21, no. 5, pp. 399-405, 2000.
10. L. Bruzzone and R. Cossu, "A multiple-cascade-classifier system for a robust and partially unsupervised updating of land-cover maps," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 9, pp. 1984-1996, Sep. 2002.
11. B. E. Boser, I. M. Guyon, and V. N. Vapnik, "A training algorithm for optimal margin classifiers," in 5th Annu. ACM Workshop on COLT, D. Haussier, Ed., Pittsburgh, PA, 1992, pp. 144-152.
12. B. Schölkopf and A. Smola, Learning With Kernels-Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press, 2001.
13. J. A. Gualtieri and R. F. Cramp, "Support vector machines for hyperspectral remote sensing classification," in Proc. SPIE 27th AIPR Workshop, Feb. 1998, pp. 221-232.
14. J. A. Gualtieri, S. R. Chettri, R. F. Cromp, and L. F. Johnson, "Support vector machine classifiers as applied to AVIRIS data," presented at the 7999 Airborne Geoscience Workshop, Feb. 1999.
15. C. Huang, L. S. Davis, and J. R. G. Townshend, "An assessment of support vector machines for land cover classification," Int. J. Remote Sens., vol. 23, no. 4, pp. 725-749, 2002.
16. G. Camps-Vails, L. Gómez-Chova, J. Calpe, E. Soria, J. D. Martín, L. Alonso, and J. Moreno, "Robust support vector method for hyperspectral data classification and knowledge discovery." IEEE Trans. Geosci. Remote Sens., vol. 42, no. 7, pp. 1530-1542, Jul. 2004.
17. F. Melgani and L. Bruzzone, "Classification of hyperspectral remotesensing images with support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
18. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
19. S. Mika, G. Ratsch, B. Schölkopf, A. Smola, J. Weston, and K.-R. Müller, "Invariant feature extraction and classification in kernel spaces," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1999, vol. 12.
20. M. Murat Dundar and A. Landgrebe, "A cost-effective semisupervised classifier approach with kernels," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 1, pp. 264-270, Jan. 2004.
21. C. Cortes and V. Vapnik, "Support vector networks," in Mach. Learn., 1995, vol. 20, pp. 273-297.
22. A. Ben-Hur, D. Horn, H. Siegelmann, and V. Vapnik, "Support vector clustering," J. Mach. Learn. Res., vol. 2, pp. 125-137, 2001.
23. G. Ratsch, B. Schökopf, A. Smola, S. Mika, T. Onoda, and K.-R. Müller, "Robust ensemble learning," in Advances in Large Margin Classifiers, A. Smola, P. Bartlett, B. Schölkopf, and D. Schuurmans, Eds. Cambridge, MA: MIT Press, 1999, pp. 207-219.
24. A. N. Srivastava and J. Stroeve, "Onboard detection of snow, ice, clouds and other geophysical processes using kernel methods," presented at the ICML 2003 Workshop on Machine Learning Technologies for Autonomous Space Sciences, Washington, DC, Aug. 2003.
25. G. Camps-Vails, A. Serrano-Lopez, L. Gömez-Chova, J. D. Martín, J. Calpe, and J. Moreno, "Regularized RBF networks for hyperspectral data classification," in International Conference on Image Recognition, ICIAR 2004. Berlin, Germany: Springer-Verlag, Oct. 2004, Lecture Notes in Computer Science.
26. G. Camps-Vails and L. Bruzzone, "Regularized methods for HyMap data classification," presented at the SPIE Int. Symp. Remote Sensing. Gran Canaria, Spain, Sep. 2004.
27. B. Schólkopf, K.-K. Sung, C. Burges, F. Girosi, P. Niyogi, T. Poggio, and V. N. Vapnik, "Comparing support vector machines with Gaussian kernels to radial basis function classifiers," IEEE Trans. Signal Process., vol. 45, no. 11, pp. 2758-2765, Nov. 1997.
28. K.-R. Müller, S. Mika, G. Ratsch, and K. Tsuda, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, Mar. 2001.
29. A. Tikhonov and V. Arsenin, Solutions of Ill-Posed Problems. Washington, DC: W. H. Winston, 1977.
30. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
31. V. Vapnik, The Nature of Statistical Learning Theory, 2nd ed. New York: Springer-Verlag, 2000.
32. T. M. Cover, "Geometrical and statistical properties of systems of linear inequalities with application in pattern recognition," IEEE Trans. Electron. Comput., vol. 14, pp. 326-334, Jun. 1965.
33. R. Courant and D. Hubert, Methods of Mathematical Physics. New York: Wiley, 1953.
34. A. Aizerman, E. M. Braverman, and L. I. Rozoner, "Theoretical foundations of the potential function method in pattern recognition learning," Automat. Remote Contr., vol. 25, pp. 821-837, 1964.
35. V. Vapnik and A. Chervonenkis, "A note on one class of perceptrons," Automat. Remote Contr., vol. 25, 1964.
36. S. Mika, G. Ratsch, J. Weston, B. Schölkopf, and K.-R. Müller, "Fisher discriminant analysis with kernels," in Neural Networks for Signal Processing, Y.-H. Hu, J. Larsen, E. Wilson, and S. Douglas, Eds. Piscataway, NJ: IEEE, 1999, vol. 9, pp. 41-48.
37. S. Mika, G. Rätsch, and K.-R. Müller, "A mathematical programming approach to the kernel fisher algorithm," in Neural Networks for Signal Processing Xlll, T. G. D. T. K. Leen and V. Tresp, Eds. Cambridge, MA: MIT Press, 2001, pp. 591-597.
38. S. Mika, "Kernel Fisher discriminants," Ph.D. dissertation, Dept. Comput. Sci., Univ. Technol., Berlin, Germany, 2002.
39. Y. Freund and R. E. Schapire, "A short introduction to boosting," J. Jpn. Soc. Artif. Intell., vol. 14, no. 5, pp. 771-780, Sep. 1999.
40. R. Schapire, "The strength of weak learnability," Mach. Learn., vol. 5, no. 2, pp. 197-227, 1990.
41. G. Ratsch, "Robust boosting via convex optimization," Ph.D. dissertation, Univ. Potsdam, Potsdam. Germany, Oct. 2001. [Online]. Available: http://www.boosting.org/papers/thesis.ps.gz.
42. J. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle, Least Squares Support Vector Machines, Singapore: World Scientific, 2002.
43. J. A. K. Suykens and J. Vandewalle, "Least squares support vector machine classifiers," Neural Process. Lett., vol. 9, no. 3, pp. 293-300, 1999.
44. T. Hastie and R. Tibshirani, "Classification by pairwise coupling," Ann. Stat., vol. 26, no. 2, pp. 471-475, 1998.
45. F. Pérez-Cruz and A. Artés-Rodriguez, "Puncturing multi-class support vector machines," in Int. Conf. Artificial Neural Networks, ICANN02, J. Dorronsoro, Ed. Berlin, Germany: Springer-Verlag, 2002, vol. 2415, Lecture Notes on Computer Science.
46. T. G. Dietterich and G. Bakiri, "Solving multiclass learning problems via error-correcting output codes," J. Artif. Intell. Res., vol. 2, no. 2, pp. 263-286, 1995.
47. L. L. Lapin, Probability and Statistics for Modern Engineering. Boston, MA: PWS, 1983.
48. P. Huber, Robust Statistics. New York: Wiley, 1981.
49. E. Osuna, R. Freund, and F. Girosi, "An improved training algorithm for support vector machines," in Neural Networks for Signal Processing VII-Proc. 1997 IEEE Workshop, J. Principe, L. Gile, N. Morgan, and E. Wilson, Eds., 1997, pp. 276-285.
50. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 185-208.
51. _, "Probabilities for SV machines," in Advances In Large Margin Classifiers, A. Smola, P. Bartlett, B. Scholkopf, and D. Schuurmans, Eds. Cambridge, MA: MIT Press, 2000, pp. 61-74.
52. T. M. Cover, "Geometrical and statistical properties of systems of linear inequalities with application in pattern recognition," in Artificial Neural Networks: Concepts and Theory, P. Mehra and B. Wah, Eds. Los Alamitos, CA: IEEE Comput. Soc. Press, 1992. Reprinted.