Semisupervised neural networks for efficient hyperspectral image classification

IEEE Transactions on Geoscience and Remote Sensing

Volumn 48, Issue 5, 2010, Pages 2271-2282

  Ratle, Frédéric ^a   Camps Valls, Gustavo ^b   Weston, Jason ^c  

^a NUANCE COMMUNICATIONS   (United States)

^b UNIVERSITY OF VALENCIA   (Spain)

^c GOOGLE INC   (United States)

Author keywords

Graph Laplacian; Hyperspectral image classification; Laplacian support vector machine (LapSVM); Neural networks; Regularization; Semisupervised learning (SSL); Support vector machine (SVM); Transductive SVM (TSVM)

Indexed keywords

GRAPH LAPLACIAN; HYPERSPECTRAL IMAGE CLASSIFICATION; LAPLACIAN SUPPORT VECTOR MACHINE (LAPSVM); LAPLACIANS; SEMI-SUPERVISED LEARNING; TRANSDUCTIVE SVM;

GEARS; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGE RECONSTRUCTION; LAPLACE TRANSFORMS; MULTILAYER NEURAL NETWORKS; REMOTE SENSING; VECTORS;

SUPPORT VECTOR MACHINES;

IMAGE CLASSIFICATION; IMAGE PROCESSING; LAPLACE TRANSFORM; NETWORK ANALYSIS; NUMERICAL MODEL; REMOTE SENSING; SAMPLING; STOCHASTICITY; UNSUPERVISED CLASSIFICATION; VECTOR;

EID: 77951295198     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2009.2037898     Document Type: Article

References (50)

1. G. F. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Trans. Inf. Theory, vol.IT-14, no.1, pp. 55-63, Jan. 1968.
2. B. Schölkopf and A. Smola, Learning With Kernels-Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press, 2002.
3. G. Camps-Valls and L. Bruzzone, "Kernel-based methods for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol.43, no.6, pp. 1351-1362, Jun. 2005. (Pubitemid 40811944)
4. G. Camps-Valls, L. Gómez-Chova, J. Muñoz-Marí, J. Vila-Francés, and J. Calpe-Maravilla, "Composite kernels for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol.3, no.1, pp. 93-97, Jan. 2006. (Pubitemid 43131904)
5. G. Camps-Valls, L. Gómez-Chova, J. Muñoz Marí, M. Martínez-Ramón, and J.L. Rojo-Álvarez, "Kernel-based framework for multi-temporal and multi-source remote sensing data classification and change detection," IEEE Trans. Geosci. Remote Sens., vol.46, no.6, pp. 1822-1835, Jun. 2008. (Pubitemid 351711220)
6. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning, 1st ed. Cambridge, MA: MIT Press, 2006.
7. X. Zhu, "Semi-supervised learning literature survey," Comput. Sci., Univ. Wisconsin-Madison, Madison, Tech. Rep. 1530, 2005.
8. Q. Jackson and D. Landgrebe, "An adaptive classifier design for highdimensional data analysis with a limited training data set," IEEE Trans. Geosci. Remote Sens., vol.39, no.12, pp. 2664-2679, Dec. 2001. (Pubitemid 34091845)
9. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
10. L. Bruzzone, M. Chi, and M. Marconcini, "A novel transductive SVM for the semisupervised classification of remote-sensing images," IEEE Trans. Geosci. Remote Sens., vol.44, no.11, pp. 3363-3373, Nov. 2006. (Pubitemid 47516069)
11. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Advances in Neural Information Processing Systems, NIPS2004, vol.16. Vancouver, BC, Canada: MIT Press, Dec. 2004.
12. G. Camps-Valls, T. Bandos, and D. Zhou, "Semi-supervised graph-based hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol.45, no.10, pp. 3044-3054, Oct. 2007. (Pubitemid 351562538)
13. V. Sindhwani, P. Niyogi, and M. Belkin, "Beyond the point cloud: From transductive to semi-supervised learning," in Proc. 22nd ICML, 2005, pp. 824-831. (Pubitemid 43183411)
14. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol.7, pp. 2399-2434, Dec. 2006. (Pubitemid 44708005)
15. L. Gómez-Chova, G. Camps-Valls, J. Muñoz-Marí, and J. Calpe-Maravilla, "Semi-supervised image classification with Laplacian support vector machines," IEEE Geosci. Remote Sens. Lett., vol.5, no.3, pp. 336-340, Jul. 2008. (Pubitemid 351243574)
16. V. Castelli and T. Cover, "The relative value of labeled and unlabeled samples in pattern recognition with an unknown mixing parameter," IEEE Trans. Inf. Theory, vol.42, no.6, pp. 2101-2117, Nov. 1996. (Pubitemid 126771539)
17. R. Duda and P. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
18. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ: Prentice-Hall, 1999.
19. J. Kivinen, A. Smola, and R. Williamson, "Online learning with kernels," IEEE Trans. Signal Process., vol.52, no.8, pp. 2165-2176, Aug. 2004.
20. A. Bordes and L. Bottou, "The Huller: A simple and efficient online SVM," in Proc. ECML, 2005, pp. 505-512.
21. A. N. Tikhonov, "Regularization of incorrectly posed problems," Sov. Math., Dokl., vol.4, no.6, pp. 1624-1627, Jan. 1963.
22. T. Evgeniou, M. Pontil, and T. Poggio, "Regularization networks and support vector machines," Adv. Comput. Math., vol.13, no.1, pp. 1-50, Apr. 2000.
23. A. Berge, A. C. Jensen, and A. H. S. Solberg, "Sparse inverse covariance estimates for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol.45, no.5, pp. 1399-1407, May 2007. (Pubitemid 46652340)
24. T. V. Bandos, L. Bruzzone, and G. Camps-Valls, "Classification of hyperspectral images with regularized linear discriminant analysis," IEEE Trans. Geosci. Remote Sens., vol.47, no.3, pp. 862-873, Mar. 2009.
25. G. Camps-Valls and A. Rodrigo-González, "Classification of satellite images with regularized AdaBoosting of RBF neural networks," in Speech, Audio, Image and Biomedical Signal Processing Using Neural Networks, B. Prasad and S. R. M. Prasanna, Eds. Berlin, Germany: Springer-Verlag, 2008, pp. 309-326.
26. K. Bennet and A. Demiriz, "Semi-supervised support vector machines," in NIPS 12. Cambridge, MA: MIT Press, Dec. 1998.
27. T. Joachims, Making Large-Scale Support Vector Machine Learning Practical. Cambridge, MA: MIT Press, 1999, pp. 169-184.
28. O. Chapelle and A. Zien, "Semi-supervised classification by low density separation," in Proc. AISTATS, 2005, pp. 57-64.
29. R. Collobert, F. Sinz, J. Weston, and L. Bottou, "Large scale transductive SVMs," J. Mach. Learn. Res., vol.7, pp. 1687-1712, Aug. 2006. (Pubitemid 44223088)
30. I. W. Tsang and J. T. Kwok, "Large-scale sparsified manifold regularization," in Proc. NIPS, 2006, pp. 1401-1408.
31. G. Gasso, K. Zapien, and S. Canu, L1-Norm Regularization Path for Sparse Semi-Supervised Laplacian SVM, 2007. [Online]. Available: http://eprints.pascal- network.org/archive/00003875/
32. L. Bottou, "Stochastic learning," in Advanced Lectures on Machine Learning, vol.3176, Lecture Notes in Artificial Intelligence, O. Bousquet and U. von Luxburg, Eds. Berlin, Germany: Springer-Verlag, 2004, pp. 146-168. [Online]. Available: http://leon.bottou.org/papers/bottoumlss-2004 (Pubitemid 39741631)
33. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
34. R. Hadsell, S. Chopra, and Y. LeCun, "Dimensionality reduction by learning an invariant mapping," in Proc. CVPR, 2006, pp. 1735-1742. (Pubitemid 44931527)
35. F. Karlen, J. Weston, F. Ratle, and R. Collobert, "Deep learning via semi-supervised embedding," in Proc. ICML, 2008, pp. 1168-1175.
36. M. Karlen, J. Weston, A. Erken, and R. Collobert, "Large scale manifold transduction," in Proc. ICML, 2008, pp. 448-455.
37. F. Ratle, J. Weston, and M. Miller, "Large-scale clustering through functional embedding," in Proc. ECML, 2008, pp. 266-281.
38. L. Bottou and L. Yann, "On-line learning for very large data sets," Appl. Stoch. Models Bus. Ind., vol.21, no.2, pp. 137-151, Mar. 2005. (Pubitemid 40541359)
39. L. Bottou and Y. LeCun, "Large-scale on-line learning," in Advances in Neural Information Processing Systems 15. Cambridge, MA: MIT Press, 2004.
40. Y. LeCun, L. Bottou, G. Orr, and K. Müller, "Efficient backprop," in Neural Networks-Tricks of the Trade. Berlin, Germany: Spinger-Verlag, 1998. (Pubitemid 128162408)
41. J. D. Paola and R. A. Schowengerdt, "A review and analysis of backpropagation neural networks for classification of remotely-sensed multispectral imagery," Int. J. Remote Sens., vol.16, no.16, pp. 3033-3058, Nov. 1995.
42. D. L. Civco, "Artificial neural networks for land-cover classification and mapping," Int. J. Geophys. Inf. Syst., vol.7, no.2, pp. 173-186, Mar. 1993. (Pubitemid 23384294)
43. H. Bischof and A. Leona, "Finding optimal neural networks for land use classification," IEEE Trans. Geosci. Remote Sens., vol.36, no.1, pp. 337-341, Jan. 1998. (Pubitemid 128748448)
44. L. Bruzzone and D. Fernandez-Prieto, "A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images," IEEE Trans. Geosci. Remote Sens., vol.37, no.2, pp. 1179-1184, Mar. 1999.
45. G. Camps-Valls, L. Gómez-Chova, J. Calpe, E. Soria, J. D. Martín, L. Alonso, and J. Moreno, "Robust support vector method for hyperspectral data classification and knowledge discovery," IEEE Trans. Geosci. Remote Sens., vol.42, no.7, pp. 1530-1542, Jul. 2004.
46. V. Castelli and T. M. Cover, "On the exponential value of labeled samples," Pattern Recognit. Lett., vol.16, no.1, pp. 105-111, Jan. 1995.
47. K. Sinha and M. Belkin, "The value of labeled and unlabeled examples when the model is imperfect," in NIPS 2007, vol.20. Cambridge, MA: MIT Press, 2008.
48. L. Capobianco, A. Garzelli, and G. Camps-Valls, "Target detection with semisupervised kernel orthogonal subspace projection," IEEE Trans. Geosci. Remote Sens., vol.47, no.11, pp. 3822-3833, Nov. 2009.
49. L. L. Lapin, Probability and Statistics for Modern Engineering. Long Grove, IL: Waveland Press, 1998.
50. G. M. Foody, "Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy," Photogramm. Eng. Remote Sens., vol.70, no.5, pp. 627-633, May 2004.