A survey of active learning algorithms for supervised remote sensing image classification

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 3, 2011, Pages 606-617

  Tuia, Devis ^a   Volpi, Michele ^b   Copa, Loris ^b,c   Kanevski, Mikhail ^b   Muñoz Marí, Jordi ^a  

^a UNIVERSITY OF VALENCIA   (Spain)

^b UNIVERSITY OF LAUSANNE   (Switzerland)

^c SARMAP SA   (Switzerland)

Author keywords

active learning; hyperspectral; image classification; support vector machine (SVM); training set definition; very high resolution (VHR)

Indexed keywords

ACTIVE LEARNING; ACTIVE-LEARNING ALGORITHM; DATA SETS; FINANCIAL RESOURCES; HYPERSPECTRAL; HYPERSPECTRAL IMAGE CLASSIFICATION; MODEL PERFORMANCE; REMOTE SENSING IMAGE CLASSIFICATION; TRAINING SET DEFINITION; TRAINING SETS; VERY HIGH RESOLUTION; VERY HIGH SPATIAL RESOLUTIONS;

IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGE RECONSTRUCTION; PIXELS; REMOTE SENSING;

LEARNING ALGORITHMS;

EID: 79957456032     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2139193     Document Type: Article

References (56)

1. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, ser. Statistics, 2nd ed. New York: Springer, 2009.
2. B. E. Boser, I. M. Guyon, and V. N. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. Annu. Workshop Comput. Learn. Theroy, 1992, pp. 144-152.
3. B. Schölkopf and A. J. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
4. S. Haykin, Neural Networks and Learning Machines, 3rd ed. Cambridge, MA: Prentice-Hall, 2008.
5. G. Camps-Valls and L. Bruzzone, Kernel Methods in Remote Sensing Image Processing. New York: Wiley, 2009.
6. L. Bruzzone and L. Carlin, "A multilevel context-based system for classification of very high resolution images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 9, pp. 2587-2600, Sep. 2006. (Pubitemid 44321552)
7. F. Pacifici, M. Chini, and W. J. Emery, "A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification," Remote Sens. Environ., vol. 113, no. 6, pp. 1276-1292, 2009.
8. D. Tuia, F. Pacifici, M. Kanevski, and W. J. Emery, "Classification of very high spatial resolution imagery using mathematical morphology and support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3866-3879, Nov. 2009.
9. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
10. G. Camps-Valls, L. Gómez-Chova, J. Calpe-Maravilla, J. D. Martín- Guerrero, E. Soria-Olivas, L. Alonso-Chordá, and J. Moreno, "Robust support vector method for hyperspectral data classification and knowledge discovery," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 7, pp. 1530-1542, Jul. 2004.
11. M. Fauvel, J. A. Benediktsson, J. Chanussot, and J. R. Sveinsson, "Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 11, pp. 3804-3814, Nov. 2008.
12. G. M. Foody and A. Mathur, "Toward intelligent training of supervised image classifications: Directing training data acquisition for SVM classification," Remote Sens. Env., vol. 93, pp. 107-117, 2004. (Pubitemid 39234714)
13. G. M. Foody, A. Mathur, C. Sanchez-Hernandez, and D. S. Boyd, "Training set size requirements for the classification of a specific class," Remote Sens. Env., vol. 104, pp. 1-14, 2006. (Pubitemid 44262339)
14. G. M. Foody and A. Mathur, "The use of small training sets containing mixed pixels for accurate hard image classification: Training on mixed spectral responses for classification by a SVM," Remote Sens. Environ., vol. 103, no. 2, pp. 179-189, 2006. (Pubitemid 44015803)
15. D. J. C. MacKay, "Information based objective functions for active data selection," Neural Comput., vol. 4, no. 4, pp. 590-604, 1992.
16. D. Cohn, L. Atlas, and R. Ladner, "Improving generalization with active learning," Mach. Learn., vol. 15, no. 2, pp. 201-221, 1994.
17. D. Cohn, Z. Ghaharamani, and M. I. Jordan, "Active learning with statistical models," J. Artif. Intell. Res., vol. 4, pp. 129-145, 1996. (Pubitemid 126646151)
18. D. D. Lewis and J. Catlett, "Heterogeneous uncertainty sampling for supervised learning," in Proc. Int. Conf. Mach. Learn. (ICML), 1994, pp. 148-156.
19. F. Olsson, "A literature survey of active machine learning in the context of natural language processing," Swedish Inst. of Comput. Sci., SICS Tech. Rep. T2009:06, 2009.
20. B. Settles, "Active learning literature survey," Univ. of Wisconsin- Madison, Comput. Sci. Tech. Rep. 1648, 2010.
21. D. Tuia, F. Ratle, F. Pacifici, M. Kanevski, and W. J. Emery, "Active learning methods for remote sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 7, pp. 2218-2232, Jul. 2009.
22. D. Tuia, J. Muñoz-Marí, M. Kanevski, and G. Camps-Valls, "Clusterbased active learning for compact image classification," in Proc. IEEE Int. Geosci. Remote Sens. Symp., IGARSS, Honolulu, HI, 2010, pp. 2827-2827.
23. H. S. Seung, M. Opper, and H. Sompolinsky, "Query by committee," in Proc. Annu. Workshop Comput. Learn. Theroy, 1992, pp. 287-294. (Pubitemid 23615454)
24. Y. Freund, H. S. Seung, E. Shamir, and N. Tishby, "Selective sampling using the query by committee algorithm," Mach. Learn., vol. 28, pp. 133-168, 1997. (Pubitemid 127506338)
25. N. Abe and H. Mamitsuka, "Query learning strategies using boosting and bagging," in Proc. Int. Conf. Mach. Learn. (ICML), 1998, pp. 1-9.
26. P. Melville and R. J. Mooney, "Diverse ensembles for active learning," in Proc. Int. Conf. Mach. Learn. (ICML), 2004, pp. 74-82.
27. L. Copa, D. Tuia, M. Volpi, and M. Kanevski, "Unbiased query-bybagging active learning for VHR image classification," in Proc. SPIE Remote Sens. Conf., Toulouse, France, 2010.
28. W. Di and M. Crawford, "Multi-view adaptive disagreement based active learning for hyperspectral image classification," in Proc. IEEE Int. Geosci. Remote Sens. Symp., IGARSS, Honolulu, HI, 2010, pp. 1374-1377.
29. L. Breiman, "Bagging predictors," Univ. of California at Berkeley, Tech. Rep. 421, 1994.
30. I. Muslea, "Active learning with multiple views," J. Artif. Intell. Res., vol. 27, pp. 203-233, 2006. (Pubitemid 44681377)
31. S. Tong and D. Koller, "Support vector machine active learning with applications to text classification," J. Mach. Learn. Res., vol. 2, pp. 45-66, 2001.
32. C. Campbell, N. Cristianini, and A. J. Smola, "Query learning with large margin classifiers," in Proc. Int. Conf. Mach. Learn. (ICML), 2000, pp. 111-118.
33. G. Schohn and D. Cohn, "Less is more: Active learning with support vector machines," in Proc. 17th ICML, 2000, pp. 839-846.
34. S. Zomer, M. N. Sànchez, R. G. Brereton, and J. L. Pérez-Pavón, "Active learning support vector machines for optimal sample selection in classification," J. Chemometrics, vol. 18, no. 6, pp. 294-305, 2004.
35. S. Cheng and F. Y. Shih, "An improved incremental training algorithm for support vector machines using active query," Patter Recogn., vol. 40, pp. 964-971, 2007. (Pubitemid 44667752)
36. P. Mitra, B. Uma Shankar, and S. K. Pal, "Segmentation of multispectral remote sensing images using active support vector machines," Pattern Recogn. Lett., vol. 25, no. 9, pp. 1067-1074, 2004. (Pubitemid 38763570)
37. L. Bruzzone and C. Persello, "Active learning for classification of remote sensing images," in Proc. IEEE Int. Geosci. Remote Sens. Symp., IGARSS, Cape Town, South Africa, 2009, pp. 693-696.
38. M. Ferecatu and N. Boujemaa, "Interactive remote sensing image retrieval using active relevance feedback," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 4, pp. 818-826, Apr. 2007. (Pubitemid 46495617)
39. B. Demir, C. Persello, and L. Bruzzone, "Batch mode active learning methods for the interactive classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 3, pp. 1014-1031.
40. A. Vlachos, "A stopping criterion for active learning," Comput. Speech Lang., vol. 22, no. 3, pp. 295-312, Mar. 2008. (Pubitemid 351329454)
41. E. Pasolli, F. Melgani, and Y. Bazi, "Support vector machine active learning through significance space construction," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 3, pp. 431-435, May 2011.
42. K. Brinker, "Incorporating diversity in active learning with support vector machines," in Proc. 20th ICML, 2003.
43. M. Girolami, "Mercer kernel-based clustering in feature space," IEEE Trans. Neural Net., vol. 13, no. 3, pp. 780-784, May 2002. (Pubitemid 34669666)
44. I. Dhillon, Y. Guan, and B. Kulis, "A unified view of kernel k-means, spectral clustering and graph cuts," Dept. of Comput. Sci., Univ. of Texas, Austin, Tech. Rep. UTCS Tech. Rep. TR-04-25, 2005.
45. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
46. M. Volpi, D. Tuia, and M. Kanevski, "Cluster-based active learning for remote sensing image classification," IEEE Trans. Geosci. Remote Sens., submitted for publication.
47. N. Roy and A. McCallum, "Toward optimal active learning through sampling estimation of error reduction," in Proc. Int. Conf. Mach. Learn. (ICML), pp. 441-448.
48. S. Rajan, J. Ghosh, and M. Crawford, "An active learning approach to hyperspectral data classification," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 4, pp. 1231-1242, Apr. 2008. (Pubitemid 351459470)
49. G. Jun and J. Ghosh, "An efficient active learning algorithm with knowledge transfer for hyperspectral data analysis," in IEEE Geosci. Remote Sens. Symp. IGARSS, 2008, pp. 52-55.
50. J. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," in Advances in Large Margin Classifiers. Cambridge, MA: MIT Press, 1999.
51. T. Luo, K. Kramer, D. B. Golgof, L. O. Hall, S. Samson, A. Remsen, and T. Hopkins, "Active learning to recognize multiple types of plankton," J. Mach. Learn. Res., vol. 6, pp. 589-613, 2005.
52. G. Licciardi, F. Pacifici, D. Tuia, S. Prasad, T. West, F. Giacco, J. Inglada, E. Christophe, J. Chanussot, and P. Gamba, "Decision fusion for the classification of hyperspectral data: Outcome of the 2008 GRS-S data fusion contest," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3857-3865, Nov. 2009.
53. Q. Jackson and D. Landgrebe, "An adaptive classifier design for high-dimensional data analysis with a limited training data set," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 12, pp. 2664-2679, Dec. 2001. (Pubitemid 34091845)
54. A. Liu, G. Jun, and J. Ghosh, "Active learning with spatially sensitive labeling costs," in Proc. NIPS Workshop Cost-Sensitive Learn., 2008.
55. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Semisupervised hyperspectral image segmentation using multinomial logistic regression with active learning," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 4085-4098, Nov. 2010.
56. D. Tuia, E. Pasolli, and W. J. Emery, "Using active learning to adapt remote sensing image classifiers," Remote Sens. Environ., 2011, to be published.