Active learning: Any value for classification of remotely sensed data?

Proceedings of the IEEE

Volumn 101, Issue 3, 2013, Pages 593-608

  Crawford, Melba M ^a   Tuia, Devis ^b   Yang, Hsiuhan Lexie ^a  

^a PURDUE UNIVERSITY   (United States)

^b EPFL   (Switzerland)

Author keywords

Active learning; adaptation; classification; high resolution multispectral; hyperspectral; multiview; spatial learning; support vector machines (SVMs)

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA HANDLING; PIXELS; REMOTE SENSING; SPECTROSCOPY; SUPPORT VECTOR MACHINES;

ACTIVE LEARNING; ADAPTATION; HYPERSPECTRAL; MULTI-SPECTRAL; MULTI-VIEWS; SPATIAL LEARNING; SUPPORT VECTOR MACHINE (SVMS);

CLASSIFICATION (OF INFORMATION);

EID: 84874518998     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2012.2231951     Document Type: Article

References (76)

1. L. Bruzzone and L. Carlin, "A multilevel context-based system for classification of very high resolution images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 9, pp. 2587-2600, Sep. 2006. (Pubitemid 44321552)
2. F. Pacifici, M. Chini, and W. J. Emery, "A neural network approach using multi-scale textural metrics from very high resolution panchromatic imagery for urban land-use classification," Remote Sens. Environ., vol. 113, no. 1, pp. 1276-1292, 2009.
3. D. Landgrebe, "Hyperspectral image data analysis as a high dimensional signal processing problem," IEEE Signal Process., vol. 19, no. 1, pp. 17-28, Jan. 2002.
4. G. Camps-Valls, L. Gómez-Chova, J. Calpe-Maravilla, J. D. Mart́n-Guerrero, E. Soria-Olivas, L. Alonso-Chordá, and J. Moreno, "Robust support vector method for hyperspectral data classification and knowledge discovery," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 7, pp. 1530-1542, Jul. 2004.
5. G. M. Foody, A. Mathur, C. Sanchez-Hernandez, and D. S. Boyd, "Training set size requirements for the classification of a specific class," Remote Sens. Environ., vol. 104, no. 1, pp. 1-14, 2006. (Pubitemid 44262339)
6. G. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Trans. Inf. Theory, vol. IT-14, no. 1, pp. 55-63, Jan. 1968.
7. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. Hoboken, NJ: Wiley-Interscience, 2000.
8. G. Schohn and D. Cohn, "Less is more: Active learning with support vector machines," in Proc. 17th Int. Conf. Mach. Learn., Stanford, CA, Jun. 20-Jul. 2 2000, pp. 839-846.
9. S. Tong and D. Koller, "Support vector machine active learning with applications to text classification," J. Mach. Learn. Res., vol. 2, pp. 45-66, 2002.
10. F. Olsson, "A literature survey of active machine learning in the context of natural language processing," Swedish Inst. Comput. Sci. (SICS), Kista, Sweden, SICS Tech. Rep. T2009:06, 2009.
11. B. Settles, "Active learning literature survey," Univ. WisconsinVMadison, Madison, WI, Comput. Sci. Tech. Rep. 1648, 2010.
12. D. Tuia, M. Volpi, L. Copa, M. Kanevski, and J. Muñoz-Maŕ, "A survey of active learning algorithms for supervised remote sensing image classification," IEEE J. Sel. Top. Signal Process., vol. 5, no. 3, pp. 606-617, Jun. 2011.
13. J. Muñoz-Maŕ, D. Tuia, and G. Camps-Valls, "Semisupervised segmentation of remote sensing images with active queries," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 10, pp. 3751-3763, Oct. 2012.
14. E. Dura, Y. Zhang, X. Liao, G. J. Dobeck, and L. Carin, "Active learning for detection of mine-like objects in side-scan sonar imagery," IEEE J. Ocean. Eng., vol. 30, no. 2, pp. 360-371, Apr. 2005. (Pubitemid 41656213)
15. E. Pasolli, F. Melgani, N. Alajlan, and Y. Bazi, "Active learning methods for biophysical parameter estimation," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 10, pp. 4071-4084, Oct. 2012.
16. J. de Gruijter, D. Brus, M. Bierkens, and M. Knotters, Sampling for Natural Resource Monitoring. New York: Springer-Verlag, 2006.
17. W. G.Müller, Collecting Spatial Data. Optimum Design of Experiments for Random Fields. New York: Springer-Verlag, 2007.
18. W. Müller, L. Pronzato, and H. Waldl, "Beyond space-filling: An illustrative case," Institut für Angewandte Statistik (IFAS), Tech. Rep. 2011-53, 2011.
19. F. Achard, H. D. Eva, H.-J. Stibig, P. Mayaux, J. Gallego, T. Richards, and J.-P. Malingreau, "Determination of deforestation rates of the world's humid tropical forests," Science, vol. 5583, pp. 999-1002, 2002. (Pubitemid 34856031)
20. F. Javier Gallego, "Stratified sampling of satellite images with a systematic grid of points," ISPRS J. Photogramm. Remote Sens., vol. 59, no. 6, pp. 369-376, 2005.
21. H. Eva, S. Carboni, F. Achard, N. Stach, L. Durieux, J.-F. Faure, and D. Mollicone, "Monitoring forest areas from continental to territorial levels using a sample of medium spatial resolution satellite imagery," ISPRS J. Photogramm. Remote Sens., vol. 65, no. 2, pp. 191-197, 2010.
22. G. J. Fitzgerald, S. M. Lesch, E. M. Barnes, and W. E. Luckett, "Directed sampling using remote sensing with a response surface sampling design for site-specific agriculture," Comput. Electron. Agr., vol. 53, no. 2, pp. 98-112, 2006. (Pubitemid 44247200)
23. D. Tuia, A. Pozdnoukhov, L. Foresti, and M. Kanevski, "Active learning for monitoring network optimization," in Spatio-Temporal Design: Advances in Efficient Data Acquisition, J. Mateu and W. G. Müller, Eds. New York: Wiley, 2013.
24. M. Li and I. K. Sethi, "Confidence-based active learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1251-1261, Aug. 2006. (Pubitemid 46405023)
25. P. Mitra, B. Uma Shankar, and S. K. Pal, "Segmentation of multispectral remote sensing images using active support vector machines," Pattern Recognit. Lett., vol. 25, no. 9, pp. 1067-1074, 2004. (Pubitemid 38763570)
26. D. Tuia, E. Pasolli, and W. J. Emery, "Using active learning to adapt remote sensing image classifiers," Remote Sens. Environ., vol. 115, no. 9, pp. 2232-2242, 2011.
27. B. Demir, C. Persello, and L. Bruzzone, "Batch mode active learning methods for the interactive classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 3, pp. 1014-1032, Mar. 2011.
28. S. Patra and L. Bruzzone, "A fast cluster-assumption based active-learning technique for classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 5, pp. 1617-1626, May 2011.
29. E. Pasolli, F. Melgani, and Y. Bazi, "Support vector machine active learning through significance space construction," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 3, pp. 431-435, May 2011.
30. D. Tuia, F. Ratle, F. Pacifici, M. Kanevski, and W. J. Emery, "Active learning methods for remote sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 7, pp. 2218-2232, Jul. 2009.
31. W. Di and M. M. Crawford, "Active learning via multi-view and local proximity co-regularization for hyperspectral image classification," IEEE J. Sel. Top. Signal Process., vol. 5, no. 3, pp. 618-628, Jun. 2011.
32. W. Di and M. M. Crawford, "View generation for multiview maximum disagreement based active learning for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 5, pp. 1942-1954, May 2012.
33. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Hyperspectral image segmentation using a new Bayesian approach with active learning," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 10, pp. 3947-3960, Oct. 2011.
34. S. Rajan, J. Ghosh, and M. Crawford, "An active learning approach to hyperspectral data classification," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 4, pp. 1231-1242, Apr. 2008. (Pubitemid 351459470)
35. K. Brinker, "Incorporating diversity in active learning with support vector machines," in Proc. Int. Conf. Mach. Learn., Washington, DC, 2003, pp. 59-66.
36. M. Ferecatu and N. Boujemaa, "Interactive remote sensing image retrieval using active relevance feedback," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 4, pp. 818-826, Apr. 2007. (Pubitemid 46495617)
37. M. Volpi, D. Tuia, and M. Kanevski, "Memory-based cluster sampling for remote sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 8, pp. 3096-3106, Aug. 2012.
38. T. K. Ho, "The random subspace method for constructing decision forests," IEEE Trans. Pattern Anal. Mach. Intell, vol. 20, no. 8, pp. 832-844, Aug. 1998. (Pubitemid 128741345)
39. H. S. Seung, M. Opper, and H. Smopolinsky, "Query by committee," in Proc. 5th Annu. ACM Workshop Comput. Learn. Theory, Pittsburgh, PA, Jul. 27-29, 1992, pp. 287-294. (Pubitemid 23615454)
40. B. Leskes and L. Torenvliet, "The value of agreement: A new boosting algorithm," J. Comput. Syst. Sci., vol. 74, no. 4, pp. 557-586, 2008. (Pubitemid 351601546)
41. Z. Zhou and M. Li, "Semi-supervised learning by disagreement," Knowl. Inf. Syst., vol. 24, no. 24, pp. 415-439, 2009.
42. V. R. de Sa, "Learning classification with unlabeled data," in Proc. Adv. Neural Inf. Process. Syst., 1994, vol. 6, pp. 112-119.
43. D. L. Donoho, "High-dimensional data analysis: The curses and blessings of dimensionality," presented at the Conf. "Mathematical Challenges of the 21st Century", Los Angeles, CA, Aug. 2000, Aide-Memoire Invited Lecture.
44. J. A. Benediktsson, J. A. Palmason, and J. R. Sveinsson, "Classification of hyperspectral data from urban areas based on extended morphological profiles," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 480-490, Mar. 2005.
45. M. Fauvel, J. A. Benediktsson, J. Chanussot, and J. R. Sveinsson, "Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 11, pp. 3804-3814, Nov. 2008.
46. S. Lee and M. M. Crawford, "Unsupervised multistage image classification using hierarchical clustering with a bayesian similarity measure," IEEE Trans. Image Process., vol. 14, no. 3, pp. 312-320, Mar. 2005. (Pubitemid 40351909)
47. A. Marcal and L. Castro, "Hierarchical clustering of multispectral images using combined spectral and spatial criteria," IEEE Geosci. Remote Sens. Lett., vol. 2, no. 1, pp. 59-63, Jan. 2005. (Pubitemid 40162806)
48. J. Tilton, "Image segmentation by region growing and spectral clustering with a natural convergence criterion," in Proc. IEEE Geosci. Remote Sens. Symp., Seattle, WA, Jul. 6-10, 1998, vol. 4, pp. 1766-1768.
49. A. J. Plaza and J. C. Tilton, "Automated selection of results in hierarchical segmentations of remotely sensed hyperspectral images," in Proc. IEEE Geosci. Remote Sens. Symp., Seoul, Korea, Jul. 25-29, 2005, vol. 7, pp. 4946-4949.
50. A. Liu, G. Jun, and J. Ghosh, "Active learning with spatially sensitive labeling costs," presented at the NIPS Workshop Cost-Sensitive Learn., Whistler, Canada, 2008.
51. S. Lin and B. W. Kernighan, "An effective heuristic algorithm for the traveling-salesman problem," Oper. Res., vol. 21, pp. 498-516, 1973.
52. E. L. Laweler, J. K. Lenstra, A. H. G. R. Kan, and D. B. Shmoys, The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization. New York: Wiley, 1985.
53. B. Demir, L. Minello, and L. Bruzzone, "A cost-sensitive active learning technique for the definition of effective training sets for supervised classifiers," in Proc. IEEE Geosci. Remote Sens. Symp., Munich, Germany, Jul. 22-27, 2012, pp. 1781-1784.
54. E. Pasolli, F. Melgani, D. Tuia, F. Pacifici, and W. J. Emery, "Improving active learning methods using spatial information," in Proc. IEEE Geosci. Remote Sens. Symp., Vancouver, BC, Canada, Jul. 24-29, 2011, pp. 3923-3926.
55. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182-197, Apr. 2002. (Pubitemid 34555372)
56. A. Stumpf, N. Lachiche, J. P. Malet, N. Kerle, and A. Puissant, "Active learning in the spatial-domain for landslide mapping in remote sensing images," presented at the Eur. Conf. Mach. Learn./Workshop "Active Learning in Real Applications", Edinbrough, Scotland, Sep. 24-28, 2012.
57. R. Kashef and M. S. Kamel, "Enhanced bisecting k-means clustering using intermediate cooperation," Pattern Recognit., vol. 42, no. 11, pp. 2257-2569, 2009.
58. M. D. Fleming, J. S. Berkebile, and R. M. Hoffer, "Computer-aided analysis of LANDSAT-I MSS data: A comparison of three approaches, including a 'modified clustering' approach," Purdue Univ., West Lafayette, IN, LARS Inf. Note 072475, 1975.
59. L. Bruzzone and C. Persello, "A novel approach to the selection of spatially invariant features for the classification of hyperspectral images with improved generalization capability," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 9, pp. 3180-3191, Sep. 2009.
60. G. Jun and J. Ghosh, "Spatially adaptive classification of land cover with remote sensing data," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 7, pp. 2662-2673, Jul. 2011.
61. D. Tuia, J. Muñoz-Maŕ, L. Gómez-Chova, and J. Malo, "Graph matching for adaptation in remote sensing," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 1, pt. 1, pp. 329-341, Jan. 2013.
62. L. Bruzzone and D. Fernandez-Prieto, "Unsupervised retraining of a maximum likelihood classifier for the analysis of multitemporal remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 2, pp. 456-460, Feb. 2001. (Pubitemid 32271010)
63. L. Bruzzone and M. Marconcini, "Toward the automatic updating of land-cover maps by a domain-adaptation SVM classifier and a circular validation strategy," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 4, pp. 1108-1122, Apr. 2009.
64. S. Rajan, J. Ghosh, and M. Crawford, "Exploiting class hierarchy for knowledge transfer in hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 11, pp. 3408-3417, Nov. 2006. (Pubitemid 44711682)
65. W. Kim and M. M. Crawford, "Adaptive classification for hyperspectral image data using manifold regularization kernel machines," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 4110-4121, Nov. 2010.
66. G. Jun and J. Ghosh, "An efficient active learning algorithm with knowledge transfer for hyperspectral remote sensing data," in Proc. IEEE Geosci. Remote Sens. Symp., Boston, MA, Jul. 6-11, 2008, pp. I-52-I-55.
67. C. Persello and L. Bruzzone, "Active learning for domain adaptation in the supervised classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 11, pp. 4468-4483, Nov. 2012.
68. G. Matasci, D. Tuia, and M. Kanevski, "SVM-based boosting of active learning strategies for efficient domain adaptation," IEEE J. Sel. Top. Appl. Earth Observ., vol. 5, no. 5, pp. 1335-1343, Oct. 2012.
69. D. Tuia and J. Muñoz-Maŕ, "Learning user's confidence for active learning," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 872-880, Feb. 2013, DOI: 10.1109/TGRS. 2012.2203605.
70. W. Di and M. Crawford, "Critical class oriented active learning for hyperspectral image classification," in Proc. IEEE Geosci. Remote Sens. Symp., Vancouver, BC, Canada, Jul. 22-27, 2011, pp. 3899-3902.
71. B. Demir, F. Bovolo, and L. Bruzzone, "Updating land-cover maps by classification of image time series: A novel change-detection-driven transfer learning approach," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 1, pt. 1, pp. 300-312, Jan. 2013.
72. B. Demir, F. Bovolo, and L. Bruzzone, "Detection of land-cover transitions in multitemporal remote sensing images with active learning based compound classification," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 5, pp. 1930-1941, May 2012.
73. M. Furlani, D. Tuia, J.Muñoz-Maŕ, F. Bovolo, G. Camps-Valls, and L. Bruzzone, "Discovering single classes in remote sensing images with active learning," in Proc. IEEE Geosci. Remote Sens. Symp.,Munich, Germany, Jul. 22-27, 2012, pp. 7341-7344.
74. J. Michel, J. Inglada, and J. Malik, "Object based and geo-spatial image analysis: A semi-automatic pre-operational system," in Proc. SPIE Remote Sens. Eur., Toulouse, France, Sep. 20-22, 2010, vol. 7830, DOI: 10.1117/12.864691.
75. G. Mountrakis, J. Ima, and C. Ogole, "Support vector machines in remote sensing: A review," ISPRS J. Photogramm. Remote Sens., vol. 66, no. 3, pp. 247-259, 2011.
76. B. Boser, I. Guyon, and V. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th ACM Workshop Comput. Learn. Theory, Pittsburgh, PA, Jul. 27-29, 1992, pp. 144-152. (Pubitemid 23615470)