Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning

IEEE Transactions on Geoscience and Remote Sensing

Volumn 54, Issue 6, 2016, Pages 3660-3671

  Yao, Xiwen ^a   Han, Junwei ^a   Cheng, Gong ^a   Qian, Xueming ^b   Guo, Lei ^a  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Deep feature learning; feature transferring; satellite image annotation; weakly supervised learning (WSL)

Indexed keywords

DEEP LEARNING; IMAGE ANNOTATION; ITERATIVE METHODS; LAND USE; SATELLITES; SEMANTICS; SUPERVISED LEARNING; WAGES;

ANNOTATED TRAINING DATA; DEEP FEATURE LEARNING; FEATURE TRANSFERRING; HIGH RESOLUTION SATELLITE IMAGES; LANDUSE CLASSIFICATIONS; OPTICAL SATELLITE IMAGES; SATELLITE IMAGES; WEAKLY SUPERVISED LEARNING;

CLASSIFICATION (OF INFORMATION);

DATA SET; EXPERIMENTAL STUDY; IMAGE RESOLUTION; LAND USE; MACHINE LEARNING; OPTIMIZATION; PIXEL; SATELLITE DATA; SATELLITE IMAGERY;

EID: 84976243077     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2016.2523563     Document Type: Article

References (55)

1. P. Tokarczyk, J. D. Wegner, S. Walk, K. Schindler, "Features, color spaces, boosting: New insights on semantic classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 1, pp. 280-295, Jan. 2015.
2. F. Zhang, B. Du, L. Zhang, "Saliency-guided unsupervised feature learning for scene classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2175-2184, Apr. 2015.
3. G. Cheng et al., "Effective and efficient midlevel visual elements-oriented land-use classification using VHR remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 8, pp. 4238-4249, Aug. 2015.
4. Y. Zhang et al., "Semi-supervised manifold learning based multigraph fusion for high-resolution remote sensing image classification," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 2, pp. 464-468, Feb. 2014.
5. J. Han et al., "Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding," ISPRS J. Photogramm. Remote Sens., vol. 89, pp. 37-48, Mar. 2014.
6. A. M. Cheriyadat, "Unsupervised feature learning for aerial scene classification," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 439-451, Jan. 2014.
7. G. Cheng, J. Han, P. Zhou, L. Guo, "Multi-class geospatial object detection and geographic image classification based on collection of part detectors," ISPRS J. Photogramm. Remote Sens., vol. 98, pp. 119-132, Dec. 2014.
8. Y. Yang and S. Newsam, "Geographic image retrieval using local invariant features," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 818-832, Feb. 2013.
9. Y. Yi and S. Newsam, "Spatial pyramid co-occurrence for image classification," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 1465-1472.
10. Y. Yang and S. Newsam, "Bag-of-visual-words and spatial extensions for land-use classification," in Proc. ACM SIGSPATIAL GIS, 2010, pp. 270-279.
11. J. Hu, G.-S. Xia, F. Hu, L. Zhang, "A comparative study of sampling analysis in scene classification of high-resolution remote sensing imagery," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2015, pp. 2389-2392.
12. X. Huang, Q. Lu, L. Zhang, "A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas," ISPRS J. Photogramm. Remote Sens., vol. 90, pp. 36-48, Apr. 2014.
13. W. Luo, H. Li, G. Liu, "Automatic annotation of multispectral satellite images using author-topic model," IEEE Geosci. Remote Sens. Lett., vol. 9, no. 4, pp. 634-638, Jul. 2012.
14. W. Luo, H. Li, G. Liu, L. Zeng, "Semantic annotation of satellite images using author-genre-topic model," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 2, pp. 1356-1368, Feb. 2014.
15. X. Zheng, X. Sun, K. Fu, H.Wang, "Automatic annotation of satellite images via multifeature joint sparse coding with spatial relation constraint," IEEE Geosci. Remote Sens. Lett., vol. 10, no. 4, pp. 652-656, Jul. 2013.
16. W. Shao, W. Yang, G.-S. Xia, "Extreme value theory-based calibration for the fusion of multiple features in high-resolution satellite scene classification," Int. J. Remote Sens., vol. 34, no. 23, pp. 8588-8602, Dec. 2013.
17. F. Hu,W. Yang, J. Chen, H. Sun, "Tile-level annotation of satellite images using multi-level max-margin discriminative random field," Remote Sens., vol. 5, no. 5, pp. 2275-2291, 2013.
18. K. Chen, P. Jian, Z. Zhou, D. Zhang, "Semantic annotation of highresolution remote sensing images via Gaussian process multi-instance multilabel learning," IEEE Geosci. Remote Sens. Lett., vol. 10, no. 6, pp. 1285-1289, Nov. 2013.
19. M. Lienou, H. Maitre, M. Datcu, "Semantic annotation of satellite images using latent Dirichlet allocation," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 1, pp. 28-32, Jan. 2010.
20. G. G. Wilkinson, "Results and implications of a study of fifteen years of satellite image classification experiments," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 433-440, Mar. 2005.
21. M. Petrakos, J. A. Benediktsson, I. Kanellopoulos, "The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 11, pp. 2539-2546, Nov. 2001.
22. Y. Mori, H. Takahashi, R. Oka, "Image-to-word transformation based on dividing and vector quantizing images with words," in Proc. Int. Workshop Multimedia Intell. Storage Retrieval Manage., 1999, pp. 1-9.
23. L. Bruzzone, D. F. Prieto, S. B. Serpico, "A neural-statistical approach to multitemporal and multisource remote-sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1350-1359, May 1999.
24. A. Krizhevsky, I. Sutskever, G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. Conf. Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
25. D. Zhang et al., "Weakly supervised learning for target detection in remote sensing images," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 4, pp. 701-705, Apr. 2015.
26. J. Han, D. Zhang, G. Cheng, L. Guo, J. Ren, "Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 6, pp. 3325-3337, Jun. 2015.
27. W. Yang, D. Dai, B. Triggs, G. S. Xia, "SAR-based terrain classification using weakly supervised hierarchical Markov aspect models," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4232-4243, Sep. 2012.
28. F.-F. Li and P. Pietro, "A Bayesian hierarchical model for learning natural scene categories," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 524-531.
29. J. dos Santos et al., "Improving texture description in remote sensing image multi-scale classification tasks by using visual words," in Proc. IEEE Int. Conf. Pattern Recognit., 2012, pp. 3090-3093.
30. L.-J. Zhao, P. Tang, L.-Z. Huo, "Land-use scene classification using a concentric circle-structured multiscale bag-of-visual-words model," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 12, pp. 4620-4631, Dec. 2014.
31. R. Bahmanyar, S. Cui, M. Datcu, "A comparative study of bag-ofwords and bag-of-topics models of EO image patches," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 6, pp. 1357-1361, Jun. 2015.
32. S. Chen and Y. Tian, "Pyramid of spatial relatons for scene-level land use classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 1947-1957, Apr. 2015.
33. S. Lazebnik, C. Schmid, J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2006, pp. 2169-2178.
34. T. Hofmann, "Unsupervised learning by probabilistic latent semantic analysis," J. Mach. Learn., vol. 42, no. 1/2, pp. 177-196, Jan./Feb. 2001.
35. D. M. Blei, "Probabilistic topic models," Commun. ACM, vol. 55, no. 4, pp. 77-84, Apr. 2012.
36. Y.-L. Boureau, F. Bach, Y. LeCun, J. Ponce, "Learning mid-level features for recognition," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 2559-2566.
37. X. Yao, J. Han, L. Guo, S. Bu, Z. Liu, "A coarse-to-fine model for airport detection from remote sensing images using target-oriented visual saliency and CRF," Neurocomputing, vol. 164, pp. 162-172, Sep. 2015.
38. Q. Lv et al., "Urban land use and land cover classification using remotely sensed SAR data through deep belief networks," J. Sens., vol. 501, pp. 53-63, 2015.
39. S. Paisitkriangkrai, J. Sherrah, P. Janney, A. Hengel, "Effective semantic pixel labelling with convolutional networks and conditional random fields," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. Workshops, 2015, pp. 36-43.
40. O. A. Penatti, K. Nogueira, J. A. dos Santos, "Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?" in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. Workshops, 2015, pp. 44-51.
41. P. Zhou, D. Zhang, G. Cheng, J. Han, "Negative bootstrapping for weakly supervised target detection in remote sensing images," in Proc. IEEE Int. Conf. Multimedia Big Data, 2015, pp. 318-323.
42. H.-C. Shin, M. R. Orton, D. J. Collins, S. J. Doran, M. O. Leach, "Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1930-1943, Aug. 2013.
43. S. Kullback and R. A. Leibler, "On information and sufficiency," Ann. Math. Statist., vol. 22, no. 1, pp. 79-86, Mar. 1951.
44. D. R. Wilson and T. R. Martinez, "The general inefficiency of batch training for gradient descent learning," Neural Netw., vol. 16, no. 10, pp. 1429-1451, Dec. 2003.
45. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, Jul. 2006.
46. D. E. Rumelhart, G. E. Hintont, R. J. Williams, "Learning representations by back-propagating errors," Nature, vol. 323, p. 9, Oct. 1986.
47. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
48. X. Liu, S. Yan, J. Yan, H. Jin, "Unified solution to nonnegative data factorization problems," in Proc. IEEE Conf. Data Mining, 2009, pp. 307-316.
49. S. Liu et al., "Weakly supervised graph propagation towards collective image parsing," IEEE Trans. Multimedia, vol. 14, no. 2, pp. 361-373, Apr. 2012.
50. C. Siagian and L. Itti, "Rapid biologically-inspired scene classification using features shared with visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 2, pp. 300-312, Feb. 2007.
51. G. Montavon, G. Orr, K.-R. Muller, Neural Networks: Tricks of the Trade. San Francisco, CA, USA: Springer-Verlag, 2012.
52. A. Ng, CS294 A Lecture Notes: Sparse Autoencoder. Standford, CA, USA: Stanford Univ. Press, 2010.
53. J. Han et al., "An object-oriented visual saliency detection framework based on sparse coding representations," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 12, pp. 2009-2021, Dec. 2013.
54. J. Han et al., "Background prior-based salient object detection via deep reconstruction residual," IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 8, pp. 1309-1321, Aug. 2015.
55. J. Han et al., "Two-stage learning to predict human eye fixations via SDAEs," IEEE Trans. Cybern., vol. 46, no. 2, pp. 487-498, Feb. 2016.