Scene Classification Based on the Fully Sparse Semantic Topic Model

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 10, 2017, Pages 5525-5538

  Zhu, Qiqi ^a   Zhong, Yanfei ^a   Zhang, Liangpei ^a   Li, Deren ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

Fusion; high spatial resolution (HSR) imagery; limited training samples; probabilistic topic model (PTM); scene classification; sparsity

Indexed keywords

CLASSIFICATION (OF INFORMATION); FUSION REACTIONS; IMAGE RESOLUTION; SAMPLING; SEMANTICS;

HIGH SPATIAL RESOLUTION; PROBABILISTIC TOPIC MODELS; SCENE CLASSIFICATION; SPARSITY; TRAINING SAMPLE;

IMAGE CLASSIFICATION;

ALGORITHM; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGERY; MODEL; NUMERICAL METHOD; PROBABILITY;

EID: 85023757703     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2709802     Document Type: Article

References (48)

1. R. Bellens, S. Gautama, L. Martinez-Fonte, W. Philips, J. C. W. Chan, F. Canters, "Improved classification of VHR images of urban areas using directional morphological profiles, " IEEE Trans. Geosci. Remote Sens., vol. 46, no. 10, pp. 2803-2813, Oct. 2008.
2. G. Moser, S. B. Serpico, J. A. Benediktsson, "Land-cover mapping by Markov modeling of spatial-contextual information in veryhigh-resolution remote sensing images, " Proc. IEEE, vol. 101, no. 3, pp. 631-651, Mar. 2013.
3. S. Aksoy, K. Koperski, C. Tusk, G. Marchisio, J. C. Tilton, "Learning Bayesian classifiers for scene classification with a visual grammar, " IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 581-589, Mar. 2005.
4. R. Bahmanyar, S. Cui, M. Datcu, "A comparative study of bag-ofwords and bag-of-topics models of EO image patches, " IEEE Geosci. Remote Sens. Lett., vol. 12, no. 6, pp. 1357-1361, Jun. 2015.
5. M. Gong, J. Zhao, J. Liu, Q. Miao, L. Jiao, "Change detection in synthetic aperture radar images based on deep neural networks, " IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 1, pp. 125-138, Jan. 2016.
6. O. A. B. Penatti, K. Nogueira, J. A. dos Santos, "Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) Workshops, Jun. 2015, pp. 44-51.
7. P. Zhang, M. Gong, L. Su, J. Liu, Z. Li, "Change detection based on deep feature representation and mapping transformation for multi-spatial-resolution remote sensing images, " ISPRS J. Photogramm. Remote Sens., vol. 116, pp. 24-41, Jun. 2016.
8. Y. Yang and S. Newsam, "Bag-of-visual-words and spatial extensions for land-use classification, " in Proc. Int. Conf. ACM SIGSPATIAL GIS, San Jose, CA, USA, 2010, pp. 270-279.
9. A. M. Cheriyadat, "Unsupervised feature learning for aerial scene classification, " IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 439-451, Jan. 2014.
10. B. Zhao, Y. Zhong, L. Zhang, "Scene classification via latent Dirichlet allocation using a hybrid generative/discriminative strategy for high spatial resolution remote sensing imagery, " Remote Sens. Lett., vol. 4, no. 12, pp. 1204-1213, Dec. 2013.
11. N. Serrano, A. E. Savakis, J. Luo, "Improved scene classification using efficient low-level features and semantic cues, " Pattern Recognit., vol. 37, no. 9, pp. 1773-1784, 2004.
12. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos, " in Proc. 9th IEEE Int. Conf. Comput. Vis., vol. 2. Oct. 2003, pp. 1470-1477.
13. L.-J. Zhao, P. Tang, L.-Z. Huo, "Land-use scene classification using a concentric circle-structured multiscale bag-of-visual-words model, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 12, pp. 4620-4631, Dec. 2014.
14. Q. Zhu, Y. Zhong, B. Zhao, G.-S. Xia, L. Zhang, "Bag-of-visualwords scene classifier with local and global features for high spatial resolution remote sensing imagery, " IEEE Geosci. Remote Sens. Lett., vol. 13, no. 6, pp. 747-751, Jun. 2016.
15. T. Hofmann, "Unsupervised learning by probabilistic latent semantic analysis, " Mach. Learn., vol. 42, no. 1, pp. 177-196, Jan./Feb. 2001.
16. D. M. Blei, A. Y. Ng, M. I. Jordan, "Latent Dirichlet allocation, " J. Mach. Learn. Res., vol. 3, no. 5, pp. 993-1022, Mar. 2003.
17. D. M. Blei, "Probabilistic topic models, " Commun. ACM, vol. 55, no. 4, pp. 77-84, Apr. 2012.
18. A. Bosch, A. Zisserman, X. Munõz, "Scene classification using a hybrid generative/discriminative approach, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 712-727, Apr. 2008.
19. M. Lienou, H. Maitre, M. Datcu, "Semantic annotation of satellite images using latent Dirichlet allocation, " IEEE Geosci. Remote Sens. Lett., vol. 7, no. 1, pp. 28-32, Jan. 2010.
20. C. Vaduva, I. Gavat, M. Datcu, "Latent Dirichlet allocation for spatial analysis of satellite images, " IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2770-2786, May 2013.
21. X. Yao, J. Han, G. Cheng, X. Qian, L. Guo, "Semantic annotation of high-resolution satellite images via weakly supervised learning, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 6, pp. 3660-3671, Jun. 2016.
22. Y. Zhong, Q. Zhu, L. Zhang, "Scene classification based on the multifeature fusion probabilistic topic model for high spatial resolution remote sensing imagery, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 11, pp. 6207-6222, Nov. 2015.
23. W. Shao, W. Yang, G.-S. Xia, G. Liu, "A hierarchical scheme of multiple feature fusion for high-resolution satellite scene categorization, " in Computer Vision Systems. Berlin, Germany: Springer, 2013, pp. 324-333.
24. X. Zheng, X. Sun, K. Fu, H. Wang, "Automatic annotation of satellite images via multifeature joint sparse coding with spatial relation constraint, " IEEE Geosci. Remote Sens. Lett., vol. 10, no. 4, pp. 652-656, Jul. 2013.
25. P. Tokarczyk, J. D. Wegner, S. Walk, K. Schindler, "Features, color spaces, boosting: New insights on semantic classification of remote sensing images, " IEEE Trans. Geosci Remote Sens., vol. 53, no. 1, pp. 280-295, Jan. 2015.
26. M. Shashanka, B. Raj, P. Smaragdis, "Sparse overcomplete latent variable decomposition of counts data, " in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 1313-1320.
27. J. Zhu and E. P. Xing, "Sparse topical coding, " in Proc. Uncertainty Artif. Intell. (UAI) 2011, pp. 831-838.
28. K. Than and T. B. Ho, "Fully sparse topic models, " in Proc. Eur. Conf. Mach. Learn. Principles Pract. Knowl. Discovery Databases (ECML PKDD), vol. 7523. Bristol, U.K., 2012, pp. 490-505.
29. R. Fernandez-Beltran and F. Pla, "Incremental probabilistic latent semantic analysis for video retrieval, " Image Vis. Comput., vol. 38, pp. 1-12, Jun. 2015.
30. R. Kaviani, P. Ahmadi, I. Gholampour, "Incorporating fully sparse topic models for abnormality detection in traffic videos, " in Proc. IEEE Conf. Comput. Knowl. Eng., Oct. 2014, pp. 586-591.
31. W. Yang, X. Yin, G. S. Xia, "Learning high-level features for satellite image classification with limited labeled samples, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 8, pp. 4472-4482, Aug. 2015.
32. F. Hu, G.-S. Xia, Z. Wang, X. Huang, L. Zhang, H. Sun, "Unsupervised feature learning via spectral clustering of multidimensional patches for remotely sensed scene classification, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 5, pp. 2015-2030, May 2015.
33. D. Bratasanu, I. Nedelcu, M. Datcu, "Bridging the semantic gap for satellite image annotation and automatic mapping applications, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 4, no. 1, pp. 193-204, Mar. 2011.
34. R. M. Haralick, K. Shanmugam, I. Dinstein, "Textural features for image classification, " IEEE Trans. Syst., Man, Cybern., vol. SMC-3, no. 6, pp. 610-621, Nov. 1973.
35. K. Huang and S. Aviyente, "Wavelet feature selection for image classification, " IEEE Trans. Image Process., vol. 17, no. 9, pp. 1709-1720, Sep. 2008.
36. D. G. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Jan. 2004.
37. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 524-531.
38. A. Barla, F. Odone, A. Verri, "Histogram intersection kernel for image classification, " in Proc. IEEE Int. Conf. Image Process., Sep. 2003, pp. III-513-III-516.
39. S. Lazebnik, C. Schmid, J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 2169-2178.
40. S. Chen and Y. Tian, "Pyramid of spatial relatons for scene-level land use classification, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 1947-1957, Apr. 2015.
41. M. L. Mekhalfi, F. Melgani, Y. Bazi, N. Alajlan, "Land-use classification with compressive sensing multifeature fusion, " IEEE Geosci. Remote Sens. Lett., vol. 12, no. 10, pp. 2155-2159, Oct. 2015.
42. B. Zhao, Y. Zhong, G.-S. Xia, L. Zhang, "Dirichlet-derived multiple topic scene classification model for high spatial resolution remote sensing imagery, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 4, pp. 2108-2123, Apr. 2016.
43. B. Zhao, Y. Zhong, L. Zhang, B. Huang, "The Fisher kernel coding framework for high spatial resolution scene classification, " Remote Sens., vol. 8, no. 2, p. 157, 2016.
44. Y. Zhong, M. Cui, Q. Zhu, L. Zhang, "Scene classification based on multifeature probabilistic latent semantic analysis for high spatial resolution remote sensing images, " J. Appl. Remote Sens., vol. 9, no. 1, p. 095064, 2015.
45. K. L. Clarkson, "Coresets, sparse greedy approximation, the Frank-Wolfe algorithm, " ACM Trans. Algorithms, vol. 6, no. 4, pp. 63:1-63:30, 2010.
46. F. Hu, G.-S. Xia, J. Hu, L. Zhang, "Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery, " Remote Sens., vol. 7, no. 11, pp. 14680-14707, 2015.
47. L. Zhang, L. Zhang, B. Du, "Deep learning for remote sensing data: A technical tutorial on the state of the art, " IEEE Geosci. Remote Sens. Mag., vol. 4, no. 2, pp. 22-40, Jun. 2016.
48. S. D. Newsam and C. Kamath, "Retrieval using texture features in high-resolution multispectral satellite imagery, " Proc. SPIE, vol. 5433, pp. 21-32, Apr. 2004.