Remote Sensing Image Fusion Using Hierarchical Multimodal Probabilistic Latent Semantic Analysis

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 11, Issue 12, 2018, Pages 4982-4993

  Fernandez Beltran, Ruben ^a   Haut, Juan M ^b   Paoletti, Mercedes E ^b   Plaza, Javier ^b   Plaza, Antonio ^b   Pla, Filiberto ^a  

^a UNIVERSITAT JAUME I   (Spain)

^b UNIVERSITY OF EXTREMADURA   (Spain)

Author keywords

Image fusion; multispectral imaging (MSI); probabilistic latent semantic analysis (pLSA); synthetic aperture radar (SAR)

Indexed keywords

COMPETITION; DATA STRUCTURES; IMAGE ANALYSIS; MODAL ANALYSIS; PROBABILISTIC LOGICS; RADAR IMAGING; REMOTE SENSING; SEMANTICS; STATISTICS; SYNTHETIC APERTURE RADAR;

ADAPTATION MODELS; COMPETITIVE ADVANTAGE; INHERENT COMPLEXITY; MULTISPECTRAL IMAGING; PROBABILISTIC LATENT SEMANTIC ANALYSIS; PROBABILISTIC TOPIC MODELS; REMOTE SENSING IMAGES; REMOTELY SENSED DATA;

IMAGE FUSION;

IMAGE PROCESSING; MULTISPECTRAL IMAGE; PROBABILITY; REMOTE SENSING; SYNTHETIC APERTURE RADAR;

EID: 85057851736     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2018.2881342     Document Type: Article

References (47)

1. K. Rousseeuw, E. P. Caillault, A. Lefebvre, and D. Hamad, "Hybrid hidden Markov model for marine environment monitoring, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 1, pp. 204-213, Jan. 2015.
2. A. Karpatne, Z. Jiang, R. R. Vatsavai, S. Shekhar, and V. Kumar, "Monitoring land-cover changes: A machine-learning perspective, " IEEE Geosci. Remote Sens. Mag., vol. 4, no. 2, pp. 8-21, Jun. 2016.
3. W. Yang and W. Qi, "Spatial-temporal dynamic monitoring of vegetation recovery after the Wenchuan earthquake, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 3, pp. 868-876, Mar. 2017.
4. S. Voigt, T. Kemper, T. Riedlinger, R. Kiefl, K. Scholte, and H. Mehl, "Satellite image analysis for disaster and crisis-management support, " IEEE Trans. Geosci. Remote Sens., vol. 45, no. 6, pp. 1520-1528, Jun. 2007.
5. J. Li et al., "Social media: New perspectives to improve remote sensing for emergency response, " Proc. IEEE, vol. 105, no. 10, pp. 1900-1912, Oct. 2017.
6. B. Chen et al., "Mapping forest and their spatial-temporal changes from 2007 to 2015 in tropical hainan island by integrating ALOS/ALOS-2 L-Band SAR and landsat optical images, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 11, no. 3, pp. 852-867, Mar. 2018.
7. L. Yue, H. Shen, W. Yu, and L. Zhang, "Monitoring of historical glacier recession in yulong mountain by the integration of multisource remote sensing data, " IEEE J. Sel Topics Appl Earth Observ. Remote Sens., vol. 11, no. 2, pp. 388-400, Feb. 2018.
8. M. Stasolla, J. J. Mallorqui, G. Margarit, C. Santamaria, and N. Walker, "A comparative study of operational vessel detectors for maritime surveillance using satellite-borne synthetic aperture radar, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 9, no. 6, pp. 2687-2701, Jun. 2016.
9. M. Schmitt and X. X. Zhu, "Data fusion and remote sensing: An evergrowing relationship, " IEEE Geosci. Remote Sensing Mag., vol. 4, no. 4, pp. 6-23, Dec. 2016.
10. C. Pohl and J. L. Van Genderen, "Review article multisensor image fusion in remote sensing: Concepts, methods and applications, " Int. J. Remote Sens., vol. 19, no. 5, pp. 823-854, 1998.
11. N. Yokoya, C. Grohnfeldt, and J. Chanussot, "Hyperspectral and multi-spectral data fusion: A comparative review of the recent literature, " IEEE Geosci. Remote Sens. Mag., vol. 5, no. 2, pp. 29-56, Jun. 2017.
12. B. Waske and S. van der Linden, "Classifying multilevel imagery from SAR and optical sensors by decision fusion, " IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1457-1466, May 2008.
13. A. Mazher, P. Li, T. A. Moughal, and H. Xu, "A decision fusion method using an algorithm for fusion of correlated probabilities, " Int. J. Remote Sens., vol. 37, no. 1, pp. 14-25, 2016.
14. M. Ghahremani and H. Ghassemian, "Remote-sensing image fusion based on curvelets and ICA, " Int. J. Remote Sens., vol. 36, no. 16, pp. 4131-4143, 2015.
15. C. Sukawattanavijit, J. Chen, and H. Zhang, "GA-SVM algorithm for improving land-cover classification using SAR and optical remote sensing data, " IEEE Geosci. Remote Sens. Lett., vol. 14, no. 3, pp. 284-288, Mar. 2017.
16. H. Zhang, H. Lin, and Y. Li, "Impacts of feature normalization on optical and SAR data fusion for land use/land cover classification, " IEEE Geosci. Remote Sens. Lett., vol. 12, no. 5, pp. 1061-1065, May 2015.
17. A. Popescu, D. FAUR, C. VADUVA, and M. Datcu, "Enhanced classification of land cover through joint analysis of sentinel-1 and sentinel-2 data, " in Proc. ESA Living Planet Symp., Prague, Czech Republic, 2016, pp. 9-13.
18. K. Spröhnle, E.-M. Fuchs, and P. A. Pelizari, "Object-based analysis and fusion of optical and SAR satellite data for dwelling detection in refugee camps, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 5, pp. 1780-1791, May 2017.
19. Y. Byun, J. Choi, and Y. Han, "An area-based image fusion scheme for the integration of SAR and optical satellite imagery, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 5, pp. 2212-2220, Oct. 2013.
20. H. Ghassemian, "A review of remote sensing image fusion methods, " Inf. Fusion, vol. 32, pp. 75-89, 2016.
21. Y. Zhong, Q. Zhu, and L. Zhang, "Scene classification based on the multi-feature fusion probabilistic topic model for high spatial resolution remote sensing imagery, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 11, pp. 6207-6222, Nov. 2015.
22. R. Bahmanyar, D. Espinoza-Molina, and M. Datcu, "Multisensor earth observation image classification based on a multimodal latent Dirichlet allocation model, " IEEE Geosci. Remote Sens. Lett., vol. 15, no. 3, pp. 459-463, Mar. 2018.
23. R. Bahmanyar, S. Cui, and M. Datcu, "A comparative study of bag-of-words and bag-of-topics models of EO image patches, " IEEE Geosci. Remote Sens. Lett., vol. 12, no. 6, pp. 1357-1361, Jun. 2015.
24. D. M. Blei, "Probabilistic topic models, " Commun. ACM, vol. 55, no. 4, pp. 77-84, 2012.
25. F. Rodrigues, M. Lourenco, B. Ribeiro, and F. C. Pereira, "Learning supervised topic models for classification and regression from crowds, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 12, pp. 2409-2422, Dec. 2017.
26. R. Fernández-Beltran, R. Montoliu, and F. Pla, "Vocabulary reduction in bow representing by topic modeling, " in Proc. Iberian Conf. Pattern Recogn. Image Anal., 2013, pp. 648-655.
27. C. Chen, A. Zare, H. N. Trinh, G. O. Omotara, J. T. Cobb, and T. A. Lagaunne, "Partial membership latent Dirichlet allocation for soft image segmentation, " IEEE Trans. Image Process., vol. 26, no. 12, pp. 5590-5602, Dec. 2017.
28. Z. Niu, G. Hua, L. Wang, and X. Gao, "Knowledge-based topic model for unsupervised object discovery and localization, " IEEE Trans. Image Process., vol. 27, no. 1, pp. 50-63, Jan. 2018.
29. R. Fernández-Beltran and F. Pla, "An interactive video retrieval approach based on latent topics, " in Proc. Int. Conf. Image Anal. Process., 2013, pp. 290-299.
30. R. Fernandez-Beltran and F. Pla, "Latent topics-based relevance feedback for video retrieval, " Pattern Recognit., vol. 51, pp. 72-84, 2016.
31. Q. Zhu, Y. Zhong, L. Zhang, and D. Li, "Scene classification based on the fully sparse semantic topic model, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 10, pp. 5525-5538, Oct. 2017.
32. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation, " J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
33. T. Hofmann, "Probabilistic latent semantic analysis, " in Proc. 15th Conf. Uncertainty Artif. Intell., 1999, pp. 289-296.
34. J. Chang, S. Gerrish, C. Wang, J. L. Boyd-Graber, and D. M. Blei, "Reading tea leaves: How humans interpret topic models, " in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 288-296.
35. R. Fernandez-Beltran and F. Pla, "Incremental probabilistic latent semantic analysis for video retrieval, " Image Vis. Comput., vol. 38, pp. 1-12, 2015.
36. R. Fernandez-Beltran and F. Pla, "Prior-based probabilistic latent semantic analysis for multimedia retrieval, " Multimedia Tools Appl., vol. 77, no. 13, pp. 16771-16793, 2018.
37. B. Chen, B. Huang, and B. Xu, "Multi-source remotely sensed data fusion for improving land cover classification, " ISPRS J. Photogram. Remote Sens., vol. 124, pp. 27-39, 2017.
38. M. Paoletti, J. Haut, J. Plaza, and A. Plaza, "A new deep convolutional neural network for fast hyperspectral image classification, " ISPRS J. Pho-togrammetry Remote Sens., vol. 145, pp. 120-147, 2018.
39. T. K. Moon, "The expectation-maximization algorithm, " IEEE Signal Process. Mag., vol. 13, no. 6, pp. 47-60, Nov. 1996.
40. Y. Zhang, R. Jin, and Z.-H. Zhou, "Understanding bag-of-words model: a statistical framework, " Int. J. Mach. Learn. Cybern., vol. 1, no.s 1-4, pp. 43-52, 2010.
41. J. M. Haut, M. Paoletti, J. Plaza, and A. Plaza, "Cloud implementation of the K-means algorithm for hyperspectral image analysis, " J. Supercomput., vol. 73, no. 1, pp. 514-529, 2017.
42. R. Fernandez-Beltran, A. Plaza, J. Plaza, and F. Pla, "Hyperspectral unmixing based on dual-depth sparse probabilistic latent semantic analy-sis, " IEEE Trans. Geosci. Remote Sens., vol. 56, no. 11, pp. 6344-6360, Nov. 2018.
43. D. Putthividhy, H. T. Attias, and S. S. Nagarajan, "Topic regression multi-modal latent Dirichlet allocation for image annotation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3408-3415.
44. P. Chandrika and C. Jawahar, "Multi modal semantic indexing for image retrieval, " in Proc. ACM Int. Conf. Image Video Retrieval, 2010, pp. 342-349.
45. R. Fernandez-Beltran and F. Pla, "Sparse multi-modal probabilistic latent semantic analysis for single-image super-resolution, " Signal Process., vol. 152, pp. 227-237, 2018.
46. T. Zhang, R. Ramakrishnan, and M. Livny, "Birch: An efficient data clustering method for very large databases, " in Proc. ACM Sigmod Rec., vol. 25, no. 2, pp. 103-114, 1996.
47. N. Yokoya et al., "Open data for global multimodal land use classification: Outcome of the 2017 IEEE GRSS data fusion contest, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 11, no. 5, pp. 1363-1377, May 2018.