Discriminant deep belief network for high-resolution SAR image classification

Pattern Recognition

Volumn 61, Issue , 2017, Pages 686-701

  Zhao, Zhiqiang ^a   Jiao, Licheng ^a   Zhao, Jiaqi ^a   Gu, Jing ^a   Zhao, Jin ^a  

^a XIDIAN UNIVERSITY   (China)

Author keywords

Deep belief network; Discriminant feature learning; Ensemble learning; SAR image classification; Similarity measurement

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; RADAR IMAGING; SYNTHETIC APERTURE RADAR; VECTOR SPACES;

DEEP BELIEF NETWORKS; ENSEMBLE LEARNING; FEATURE LEARNING; SAR IMAGE CLASSIFICATIONS; SIMILARITY MEASUREMENTS;

IMAGE CLASSIFICATION;

EID: 84973517679     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2016.05.028     Document Type: Article

References (61)

1. A. Reigber, R. Scheiber, M. Jager, P. Prats-Iraola, I. Hajnsek, T. Jagdhuber, K. P. Papathanassiou, M. Nannini, E. Aguilera, S. Baumgartner, R. Horn, A. Nottensteiner, A. Moreira, Very-high-resolution airborne synthetic aperture radar imaging: Signal processing and applications, Proc. IEEE 101(3) (2013) 759–783. doi:10.1109/JPROC.2012.2220511.
2. Sanjuan-Ferrer, M.J., Hajnsek, I., Papathanassiou, K.P., Moreira, A., A new detection algorithm for coherent scatterers in SAR data. IEEE Trans. Geosci. Remote Sens. 11 (2015), 6293–6307, 10.1109/TGRS.2015.2438173.
3. Li, G., Lu, D., Moran, E., Dutra, L., Batistella, M., A comparative analysis of ALOS PALSAR L-band and RADARSAT-2 C-band data for land-cover classification in a tropical moist region. ISPRS J. Photogramm. Remote Sens. 70 (2012), 26–38, 10.1016/J.ISPRSJPRS.2012.03.010.
4. G. Moser, S.B. Serpico, J.A. Benediktsson, Land-cover mapping by Markov modeling of spatial-contextual information in very-high-resolution remote sensing images, Proc. IEEE 101(3) (2013) 631–651. doi:10.1109/JPROC.2012.2211551.
5. Rossi, C., Erten, E., Paddy-rice monitoring using TanDEM-X. IEEE Trans. Geosci. Remote Sens. 53:2 (2015), 900–910, 10.1109/TGRS.2014.2330377.
6. Chaabouni-Chouayakh, H., Datcu, M., Backscattering and statistical information fusion for urban area mapping using TerraSAR-X data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 3:4 (2010), 718–730, 10.1109/JSTARS.2010.2059695.
7. Marin, C., Bovolo, F., Bruzzone, L., Building change detection in multitemporal very high resolution SAR images. IEEE Trans. Geosci. Remote Sens. 53:5 (2015), 2664–2682, 10.1109/TGRS.2014.2363548.
8. Raucoules, D., de Michele, M., Malet, J.-P., Ulrich, P., Time-variable 3d ground displacements from high-resolution synthetic aperture radar (SAR). Application to La Valette landslide (south French Alps). Remote Sens. Environ. 139 (2014), 198–204, 10.1016/J.RSE.2013.08.006.
9. Iervolino, P., Guida, R., Iodice, A., Riccio, D., Flooding water depth estimation with high-resolution SAR. IEEE Trans. Geosci. Remote Sens. 53:5 (2015), 2295–2307, 10.1109/TGRS.2014.2358501.
10. Maksymiuk, O., Mayer, C., Stilla, U., Velocity estimation of glaciers with physically-based spatial regularization—experiments using satellite SAR intensity images. Remote Sens. Environ. 172 (2016), 190–204, 10.1016/J.RSE.2015.11.007.
11. Argenti, F., Lapini, A., amd Luciano Alparone, T.B., A tutorial on speckle reduction in synthetic aperture radar images. IEEE Geosci. Remote Sens. Mag. 1:3 (2013), 6–35, 10.1109/MGRS.2013.2277512.
12. Moreira, A., Prats-Iraola, P., Younis, M., Krieger, G., Hajnsek, I., Papathanassiou, K.P., A tutorial on synthetic aperture radar. IEEE Geosci. Remote Sens. Mag. 1:1 (2013), 6–43, 10.1109/MGRS.2013.2248301.
13. Wu, W., Guo, H., Li, X., Ferro-Famil, L., Zhang, L., Urban land use information extraction using the ultrahigh-resolution Chinese airborne SAR imagery. IEEE Trans. Geosci. Remote Sens. 53:10 (2015), 5583–5599, 10.1109/TGRS.2015.2425658.
14. Li, L., Heymsfield, G., Carswell, J., Schaubert, D.H., McLinden, M.L., Creticos, J., Perrine, M., Coon, M., Cervantes, J.I., Vega, M., Guimond, S., Tian, L., Emory, A., The NASA high-altitude imaging wind and rain airborne profile. IEEE Trans. Geosci. Remote Sens. 54:1 (2016), 298–310, 10.1109/TGRS.2015.2456501.
15. Champion, I., Germain, C., Costa, J.P.D., Alborini, A., Dubois-Fernandez, P., Retrieval of forest stand age from SAR image texture for varying distance and orientation values of the gray level co-occurrence matrix. IEEE Geosci. Remote Sens. Lett. 11:1 (2014), 5–9, 10.1109/LGRS.2013.2244060.
16. Ressel, R., Frost, A., Lehner, S., A neural network-based classification for sea ice types on X-band SAR images. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8:7 (2015), 3672–3680, 10.1109/JSTARS.2015.2436993.
17. Kandaswamy, U., Adjeroh, D.A., Lee, M.C., Efficient texture analysis of SAR imagery. IEEE Trans. Geosci. Remote Sens. 43:9 (2005), 2075–2083, 10.1109/TGRS.2005.852768.
18. Hou, B., Zhang, X., Li, N., MPM SAR image segmentation using feature extraction and context model. IEEE Geosci. Remote Sens. Lett. 9:6 (2012), 1041–1045, 10.1109/LGRS.2012.2189352.
19. Dumitru, C.O., Cui, S., Schwarz, G., Datcu, M., Information content of very-high-resolution SAR images: semantics, geospatial context, and ontologies. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8:4 (2015), 1635–1650, 10.1109/JSTARS.2014.2363595.
20. Akbarizadeh, G., A new statistical-based kurtosis wavelet energy feature for texture recognition of SAR images. IEEE Trans. Geosci. Remote Sens. 50:11 (2012), 4358–4368, 10.1109/TGRS.2012.2194787.
21. Deng, J., Ban, Y., Liu, J., Li, L., Niu, X., Zou, B., Hierarchical segmentation of multitemporal RADARSAT-2 SAR data using stationary wavelet transform and algebraic multigrid method. IEEE Trans. Geosci. Remote Sens. 52:7 (2014), 4353–4363, 10.1109/TGRS.2013.2281462.
22. Feng, J., Jiao, L.C., Zhang, X., Yang, D., Bag-of-visual-words based on clonal selection algorithm for SAR image classification. IEEE Geosci. Remote Sens. Lett. 8:4 (2011), 691–695, 10.1109/LGRS.2010.2100363.
23. Cui, S., Dumitru, C.O., Datcu, M., Ratio-detector-based feature extraction for very high resolution SAR image patch indexing. IEEE Geosci. Remote Sens. Lett. 10:5 (2013), 1175–1179, 10.1109/LGRS.2012.2235406.
24. Alonso, K., Datcu, M., Accelerated probabilistic learning concept for mining heterogeneous earth observation images. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8:7 (2015), 3356–3371, 10.1109/JSTARS.2015.2435491.
25. H. Zhang, N.M. Nasrabadi, T.S. Huang, Y. Zhang, Joint sparse representation based automatic target recognition in SAR images, in: Proc. SPIE 8051, Algorithms for Synthetic Aperture Radar Imagery, 2011, pp. 805112:1–805112:12. doi:10.1117/12.883665.
26. Xing, X., Ji, K., Zou, H., Chen, W., Sun, J., Ship classification in TerraSAR-X images with feature space based sparse representation. IEEE Geosci. Remote Sens. Lett. 10:6 (2013), 1562–1566, 10.1109/LGRS.2013.2262073.
27. A. Dosovitskiy, J. T. Springenberg, M. Riedmiller, T. Brox, Discriminative unsupervised feature learning with convolutional neural networks, in: Advances in Neural Information Processing Systems, Curran Associates, Inc., Montreal, Canada, 2014, pp. 766–774.
28. Deledalle, C.-A., Denis, L., Tupin, F., How to compare noisy patches? Patch similarity beyond gaussian noise. Int. J. Comput. Vis. 99:1 (2012), 86–102, 10.1007/s11263-012-0519-6.
29. D.S. Hayden, S. Chien, D.R. Thompson, R. Castan¨o, Using clustering and metric learning to improve science return of remote sensed imagery, ACM Trans. Intell. Syst. Technol. 3(3) (2012) 51:1–51:19. doi:10.1145/2168752.2168765.
30. Cooke, T., Two variations on fisher's linear discriminant for pattern recognition. IEEE Trans. Pattern Anal. Mach. Intell. 24:2 (2002), 268–273, 10.1109/34.982904.
31. Liu, X., Huang, Y., Pei, J., Yang, J., Sample discriminant analysis for SAR ATR. IEEE Geosci. Remote Sens. Lett. 11:12 (2014), 2120–2124, 10.1109/LGRS.2014.2321164.
32. Brown, M., Hua, G., Winder, S., Discriminative learning of local image descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 33:1 (2011), 43–57, 10.1109/TPAMI.2010.54.
33. D. Lowe, J. Behnke, K. Murphy, NASA's EOSDIS approach to big earth data challenges, in: AGU Fall Meeting Abstracts, vol. 1, 2014, p. 06.
34. Ma, Y., Wu, H., Wang, L., Huang, B., Ranjan, R., Zomaya, A., Jie, W., Remote sensing big data computing: challenges and opportunities. Future Gener. Comput. Syst. 51 (2015), 47–60, 10.1016/J.FUTURE.2014.10.029.
35. H. Goh, Learning deep visual representations (Ph.D. thesis), Universitè Pierre et Marie Curie, Paris, 2013.
36. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444, 10.1038/NATURE14539.
37. Schmidhuber, J., Deep learning in neural networks: an overview. Neural Netw. 61 (2015), 85–117, 10.1016/J.NEUNET.2014.09.003.
38. Bengio, Y., Courville, A., Vincent, P., Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35:8 (2013), 1798–1828, 10.1109/TPAMI.2013.50.
39. Lee, H., Grosse, R., Ranganath, R., Ng, A.Y., Unsupervised learning of hierarchical representations with convolutional deep belief networks. Commun. ACM 54:10 (2011), 95–103, 10.1145/2001269.2001295.
40. Hinton, G.E., Salakhutdinov, R., Reducing the dimensionality of data with neural networks. Science 313:5786 (2006), 504–507, 10.1126/SCIENCE.1127647.
41. Roux, N.L., Bengio, Y., Representational power of restricted Boltzmann machines and deep belief networks. Neural Comput. 20:6 (2008), 1631–1649, 10.1162/NECO.2008.04-07-510.
42. H. Larochelle, Y. Bengio, Classification using discriminative restricted Boltzmann machines, in: Proceedings of the 25th International Conference on Machine Learning, ACM, Helsinki, Finland, 2008, pp. 536–543. doi:10.1145/1390156.1390224.
43. Goh, H., Thome, N., Cord, M., Lim, J.-H., Learning deep hierarchical visual feature coding. IEEE Trans. Neural Netw. Learn. Syst. 25:12 (2014), 2212–2225, 10.1109/TNNLS.2014.2307532.
44. Fischer, A., Igel, C., Training restricted Boltzmann machines: an introduction. Pattern Recognit. 47:1 (2014), 25–39, 10.1016/J.PATCOG.2013.05.025.
45. J.C. Nascimento, G. Carneiro, Non-rigid segmentation using sparse low dimensional manifolds and deep belief networks, in: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, 2014, pp. 288–295. doi:10.1109/CVPR.2014.44.
46. Y. Tang, R. Salakhutdinov, G. Hinton, Robust Boltzmann machines for rrecognition and denoising, in: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, 2012, pp. 2264–2271. doi:10.1109/CVPR.2012.6247936.
47. Chen, Y., Zhao, X., Jia, X., Spectral-spatial classification of hyperspectral data based on deep belief network. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8:6 (2015), 2381–2392, 10.1109/JSTARS.2015.2388577.
48. García, S., Derrac, J., Cano, J.R., Herrera, F., Prototype selection for nearest neighbor classification: taxonomy and empirical study. IEEE Trans. Pattern Anal. Mach. Intell. 34:3 (2012), 417–435, 10.1109/TPAMI.2011.142.
49. Triguero, I., Derrac, J., Garcí, S., Herrera, F., A taxonomy and experimental study on prototype generation for nearest neighbor classification. IEEE Trans. Syst. Man. Cybern. Part C: Appl. Rev. 42:1 (2012), 86–100, 10.1109/TSMCC.2010.2103939.
50. D. Dai, M. Prasad, C. Leistner, L. Gool, Ensemble partitioning for unsupervised image categorization, in: Computer Vision – ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7–13, 2012, Proceedings, Part III, Springer, Berlin, Heidelberg, 2012, pp. 483–496. doi:10.1007/978-3-642-33712-3_35.
51. D. Dai, L. V. Gool, Ensemble projection for semi-supervised image classification, in: 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, NSW, 2013, pp. 2072–2079. doi:10.1109/ICCV.2013.259.
52. T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning: Data Mining, Inference and Prediction, 2nd Edition, Springer Series in Statistics, Springer, New York, USA, 2009.
53. Yang, W., Yin, X., Xia, C.-S., Learning high-level feature for satellite image classification with limited labeled samples. IEEE Trans. Geosci. Remote Sens. 53:8 (2015), 4472–4482 doi:11.1109/TGRS.2015.2400449.
54. G. Hinton, A practical guide to training restricted Boltzmann machines, in: G. Montavon, G. B. O. Orr, K.-R. Müller (Eds.), Neural Networks: Tricks of the Trade, Lecture Notes in Computer Science, vol. 7700, Springer, Berlin, Heidelberg, 2012, pp. 599–619. doi:10.1007/978-3-642-35289-8_32.
55. K. Cho, T. Raiko, A. Ilin, Parallel tempering is efficient for learning restricted Boltzmann machines, in: The 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona, 2010, pp. 1–8. doi:10.1109/IJCNN.2010.5596837.
56. Dumitru, C.O., Datcu, M., Information content of very high resolution SAR images: study of feature extraction and imaging parameters. IEEE Trans. Geosci. Remote Sens. 51:8 (2013), 4591–4610, 10.1109/TGRS.2013.2265413.
57. Fan, R.-E., Chang, K.-W., Hsieh, C.-J., Wang, X.-R., Lin, C.-J., LIBLINEAR: a library for large linear classification. J. Mach. Learn. Res. 9 (2008), 1871–1874, 10.1145/1390681.1442794.
58. Chang, C.-C., Lin, C.-J., LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2:3 (2011), 27:1–27:27, 10.1145/1961189.1961199.
59. Mountrakis, G., Im, J., Ogole, C., Support vector machines in remote sensing: a review. ISPRS J. Photogramm. Remote Sens. 66:3 (2011), 247–259, 10.1016/J.ISPRSJPRS.2010.11.001.
60. Fay, M.P., Proschan, M.A., Wilcoxon-Mann-Whitney or t-Test? On assumptions for hypothesis tests and multiple interpretations of decision rules. Stat. Surv. 4 (2010), 1–39, 10.1214/09-SS051.
61. Jia, X., Richards, J.A., Fast K-NN classification using the cluster-space approach. IEEE Geosci. Remote Sens. Lett. 2:2 (2005), 225–228, 10.1109/LGRS.2005.846437.