Bilayer Elastic Net Regression Model for Supervised Spectral-Spatial Hyperspectral Image Classification

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 9, Issue 9, 2016, Pages 4102-4116

  Soomro, Bushra Naz ^a   Xiao, Liang ^a   Huang, Lili ^b   Soomro, Shahzad Hyder ^a   Molaei, Mohsen ^a  

^a NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b GUANGXI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Alternating direction method of multiplier (ADMM); bilayer elastic net (ELN2); hyperspectral image (HSI) classification; maximum a posterior marginal (MPM); regularized multinomial logistic regression (RegMLR); spectralspatial analysis

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONSTRAINED OPTIMIZATION; LAGRANGE MULTIPLIERS; MARKOV PROCESSES; OPTIMIZATION; PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS; SPECTROSCOPY;

AUGMENTED LAGRANGIAN APPROACH; CLASSIFICATION ACCURACY; HYPERSPECTRAL IMAGE CLASSIFICATION; MARGINAL PROBABILITY; MULTINOMIAL LOGISTIC REGRESSION; POSTERIOR DISTRIBUTIONS; SPATIAL INFORMATIONS; VISUAL CLASSIFICATION;

IMAGE CLASSIFICATION;

ALGORITHM; IMAGE CLASSIFICATION; MARKOV CHAIN; NUMERICAL MODEL; PIXEL; REGRESSION ANALYSIS; SPATIAL ANALYSIS; SPECTRAL ANALYSIS;

EID: 84973573012     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2016.2559524     Document Type: Article

References (38)

1. G. Camps-Valls, D. Tuia, L. Bruzzone, and J. A. Benediktsson, "Advances in hyperspectral image classification: Earth monitoring with statistical learning methods," IEEE Signal Process. Mag., vol. 31, no. 1, pp. 45-54, Jan. 2013.
2. A. Plaza, J. A. Benediktsson, J. W. Boardman, J. Brazile, L. Bruzzone, G. Camps-Valls, J. Chanussot, M. Fauvel, P. Gamba, A. Gualtieri, M. Marconcini, J. C. Tilton, and G. Trianni, "Recent advances in techniques for hyperspectral image processing," Remote Sens. Environ., vol. 113, pp. S110-S122, Sep. 2009.
3. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," IEEE Trans. Geosci. Remote. Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
4. D. Bohning, "Multinomial logistic regression algorithm," Ann. Inst. Stat. Math., vol. 44, no. 1, pp. 197-200, Mar. 1992.
5. G. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Trans. Inf. Theory, vol. 14, no. 1, pp. 55-63, Jan. 1968.
6. D. Landgrebe, "Hyperspectral image data analysis as a high dimensional signal processing problems," IEEE Signal Process. Mag., vol. 19, no. 1, pp. 17-28, Jan. 2002.
7. P. Zhong and R. Wang, "Modeling and classifying hyperspectral imagery by CRFs with sparse higher order potentials," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 688-705, Feb. 2011.
8. J. Li and Y. Qian, "Regularized multinomial regression method for hyperspectral data classification via pathwise coordinate optimization," Dig. Image Comput.: Techn. Appl., Dec. 2009, pp. 540-545.
9. R. Tibshirani, "Regularization and variable selection with lasso," J. Roy. Statist. Soc. B, vol. B, no. 58, pp. 267-288, Jan. 1996.
10. J. S. Borges, A. R. Marcal, and J. M. Bioucas-Dias, "Evaluation of Bayesian hyperspectral image segmentation with a discriminative class learning," in Proc. IEEE Int. Geosci. Remote Sens. Symp., Barcelona, Spain, Jul. 2007, pp. 3810-3813.
11. B. Krishnapuram, L. Carin, M. A. Figueiredo, and A. J. Hartemink, "Sparse multinomial logistic regression: Fast algorithms and generalization bounds," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 957-968, Jun. 2005.
12. H. Zou and T. Hastie, "Regularization and variable selection via the Elastic Net," J. Roy. Stat. Soc. Ser. B Stat. Methodol., vol. 67, no. 2, pp. 301-320, Mar. 2005.
13. L. Wang, J. Zhu, and H. Zou, "The doubly regularized support vector machines," Statistica Sinica, vol. 16, no. 2, pp. 589-615, Mar. 2006.
14. P. Balamurugan, "Large-Scale elastic net regularized linear classification SVMs and logistic regression," in IEEE 13th Proc. Int. Conf. DataMining, Dallas, TX, pp. 949-954, Dec. 2013.
15. R. Tomioka, T. Suzuki, and M. Sugiyama, "Super-linear convergence of dual augmented Lagrangian algorithm for sparse learning," J. Mach. Learning Res., arXiv:0911.4046, pp. 1537-1586, May 2011.
16. Z. Hussain and J. Shawe-Taylor, "Metric learning analysis," PinView FP7-216529 Project Deliverable Report D3, 2010.
17. P. Balamurugan, S. Shevade, and T. R. Babu, "Sequential alternating proximal method for scalable sparse structural SVMs," in Proc. Int. Conf. Data Mining, 2012, vol. 61, no. 70, pp. 10-13.
18. J. H. Friedman, T. Hastie, and R. Tibshirani, "Regularization paths for generalized linear models via coordinate descent," J. Stat. Softw., vol. 33, no. 1, pp. 844-856, Jan. 2010.
19. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Spectral-spatial hyperspectral image segmentation using subspace multinomial logistic regression and Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 3, pp. 809-823, Mar. 2012.
20. J.W. Kelly, A.D. Degenhart, and D. P. Siewiorek, "Sparse linear regression with elastic net regularization for brain-computer interfaces," in Proc. 34th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2012, pp. 4275-4278.
21. M. A. T. Figueiredo, "Bayesian image segmentation using Gaussian field priors," in Proc. Energy Minimization Methods Comput. Vis. Pattern Recog., Nov. 2005, pp. 74-89.
22. L. Sun, Z. Wu, J. Liu, L. Xiao, and Z. Wei, "Supervised spectral-spatial hyperspectral image classification with weighted Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 3, pp. 1490-1503, Mar. 2015.
23. P. Ghamisi, J. A. Benediktsson, and M. O. Ulfarsson, "SpectralSpatial classification of hyperspectral images based on hidden markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 5, pp. 2565-2574, May 2014.
24. M. A. T. Figueiredo, "Bayesian image segmentation using wavelet-based priors," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Nov. 2005, pp. 437-443.
25. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Spectral-Spatial classification of hyperspectral data using loopy belief propagation and active learning," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 844-856, Feb. 2013.
26. Y. Boykov, O. Veksler, and R. Zabih, "Efficient approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 1, pp. 1222-1239, Nov. 2001.
27. Y. Chen and M. Welling, "Bayesian structure learning for Markov random fields with a spike and slab prior," in Proc. Uncertainty Artif. Intell., arXiv:1206.1088, pp. 174-184, 2012.
28. Y. Tarabalka, M. Fauvel, J. Chanussot, and J. A. Benediktsson, "SVM-and MRF-based method for accurate classification of hyperspectral images," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 736-740, Oct. 2010.
29. J. M. Bioucas-Dias and M. A. T. Figueiredo, "Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing," in Proc. Workshop Hyperspectral Image Signal Process.: Evolution Remote Sens., Jun. 14-16, 2010, pp. 1-4.
30. M. Afonso, J. Bioucas-Dias, and M. Figueiredo, "An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems," IEEE Trans. Image Process., vol. 20, no. 3, pp. 681-695, Mar. 2011.
31. M. D. Iordache, J. M. Bioucas-Dias, and A. Plaza, "Total variation spatial regularization for sparse hyperspectral unmixing," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 11, pp. 4484-4502, Nov. 2012.
32. Y. Wang, J. Yang, W. Yin, and Y. Zhang, "A new alternating minimization algorithm for total variation image reconstruction," SIAM J. Imag. Sci., vol. 1, no. 3, pp. 248-272, Aug. 2008.
33. J. M. Bioucas-Dias and M. Figueiredo, "Logistic regression via variable splitting and augmented lagrangian tools," Inst. Superior Tecnico, TULisbon, Lisbon, Portugal, 2009.
34. Y. Chen and N. M. Nasrabadi, "Hyperspectral image classification using dictionary-based sparse representation," IEEE Trans. Geosci. Remote. Sens., vol. 49, no. 10, pp. 3973-3985, Oct. 2011.
35. Y. Chen, N. M. Nasrabadi, and T. D. Tran, "Hyperspectral image classification via kernel sparse representation," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 1, pp. 217-237, Jan. 2013.
36. G. Camps-Valls, L. Gomez-Chova, J. Munoz-Mari, J. Vila-Frances, and J. Calpe-Maravilla, "Composite kernels for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 3, no. 1, pp. 93-97, Jan. 2006.
37. J. Li, P. R. Marpu, A. Plaza, J. M. Bioucas-Dias, and J. A. Benediktsson, "Generalized Composite Kernel Framework for Hyperspectral Image Classification," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 9, pp. 4816-4829, Sep. 2013.
38. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Hyperspectral image segmentation using a new Bayesian approach with active learning," IEEE Trans. Geosci. Remote Sens., vol. 49, pp. 3947-3960, 2011.