Learning a Discriminative Distance Metric With Label Consistency for Scene Classification

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 8, 2017, Pages 4427-4440

  Wang, Yuebin ^a   Zhang, Liqiang ^a   Deng, Hao ^b   Lu, Jiwen ^c   Huang, Haiyang ^a   Zhang, Liang ^a   Liu, Jun ^a   Tang, Hong ^a   Xing, Xiaoyue ^a  

^a BEIJING NORMAL UNIVERSITY   (China)

^b CENTRAL SOUTH UNIVERSITY   (China)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

Distance metric learning (DML); high spatial resolution (HSR); label consistency (LC); optimization; scene classification

Indexed keywords

CONSTRAINED OPTIMIZATION; IMAGE RECONSTRUCTION; LEARNING SYSTEMS; REMOTE SENSING;

DISTANCE METRIC LEARNING; FEATURE TRANSFORMATIONS; HIGH SPATIAL RESOLUTION; LABEL DISTRIBUTION; REMOTE SENSING IMAGES; SCALE INVARIANT FEATURE TRANSFORMATIONS; SCENE CLASSIFICATION; STATE-OF-THE-ART TECHNIQUES;

CLASSIFICATION (OF INFORMATION);

ACCURACY ASSESSMENT; IMAGE CLASSIFICATION; IMAGE RESOLUTION; LEARNING; OPTIMIZATION; PERFORMANCE ASSESSMENT; REMOTE SENSING; SPATIAL RESOLUTION;

EID: 85019936471     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2692280     Document Type: Article

References (59)

1. M. Fauvel, Y. Tarabalka, J. A. Benediktsson, J. Chanussot, and J. C. Tilton, "Advances in spectral-spatial classification of hyperspectral images," Proc. IEEE, vol. 101, no. 3, pp. 652-675, Mar. 2013.
2. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Semisupervised hyperspectral image segmentation using multinomial logistic regression with active learning," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 4085-4098, Nov. 2010.
3. L. Gómez-Chova, D. Tuia, G. Moser, and G. Camps-Valls, "Multimodal classification of remote sensing images: A review and future directions," Proc. IEEE, vol. 103, no. 9, pp. 1560-1584, Sep. 2015.
4. J. A. Benediktsson, J. Chanussot, and W. M. Moon, "Very highresolution remote sensing: Challenges and opportunities [point of view]," Proc. IEEE, vol. 100, no. 6, pp. 1907-1910, Jun. 2012.
5. O. Boiman, E. Shechtman, and M. Irani, "In defense of nearest-neighbor based image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
6. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2005, pp. 886-893.
7. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
8. Z. Wang, J. Feng, S. Yan, and H. Xi, "Linear distance coding for image classification," IEEE Trans. Image Process., vol. 22, no. 2, pp. 537-548, Feb. 2013.
9. R. Behmo, P. Marcombes, A. Dalalyan, and V. Prinet, "Towards optimal naive Bayes nearest neighbor," in Proc. Eur. Conf. Comput. Vis., vol. 4. Sep. 2010, pp. 171-184.
10. Z. Wang, Y. Hu, and L.-T. Chia, "Image-to-class distance metric learning for image classification," in Proc. Eur. Conf. Comput. Vis., vol. 1. Sep. 2010, pp. 706-719.
11. A. Globerson and S. Roweis, "Metric learning by collapsing classes," in Advances in Neural Information Processing Systems, vol. 18, Y. Weiss, P. B. Schölkopf, and J. C. Platt, Eds. Cambridge, MA, USA: MIT Press, 2006, pp. 451-458.
12. N. Shental, T. Hertz, D. Weinshall, and M. Pavel, "Adjustment learning and relevant component analysis," in Computer Vision (Lecture Notes in Computer Science). Berlin, Germany: Springer, 2002, pp. 776-792.
13. S. Shalev-Shwartz, Y. Singer, and A. Y. Ng, "Online and batch learning of pseudo-metrics," in Proc. 21st Int. Conf. Mach. Learn., Banff, AB, Canada, 2004, pp. 94-101.
14. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell, "Distance metric learning with application to clustering with side-information," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 521-528.
15. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. Hoboken, NJ, USA: Wiley, 2000.
16. L. Yang and R. Jin, "Distance metric learning: A comprehensive survey," Dept. Comput. Sci. Eng., Michigan State Univ., East Lansing, MI, USA, Tech. Rep. 06-38, 2006.
17. K. Q. Weinberger, F. Sha, and L. K. Saul, "Convex optimizations for distance metric learning and pattern classification [applications corner]," IEEE Signal Process. Mag., vol. 27, no. 3, pp. 146-158, May 2010.
18. I. T. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer-Verlag, 1989.
19. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
20. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
21. D. L. Donoho and C. Grimes, "Hessian Eigenmaps: New locally linear embedding techniques for high-dimensional data," Dept. Statist., Stanford Univ., Stanford, CA, USA, Tech. Rep. 2003-08, 2003.
22. J. Yu, Y. Rui, Y. Y. Tang, and D. Tao, "High-order distance-based multiview stochastic learning in image classification," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2431-2442, Dec. 2014.
23. F. Wang, W. Zuo, L. Zhang, D. Meng, and D. Zhang, "A kernel classification framework for metric learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 9, pp. 1950-1962, Sep. 2015.
24. Y. Luo, T. Liu, D. Tao, and C. Xu, "Decomposition-based transfer distance metric learning for image classification," IEEE Trans. Image Process., vol. 23, no. 9, pp. 3789-3801, Sep. 2014.
25. J. Yu, M. Wang, and D. Tao, "Semisupervised multiview distance metric learning for cartoon synthesis," IEEE Trans. Image Process., vol. 21, no. 11, pp. 4636-4648, Nov. 2012.
26. L. Zhang, L. Zhang, D. Tao, X. Huang, and B. Du, "Hyperspectral remote sensing image subpixel target detection based on supervised metric learning," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 8, pp. 4955-4965, Aug. 2014.
27. J. Hu, J. Lu, and Y.-P. Tan, "Deep transfer metric learning," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2015, pp. 325-333.
28. Y. Gu and K. Feng, "Optimized Laplacian SVM with distance metric learning for hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 3, pp. 1109-1117, Jun. 2013.
29. J. Yu, D. Tao, J. Li, and J. Cheng, "Semantic preserving distance metric learning and applications," Inf. Sci., vol. 281, pp. 674-686, Oct. 2014.
30. T. Mensink, J. Verbeek, F. Perronnin, and G. Csurka, "Distance-based image classification: Generalizing to new classes at near-zero cost," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2624-2637, Nov. 2013.
31. Y. Yang and S. Newsam, "Bag-of-visual-words and spatial extensions for land-use classification," in Proc. ACM Int. Conf. Adv. Geogr. Inf. Syst., 2010, pp. 270-279.
32. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., vol. 2. 2006, pp. 2169-2178.
33. Y. Yang and S. Newsam, "Spatial pyramid co-occurrence for image classification," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1465-1472.
34. A. M. Cheriyadat, "Unsupervised feature learning for aerial scene classification," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 439-451, Jan. 2014.
35. F. Zhang, B. Du, and L. Zhang, "Saliency-guided unsupervised feature learning for scene classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2175-2184, Apr. 2015.
36. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1794-1801.
37. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Advances in Neural Information Processing Systems, vol. 16. Cambridge, MA, USA: MIT Press, 2003.
38. C. K. I. Williams and M. Seeger, "Using the Nyström method to speed up kernel machines," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2001, pp. 682-688.
39. S. P. Lloyd, "Least squares quantization in PCM," IEEE Trans. Inf. Theory, vol. 28, no. 2, pp. 129-137, Mar. 1982.
40. J. Li, X. Lin, X. Rui, Y. Rui, and D. Tao, "A distributed approach toward discriminative distance metric learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 9, pp. 2111-2122, Sep. 2015.
41. L. Zhang, Y. Zhong, B. Huang, J. Gong, and P. Li, "Dimensionality reduction based on clonal selection for hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 12, pp. 4172-4186, Dec. 2007.
42. E. Pasolli, H. L. Yang, and M. M. Crawford, "Active-metric learning for classification of remotely sensed hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 4, pp. 1925-1939, Apr. 2016.
43. Y. Yang and S. Newsam, "Geographic image retrieval using local invariant features," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 818-832, Feb. 2013.
44. E. Aptoula, "Remote sensing image retrieval with global morphological texture descriptors," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 5, pp. 3023-3034, May 2014.
45. X. Li, Y. Zhang, X. Liu, and Y. Chen, "Assimilating process context information of cellular automata into change detection for monitoring land use changes," Int. J. Geogr. Inf. Sci., vol. 26, no. 9, pp. 1667-1687, Sep. 2012.
46. X. He and P. Niyogi, "Locality preserving projections," in Advances in Neural Information Processing Systems, vol. 16. Cambridge, MA, USA: MIT Press, 2004, p. 153.
47. W. Yang, X. Yin, and G. S. Xia, "Learning high-level features for satellite image classification with limited labeled samples," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 8, pp. 4472-4482, Aug. 2015.
48. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Proc. Adv. Neural Inf. Process. Syst., 2007, pp. 801-808.
49. Y. Wang et al., "A three-layered graph-based learning approach for remote sensing image retrieval," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 10, pp. 6020-6034, Oct. 2016.
50. Q. V. Le, A. Karpenko, J. Ngiam, and A. Y. Ng, "ICA with reconstruction cost for efficient overcomplete feature learning," in Proc. NIPS, 2011, pp. 1017-1025.
51. G.-S. Xia, W. Yang, J. Delon, Y. Gousseau, H. Sun, and H. Maître, "Structural high-resolution satellite image indexing," in Proc. ISPRS TC 7th Symp.-100 Years, vol. 38. 2010, pp. 298-303.
52. D. Dai and W. Yang, "Satellite image classification via two-layer sparse coding with biased image representation," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 1, pp. 173-176, Jan. 2011.
53. F. Nie, D. Xu, I. W. Tsang, and C. Zhang, "Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction," IEEE Trans. Image Process., vol. 19, no. 7, pp. 1921-1932, Jul. 2010.
54. X. Fang, Y. Xu, X. Li, Z. Lai, and W. K. Wong, "Learning a nonnegative sparse graph for linear regression," IEEE Trans. Image Process., vol. 24, no. 9, pp. 2760-2771, Sep. 2015.
55. V. Sindhwani, P. Niyogi, M. Belkin, and S. Keerthi, "Linear manifold regularization for large scale semi-supervised learning," in Proc. ICML Workshop Learn. Partially Classified Training Data, 2005, pp. 1-4.
56. Z. Ma, F. Nie, Y. Yang, J. R. R. Uijlings, N. Sebe, and A. G. Hauptmann, "Discriminating joint feature analysis for multimedia data understanding," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1662-1672, Dec. 2012.
57. D. Cai, X. He, and J. Han, "Semi-supervised discriminant analysis," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-7.
58. G. Camps-Valls, T. V. B. Marsheva, and D. Zhou, "Semi-supervised graph-based hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3044-3054, Oct. 2007.
59. B. Yang, Z. Dong, Y. Liu, F. Liang, and Y. Wang, "Computing multiple aggregation levels and contextual features for road facilities recognition using mobile laser scanning data," ISPRS J. Photogramm. Remote Sens., vol. 126, pp. 180-194, Apr. 2017.