Incremental and decremental affinity propagation for semisupervised clustering in multispectral images

IEEE Transactions on Geoscience and Remote Sensing

Volumn 51, Issue 3, 2013, Pages 1666-1679

  Yang, Chen ^a   Bruzzone, Lorenzo ^b   Guan, Renchu ^a   Lu, Laijun ^a   Liang, Yanchun ^a  

^a JILIN UNIVERSITY   (China)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

Affinity propagation (AP); decremental learning; incremental learning; multispectral images; semisupervised clustering

Indexed keywords

AFFINITY PROPAGATION; DECREMENTAL LEARNING; INCREMENTAL LEARNING; MULTISPECTRAL IMAGES; SEMI-SUPERVISED CLUSTERING;

DATA REDUCTION; IMAGE RECONSTRUCTION;

CLUSTERING ALGORITHMS;

ACCURACY ASSESSMENT; ALGORITHM; CLUSTER ANALYSIS; DATA ACQUISITION; IDENTIFICATION METHOD; LAND COVER; MULTISPECTRAL IMAGE; REMOTE SENSING; SATELLITE DATA; SPECTRAL ANALYSIS; STABILIZATION;

EID: 84874655017     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2012.2206818     Document Type: Article

References (55)

1. T. Celik, "Unsupervised change detection in satellite images using principal component analysis and K-means clustering," IEEE Trans. Geosci. Remote Sens. Lett., vol. 6, no. 4, pp. 772-776, Oct. 2009.
2. J. Fan, M. Han, and J. Wang, "Single point iterative weighted fuzzy C-means clustering algorithm for remote sensing image segmentation," Pattern Recognit., vol. 42, no. 11, pp. 2527-2540, Nov. 2009.
3. T. S. Korting, L. V. Dutra, L. M. G. Fonseca, and G. J. Erthal, "Assessment of a modified version of the EM algorithm for remote sensing data classification," in Proc. 15th CIARP, Sao Paulo, Brazil, 2010, pp. 476-483.
4. B. J. Frey and D. Dueck, "Clustering by passing messages between data points," Science, vol. 315, no. 5814, pp. 972-976, Jan. 2007. (Pubitemid 46281181)
5. B. J. Frey and D. Dueck, "Mixture modeling by affinity propagation," in Advances in Neural Information Processing Systems, vol. 18. Cambridge, MA: MIT Press, 2006.
6. B. J. Frey and D. Dueck, "Response to comment on 'Clustering by passing messages between data points'," Science, vol. 319, no. 5864, p. 726d, Feb. 2008. (Pubitemid 351225877)
7. R. Guan, X. Shi, M. Marchese, C. Yang, and Y. Liang, "Text clustering with seeds affinity propagation," IEEE Trans. Knowl. Data Eng., vol. 23, no. 4, pp. 627-637, Apr. 2011.
8. C. Yang, L. Bruzzone, F. Sun, L. Lu, R. Guan, and Y. Liang, "A fuzzy-statistics-based affinity propagation technique for clustering in multi-spectral images," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 6, pp. 2647-2659, Jun. 2010.
9. J. B. Campbell, Introduction to Remote Sensing, 4th ed. London, U.K.: Taylor & Francis.
10. G. Jun and J. Ghosh, "An efficient active learning algorithm with knowledge transfer for hyperspectral data analysis," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2008, pp. 52-55.
11. O. Chapelle, B. Schoelkopf, and A. Zien, Semi-Supervised Learning. Cambridge, MA: MIT Press, 2006.
12. N. Grira, M. Crucianu, and N. Boujemaa, "Unsupervised and semi-supervised clustering: A brief survey," in Proc. 6th MUSCLE, 2005, pp. 1-12.
13. X. Zhu, "Semi-supervised learning literature survey," Madison Dept. Comput. Sci., Univ. Wisconsin, Madison, WI, TR-1530, 2005.
14. L. Gomez-Chova, L. Bruzzone, G. Camps-Valls, and J. Calpe-Maravilla, "Semi-supervised remote sensing image classification based on clustering and the mean map kernel," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2008, pp. 391-394.
15. X. Zhang, T. Wang, L. Jiao, and C. Yang, "Semi-supervised segmentation of multispectral remote sensing image based on spectral clustering," in Proc. MIPPR, Yichang, China, 2009, pp. 74941F-1-74941F-6.
16. M. Torres, M. Moreno, R. M. Mendez, R. Quintero, and G. Guzman, "Semantic supervised clustering approach to classify land cover in remotely sensed images," Signal Processing Multimedia, vol. 123, pp. 68-77, 2010.
17. L. Bruzzone, M. Chi, and M. Marconcini, "A novel transductive SVM for semisupervised classification of remote-sensing images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 11, pp. 3363-3373, Nov. 2006.
18. M. Chi and L. Bruzzone, "Semi-supervised classification of hyperspectral images by SVMs optimized in the primal," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 6, pp. 1870-1880, Jun. 2007. (Pubitemid 46853295)
19. L. Bruzzone, M. Chi, and M. Marconcini, "Semisupervised support vector machines for classification of hyperspectral remote sensing images," in Hyperspectral Data Exploitation: Theory and Applications, C.-I. Chang, Ed. New York: Wiley, 2007, ch. 11, pp. 275-311.
20. M. Marconcini, G. Camps-Valls, and L. Bruzzone, "A composite semisupervised SVM for classification of hyperspectral images," IEEE Trans. Geosci. Remote Sens. Lett., vol. 6, no. 2, pp. 234-238, Apr. 2009.
21. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. 11th Conf. Comput. Learn. Theory, 1998, pp. 92-100.
22. F. G. Cozman, I. Cohen, and M. C. Cirelo, "Semi-supervised learning of mixture models and Bayesian networks," in Proc. 20th Int. Conf. Mach. Learn., 2003, pp. 1-9.
23. S. Basu, Semi-Supervised Clustering: Learning With Limited User Feedback. Austin, TX: Univ. Texas, 2003.
24. R. Polikar, L. Udpa, L. S. Udpa, and V. Honavar, "Learn++: An incremental learning algorithm for supervised neural networks," IEEE Trans. Syst., Man Cybern. C, Appl. Rev., vol. 31, no. 4, pp. 497-508, Nov. 2001. (Pubitemid 34191829)
25. P. J. Moreno and S. Agarwal, "An experimental study of EM-based algorithms for semi-supervised learning in audio classification," in Proc. ICML, Washington, DC, 2003, pp. 1-7.
26. C. Rosenberg, M. Hebert, and H. Schneiderman, "Semi-supervised self-training of object detection models," in Proc. 7th IEEE Workshop Appl. Comput. Vis., Washington, DC, 2005, pp. 29-36.
27. R. Zhang and A. I. Rudnicky, "A new data selection principle for semi-supervised incremental learning," in Proc. 18th Int. Conf. Pattern Recog., 2006, pp. 780-783. (Pubitemid 46532315)
28. S. Grossberg, "Nonlinear neural networks: Principles, mechanisms and architectures," Neural Netw., vol. 1, no. 1, pp. 17-61, 1988.
29. F. Kschischang, B. J. Frey, and H. A. Loeliger, "Factor graphs and the sum-product algorithm," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 498-519, Feb. 2001. (Pubitemid 32318087)
30. I. Givoni and B. J. Frey, "A binary variable model for affinity propagation," Neural Comput., vol. 21, no. 6, pp. 1589-1600, Jun. 2009.
31. N. Nguyen and R. Caruana, "Classification with partial labels," in Proc. 14th ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., 2008, pp. 551-559.
32. K. Wagsta and C. Cardie, "Clustering with instance-level constraints," in Proc. 17th Int. Conf. Mach. Learn., 2000, pp. 1103-1110.
33. I. E. Givoni and B. J. Frey, "Semi-supervised affinity propagation with instance-level constraints," in Proc. 12th Int. Conf. AISTATS, 2009, pp. 161-168.
34. K. Wagstaff, C. Cardie, S. Rogers, and S. Schrödl, "Constrained k-means clustering with background knowledge," in Proc. 18th Int. Conf. Mach. Learn., 2001, pp. 577-584.
35. S. Basu, A. Banerjee, and R. Mooney, "Semi-supervised clustering by seeding," in Proc. 19th Int. Conf. Mach. Learn., 2002, pp. 27-34.
36. M. Bilenko, S. Basu, and R. J. Mooney, "Integrating constraints and metric learning in semi-supervised clustering," in Proc. 21st Int. Conf. Mach. Learn, 2004, pp. 1-11.
37. A. Globerson and S. Roweis, "Metric learning by collapsing classes," in Advance in Neural Information Processing System, vol. 18, Y. Weiss, B. Schölkopf, and J. Platt, Eds. Cambridge, MA: MIT Press, 2006, pp. 451-458.
38. A. Ghodsi, D. F. Wilkinson, and F. Southey, "Improving embeddings by flexible exploitation of side information," in Proc. Int. Conf. Artif. Intell., M. M. Veloso, Ed., 2007, pp. 810-816.
39. P. Jantke, "Type of incremental learning," in Proc. AAAI Symp. Training Issues Incremental Learn., 1993, pp. 23-25.
40. Q. Liu, X. Liao, and L. Carin, "Detection of unexploded ordnance via efficient semisupervised and active learning," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 9, pp. 2558-2567, Sep. 2008.
41. S. Patra and L. Bruzzone, "A fast cluster-assumption based active-learning technique for classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 5, pp. 1617-1626, May 2011.
42. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Hyperspectral image segmentation using a new Bayesian approach with active learning," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 10, pp. 3947-3960, Oct. 2011.
43. J. Zhou, L. Cheng, and W. F. Bischof, "Online learning with novelty detection in human-guided road tracking," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 12, pp. 3967-3977, Dec. 2007. (Pubitemid 350157833)
44. W. M. Shen, Efficient Incremental Induction of Decision Lists. Can Incremental Learning Outperform Non-Incremental Learning? 1996.
45. F. R. Shen, O. Tomotaka, and H. Osamu, "An enhanced self-organizing incremental neural network for online unsupervised learning," Neural Netw., vol. 20, no. 8, pp. 893-903, Oct. 2007.
46. X. S. Deng and X. Z. Wang, "Incremental learning of dynamic fuzzy neural networks for accurate system modeling," Fuzzy Sets Syst., vol. 160, no. 7, pp. 972-987, Apr. 2009.
47. L. Zou, T. Zhang, and Z. Cao, "An incremental learning algorithm based on support vector machine for pattern recognition," in Proc. SPIE, 2009, vol. 7496, pp. 74961H-1-74961H-8.
48. Z. Z. Liang and Y. F. Li, "Incremental support vector machine learning in the primal and applications," Neurocomputing, vol. 72, no. 10-12, pp. 2249-2258, Jun. 2009.
49. M. N. Kurnaz, Z. Dokur, and T. Ölmez, "Segmentation of remote-sensing images by incremental neural network," Pattern Recognit. Lett., vol. 26, no. 8, pp. 1096-1104, Jun. 2005. (Pubitemid 40556478)
50. G. Cauwenberghs and T. Poggio, "Incremental and decremental support vector machine learning," in Advance in Neural Information Processing System, vol. 13. Cambridge, MA: MIT Press, 2001.
51. D. M. J. Tax and P. Laskov, "Online SVM learning: From classification to data description and back," in Proc. IEEE Workshop Neural Netw. Signal Process., Toulouse, France, 2003, pp. 499-508.
52. A. Tsymbal, "The problem of concept drift: Definitions and related work," Dept. Comput. Sci., Trinity College, Dublin, Ireland, Tech. Rep. TCD-CS-2004-15, 2004.
53. B. Raducanu and J. Vitrià, "Face recognition by artificial vision systems: A cognitive perspective," Int. J. Pattern Recognit. Artif. Intell., vol. 22, no. 5, pp. 899-913, 2008.
54. G. M. Foody, "Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy," Photogramm. Eng. Remote Sens., vol. 70, no. 5, pp. 627-633, 2004. (Pubitemid 39081774)
55. W. H. Wang, H. W. Zhang, F. Wu, and Y. T. Zhuang, "Large scale of e-learning resources clustering with parallel affinity propagation," in Proc. Int. Conf. Hybrid Learn., Aug. 2008, pp. 1-10.