A multiscale expectation-maximization semisupervised classifier suitable for badly posed image classification

IEEE Transactions on Image Processing

Volumn 15, Issue 8, 2006, Pages 2208-2225

  Baraldi, Andrea ^a,c   Bruzzone, Lorenzo ^b   Blonda, Palma ^c  

^a JOINT RESEARCH CENTRE   (Italy)

^b UNIVERSITY OF TRENTO   (Italy)

^c INSTITUTE OF INTELLIGENT SYSTEMS FOR AUTOMATION   (Italy)

Author keywords

Badly posed image classification; Data clustering; Generalization capability; Image mapping; Inductive learning; Remotely sensed images; Semisupervised samples; Supervised learning; Texture information; Unsupervised learning

Indexed keywords

ALGORITHMS; IMAGE ANALYSIS; IMAGE QUALITY; LEARNING SYSTEMS; PATTERN RECOGNITION SYSTEMS; REMOTE SENSING;

DATA CLUSTERING; IMAGE CLASSIFICATION; IMAGE MAPPING; MULTISCALE SEMISUPERVISED EXPECTATION MAXIMIZATION (MSEM);

PATTERN RECOGNITION;

ALGORITHM; ARTICLE; ARTIFACT; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; SIGNAL PROCESSING; STATISTICAL MODEL;

ALGORITHMS; ARTIFACTS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER GRAPHICS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; LIKELIHOOD FUNCTIONS; MODELS, STATISTICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 33746256215     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2006.875220     Document Type: Article

References (65)

1. A. Mojsilovic, J. Kovacevic, J. Hu, R. Safranek, and S. K. Ganapathy, "Matching and retrieval based on the vocabulary and grammar of color patterns," IEEE Trans. Image Process., vol. 9, no. 1, pp. 38-54, Sep. 2000.
2. Q. Jackson and D. Landgrebe, "An adaptive classifier design for high-dimensional data analysis with a limited training data set," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 12, pp. 2664-2679, Dec. 2001.
3. C. Kervrann and F. Heitz, "A Markov random field model-based approach to unsupervised texture segmentation using local and global spatial statistics," IEEE Trans. Image Process., vol. 4, no. 6, pp. 856-862, Jun. 1995.
4. T. N. Pappas, "An adaptive clustering algorithm for image segmentation," IEEE Trans. Signal Process., vol. 3, no. 2, pp. 162-177, Feb. 1992.
5. L. Bruzzone and D. Fernández Prieto, "A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 2, pp. 1179-1184, Mar. 1999.
6. M. Sgrenzaroli, A. Baraldi, H. Eva, G. De Grandi, and F. Achard, "Contextual clustering for image labeling: An application to degraded forest assessment in Landsat TM images of the Brazilian Amazon," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 8, pp. 1833-1847, Aug. 2002.
7. G. Patanè and M. Russo, "The enhanced-LBG algorithm," Neural Netw., vol. 14, no. 9, pp. 1219-1237, 2001.
8. C. Liu and H. Wechsler, "A shape- and texture-based enhanced Fisher classifier for face recognition," IEEE Trans. Image Process., vol. 10, no. 4, pp. 598-608, Apr. 2001.
9. F. J. Cortijo and N. Perez de la Blanca, "Improving classical contextual classifications," Int. J. Remote Sens., vol. 19, no. 8, pp. 1591-1613, 1998.
10. J. T. Morgan, A. Henneguelle, J. Ham, J. Ghosh, and M. M. Crawford, "Adaptive feature spaces for land cover classification with limited ground truth," Int. J. Pattern Recognit. Artif. Intell., vol. 18, no. 5, pp. 777-799, 2004.
11. E. Binaghi, I. Gallo, and M. Pepe, "A cognitive pyramid for contextual classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 12, pp. 2906-2922, Dec. 2003.
12. P. Zamperoni, "Plus ça va, moins ça va," Pattern Recognit. Lett., vol. 17, no. 7, pp. 671-677, 1996.
13. R. C. Jain and T. O. Binford, "Ignorance, myopia and naivete' in computer vision systems," Comput. Vis., Graph., Image Process.: Image Understanding, vol. 53, pp. 112-117, 1991.
14. M. Kunt, "Comments on 'Dialogue,' a series of articles generated by the paper entitled 'Ignorance, myopia and naivete' in computer vision systems'," Comput. Vis., Graphics, Image Process.: Image Understanding, vol. 54, pp. 428-429, 1991.
15. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
16. V. Cherkassky and F. Mulier, Learning From Data: Concepts, Theory, and Methods. New York: Wiley, 1998.
17. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
18. R. Kothari and V. Jain, "Learning from labeled and unlabeled data using a minimal number of queries," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1496-1505, Nov. 2003.
19. R. G. Congalton and K. Green, Assessing the Accuracy of Remotely Sensed Data. Boca Raton, FL: Lewis, 1999.
20. M. P. Buchheim and T. M. Lillesand, "Semi-automated training field extraction and analysis for efficient digital image classification," Photogramm. Eng. Remote Sens., vol. 55, no. 9, pp. 1347-1355, 1989.
21. Q. Jackson and D. Landgrebe, "An adaptive method for combined covariance estimation and classification," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 5, pp. 1082-1087, May 2002.
22. Q. Jackson and D. A. Landgrebe, "Adaptive Bayesian contextual classification based on a Markov random field," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 11, pp. 2454-2463, Nov. 2002.
23. E. Backer and A. K. Jain, "A clustering performance measure based on fuzzy set decomposition," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-3, no. 1, pp. 66-75, Jan. 1981.
24. T. Lillesand and R. Kiefer, Remote Sensing and Image Interpretation, 3rd ed. New York: Wiley, 1994.
25. M. M. Durat and D. A. Landgrebe, "A cost-effective semisupervised classifier approach with kernels," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 1, pp. 264-270, Jan. 2004.
26. L. Bruzzone, F. Roli, and S. Serpico, "Structured neural networks for signal classification," Signal Process., vol. 64, pp. 271-290, 1998.
27. A. Baraldi, P. Blonda, F. Parmiggiani, and G. Satalino, "Contextual clustering for image segmentation," Opt. Eng., vol. 39, no. 4, pp. 1-17, Apr. 2000.
28. A. Baraldi, M. Sgrenzaroli, and P. Smits, "Contextual clustering with label backtracking in remotely sensed image applications," in Geospatial Pattern Recognit., E. Binaghi, P. Brivio, and S. Serpico, Eds. Kerala, India: Research Signpost/Transworld Research, Apr. 2002, in press.
29. T. Mitchell, Machine Learning. New York: McGraw-Hill, 1997.
30. M. J. Barnsley and S. L. Barr, "Inferring urban land use from satellite sensor images using kernel-based spatial reclassification," Photogramm. Eng. Remote Sens., vol. 62, no. 8, pp. 949-958, Aug. 1996.
31. M. Pesaresi and J. A. Benediktsson, "A new approach for the morphological segmentation of high-resolution satellite imagery," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 2, pp. 309-320, Feb. 2001.
32. I. Kanellopoulos and G. G. Wilkinson, "Strategies and best practice for neural network image classification," Int. J. Remote Sens., vol. 18, no. 4, pp. 711-725, 1997.
33. E. J. Kaminsky, H. Barad, and W. Brown, "Textural neural network and version space classifers for remote sensing," Int. J. Remote Sens., vol. 18, no. 4, pp. 741-762, 1997.
34. A. K. Jain and F. Farrokhnia, "Unsupervised texture segmentation using Gabor filters," Pattern Recognit., vol. 24, no. 12, pp. 1167-1186, 1991.
35. M. Ceccarelli and A. Petrosino, "Feature adaptive classifiers for SAR image segmentation," Neurocomputing, vol. 14, pp. 345-363, 1997.
36. N. Petkov, "Biologically motivated image classification system," in Real-Time Imaging, P. A. Laplante and A. D. Stoyenko, Eds. New York: IEEE Press, 1996, pp. 195-223.
37. L. Bruzzone and D. Fernández Prieto, "A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 2, pp. 1179-1184, Feb. 1999.
38. L. Bruzzone, D. Fernández Prieto, and S. B. Serpico, "A neural-statistical approach to multitemporal and multisource remote-sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1350-1359, Mar. 1999.
39. P. Burt and E. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-31, no. 4, pp. 532-540, Apr. 1983.
40. G. Strang and T. Nguyen, Wavelets and Filter Banks. Wellesley MA: Wellesley-Cambridge, 1997.
41. J. S. De Bonet, "Novel Statistical Multiresolution Techniques for Imgage Synthesis, Discrimination, and Recognition," Ph.D. dissertation, MIT, Cambridge, MA, 1997.
42. "ENVI User's Guide," Research Systems, Inc., 2003.
43. R. Haralick and L. Shapiro, "Survey of image segmentation techniques," Comput. Vis., Graph., Image Process., vol. 29, pp. 100-132, 1985.
44. Y. Jhung and P. H. Swain, "Bayesian contextual classification based on modified M-estimates and Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 34, no. 1, pp. 67-75, Jan. 1996.
45. S. Krishnamachari and R. Chellappa, "Multiresolution Gauss-Markov random filed models for texture segmentation," IEEE Trans. Image Process., vol. 6, no. 2, pp. 251-267, Feb. 1997.
46. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, no. 6, pp. 721-741, Jun. 1984.
47. J. Besag, "On the statistical analysis of dirty pictures," J. Roy. Statist. Soc. B, vol. 48, no. 3, pp. 259-302, 1986.
48. M. Walessa and M. Datcu, "Model-based despeckling and information extraction from SAR images," IEEE Trans. Geosci. Remote Sens., vol. 38, no. 5, pp. 2258-2269, Sep. 2000.
49. R. Krishnapuram and J. M. Keller, "A possibilistic approach to clustering," IEEE Trans. Fuzzy Syst., vol. 1, no. 2, pp. 98-110, Apr. 1993.
50. A. Baraldi and P. Blonda, "A survey on fuzzy neural networks for pattern recognition: Part I," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 29, no. 6, pp. 778-785, Dec. 1999.
51. A. Baraldi and P. Blonda, "A survey on fuzzy neural networks for pattern recognition: Part II," IIEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 29, no. 6, pp. 786-801, Dec. 1999.
52. R. N. Davè and R. Krishnapuram, "Robust clustering method: A unified view," IEEE Trans. Fuzzy Syst., vol. 5, no. 2, pp. 270-293, 1997.
53. A. H. Schistad Solberg, T. Taxt, and A. K. Jain, "A Markov random field model for classification of multisource satellite imagery," IEEE Trans. Geosci. Remote Sens., vol. 34, no. 1, pp. 100-113, Jan. 1996.
54. L. Delves, R. Wilkinson, C. Oliver, and R. White, "Comparing the performance of SAR image segmentation algorithms," Int. J. Remote Sens., vol. 13, no. 11, pp. 2121-2149, 1992.
55. L. Prechelt, "A quantitative study of experimental evaluations of neural network learning algorithms: Current research practice," Neural Netw., vol. 9, no. 3, pp. 457-462, 1996.
56. P. Lukowicz, E. Heinz, L. Prechelt, and W. Tichy, Experimental Evaluation in Computer Science: A Quantitative Study Univ. Karlsruhe, Karlsruhe, Germany, Tech. Rep. 17/94, 1994.
57. A. K. Jain, R. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000.
58. M. R. Spiegel, Statistics. New York: McGraw Hill, 1961.
59. A. Baraldi, L. Bruzzone, and P. Blonda, "Quality assessment of classification and cluster maps without ground truth knowledge," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 4, pp. 857-873, Apr. 2005.
60. R. Kohavi, "A study of cross-validation and bootstrap for accuracy estimation and model selection," in Int. Joint Conf. Artific. Intell., 1995 Online. Available: http://www.robotics.stanford.edu/users/ronnyk/ronnyk-bib.html
61. [Online]. Available: http://www.dfc-grss.org
62. P. H. Swain and S. M. Davis, Remote Sensing: The Quantitative Approach. New York: McGraw-Hill, 1978.
63. D. Specht, "Probabilistic neural networks," Neural Netw., vol. 3, pp. 109-118, 1990.
64. E. Rignot and R. Chellappa, "Segmentation of polarimetric synthetic aperture radar data," IEEE Trans. Image Process., vol. 1, no. 3, pp. 281-300, Mar. 1992.
65. J. C. Bezdek, T. R. Reichherzer, G. S. Lim, and Y. Attikiouzel, "Multiple-prototype classifier design," IEEE Trans. Syst., Man, Cybern. C Appl. Rev., vol. 28, no. 1, pp. 67-79, Feb. 1998.