Image classification by a two-dimensional hidden Markov model

IEEE Transactions on Signal Processing

Volumn 48, Issue 2, 2000, Pages 517-533

  Li, Jia ^a   Najmi, Amir ^a   Gray, Robert M ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; MARKOV PROCESSES; MATHEMATICAL MODELS; PARAMETER ESTIMATION; STATISTICAL METHODS; VECTORS;

HIDDEN MARKOV MODEL (HMM); IMAGE CLASSIFICATION;

IMAGE PROCESSING;

EID: 0033882275     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.823977     Document Type: Article

References (52)

1. K. Abend, T. J. Harley, and E. N. Kanal, "Classification of binary random patterns," IEEE Trans. Inform. Theory, vol. IT-11, pp. 538-544, Oct. 1965.
2. J. K. Baker, "The dragon system-An overview," in Proc. Int. Conf. Acoust., Speech, Signal Process., Feb. 1975, pp. 24-29.
3. E. E. Baum, "An inequality and associated maximization technique in statistical estimation for probabilistic functions of finite state Markov chains," in Inequalities III. New York: Academic, 1972, pp. 1-8.
4. E. E. Baum and J. A. Eagon, "An inequality with applications to statistical estimation for probabilistic functions of Markov processes and to a model for ecology," Bull. Amer. Math. Stat., vol. 37, pp. 360-363, 1967.
5. E. E. Baum and T. Pétrie, "Statistical inference for probabilistic functions of finite state Markov chains," A. Math. Stat., vol. 37, pp. 1554-1563, 1966.
6. E. E. Baum, T. Pétrie, G. Soûles, and N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains," A. Math. Stat., vol. 41, no. 1, pp. 164-171, 1970.
7. J. Besag, "Spatial interaction and the statistical analysis of lattice systems (with discussion)," J. R. Stat. Soc., ser. B, vol. 34, pp. 75-83, 1972.
8. P. J. Bickel and K. A. Doksum, Mathematical Statistics: Basic Ideas and Selected Topics. Englewood Cliffs, NJ: Prentice-Hall, 1977.
9. J. M. Boyett, "Random RxC tables with given row and column totals," Appl. Stat., vol. 28, pp. 329-332, 1979.
10. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. London, U.K.: Chapman & Hall, 1984.
11. N. Chaddha, R. Sharma, A. Agrawal, and A. Gupta, "Text segmentation in mixed-mode images," in Proc. Asilomar Conf. Signals, Syst., Comput.. vol. 2, Nov. 1994, pp. 1356-1361.
12. R. Cole, L. Hirschman, L. Atlas, and M. Beckman et al, "The challenge of spoken language systems: Research directions for the nineties," IEEE Trans. Speech Audio Processing, vol. 3, pp. 1-21, Jan. 1995.
13. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc., vol. 39, no. l,pp. 1-21, 1977.
14. P. A. Devijver, "Probabilistic labeling in a hidden second order Markov mesh," Pattern Recognition in Practice II, pp. 113-123, 1985.
15. P. A. Devijver, "Segmentation of binary images using third order Markov mesh image models," in Proc. 8th Int. Conf. Pattern Recogn., Paris, France, Oct. 1986, pp. 259-261.
16. P. A. Devijver, "Modeling of digital images using hidden Markov mesh random fields," Signal Processing IV: Theories and Applications (Proc. EUSIPCO-88), pp. 23-28, 1988.
17. P. A. Devijver, "Real-time modeling of image sequences based on hidden Markov mesh random field models," in Proc. 10th Int. Conf. Pattern Recogn., vol. 2, Los Alamitos, CA, 1990, pp. 194-199.
18. P. A. Devijver and M. M. Dekesel, "Experiments with an adaptive hidden Markov mesh image model," Philips J. Res., vol. 43, no. 3/4, pp. 375-392, 1988.
19. C. H. Fosgate, H. Krim, W. W. Irving, W. C. Karl, and A. S. Willsky, "Multiscale segmentation and anomaly enhancement of SAR imagery," IEEE Trans. Image Processing, vol. 6, pp. 7-20, Jan. 1997.
20. R. G. Gallager, Information Theory and Reliable Communication. New York, NY: Wiley, 1968.
21. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell, vol. PAMI-6, pp. 721-741, Nov. 1984.
22. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, MA: Kluwer, 1992.
23. X. D. Huang, Y Ariki, and M. A. Jack, Hidden Markov Models for Speech Recognition. Edinburgh, U.K.: Edinburgh Univ. Press, 1990.
24. F. Jelinek and J. B. Anderson, "Instrumentable tree encoding of information sources," IEEE Trans. Inform. Theory, vol. IT-17, pp. 118-119, Jan. 1971.
25. L. N. Kanal, "Markov mesh models," in Image Modeling. New York: Academic, 1980, pp. 239-243.
26. NYR. Kindermann and J. L. Snell, Markov Random Fields and Their Applications. New York: Amer. Math. Soc., 1980.
27. T. Kohonen, G. Barna, and R. Chrisley, "Statistical pattern recognition with Neural Networks: Benchmarking studies," in Proc. IEEE Int. Conf. Neural Networks, July 1988, pp. I-61-I-68.
28. T. Kohonen, J. Hynninen, J. Kangas, J. Laaksonen, and K. Torkkola, "LVQ_PAK: The learning vector quantization program package (version 3.1)," Helsinki Univ. Technol., Lab. Comput. Inform. Sei., Helsinki, Finland, Tech. Rep., Apr. 1995. Available via anonymous ftp to cochlea.hut.fi.
29. S. S. Kuo and O. E. Agazzi, "Machine vision for keyword spotting using pseudo 2D hidden Markov models," in Proc. Int. Conf. Acoust., Speech Signal Process., vol. 5, 1993, pp. 81-84.
30. E. Levin and R. Pieraccini, "Dynamic planar warping for optical character recognition," in Proc. Int. Conf. Acoust., Speech Signal Process., vol. 3, San Francisco, CA, Mar. 1992, pp. 149-152.
31. J. Li and R. M. Gray, "Context based multiscale classification of images,"presented at the Int. Conf. Image Process..Chicago, IL, Oct. 1998.
32. "Text and picture segmentation by the distribution analysis of wavelet coefficients," presented at the Int. Conf. Image Processing, Chicago, IL, Oct. 1998.
33. A. A. Markov, "An example of statistical investigation in the text of 'Eugene Onyegin' illustrating coupling of 'tests' in chains," Proc. Acad. Sei., ser. 7, p. 153, 1913.
34. N. J. Nilsson, Learning Machines: Foundations of Trainable PatternClassifying Systems. New York: McGraw-Hill, 1965.
35. K. L. Oehler, "Image compression and classification using vector quantization," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1993.
36. K. L. Oehler and R. M. Gray, "Combining image classification and image compression using vector quantization," in Proc. Data Compression Conf., Snowbird, UT, Mar. 1993, pp. 2-11.
37. "Combining image compression and classification using vector quantization," IEEE Trans. Pattern Anal. Machine Intell., vol. 17, pp. 461-473, 1995.
38. S. Ohuchi, K. Imao, and W. Yamada, "Segmentation method for documents containing text/picture (screened halftone, continuous tone)," Trans. Inst. Electron., Inform., Commun. Eng. D-II, vol. J75D-II, no. 1, pp. 39-47, Jan. 1992.
39. M. Park and D. J. Miller, "Image decoding over noisy channels using minimum mean-squared estimation and a Markov mesh," in Proc. Int. Conf. Image Process., vol. 3, Santa Barbara, CA, Oct. 1997, pp. 594-597.
40. D. B. Paul, "Speech recognition using hidden Markov models," Lincoln Lab. ]., vol. 3, no. 1, pp. 41-62, 1990.
41. K. O. Perlmutter, "Compression and classification of images using vector quantization and decision trees," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1995.
42. K. O. Perlmutter, N. Chaddha, J. B. Buckheit, R. M. Gray, and R. A. Olshen, "Text segmentation in mixed-mode images using classification trees and transform tree-structured vector quantization," in Proc. Int. Conf. Acoust., Speech Signal Process., vol. 4, Atlanta, GA, May 1996, pp. 2231-2234.
43. K. O. Perlmutter, S. M. Perlmutter, R. M. Gray, R. A. Olshen, and K. L. Oehler, "Bayes risk weighted vector quantization with posterior estimation for image compression and classification," IEEE Trans. Image Processing, vol. 5, pp. 347-360, Feb. 1996.
44. D. K. Pickard, "A curious binary lattice process," J. Appl. Prob., vol. 14, pp. 717-731, 1977.
45. L. Rabiner and B. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
46. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, July 1948.
47. M. Stone, "Cross-validation: A review," Math. Oper. Statist., no. 9, pp. 127-139, 1978.
48. A. J. Viterbi and J. K. Omura, "Trellis encoding of memoryless discrete-time sources with a fidelity criterion," IEEE Trans. Inform. Theory, vol. IT-20, pp. 325-332, May 1974.
49. P. S. Williams and M. D. Alder, "Generic texture analysis applied to newspaper segmentation," in Proc. Int. Conf. Neural Networks, vol. 3, Washington, DC, June 1996, pp. 1664-1669.
50. C. F. J. Wu, "On the convergence properties of the EM algorithm," A. Stat., vol. 11, no. 1, pp. 95-103, 1983.
51. C. C. Yen and S. S. Kuo, "Degraded documents recognition using pseudo 2D hidden Markov models in Gray-scale images," Proc. SPIE, vol. 2277, pp. 180-191, 1994.
52. S. Young, J. Jansen, J. Odell, D. Ollason, and P. Woodland, HTK-Hidden Markov Model Toolkit. Cambridge, U.K.: Cambridge Univ. Press, 1995.