A sequence-based extension of mean-field annealing using the Forward/Backward algorithm application to image segmentation

IEEE Transactions on Signal Processing

Volumn 51, Issue 10, 2003, Pages 2692-2705

  Miller, David J ^a   Zhao, Qi ^a  

^a The Pennsylvania State University   (United States)

Author keywords

Deterministic annealing; Forward backward (F B) algorithm; Image segmentation; Markov random field; Mean field annealing

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE QUALITY; MARKOV PROCESSES; OPTIMIZATION; PROBABILITY DISTRIBUTIONS;

FORWARD-BACKWARD ALGORITHM; MARKOV RANDOM FIELD; MEAN-FIELD ANNEALING; SEQUENCE-BASED EXTENSION;

IMAGE SEGMENTATION;

EID: 0141954070     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2003.816770     Document Type: Article

References (37)

1. H. Choi and R. Baraniuk, "Multiscale image segmentation using wavelet-domain hidden Markov models," IEEE Trans. Image Processing, vol. 10, pp. 1309-1321, Sept. 2001.
2. L. E. Baum, T. Petrie, G. Soules, and N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains," Ann. Math. Statist., vol. 41, pp. 164-171, 1970.
3. J. Besag, "On the statistical analysis of dirty pictures," J. R. Statist. Soc. B., vol. 48, pp. 259-302, 1986.
4. G. L. Bilbro, W. E. Snyder, and R. C. Mann, "Mean-field approximation minimizes relative entropy," J. Opt. Soc. Amer., vol. 8, pp. 290-294, 1991.
5. C. Bouman and B. Liu, "Multiple resolution segmentation of textured images," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 99-113, Feb. 1991.
6. J. Buhmann and H. Kuhnel, "Vector quantization with complexity costs," IEEE Trans. Inform. Theory, vol. 39, pp. 1133-1145, Aug. 1993.
7. P. Bunyaratavej and D. J. Miller, "An iterative hillclimbing algorithm for discrete optimization on images: Application to joint encoding of image transform coefficients," IEEE Signal Processing Lett., vol. 9, pp. 46-50, Feb. 2002.
8. R. Chellappa and B. S. Manjunath, "Unsupervised texture segmentation using Markov random field models," IEEE Trans. Pattern Anal. Machne Intell., vol. 13, pp. 478-482, May 1991.
9. P. B. Chou and C. M. Brown, "The theory and practice of Bayesian image labeling," Int. J. Comput. Vision, vol. 4, pp. 185-210, 1990.
10. K. M. Chugg, C. Xiaopeng, A. Ortega, and C. Cheng-Wei, "An iterative algorithm for two-dimensional digital least metric problems with applications to digital image compression," in Proc. IEEE Int. Conf. Image Processing, vol. 2, 1998, pp. 722-726.
11. S. Lakshmanan and H. Derin, "Simultaneous parameter estimation and segmentation of Gibbs random fields using simulated annealing," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 799-813, Aug. 1989.
12. S. Emami and S. Miller, "DPCM picture transmission over noisy channels with the aid of a Markov model," IEEE Trans. Image Processing, vol. 4, pp. 1473-1479, Nov. 1995.
13. D. Geiger and F. Girosi, "Parallel and deterministic algorithms from MRF's: Surface reconstruction," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 401-412, May 1991.
14. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 721-741, June 1984.
15. T. Hofmann, J. Puzicha, and J. M. Buhmann, "Unsupervised texture segmentation in a deterministic annealing framework," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 803-818, Aug. 1998.
16. B. H. Juang and L. R. Rabiner, "Mixture autoregressive hidden Markov models for speech signals," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-33, pp. 1404-1412, June 1985.
17. S. Z. Li, Markov Random Field Modeling in Image Analysis. New York: Springer, 2001.
18. R. Kindermann and J. L. Snell, Markov Random Fields and Their Applications. Providence, RI: Amer. Math. Soc., 1980.
19. S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, "Optimization by simulated annealing," Science, vol. 220, pp. 671-680, 1983.
20. S. S. Kuo and O. E. Agazzi, "Keyword spotting in poorly printed texts using pseudo 2D hidden Markov models," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 842-848, Aug. 1994.
21. M. A. R. Leisink and H. J. Kappen, "Learning in higher order Boltzmann machines using linear response," Neural Networks, vol. 13, pp. 329-335, 2000.
22. R. Link and S. Kallel, "Markov model aided decoding for image transmission using soft decision feedback," IEEE Trans. Image Processing, vol. 9, pp. 190-196, Feb. 2000.
23. B. Martins and S. Forchhammer, "Lossless, near-lossless, and refinement coding of bilevel images," IEEE Trans. Image Processing, vol. 8, pp. 601-613, May 1999.
24. T. Meier and K. N. Ngan, "A flexible Bayesian framework for image segmentation," in Proc. IEEE Int. Conf. Image Processing, 1999, pp. 203-207.
25. R. Meir, "On deriving deterministic learning rules from stochastic system," Int. J. Neural Syst., vol. 2, pp. 283-289, 1992.
26. D. Miller, A. Rao, K. Rose, and A. Gersho, "A global optimization technique for statistical classifier design," IEEE Trans. Signal Processing, vol. 44, pp. 3108-3121, Dec. 1996.
27. R. A. Nobakht, S. H. Ardalan, and D. Van Den Bout, "Adaptive filtering of nonlinear systems with memory by quantized mean field annealing," IEEE Trans. Signal Processing, vol. 41, pp. 913-925, Feb. 1993.
28. T. N. Pappas, "An adaptive clustering algorithm for image segmentation," IEEE Trans. Signal Processing, vol. 40, pp. 901-914, Apr. 1992.
29. M. Park and D. J. Miller, "Improved image decoding over noisy channels using minimum mean-squared estimation and a Markov mesh," IEEE Trans. Image Processing, vol. 8, pp. 863-867, June 1999.
30. J. Puzicha, T. Hofmann, and J. M. Buhmann, "A theory of proximity based clustering: Structure detection by optimization," Pattern Recogn., vol. 33, pp. 617-634, 2000.
31. L. R. Rabiner and B. H. Juang, "An introduction to hidden Markov models," IEEE ASSP Mag., vol. 3, pp. 4-16, Jan. 1986.
32. K. Rose, E. Gurewitz, and G. C. Fox, "Vector quantization by deterministic annealing," IEEE Trans. Inform. Theory, vol. 38, pp. 1249-1258, July 1992.
33. G. Storvik and G. Dahl, "Lagrangian-based methods for finding MAP solutions for MRF models," IEEE Trans. Image Processing, vol. 9, pp. 469-479, Mar. 2000.
34. D. Van Den Bout and T. K. Miller, "Graph partitioning using annealed neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 192-203, Mar. 1990.
35. J. Vlontzos and S. Y. Kung, "Hidden Markov models for character recognition," IEEE Trans. Image Processing, vol. 4, pp. 539-543, July 1992.
36. A. L. Yuille, "Generalized deformable models, statistical physics, and matching problems," Neural Comput., vol. 2, pp. 1-24, 1990.
37. J. Zhang, "The mean field theory in EM procedures for Markov random fields," IEEE Trans. Signal Processing, vol. 40, pp. 2570-2583, Oct. 1992.