Stochastic approximation algorithms for partition function estimation of Gibbs random fields

IEEE Transactions on Information Theory

Volumn 43, Issue 6, 1997, Pages 1948-1965

  Potamianos, Gerasimos ^a,b   Goutsias, John ^a,c  

^a IEEE   (United States)

^b AT AND T LABS RESEARCH   (United States)

^c Johns Hopkins University   (United States)

Author keywords

Computational complexity; Gibbs random fields; Importance sampling; Monte Carlo simulations; Partition function estimation; Stochastic approximation

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; FUNCTIONS; MONTE CARLO METHODS; POLYNOMIALS; RANDOM PROCESSES;

GIBBS RANDOM FIELDS (GRF); PARTITION FUNCTION ESTIMATION;

INFORMATION THEORY;

EID: 0031269904     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.641558     Document Type: Article

References (28)

1. J. Besag, "Spatial interaction and the statistical analysis of lattice systems (with discussion)," J. Roy. Statist. Soc., Ser. B, vol. 36, pp. 192-236, 1974.
2. R. Kindermann and J. L. Snell, Markov Random Fields and Their Applications, vol. 1 of Contemporary Mathematics. Providence, RI: Amer. Math. Soc., 1980.
3. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 721-741, 1984.
4. R. J. Baxter, Exactly Solved Models in Statistical Mechanics. London, England: Academic, 1982.
5. J. Besag, "Statistical analysis of non-lattice data," Statistician, vol. 24, pp. 179-195, 1975.
6. L. Younes, "Estimation and annealing for Gibbsian fields," Ann. Inst. Henri Poincaré, vol. 24, pp. 269-294, 1988.
7. _, "Parametric inference for imperfectly observed Gibbsian fields," Prob. Theory Related Fields, vol. 82, pp. 625-645, 1989.
8. Y. Ogata, "A Monte Carlo method for an objective Bayesian procedure," Ann. Inst. Statist. Math., vol. 42, pp. 403-433, 1990.
9. G. Potamianos, "Stochastic simulation algorithms for partition function estimation of Markov random field images," Ph.D. dissertation, The Johns Hopkins Univ., Dept. Elec. Comput. Eng., Baltimore, MD, 1994.
10. Y. Ogata and M. Tanemura, "Estimation of interaction potentials of spatial point patterns through the maximum likelihood procedure," Ann. Inst. Statist. Math., vol. 33, pp. 315-338, 1981.
11. _, "Likelihood analysis of spatial point patterns," J. Roy. Statist. Soc., Ser. B, vol. 46, pp. 496-518, 1984.
12. _, "Likelihood estimation of soft-core interaction potentials for Gibbsian point patterns," Ann. Inst. Statist. Math., vol. 41, pp. 583-600, 1989.
13. A. Penttinen, "Modelling interactions in spatial point patterns: Parameter estimation by the maximum likelihood method," Jyväskylä Studies in Comput. Sci., Economics and Statist., vol. 7, pp. 1-107, 1984.
14. G. G. Potamianos and J. K. Goutsias, "Partition function estimation of Gibbs random field images using Monte Carlo simulations," IEEE Trans. Inform. Theory, vol. 39, pp. 1322-1332, 1993.
15. M. Jerrum and A. Sinclair, "Polynomial-time approximation algorithms for the Ising model," SIAM J. Comput., vol. 22, pp. 1087-1116, 1993.
16. J. K. Goutsias, "Mutually compatible Gibbs random fields," IEEE Trans, Inform, Theory, vol. 35, pp. 1233-1249, 1989.
17. D. Ruelle, Statistical Mechanics: Rigorous Results. Reading, MA: Addison-Wesley, 1983.
18. R. S. Ellis, Entropy, Large Deviations, and Statistical Mechanics. New York: Springer-Verlag, 1985.
19. J. Goutsias, "Unilateral approximation of Gibbs random field images," Comput. Vis., Graph., and Image Process.: Graphical Models and Image Process., vol. 53, pp. 240-257, 1991.
20. M. H. Kalos and P. A. Whitlock, Monte Carlo Methods. Volume I: Basics. New York: Wiley, 1986.
21. C. J. Geyer, "Practical Markov chain Monte Carlo (with discussion)," Statist. Sci., vol. 7, pp. 473-511, 1992.
22. P. H. Peskun, "Optimum Monte-Carlo sampling using Markov chains," Biometrika, vol. 60, pp. 607-612, 1973.
23. P. J. Bickel and K. A. Doksum, Mathematical Statistics. Oakland, CA: Holden-Day, 1977.
24. J. Stoer and R. Bulirsch, Introduction to Numerical Analysis. New York: Springer-Verlag, 1980.
25. C. J. Geyer and E. A. Thompson, "Constrained Monte Carlo maximum likelihood for dependent data (with discussion)," J. Roy. Statist. Soc., Ser. B, vol. 54, pp. 657-699, 1992.
26. C. J. Geyer, "On the convergence of Monte Carlo maximum likelihood calculations," J. Roy. Statist. Soc., Ser. B, vol. 56, pp. 261-274, 1994.
27. C. H. Bennett, "Efficient estimation of free energy differences from Monte Carlo data," J. Computat. Phys., vol. 22, pp. 245-268, 1976.
28. G. M. Torrie and J. P. Valleau, "Nonphysical sampling distributions in Monte Carlo free energy estimation: Umbrella sampling," J. Computat. Phys., vol. 23, pp. 187-199, 1977.