MEM pixel correlated solutions for generalized moment and interpolation problems

IEEE Transactions on Information Theory

Volumn 45, Issue 7, 1999, Pages 2253-2270

  Csiszár, Imre ^a,b   Gamboa, Fabrice ^c,d   Gassiat, Elisabeth ^e  

^a IEEE   (Hungary)

^b ALFRÉD RÉNYI INSTITUTE OF MATHEMATICS   (Hungary)

^c ECOLE POLYTECHNIQUE   (France)

^d UNIVERSITÉ DE PICARDIE JULES VERNE   (France)

^e UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

MAXIMUM ENTROPY ON THE MEAN (MEM);

INTERPOLATION; MATHEMATICAL MODELS; TRANSFER FUNCTIONS;

INFORMATION THEORY;

EID: 0033336975     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.796367     Document Type: Article

References (41)

1. D. J. Aldous, Exchangeability and Related Topics, Lecture Notes in Mathematics, Ecole d'Eté de Probabilités de St Flour XIII 1983, 1985.
2. S. M. Ali and S. D. Silvey, "A general class of coefficients of divergence of one distribution from another," J. Roy. Statist. Soc., ser. B, vol. 28, pp. 131-142, 1966.
3. J. M. Borwein and A. S. Lewis, "Duality relationships for entropy-like minimization problems," SIAM J. Control Optimiz., vol. 29, pp. 325-338, 1991.
4. 1 and the existence of maximum entropy estimates," SIAM J. Optimiz., vol. 3, pp. 248-267, May 1993.
5. L. M. Bregman, "The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming," USSR Comput. Math. Phys., vol. 7, pp. 200-217, 1967.
6. P. L. Brockelt, A. Charnes, and K. H. Paick, "Information-theoretic approach to unimodal density estimation," IEEE Trans. Inform. Theory, vol. 41, pp. 825-829, 1995.
7. J. P. Burg, Ph.D. dissertation, Standford Univ., Stanford, CA, 1975.
8. I. Csiszár, "Eine informationtheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizität von Markovschen Ketten," Publ. Math. Inst. Hungar. Acad. Sci., vol. 8, pp. 85-108, 1963.
9. _, "Information-type measures of difference of probability distributions and indirect observations," Studio Sci. Math. Hungar., vol. 2, pp. 299-318, 1967.
10. _, "Sanov property, generalized I-projections and a conditional limit theorem," Ann. Probab., vol. 12, pp. 768-793, 1984.
11. _, "An extended maximum entropy principle and a Bayesian justification," in Bayesian Statistics 2, J. M. Bernardo, Ed. Amsterdam, The Netherlands: Elsevier, 1985, pp. 83-98.
12. _, "Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems," Ann. Statist., vol. 19, pp. 2032-2066, 1991.
13. _, "Generalized projection for non negative functions," Acta Math. Hungar., vol. 68, pp. 161-185, 1995.
14. _, "Maxent, mathematics, and information theory," in Maximum Entropy and Bayesian Methods, K. M. Hanson and R. N. Silver, Eds. Boston, MA: Kluwer, 1996, pp. 35-50.
15. D. Dacunha-Castelle and F. Gamboa, "Maximum d'entropie et problème des moments," Ann. l'I.H.P. Probab., vol. 26, pp. 567-596, 1990.
16. B. De Finetti, "La prévision: Ses lois logiques, ses sources subjectives," Ann. l'I.H.P. Sér. B, vol. 7, pp. 1-68, 1937.
17. A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications. Boston, MA: Jones and Bartlett, 1993.
18. I. H. Dinwoodie and S. L. Zabell, "Large deviations for exchangeable random vectors," Ann. Probab., pp. 1147-1166, 1992.
19. W. Feller, An Introduction to Probability Theory and Its Applications. New York: Wiley, 1968.
20. F. Gamboa, "New Bayesian methods for ill posed problems," Statist. Decisions, to be published.
21. F. Gamboa and E. Gassiat, "Maximum d'entropie et problème des moments cas multidimensionnel," Probab. Math. Statist., vol. 12, pp. 67-83, 1991.
22. _, "The maximum entropy method on the mean: Applications to linear programming and superresolution," Math. Programming, Ser. A, vol. 66, pp. 103-122, 1994.
23. _, "Bayesian methods for ill posed problems," Ann. Statist., vol. 25, pp. 328-350, 1997.
24. E. T. Jaynes, Papers on Probability, Statistics and Statistical Physics, R. D. Rosenkrantz, Ed. Dordrecht, The Netherlands: Reidel, 1983.
25. L. Jones and C. Byrne, "General entropy criteria for inverse problems with application to data compression, pattern classification and cluster analysis," IEEE Trans. Inform. Theory, vol. 36, pp. 23-30, 1990.
26. J. N. Kapur, Maximum Entropy Models in Science and Engineering. New York: Wiley, 1989.
27. J. H. Kemperman, "Moment problems with convexity conditions," in Optimizing Methods in Statistics. New York: Academic, 1971, pp. 115-178.
28. S. Kullback, Information Theory and Statistics. New York: Wiley, 1959.
29. G. L. Besnerais, J. F. Bercher, and G. Demoment, "A new look at entropy for solving linear inverse problems," IEEE Trans. Inform. Theory, vol. 45, pp. 1565-1578, Jul. 1999.
30. C. Léonard, Minimiser of Energy Functional, preprint, Orsay, France, 1996.
31. A. S. Lewis, "Consistency of moment systems," Canadian J. Math., vol. 47, pp. 995-1006, 1995.
32. J. Lewis, C. Pfister, and W. Sullivan, "Entropy, concentration of probability, and conditional limit theorems," Markov Processes and Related Fields, vol. 1, pp. 319-386, 1995.
33. F. Liese and I. Vajda, Convex Statistical Distances. Leipzig, Germany: Teubner, 1987.
34. P. Maréchal and A. Lannes, "Unification of some deterministic and probabilistic methods for the solution of linear inverse problems via the principle of the maximum entropy on the mean," Inverse Probl., vol. 13, pp. 135-151, 1997.
35. J. Navaza, "On the maximum entropy estimate of electron density function," Acta Crist, pp. 232-244, 1985.
36. R. T. Rockafellar, "Integrals which are convex functional," Pacific J. Math., vol. 24, pp. 525-539, 1968.
37. _, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
38. J. Shore and R. Johnson, "Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy," IEEE Trans. Inform. Theory, vol. IT-26, pp. 26-37, 1980.
39. J. Skilling, "Fundamental of MaxEnt in data analysis," in Maximum Entropy in Action, B. Buck and V. A. Macaulay, Eds. Oxford, U.K.: Oxford Sci. Pub., 1991, pp. 19-40.
40. M. Teboulle and I. Vajda, "Convergence of best φ-entropy estimates," IEEE Trans. Inform. Theory, vol. 39, pp. 297-301, 1993.
41. B. Urban, "Retrieval of atmospheric thermodynamical parameters using satelite measurements with maximum entropy method," Inverse Probl., vol. 12, pp. 779-796, 1996.