Minimax Entropy Principle and Its Application to Texture Modeling

Neural Computation

Volumn 9, Issue 8, 1997, Pages 1627-1660

  Zhu, Song Chun ^a   Wu, Ying Nian ^b   Mumford, David ^a  

^a BROWN UNIVERSITY   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000806445     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/neco.1997.9.8.1627     Document Type: Article

References (41)

1. Akaike, H. (1977). On entropy maximization principle. In P. R. Krishnaiah (Ed.), Applications of Statistics (pp. 27-42). Amsterdam: North-Holland.
2. Barlow, H. B., Kaushal, T. P., & Mitchison, G. J. (1989). Finding minimum entropy codes. Neural Computation, 1, 412-423.
3. Bergen, J. R., & Adelson, E. H. (1991). Theories of visual texture perception. In D. Regan (Ed.), Spatial Vision, Boca Raton, FL: CRC Press, 1991.
4. Besag, J. (1973). Spatial interaction and the statistical analysis of lattice systems (with discussion). J. Royal Stat. Soc., B, 36, 192-236.
5. Brown, L. D. (1986). Fundamentals of statistical exponential families: With applications in statistical decision theory. Hayward, CA: Institute of Mathematical Statistics.
6. Chubb, C., & Landy, M. S. (1991). Orthogonal distribution analysis: A new approach to the study of texture perception. In M. S. Landy & J. A. Movshon (Eds.), Computational models of visual processing. Cambridge, MA: MIT Press.
7. Coifman, R. R., & Wickerhauser, M. V. (1992). Entropy based algorithms for best basis selection. IEEE Trans. on Information Theory, 38, 713-718.
8. Cross, G. R., & Jain, A. K. (1983). Markov random field texture models. IEEE, PAMI, 5, 25-39.
9. Daugman, J. (1985). Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. Journal of Optical Soc. Amer., 2(7).
10. Dayan, P., Hinton, G. E., Neal, R. N., & Zemel, R. S. (1995). The Helmholtz machine. Neural Computation, 7, 889-905.
11. Donoho, D. L., & Johnstone, I. M. (1994). Ideal de-noising in an orthonormal basis chosen from a library of bases. Acad. Sci. Paris, Ser. I, 319, 1317-1322.
12. Field, D. (1994). What is the goal of sensory coding? Neural Computation, 6, 559-601.
13. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images. IEEE Trans. PAMI, 6, 721-741.
14. Heeger, D. J., & Bergen, J. R. (1995). Pyramid-based texture analysis/synthesis. In Computer Graphics Proceedings (pp. 229-238).
15. Jaynes, E. T. (1957). Information theory and statistical mechanics. Physical Review, 106, 620-630.
16. Jolliffe, I. T. (1986). Principle components analysis. New York: Springer-Verlag.
17. Jordan, M. I., & Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6, 181-214.
18. Julesz, B. (1962). Visual pattern discrimination. IRE Transactions of Information Theory, IT-8, 84-92.
19. Julesz, B. (1995). Dialogues on perception. Cambridge, MA: MIT press.
20. Karni, A., & Sagi, D. (1991). Where practice makes perfect in texture discrimination - evidence for primary visual cortex plasticity. Proc. Nat. Acad. Sci. U.S.A., 88, 4966-4970.
21. Kullback, S. (1959). Information theory and statistics. New York: Wiley.
22. Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annual Math. Stat., 22, 79-86.
23. 2(R). Trans. Amer. Math. Soc., 315, 69-87.
24. Mumford, D. B. (1992). On the computational architecture of the neocortex II: The role of cortico-cortical loops. Biological Cybernetics, 66, 241-251.
25. Mumford, D. B., & Shah, J. (1989). Optimal approximations by piecewise smooth functions and associated variational problems. Comm. Pure Appl. Math., 42, 577-684.
26. Picard, R. W. (1996). A society of models for video and image libraries (Technical Rep. No. 360). Cambridge, MA: MIT Media Lab.
27. Priestley, M. B. (1981). Spectral analysis and time series. San Diego: Academic Press.
28. Ripley, B. (1996). Pattern recognition and neural networks. Cambridge: Cambridge University Press.
29. Rissanen, J. (1989). Stochastic complexity in statistical inquiry. Singapore: World Scientific.
30. Sherman, M. (1996). Variance estimation for statistics computed from spatial lattice data. J. R. Statistics Soc., B, 58, 509-523.
31. Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27.
32. Silverman, M. S., Grosof, D. H., De Valois, R. L., & Elfar, S. D. (1989). Spatial-frequency organization in primate striate cortex. Proc. Natl. Acad. Sci. U.S.A., 86.
33. Simoncelli, E. P., Freeman, W. T., Adelson, E. H., & Heeger, D. J. (1992). Shiftable multi-scale transforms. IEEE Trans. on Information Theory, 38, 587-607.
34. Watson, A. (1987). Efficiency of a model human image code. J. Opt. Soc. Am. A, 4(12), 2401-2417.
35. Winkler, G. (1995). Image analysis, random fields and dynamic Monte Carlo methods. Berlin: Springer-Verlag.
36. Witkin, A., & Kass, M. (1991). Reaction-diffusion textures. Computer Graphics, 25, 299-308.
37. Xu, L. (1995). Ying-Yang machine: A Bayesian-Kullback scheme for unified learnings and new results on vector quantization. Proc. Int'l Conf. on Neural Info. Proc. Hong Kong.
38. Younes, L. (1988). Estimation and annealing for Gibbsian fields (STMA V30 1845). Annales de l'Institut Henri Poincaré, Section B, Calcul des Probabilities et Statistique, 24, 269-294.
39. Zhu, S. C. (1996). Statistical and computatinal theories for image segmentation, texture modeling and object recognition. Unpublished Ph.D. dissertation, Harvard University.
40. Zhu, S. C., & Mumford, D. B. (1997). Learning generic prior models for visual computation. Proc. of Int'l Conf. on Computer Vision and Pattern Recognition. Puerto Rico.
41. Zhu, S. C., Wu, Y. N., & Mumford, D. B. (1996). FRAME: Filters, random fields and maximum entropy - to a unified theory for texture modeling. In Proc. of Int'l Conf. on Computer Vision and Pattern Recognition. San Francisco.