Statistical modeling and conceptualization of visual patterns

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 25, Issue 6, 2003, Pages 691-712

  Zhu, Song Chun ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Causal Markov models; Descriptive models; Discriminative methods; Generative models; Minimax entropy learning; Mixed Markov models; Perceptual organization

Indexed keywords

COMPUTER SIMULATION; IMAGE SEGMENTATION; MARKOV PROCESSES;

VISUAL PATTERNS;

VISION;

EID: 0038381649     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2003.1201820     Document Type: Article

References (101)

1. A. Amir and M. Lindenbaum, "Ground from Figure Discrimination," Computer Vision and Image Understanding, vol. 76, no. 1, pp. 718, 1999.
2. J.J. Atick and A.N. Redlich, "What Does the Retina Know about Natural Scenes?" Neural Computation, vol. 4, pp. 196-210, 1992.
3. F. Attneave, "Some Informational Aspects of Visual Perception," Pschological Rev., vol. 61, pp. 183-193, 1954.
4. L. Alvarez, Y. Gousseau, and J.-M. Morel, "The Size of Objects in Natural and Artificial Images," Advances in Imaging and Electron Physics, J.-M. Morel, ed., vol. 111, 1999.
5. H.B. Barlow, "Possible Principles Underlying the Transformation of Sensory Messages," Sensory Communication, W.A. Rosenblith, ed. pp. 217-234, Cambridge, Mass.: MIT Press, 1961.
6. J. Besag, "Spatial Interaction find the Statistical Analysis of Lattice Systems (with discussion)," J. Royal Statistical Soc., B, vol. 36 pp. 192-236, 1973.
7. E. Bienenstock, S. Geman, and D. Potter, "Compositionality, MDL Priors, and Object Recognition," Proc. Neural Information Processing Systems, 1997.
8. A. Blake and A. Zisserman, Visual Reconstruction, Cambridge, Mass.: MIT Press, 1987.
9. K.L. Boyer and S. Sarkar, "Perceptual Organization in Computer Vision: Status, Challenges, and Potentials," Computer Vision and Image Understanding, vol. 76, no. 1, pp. 1-5, 1999.
10. E.J. Candes and D.L. Donohoo, "Ridgelets: A Key to Highe Dimensional Intermitentcy?" Philosophical Trans. Royal Soc. London, A, vol 357, no. 1760, pp. 2495-2509, 1999.
11. C.R. Carlson, "Thresholds for Perceived Image Sharpness," Photographic Science and Eng., vol. 22, pp. 69-71, 1978.
12. D. Chandler, Introduction to Modern Statistical Mechanics. Oxford Univ. Press, 1987.
13. Z.Y. Chi, "Probabilistic Models for Complex Systems," doctoral dissertation with S. Geman, Division of Applied Math, Brown Univ., 1998.
14. C. Chubb and M.S. Landy, "Othergonal Distribution Analysis: A New Approach to the Study of Texture Perception," Comp. Models of Visual Processing, M.S. Landy, ed. Cambridge, Mass.: MIT Press, 1991.
15. R.W. Cohen, I. Gorog, and C.R. Carlson, "Image Descriptors for Displays," Technical Report contract no. N00014-74-C-0184, Office of Navy Research, 1975.
16. R.R. Coifman and M.V. Wickerhauser, "Entropy Based Algorithms for Best Basis Selection," IEEE Trans. Information Theory, vol. 38, pp. 713-718, 1992.
17. P. Common, "Independent Component Analysis - A New Concept?" Signal Processing, vol. 36, pp. 287-314, 1994.
18. D. Cooper, "Maximum Likelihood Estimation of Markov Process Blob Boundaries in Noisy Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 1, pp. 372-384, 1979.
19. G.R. Cross and A.K. Jain, "Markov Random Field Texture Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, pp. 25-39, 1983.
20. P. Dayan, G.E. Hinton, R. Neal, and R.S. Zemel, "The Helmholtz Machine," Neural Computation, vol. 7, pp. 1022-1037, 1995.
21. J.S. De Bonet and P. Viola, "A Non-Parametric Multi-Scale Statistical Model for Natural Images," Advances in Neural Information Processing, vol. 10, 1997.
22. S. Della Pietra, V. Della Pietra, and J. Lafferty, "Inducing Features of Random Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 4, Apr. 1997.
23. N.G. Deriugin, "The Power Spectrum and the Correlation Function of the Television Signal," Telecomm., vol. 1, no. 7, pp. 1-12, 1957.
24. S.J. Dickinson, A.P. Pentland, and A. Rosenfeld, "From Volumes to Views: An Approach to 3D Object Recognition," CVGIP: Image Understanding, vol. 55, no. 2, pp. 130-154, Mar. 1992.
25. D.L. Donoho, M. Vetterli, R.A. DeVore, and I. Daubechie, "Data Compression and Harmonic Analysis," IEEE Trans. Information Theory, vol. 6, pp. 2435-2476, 1998.
26. A. Efros and T. Leung, "Texture Synthesis by Non-Parametric Sampling," Proc. Int'l Conf. Computer Vision, 1999.
27. A. Efros and W.T. Freeman, "Image Quilting for Texture Synthesis and Transfer," Proc. SIGGRAPH, 2001.
28. D.J. Field, "Relations between the Statistics and Natural Images and the Responses Properties of Cortical Cells," J. Optical Soc. Am. A, vol. 4, pp. 2379-2394, 1987.
29. D.J. Field, "What Is the Goal of Sensory Coding?" Neural Computation, vol 6, pp. 559-601, 1994.
30. B. Frey and N. Jojic, "Transformed Component Analysis: Joint Estimation of Spatial Transforms and Image Components," Proc. Inl'l Conf. Computer Vision, 1999.
31. K.S. Fu, Syntactic Pattern Recognition. Prentice-Hall, 1982.
32. W.S. Geisler, J.S. Perry, B.J. Super, and O.P. Gallogly, "Edge Co-Occurence in Natural Images Predicts Contour Grouping Performance," Vision Research, vol. 41, pp. 711-724, 2001.
33. S. Geman and D. Geman, "Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp 721-741, 1984.
34. J.W. Gibbs, Elementary Principles of Statistical Mechanics. Yale Univ. Press, 1902.
35. J.J. Gibson, The Perception of the Visual World. Boston: Houghton Mifflin, 1966.
36. U. Grenander, Lectures in Pattern Theory I, II, and III. Springer, 1976-1981.
37. U. Grenander, Y. Chow, and K.M. Keenan, Hands: A Pattern Theoretical Study of Biological Shapes. New York: Springer-Verlag, 1991.
38. U. Grenander and A. Srivastava, "Probability Models for Clutter in Natural Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 4, Apr. 2001.
39. M.G. Gu and F.H. Kong, "A Stochastic Approximation Algorithm with MCMC Method for Incomplete Data Estimation Problems," Proc. Nat'l Academy of Sciences, vol. 95, pp 7270-7274, 1998.
40. C.E. Guo, S.C. Zhu, and Y.N. Wu, "Visual Learning by Integrating Descriptive and Generative Methods," Proc. Int'l Conf. Computer Vision, 2001.
41. G. Guy and G. Medioni, "Inferring Global Perceptual Contours from Local Features," Int'l J. Computer Vision, vol. 20, pp. 113-133, 1996.
42. D.J. Heeger and J.R. Bergen, "Pyramid-Based Texture Analysis/Synthesis," Proc. SIGGRAPH, 1995.
43. D.W. Jacobs, "Recognizing 3D Objects Using 2D Images," doctoral dissertation, MIT AI Laboratory, 1993.
44. E.T. Jaynes, "Information Theory and Statistical Mechanics," Physical Rev., vol. 106, pp. 620-630, 1957.
45. B. Julesz, "Textons, the Elements of Texture Perception and Their Interactions," Nature, vol. 290, pp. 91-97, 1981.
46. B. Julesz, Dislogues on Perception. Cambridge, Mass.: MIT Press, 1995.
47. G. Kanizsa, Organization in Vision. New York: Praeger, 1979.
48. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active Contour Models," Proc. Int'l Conf. Computer Vision, 1987.
49. D. Kersten, "Predictability and Redundancy of Natural Images," J. Optical Soc. Am. A, vol. 4, no. 12, pp. 2395-2400, 1987.
50. S.M. Konishi, J.M. Coughlan, A.L. Yuille, and S.C. Zhu, "Fundamental Bounds on Edge Detection: An Information Theoretic Evaluation of Different Edge Cues," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 1, Jan. 2003.
51. K. Koffka, Principles of Gestalt Psychology. New York: Harcourt, Brace and Co., 1935.
52. A. Koloydenko, "Modeling Natural Microimage Statistics," PhD Thesis, Dept. of Math and Statistics, Univ. of Massachusetts, Amherst, 2000.
53. A.B. Lee, J.G. Huang, and D.B. Mumford, "Random Collage Model for Natural Images," Int'l J. Computer Vision, Oct. 2000.
54. L. Liang, X.W. Liu, Y. Xu, B.N. Guo, and H.Y. Shum, "Real-Time Texture Synthesis by Patch-Based Sampling," Technical Report MSR-TR-2001-40, Mar. 2001.
55. C. Liu, S.C. Zhu, and H.Y. Shum, "Learning Inhomogeneous Gibbs Model of Face by Minimax Entropy," Proc. Int'l Conf. Computer Vision, 2001.
56. L.D. Lowe, Perceptual Organization and Visual Recognition. Kluwer Academic Publishers, 1985.
57. S.G. Mallat, "A Theory for Multiresolution Signal Decomposition: The Wavelet Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674-693, July 1989.
58. K.L. Mengersen and R.L. Tweedie, "Rates of Convergence of the Hastings and Metropolis Algorithms," Annals of Statistics, vol. 24, pp. 101-121,1994.
59. Y. Meyer, "Principe d'Incertitude, Bases Hilbertiennes et Algebres d'Operateurs," Bourbaki Seminar, no. 662, 1985-1986.
60. Y. Meyer, Ondelettes et Operateurs. Hermann, 1988.
61. L. Moisan, A. Desolneux, and J.-M. Morel, "Meaningful Alignments," Int'l J. Computer Vision, vol. 40, no. 1, pp. 7-23, 2000.
62. D.B. Mumford, "Elastica and Computer Vision," Algebraic Geometry and Its Applications, C.L. Bajaj, ed. New York: Springer-Verlag, 1994.
63. D.B. Mumford and J. Shah, "Optimal Approximations of Piecewise Smooth Functions and Associated Variational Problems," Comm. Pure and Applied Math., vol. 42, 1989.
64. D.B. Mumford, "Pattern Theory: A Unifying Perspective," Proc. First European Congress of Math., 1994.
65. D.B. Mumford, "The Statistical Description of Visual Signals," Proc. Third Int'l Congress on Industrial and Applied Math., K. Kirchgassner, O. Mahrenholtz, and R. Mennicken, eds., 1996.
66. D.B. Mumford and B. Gidas, "Stochastic Models for Generic Images," Quarterly of Applied Math., vol. LIX, no. 1, pp. 85-111, 2001.
67. B.A. Olshausen and D.J. Field, "Sparse Coding with an Over-Complete Basis Set: A Strategy Employed by V1?" Vision Research, vol. 37, pp. 3311-3325, 1997.
68. M.B. Priestley, Spectral Analysis and Time Series, London: Academic Press, 1981.
69. T. Poggio, V. Torre, and C. Koch, "Computational Vision and Regularization Theory," Nature, vol. 317, pp. 314-319, 1985.
70. K. Popat and R.W. Picard, "Novel Cluster-Based Probability Model for Texture Synthesis, Classification, and Compression," Proc. SPIE Visual Comm. and Image, pp. 756-768, 1993.
71. J. Portilla and E.P. Simoncelli, "A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients," Int'l J. Computer Vision, vol. 40, no. 1, pp. 49-71, 2000.
72. D.L. Ruderman, "The Statistics of Natural Images," Network: Computation in Neural Systems, vol. 5, pp. 517-548, 1994.
73. D.L. Ruderman, "Origins of Scaling in Natural Images," Vision Research, vol. 37, pp, 3385-3398, Dec. 1997.
74. S. Sarkar and K.L. Boyer, "Integration, Inference, and Management of Spatial Information Using Bayesian Networks: Perceptual Organization," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 3, Mar. 1993.
75. S. Sarkar and K.L. Boyer, Computing Perceptual Organization in Computer Vision. Singapore: World Scientific, 1994.
76. C. Shannon, "A Mathematical Theory of Communication," Bell System Technical J., vol. 27, 1948.
77. E.P. Simoncelli, W.T. Freeman, E.H. Adelson, and D.J. Heeger, "Shiftable Multiscale Transforms," IEEE Trans. Information Theory, vol. 38, no. 2, pp. 587-607, 1992.
78. E.P. Simoncelli and B.A. Olshausen, "Natural Image Statistics and Neural Representation," Ann. Rev. Neuroscience, vol. 24, pp. 1193-1216, 2003.
79. B.J. Smith, "Perceptual Organization in a Random Stimulus," Human and Machine Vision, A. Rosenfeld, ed. San Diego, Calif.: Academic Press, 1986.
80. D. Stoyan, W.S. Kendall, and J. Mecke, Stochastic Geometry and Its Applications. John Wiley and Sons, 1987.
81. D. Terzopoulos, "Multilevel Computational Process for Visual Surface Reconstruction," Computer Vision, Graphics, and Image Processing, vol. 24, pp. 52-96, 1983.
82. Z.W. Tu and S.C. Zhu, "Image Segmentation by Data Driven Markov Chain Monte Carlo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5 May 2002.
83. Z.W. Tu and S.C. Zhu, "Parsing Images into Region and Curve Processes," Proc. European Conf. Computer Vision, 2002.
84. J.H. Van Hateren and D.L. Ruderman, "Independent Component Analysis of Natural Image Sequences Yields Spatiotemproal Filters Similar to Simple Cells in Primary Visual Cortex," Proc. Royal Soc. London, vol. 265, 1998.
85. L.R. Williams and D.W. Jacobs, "Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience," Neural Computation, vol. 9, pp. 837-858, 1997.
86. D.R. Wolf and E.I. George, "Maximally Informative Statistics," unpublished manuscript, 1999.
87. Y.N. Wu and S.C. Zhu, "Equivalence of Julesz and Gibbs Ensembles," Proc. Int'l Conf. Computer Vision, 1999.
88. Y.N. Wu, S.C. Zhu, and C.E. Guo, "Statistical Modeling of Image Sketch," Proc. European Conf. Computer Vision, 2002.
89. J.S. Yedidia, W.T. Freeman, and Y. Weiss, "Generalized Belief Propagation," TR-2000-26, Mitsubishi Electric Research Lab., 2000.
90. A.L. Yuille, "Deformable Templates for Face Recognition," J. Cognitive Neuroscience, vol. 3, no. 1, 1991.
91. A.L. Yuille, J.M. Coughlan, Y.N. Wu, and S.C. Zhu, "Order Parameter for Detecting Target Curves in Images: How Does High Level Knowledge Helps?" Int'l J. Computer Vision, vol. 41, no. 1/2, pp. 9-33, 2001.
92. A.L. Yuille, "CCCP Algorithms to Minimize the Bethe and Kikuchi Free Energies: Convergent Alternatives to Belief Propagation," Neural Computation, 2001.
93. S.C. Zhu, Y.N. Wu, and D.B. Mumford, "Minimax Entropy Principle and Its Application to Texture Modeling," Neural Computation, vol. 9, no. 8, pp. 1627-1660, Nov. 1997.
94. S.C. Zhu and D.B. Mumford, "Prior Learning and Gibbs Reaction-Diffusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1236-1250, Nov. 1997.
95. S.C. Zhu, Y.N. Wu, and D.B. Mumford, "Filters, Random Fields, and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling," Int'l J. Computer Vision, vol. 27, no. 2, pp. 1-20, 1998.
96. S.C. Zhu, "Embedding Gestalt Laws in Markov Random Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 11, pp. 1170-1187, Nov. 1999.
97. S.C. Zhu, X.W. Liu, and Y.N. Wu, "Exploring Julesz Texture Ensemble by Effective Markov Chain Monte Carlo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 6, June 2000.
98. S.C. Zhu, R. Zhang, and Z.W. Tu, "Integrating Top-Down/Bottom-Up for Object Recognition by DDMCMC," Proc. Computer Vision and Pattern Recognition, 2000.
99. S.C. Zhu, C.E. Guo, Y.N. Wu, and Y.Z. Wang, "What Are Textons," Proc. European Conf. Computer Vision, 2002.
100. G.J. Burton and J.R. Moorehead, "Color and Spatial Structures in Natural Scenes," Applied Optics, vol. 26, no. 1, pp. 157-170, 1987.
101. D.L. Donoho, "Wedgelets: Nearly Minmax Estimation of Edges," Annals of Statistics, vol. 27, no. 3, pp. 859-897, 1999.