Low-rank variance approximation in GMRF models: Single and multiscale approaches

IEEE Transactions on Signal Processing

Volumn 56, Issue 10 I, 2008, Pages 4621-4634

  Malioutov, Dmitry M ^a   Johnson, Jason K ^a   Choi, Myung Jin ^a   Willsky, Alan S ^a  

^a Department of Electrical Engineering and Computer Science   (United States)

Author keywords

Approximate variances; Gaussian Markov random fields; Multiscale models; Wavelets

Indexed keywords

CORRELATION METHODS; EARTH SCIENCES; HIDDEN MARKOV MODELS; MARKOV PROCESSES; MATRIX ALGEBRA; OCEANOGRAPHY;

ALIASING; APPROXIMATE VARIANCES; GAUSSIAN MARKOV RANDOM FIELD; GAUSSIAN MARKOV RANDOM FIELDS; GRAVITY INVERSIONS; MARKOV GRAPHS; MULTI-SCALE APPROACHES; MULTI-SCALE MODELING; MULTISCALE MODELS; NOISY MEASUREMENTS; SCALE MODELING; SHORT-RANGE CORRELATIONS; WAVELETS;

GAUSSIAN NOISE (ELECTRONIC);

EID: 53149149828     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2008.927482     Document Type: Article

References (25)

1. M. I. Jordan, "Graphical models," Statist. Sci. (Special Issue on Bayesian Statistics), vol. 19, pp. 140-155, 2004.
2. S. L. Lauritzen, Graphical Models. Oxford, U.K.: Clarendon, 1996.
3. H. Rue and L. Held, Gaussian Markov Random Fields Theory and Applications. London, U.K.: Chapman and Hall/CRC Press, 2005.
4. J. K. Johnson and A. S. Willsky, "A recursive model-reduction method for approximate inference in Gaussian Markov random fields," IEEE Trans. Image Process., vol. 17, pp. 70-83, Jan. 2008.
5. U. Trottenberg, C. W. Oosterlee, and A. Schuller, Multigrid. New York: Academic, 2001.
6. D. Spielman and S. H. Teng, "Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems," in Proc. ACM Symp. Theory Comput., 2004.
7. R. G. Cowell, A. P. Dawid, S. L. Lauritzen, and D. J. Spiegelhater, Probabilistic Networks and Expert Systems. Berlin, Germany: Springer, 2003.
8. D. M. Malioutov, J. K. Johnson, and A. S. Willsky, "Walk-sums and belief propagation in Gaussian graphical models," J. Mach. Learn. Res., vol. 7, Oct. 2006.
9. D. M. Malioutov, J. K. Johnson, and A. S. Willsky, "Low-rank variance estimation in large-scale GMRF models," in Proc. IEEE ICASSP, May 2006.
10. D. M. Malioutov, J. K. Johnson, and A. S. Willsky, "GMRF variance approximation using spliced wavelet bases," in Proc. IEEE ICASSP, Apr. 2007.
11. B. Gidas, "A renormalization group approach to image processing problems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, pp. 164-180, Feb. 1989.
12. A. S. Willsky, "Multiresolution Markov models for signal and image processing," Proc. IEEE, vol. 90, pp. 1396-1458, 2002.
13. M. J. Choi, "Multiscale Gaussian graphical models and algorithms for large-scale inference," M.S. thesis, Massachusetts Inst. of Technology, Cambridge, 2007.
14. C. A. Bouman and M. Shapiro, "A multiscale random field model for Bayesian image segmentation," IEEE Trans. Image Process., vol. 3, pp. 162-177, Mar. 994.
15. M. J. Choi, V. Chandrasekaran, D. Malioutov, J. K. Johnson, and A. S. Willsky, "Multiscale stochastic modeling for tractable inference and data assimilation," Comput. Meth. Appl. Mechanics Eng., vol. 197, pp. 3492-3515, 2008.
16. B. Aspvall and J. R. Gilbert, "Graph coloring using eigenvalue decomposition," SIAM J. Alg. Disc. Meth., vol. 5, pp. 526-538, 1984.
17. S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1998.
18. Theory and Applications of Long-Range Dependence, P. Doukhan, G. Oppenheim, and M. S. Taqqu, Eds. Berlin, Germany: Birkhauser, 2003.
19. P. Flandrin, "Wavelet analysis and synthesis of fractional Browman motion," IEEE Trans. Inf. Theory, vol. 38, pp. 910-917, Mar. 1992.
20. E. Masry, "The wavelet transform of stochastic processes with stationary increments and its application to fractional Brownian motion," IEEE Trans. Inf. Theory, vol. 39, pp. 260-264, Jan. 993.
21. R. W. Dijkerman and R. R. Mazumdar, "Wavelet representation of stochastic processes and multiresolution stochastic models," IEEE Trans. Signal Process., vol. 42, pp. 1640-1652, Jul. 1994.
22. I. Daubechies, Ten Lectures on Wavelets. Singapore: SIAM, 1992.
23. R. R. Coifman and M. Maggioni, "Diffusion wavelets," Appl. Comp. Harm. Anal., vol. 21, no. 1, pp. 53-94, 2006.
24. E. Sudderth, M. J. Wainwright, and A. S. Willsky, "Embedded trees: Estimation of Gaussian processes on graphs with cycles," IEEE Trans. Signal Process., vol. 52, pp. 3136-3150, Nov. 2004.
25. V. Chandrasekaran, J. K. Johnson, and A. S. Willsky, "Estimation in Gaussian graphical models using tractable subgraphs: A walk-sum analysis," IEEE Trans. Signal Process., vol. 56, pp. 1916-1930, May 2008.