Nonparametric belief propagation

Communications of the ACM

Volumn 53, Issue 10, 2010, Pages 95-103

  Sudderth, Erik B ^a   Ihler, Alexander T ^b   Isard, Michael ^c   Freeman, William T ^d   Willsky, Alan S ^d  

^a BROWN UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c MICROSOFT RESEARCH   (United States)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE INFERENCE; BELIEF PROPAGATION; BP ALGORITHM; COMPLEX MODEL; CONTINUOUS QUANTITIES; CONTINUOUS VARIABLES; DISTRIBUTED LOCALIZATION; FILTERING TECHNIQUE; GAUSSIAN MIXTURES; MARKOV RANDOM FIELDS; NON-PARAMETRIC; NON-PARAMETRIC BELIEF PROPAGATION; PARTICLE FILTERING; PROBABILISTIC GRAPHICAL MODELS; REAL-WORLD; VISUAL MOTION;

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; INFERENCE ENGINES; SIGNAL FILTERING AND PREDICTION; SPEECH RECOGNITION; TIME SERIES;

BACKPROPAGATION;

EID: 77957966295     PISSN: 00010782     EISSN: 15577317     Source Type: Journal    
DOI: 10.1145/1831407.1831431     Document Type: Article

References (51)

1. Alspach, D.L. and Sorenson, H.W.Nonlinear Bayesian estimationusing Gaussian sumapproximations, Morgan Kaufmann.IEEE Trans. AC 17, 4 (Aug. 1972), 439-448.
2. Anderson, B.D.O., Moore, J.B. OptimalFiltering. Prentice Hall, New Jersey, 1979.
3. Andrieu, C., de Freitas, N., Doucet, A.,Jordan, M.I. An introduction to MCMCfor machine learning. Mach. Learn. 50(2003), 5-43.
4. Baron, D., Sarvotham, S., Baraniuk,R.G. Bayesian compressive sensingvia belief propagation. IEEETrans. Sig. Proc. 58, 1 (2010), 269-280.
5. Briers, M., Doucet, A., Singh, S.S.Sequential auxiliary particle beliefpropagation. In ICIF (2005), 705-711.
6. Cappé, O., Godsill, S.J., Moulines, E.An overview of existing methods andrecent advances in sequential MonteCarlo. Proc. IEEE 95, 5 (May 2007), 899-924.
7. Coughlan, J., Shen, H. Dynamicquantization for belief propagationin sparse spaces. Comput. Vis.Image Underst. 106, 1 (2007), 47-58.
8. Coughlan, J.M., Ferreira, S.J. Findingdeformable shapes using loopy beliefpropagation. In ECCV, vol. 3, (2002), 453-468.
9. Dawid, A.P., Kjærulff, U., Lauritzen, S.L.Hybrid propagation in junction trees.In Advances in Intelligent Computing(1995), 87-97.
10. Del Moral, P. Feynman-KacFormulae: Genealogical andInteracting Particle Systems withApplications. Springer-Verlag,New York, 2004.
11. Doucet, A., de Freitas, N., Gordon, N.,eds. Sequential Monte Carlo Methodsin Practice. Springer-Verlag, New York, 2001.
12. Driver, E., Morrell, D. Implementationof continuous Bayesian networksusing sums of weighted Gaussians.In UAI (1995), 134-140.
13. Felzenszwalb, P.F., Huttenlocher,D.P. Pictorial structures for objectrecognition. IJCV 61, 1 (2005), 55-79.
14. Freeman, W.T., Pasztor, E.C.,Carmichael, O.T. Learning lowlevelvision. IJCV 40, 1 (2000), 25-47.
15. Frey, B.J., MacKay, D.J.C. A revolution:Belief propagation in graphs withcycles. In NIPS 10 (1998), MIT Press, 479-485.
16. Gogate, V., Dechter, R. AND/ORimportance sampling. In UAI (2008), 212-219.
17. Grimes, D.B., Rashid, D.R., Rao, R.P.Learning nonparametric modelsfor probabilistic imitation. In NIPS(2007), MIT Press, 521-528.
18. Hamze, F., de Freitas, N. Hotcoupling: A particle approachto inference and normalizationon pairwise undirected graphsof arbitrary topology. InNIPS 18 (2006), MIT Press, 491-498.
19. Han, T.X., Ning, H., Huang, T.S.Efficient nonparametric beliefpropagation with application toarticulated body tracking. In CVPR(2006), 214-221.
20. Heskes, T. On the uniqueness of loopybelief propagation fixed points. NeuralComp. 16 (2004), 2379-2413.
21. Ihler, A., McAllester, D. Particlebelief propagation. In AI Stat. 12(2009).
22. Ihler, A.T., Fisher, J.W., Moses, R.L.,Willsky, A.S. Nonparametric beliefpropagation for self-localizationof sensor networks. IEEE J. Sel.Areas Commun. 23, 4 (Apr. 2005), 809-819.
23. Ihler, A.T., Fisher, J.W., Willsky, A.S.Loopy belief propagation: Convergenceand effects of message errors. JMLR6 (2005), 905-936.
24. Ihler, A.T., Frank, A.J., Smyth, P.Particle-based variational inference for continuous systems. In NIPS 22(2009), 826-834.
25. Ihler, A.T., Sudderth, E.B., Freeman,W.T., Willsky, A.S. Efficient multiscalesampling from products of Gaussianmixtures. In NIPS 16 (2004), MITPress.
26. Isard, M. PAMPAS : Real-valuedgraphical models for computervision. In CVPR, vol. 1 (2003), 613-620.
27. Isard, M., MacCormick, J., Achan, K.Continuously-adaptive discretizationfor message-passing algorithms.In NIPS (2009), MIT Press, 737-744.
28. Jordan, M.I. Graphical models. Stat.Sci. 19, 1 (2004), 140-155.
29. Koller, D., Lerner, U., Angelov, D.A general algorithm for approximate inference and its application tohybrid Bayes nets. In UAI 15(1999), Morgan Kaufmann, 324-333.
30. Kschischang, F.R., Frey, B.J., Loeliger,H.-A. Factor graphs and the sumproductalgorithm. IEEE Trans. IT 47,2 (Feb. 2001), 498-519.
31. Kurkoski, B., Dauwels, J. Messagepassingdecoding of lattices usingGaussian mixtures. In ISIT (July2008).
32. Lee, T.S., Mumford, D. HierarchicalBayesian inference in the visualcortex. J. Opt. Soc. Am. A 20, 7(July 2003), 1434-1448.
33. Moeslund, T.B., Hilton, A., Kruger, V.A survey of advances in vision-basedhuman motion capture and analysis.Comput. Vision Image Underst. 104(2006), 90-126.
34. Mooij, J.M., Kappen, H.J. Sufficientconditions for convergence ofthe sum-product algorithm.IEEE Trans. IT 53, 12 (Dec. 2007), 4422-4437.
35. Neal, R.M., Beal, M.J., Roweis, S.T. Inferring state sequences fornon-linear systems withembedded hidden Markovmodels. In NIPS 16 (2004),MIT Press.
36. Neil, M., Tailor, M., Marquez, D. Inference in hybrid Bayesiannetworks using dynamicdiscretization. Stat. Comput. 17, 3(2007), 219-233.
37. Pearl, J. Probabilistic Reasoningin Intelligent Systems. MorganKaufman, San Mateo, 1988.
38. Rajaram, S., Gupta, M.D., Petrovic, N.,Huang, T.S. Learning- basednonparametric image superresolution. EURASIP J. Appl.Signal Process. (2006), 229-240.
39. Rudoy, D. Wolf, P.J. Multi-scaleMCMC methods for sampling fromproducts of Gaussian mixtures.In ICASSP, vol. 3 (2007), III-1201-III-1204.
40. Seeger M. Gaussian processbelief propagation. InPredicting structured data(2007), 301-318.
41. Sigal, L., Bhatia, S., Roth, S.,Black, M.J., Isard, M. Trackingloose-limbed people. In CVPR(2004).
42. Silverman, B.W. Density Estimation forStatistics and Data Analysis. Chapman& Hall, London, 1986.
43. Sommer, N., Feder, M., Shalvi, O.Low-density lattice codes. IEEETrans. Info. Theory 54, 4 (2008), 1561-1585.
44. Sudderth, E.B., Ihler, A.T., Freeman,W.T., Willsky, A.S. Nonparametricbelief propagation. In CVPR, vol. 1(2003), 605-612.
45. Sudderth, E.B., Mandel, M.I.,Freeman, W.T., Willsky, A.S. Visualhand tracking using nonparametricbelief propagation. In CVPRWorkshop on Generative Model Based Vision (June 2004).
46. Sun, W., Cetin, M., Chan, R., Willsky, A.S. Learning thedynamics and time-recursiveboundary detection of deformableobjects. IEEE Trans. IP 17, 11(Nov. 2008), 2186-2200.
47. Wainwright, M.J., Jordan, M.I.Graphical models, exponentialfamilies, and variational inference.Foundations Trends Mach. Learn. 1,(2008), 1-305.
48. Wu, Y., Huang, T.S. Hand modeling,analysis, and recognition. IEEESignal Proc. Mag. (May 2001), 51-60.
49. Yanover, C., Weiss, Y. Approximate inference and protein-folding.In NIPS 16 (2003), MIT Press, 1457-1464.
50. Yedidia, J.S., Freeman, W.T.,Weiss, Y. Understanding beliefpropagation and itsgeneralizations. In G. Lakemeyerand B. Nebel, eds. ExploringArtificial Intelligence inthe New Millennium.Morgan Kaufmann, 2002.
51. Yedidia, J.S., Freeman, W.T.,Weiss, Y. Constructing free energyapproximations and generalizedbelief propagation algorithms. IEEE Trans. IT 51, 7 (July 2005), 2282-2312.