Principled parallel mean-field inference for discrete random fields

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 5848-5857

  Baque, Pierre ^a   Bagautdinov, Timur ^a   Fleuret, Francois ^a,b   Fua, Pascal ^a  

^a EPFL   (Switzerland)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; OPTIMIZATION;

CHOICE OF PARAMETERS; COORDINATE DESCENT; FASTER CONVERGENCE; GRADIENT BASED; MEAN FIELD; PARALLEL TECHNIQUES; RANDOM FIELDS; VARIATIONAL INFERENCE;

PATTERN RECOGNITION;

EID: 84986275913     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.630     Document Type: Conference Paper

References (35)

1. S.-I. Amari. Natural GradientWorks Efficiently in Learning. Neural computation, 10 (2): 251-276, 1998.
2. T. Bagautdinov, P. Fua, and F. Fleuret. Probability Occupancy Maps for Occluded Depth Images. In Conference on Computer Vision and Pattern Recognition, 2015.
3. H. BenShitrit, J. Berclaz, F. Fleuret, and P. Fua. Multi-Commodity Network Flow for Tracking Multiple People. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36 (8): 1614-1627, 2014.
4. K. Bernardin and R. Stiefelhagen. Evaluating Multiple Object Tracking Performance: The Clear Mot Metrics. EURASIP Journal on Image and Video Processing, 2008, 2008.
5. C. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
6. Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23 (11): 1222-1239, 2001.
7. N. Campbell, K. Subr, and J. Kautz. Fully-connected crfs with non-parametric pairwise potential. In Conference on Computer Vision and Pattern Recognition, pages 1658-1665, 2013.
8. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. Yuille. Semantic image segmentation with deep convolutional nets and fully connected crfs. In International Conference for Learning Representations, 2015.
9. T. D'Orazio, M. Leo, N. Mosca, P. Spagnolo, and P. L. Mazzeo. A Semi-Automatic System for Ground Truth Generation of Soccer Video Sequences. In International Conference on Advanced Video and Signal Based Surveillance, pages 559-564, 2009.
10. J. Duchi, E. Hazan, and Y. Singer. Adaptive subgradient methods for online learning and stochastic optimization. The Journal of Machine Learning Research, 12: 2121-2159, 2011.
11. J. C. Duchi, S. Shalev-Shwartz, Y. Singer, and A. Tewari. Composite objective mirror descent. In COLT, pages 14-26. Citeseer, 2010.
12. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. http://www.pascalnetwork. org/challenges/VOC/voc2012/workshop/index.html.
13. F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua. Multi-Camera People Tracking with a Probabilistic Occupancy Map. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30 (2): 267-282, February 2008.
14. R. Frostig, S. Wang, P. Liang, and C. Manning. Simple MAP Inference via Low-Rank Relaxations. In Advances in Neural Information Processing Systems, pages 3077-3085, 2014.
15. A. E. Gelfand and A. F. Smith. Sampling-based approaches to calculating marginal densities. Journal of the American statistical association, 85 (410): 398-409, 1990.
16. L. Gorelick, Y. Boykov, O. Veksler, I. Ben Ayed, and A. Delong. Submodularization for binary pairwise energies. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1154-1161. IEEE, 2014.
17. M. Hoffman, D. Blei, C. Wang, and J. Paisley. Stochastic Variational Inference. Journal of Machine Learning Research, 14 (1): 1303-1347, May 2013.
18. J. H. Kappes, B. Andres, F. A. Hamprecht, C. Schnörr, S. Nowozin, D. Batra, S. Kim, B. X. Kausler, T. Kröger, J. Lellmann, et al. A comparative study of modern inference techniques for structured discrete energy minimization problems. International Journal of Computer Vision, 115 (2): 155-184, 2015.
19. M. E. Khan, P. Baqué, F. Fleuret, and P. Fua. Kullback-Leibler Proximal Variational Inference. In NIPS, 2015.
20. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. CoRR, abs/1412. 6980, 2014.
21. D. Koller and N. Friedman. Probabilistc Graphical Models. The MIT Press, 2009.
22. V. Kolmogorov. A new look at reweighted message passing. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 37 (5): 919-930, 2015.
23. P. Krähenbühl and V. Koltun. Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials. In Advances in Neural Information Processing Systems, 2011.
24. P. Krähenbühl and V. Koltun. Parameter Learning and Convergent Inference for Dense Random Fields. In International Conference on Machine Learning, pages 513-521, 2013.
25. T. P. Minka. Expectation propagation for approximate Bayesian inference. In Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence, pages 362-369. Morgan Kaufmann Publishers Inc., 2001.
26. K. Murphy, Y. Weiss, and M. Jordan. Loopy Belief Propagation for Approximate Inference: An Empirical Study. In Onference on Uncertainty in Artificial Intelligence, pages 467-475, 1999.
27. S. Nowozin, C. Rother, S. Bagon, T. Sharp, B. Yao, and P. Kholi. Decision Tree Fields. In International Conference on Computer Vision, November 2011.
28. B. T. Polyak. Some methods of speeding up the convergence of iteration methods. USSR Computational Mathematics and Mathematical Physics, 4 (5): 1-17, 1964.
29. M. Saito, T. Okatani, and K. Deguchi. Application of the Mean Field Methods to MRF Optimization in Computer Vision. In Conference on Computer Vision and Pattern Recognition, June 2012.
30. X. Sun, M. Christoudias, V. Lepetit, and P. Fua. Real-Time Landing Place Assessment in Man-Made Environments. Machine Vision and Applications, 2013.
31. M. Teboulle. Entropic proximal mappings with applications to nonlinear programming. Mathematics of Operations Research, 17 (3): pp. 670-690, 1992.
32. V. Vineet, J. Warrell, and P. Torr. Filter-Based Mean-Field Inference for Random Fields with Higher-Order Terms and Product Label-Spaces. International Journal of Computer Vision, 110 (3): 290-307, 2014.
33. M. Wainwright and M. Jordan. Graphical Models, Exponential Families, and Variational Inference. Foundations and Trends in Machine Learning, 1 (1-2): 1-305, Jan. 2008.
34. J. Winn and C. Bishop. Variational Message Passing. In Journal of Machine Learning Research, pages 661-694, 2005.
35. S. Zheng, S. Jayasumana, B. Romera-Paredes, V. Vineet, Z. Su, D. Du, C. Huang, and P. Torr. Conditional random fields as recurrent neural networks. In International Conference on Computer Vision (ICCV), 2015.