Associative hierarchical random fields

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 6, 2014, Pages 1056-1077

  Ladický, L'Ubor ^a   Russell, Chris ^b   Kohli, Pushmeet ^c   Torr, Philip H S ^d  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c MICROSOFT RESEARCH   (United Kingdom)

^d OXFORD BROOKES UNIVERSITY   (United Kingdom)

Author keywords

Conditional random fields; Discrete energy minimisation; Object recognition and segmentation

Indexed keywords

ALGORITHMS; IMAGE SEGMENTATION; INFERENCE ENGINES; OBJECT RECOGNITION;

CONDITIONAL RANDOM FIELD; DISCRETE ENERGIES; MAP INFERENCES; MULTIPLE SEGMENTATION; NOVEL ALGORITHM; RANDOM FIELD MODEL; SEMANTIC SEGMENTATION; SINGLE-VIEW RECONSTRUCTION;

PIXELS;

EID: 84901834943     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.165     Document Type: Article

References (80)

1. J. Shotton, J. Winn, C. Rother, and A. Criminisi, "TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation," in Proc. European Conf. Computer Vision, Graz, Austria, 2006, pp. 1-15. (Pubitemid 44029764)
2. D. Batra, R. Sukthankar, and C. Tsuhan, "Learning class-specific affinities for image labelling," in Proc. Conf. CVPR, Anchorage, AK, USA, 2008, pp. 1-8.
3. C. Galleguillos, A. Rabinovich, and S. Belongie, "Object categorization using co-occurrence, location and appearance," in Proc. Conf. CVPR, Anchorage, AK, USA, 2008, pp. 1-8.
4. L. Yang, P. Meer, and D. J. Foran, "Multiple class segmentation using a unified framework over mean-shift patches," in Proc. Conf. Computer Vision Pattern Recognition, Minneapolis, MN, USA, 2007.
5. A. Rabinovich, A. Vedaldi, C. Galleguillos, E. Wiewiora, and S. Belongie, "Objects in context," in Proc. Int. Conf. Computer Vision, 2007.
6. C. Pantofaru, C. Schmid, and M. Hebert, "Object recognition by integrating multiple image segmentations," in Proc. ECCV, Marseille, France, 2008.
7. D. Larlus and F. Jurie, "Combining appearance models and Markov random fields for category level object segmentation," in Proc. Conf. CVPR, Anchorage, AK, USA, 2008, pp. 1-7.
8. X. Ren and J. Malik, "Learning a classification model for segmentation," in Proc. Int. Conf. Computer Vision, 2003.
9. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
10. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graphbased image segmentation," Int. J. Comput. Vis., vol. 59, no. 2, pp. 167-181, Sep. 2004.
11. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
12. X. He, R. Zemel, and D. Ray, "Learning and incorporating top-down cues in image segmentation," in Proc. ECCV, 2006, pp. 338-351. (Pubitemid 44029790)
13. B. Russell, W. Freeman, A. Efros, J. Sivic, and A. Zisserman, "Using multiple segmentations to discover objects and their extent in image collections," in Proc. Conf. CVPR, 2006, pp. 1605-1614.
14. D. Hoiem, A. Efros, and M. Hebert, "Geometric context from a single image," in Proc. Int. Conf. Computer Vision, 2005, pp. 654-661. (Pubitemid 44055018)
15. H. Tao, H. Sawhney, and R. Kumar, "A global matching framework for stereo computation," in Proc. Int. Conf. Computer Vision, Vancouver, BC, Canada, 2001.
16. J. Wang, P. Bhat, A. Colburn, M. Agrawala, and M. Cohen, "Interactive video cutout," ACM Trans. Graphics, vol. 24, no. 3, pp. 585-594, 2005.
17. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: Interactive foreground extraction using iterated graph cuts," in Proc. SIGGRAPH, New York, NY, USA, 2004.
18. S. Gould, R. Fulton, and D. Koller, "Decomposing a scene into geometric and semantically consistent regions," in Proc. Int. Conf. Computer Vision, Kyoto, Japan, 2009, pp. 1-8.
19. S. Gould, T. Gao, and D. Koller, "Region-based segmentation and object detection," in Proc. Adv. NIPS, 2009, pp. 655-663.
20. M. P. Kumar and D. Koller, "Efficiently selecting regions for scene understanding," in Proc. Conf. CVPR, 2010, pp. 3217-3224.
21. P. Kohli, L. Ladický, and P. H. S. Torr, "Robust higher order potentials for enforcing label consistency," in Proc. Conf. CVPR, Anchorage, AK, USA, 2008, pp. 1-8.
22. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
23. D. Hoiem, A. A. Efros, and M. Hebert, "Putting objects in perspective," in Proc. Conf. CVPR, 2006, pp. 2137-2144. (Pubitemid 44931578)
24. L. Zhu, Y. Chen, Y. Lin, C. Lin, and A. L. Yuille, "Recursive segmentation and recognition templates for 2D parsing," in Proc. Adv. NIPS, 2008.
25. Z. Tu, X. Chen, A. L. Yuille, and S. C. Zhu, "Image parsing: Unifying segmentation, detection, and recognition," in Proc. Int. Conf. Computer Vision, Nice, France, 2003.
26. J. Besag, "On the statisical analysis of dirty pictures," J. Roy. Statist. Soc., vol. 48, no. 3, p. 259402, May 1986.
27. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labelling sequence data," in Proc. Int. Conf. Machine Learning, San Francisco, CA, USA, 2001, pp. 282-289.
28. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large margin methods for structured and interdependent output variables," J. Mach. Learn. Res., vol. 6, pp. 1453-1484, Sep. 2005.
29. S. Nowozin, P. V. Gehler, and C. H. Lampert, "On parameter learning in CRF-based approaches to object class image segmentation," in Proc. ECCV, Crete, Greece, 2010.
30. B. Taskar, V. Chatalbashev, and D. Koller, "Learning associative markov networks," in Proc. Int. Conf. Machine Learning, Banff, AB, Canada, 2004.
31. K. Alahari, C. Russell, and P. Torr, "Efficient piecewise learning for conditional random fields," in Proc. Conf. CVPR, San Francisco, CA, USA, 2010, pp. 895-901.
32. M. Szummer, P. Kohli, and D. Hoiem, "Learning CRFs using graph cuts," in Proc. European Conf. Computer Vision, Marseille, France, 2008.
33. L. Zhu and A. L. Yuille, "A hierarchical compositional system for rapid object detection," in Proc. Adv. NIPS, 2005.
34. J. J. Lim, P. Arbelaez, C. Gu, and J. Malik, "Context by region ancestry," in Proc. Int. Conf. Computer Vision, Kyoto, Japan, 2009, pp. 1978-1985.
35. J. Reynolds and K. Murphy, "Figure-ground segmentation using a hierarchical conditional random field," in Proc. Canadian Conf. Computer Robot Vision, Washington, DC, USA, 2007.
36. S. Kumar and M. Hebert, "A hierarchical field framework for unified context-based classification," in Proc. Int. Conf. Computer Vision, vol. 2. Washington, DC, USA, 2005, pp. 1284-1291. (Pubitemid 44042328)
37. V. Lempitsky, A. Vedaldi, and A. Zisserman, "A pylon model for semantic segmentation," in Proc. Advances NIPS, 2011, pp. 1485-1493.
38. X. Boix et al., "Harmony potentials: Fusing global and local scale for semantic image segmentation," Int. J. Comput. Vis., vol. 91, no. 1, pp. 83-102, Jan. 2012.
39. D. Munoz, J. A. Bagnell, and M. Hebert, "Stacked hierarchical labeling," in Proc. ECCV, Crete, Greece, 2010.
40. L. Ladický, C. Russell, P. Kohli, and P. H. S. Torr, "Graph cut based inference with co-occurrence statistics," in Proc. ECCV, Heraklion, Greece, 2010, pp. 239-253.
41. R. Szeliski et al., "A comparative study of energy minimization methods for Markov random fields," in Proc. European Conf. Computer Vision, 2006.
42. Y. Weiss and W. Freeman, "On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 736-744, Feb. 2001. (Pubitemid 32318100)
43. V. Kolmogorov, "Convergent tree-reweighted message passing for energy minimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 10, pp. 1568-1583, Oct. 2006. (Pubitemid 46405078)
44. V. Kolmogorov and C. Rother, "Comparison of energy minimization algorithms for highly connected graphs," in Proc. ECCV, Graz, Austria, 2006, pp. 1-15. (Pubitemid 44029713)
45. D. Sontag, T. Meltzer, A. Globerson, T. Jaakkola, and Y. Weiss, "Tightening LP relaxations for MAP using message passing," in Proc. Uncertainty Artificial Intelligence, 2008.
46. T. Werner, "High-arity interactions, polyhedral relaxations, and cutting plane algorithm for soft constraint optimisation (MAPMRF)," in Proc. Conf. Computer Vision Pattern Recognition, Anchorage, AK, USA, 2009.
47. O. Veksler, "Graph cut based optimization for MRFs with truncated convex priors," in Proc. Conf. Computer Vision Pattern Recognition, Minneapolis, MN, USA, 2007.
48. M. P. Kumar, O. Veksler, and P. H. S. Torr, "Improved moves for truncated convex models," J. Mach. Learn. Res., vol. 12, no. 1, pp. 31-67, Feb. 2011.
49. X. Lan, S. Roth, D. Huttenlocher, and M. Black, "Efficient belief propagation with learned higher-order Markov random fields," in Proc. ECCV, 2006, pp. 269-282. (Pubitemid 44029733)
50. B. Potetz and T. S. Lee, "Efficient belief propegation for higher order cliques using linear constraint nodes," Comput. Vis. Image Understand., vol. 112, no. 1, pp. 39-54, Oct. 2008.
51. D. Tarlow, R. Zemel, and B. Frey, "Flexible priors for exemplarbased clustering," in Proc. Conf. Uncertainty Artificial Intelligence, 2008.
52. D. Tarlow, I. Givoni, and R. Zemel, "HOP-MAP: Efficient message passing with high order potentials," in Proc. Artificial Intelligence Statistics, Sardinia, Italy, 2010.
53. A. Fix, A. Gruber, E. Boros, and R. Zabih, "A graph cut algorithm for higher-order Markov random fields," in Proc. Int. Conf. Computer Vision, Barcelona, Spain, 2011, pp. 1020-1027.
54. H. Ishikawa, "Higher-order clique reduction in binary graph cut," in Proc. Conf. CVPR, Miami, FL, USA, 2009, pp. 2993-3000.
55. H. Ishikawa, "Transformation of general binary MRF minimization to the first-order case," IEEE Trans. Pattern Anal Mach. Intell., vol. 33, no. 6, pp. 1234-1249, Jun. 2011.
56. S. Ramalingam, C. Russell, L. Ladický, and P. H. Torr, "Efficient minimization of higher order submodular functions using monotonic Boolean functions," Arxiv preprint arXiv:11092304, 2011.
57. P. Kohli, M. Kumar, and P. H. S. Torr, "P3 and beyond: Solving energies with higher order cliques," in Proc. Conf. CVPR, Minneapolis, MN, USA, 2007, pp. 1-8.
58. V. Kolmogorov and R. Zabih, "What energy functions can be minimized via graph cuts?," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 2, pp. 147-159, Feb. 2004.
59. C. Rother, S. Kumar, V. Kolmogorov, and A. Blake, "Digital tapestry," in Proc. Conf. Computer Vision Pattern Recognition, 2005.
60. D. Schlesinger and B. Flach, "Transforming an arbitrary minsum problem into a binary one," Dresden Univ. Technol. Dresdenm, Germany, Tech. Rep., 2006.
61. J. Shotton, M. Johnson, and R. Cipolla, "Semantic texton forests for image categorization and segmentation," in Proc. Conf. Computer Vision Pattern Recognition, Anchorage, AK, USA, 2008, pp. 1-8.
62. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, The PASCAL Visual Object Classes Challenge (VOC2008) Results [Online]. Available: http://www.pascal-network.org/challenges/VOC/voc2008/inde x.html
63. J. Tighe and S. Lazebnik, "Superparsing: Scalable nonparametric image parsing with superpixels," in Proc. European Conf. Computer Vision, Crete, Greece, 2010.
64. R. Socher, C. C. Lin, A. Y. Ng, and C. D. Manning, "Parsing natural scenes and natural language with recursive neural networks," in Proc. Int. Conf. Machine Learning, Bellevue, WA, USA, 2011, pp. 129-136.
65. R. Achanta et al., "SLIC superpixels compared to state-of-theart superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, Nov. 2012.
66. Y. Zhang, R. I. Hartley, J. Mashford, and S. Burn, "Superpixels via pseudo-Boolean optimization," in Proc. Int. Conf. Computer Vision, Barcelona, Spain, 2011.
67. J. Malik, S. Belongie, T. Leung, and J. Shi, "Contour and texture analysis for image segmentation," Int. J. Comput. Vis., vol. 43, no. 1, pp. 7-27, Jun. 2001. (Pubitemid 32720090)
68. T. Ojala, M. Pietikainen, and D. Harwood, "Performance evaluation of texture measures with classification based on Kullback discrimination of distributions," in Proc. Conf. Computer Vision Image Processing, Jerusalem, Israel, 1994.
69. A. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel," in Proc. Int. Conf. Image Video Retrieval, Amsterdam, Netherlands, 2007, pp. 401-408. (Pubitemid 350229652)
70. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
71. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek, "Evaluation of color descriptors for object and scene recognition," in Proc. Conf. Computer Vision Pattern Recognition, Amsterdam, Netherlands, 2008.
72. A. Torralba, K. Murphy, and W. Freeman, "Sharing features: Efficient boosting procedures for multiclass object detection," in Proc. Conf. Computer Vision Pattern Recognition, Sardinia, Italy, 2004.
73. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. Conf. CVPR, San Diego, CA, USA, 2005, pp. 886-893. (Pubitemid 43897286)
74. Y. Boykov and M. Jolly, "Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images," in Proc. Int. Conf. Computer Vision, Vancouver, BC, Canada, 2001, pp. 105-112. (Pubitemid 32794944)
75. A. Blake, C. Rother, M. Brown, P. Perez, and P. Torr, "Interactive image segmentation using an adaptive GMMRF model," in Proc. ECCV, vol. 3021. 2004, pp. 428-441.
76. G. E. Hinton and S. Osindero, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, Jul. 2006. (Pubitemid 44024729)
77. B. Taskar, V. Chatalbashev, and D. Koller, "Learning associative Markov networks," in Proc. Int. Conf. Machine Learning, Banff, AB, Canada, 2004.
78. T. Finley and T. Joachims, "Training structural SVMs when exact inference is intractable," in Proc. Int. Conf. Mach. Learn., Helsinki, Finland, 2008, pp. 304-311.
79. J. H. Kappes et al., "A comparative study of modern inference techniques for discrete energy minimization problems," in Proc. Conf. CVPR, Portland, OR, USA, 2013, pp. 1328-1335.
80. N. Komodakis and N. Paragios, "Beyond pairwise energies: Efficient optimization for higher-order MRFs," in Proc. Conf. CVPR, Miami, FL, USA, 2009, pp. 2985-2992.