Recovering occlusion boundaries from an image

International Journal of Computer Vision

Volumn 91, Issue 3, 2011, Pages 328-346

  Hoiem, Derek ^a   Efros, Alexei A ^b   Hebert, Martial ^b  

^a University of Illinois at Urbana Champaign   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

3D reconstruction; Depth from image; Edge detection; Figure ground labeling; Image interpretation; Image segmentation; Occlusion boundaries; Scene understanding

Indexed keywords

3D RECONSTRUCTION; DEPTH FROM IMAGE; FIGURE/GROUND LABELING; IMAGE INTERPRETATION; OCCLUSION BOUNDARIES; SCENE UNDERSTANDING;

ALGORITHMS; COMPUTER VISION; EDGE DETECTION; IMAGE ANALYSIS; THREE DIMENSIONAL;

IMAGE SEGMENTATION;

EID: 79851509434     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-010-0400-4     Document Type: Article

References (77)

1. Ahuja, N. (1996). A transform for multiscale image segmentation by integrated edge and region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(12). http://dx.doi.org/10.1109/34.546258.
2. Alexe, B.; Deselaers, T.; & Ferrari, V. (2010). What is an object? In CVPR 2010.
3. Amir, A.; & Lindenbaum, M. (1998). A generic grouping algorithm and its quantitative analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(2). http://dx.doi.org/10.1109/34.659934.
4. Arbelaez, P. (2006). Boundary extraction in natural images using ultrametric contour maps. In Proc. POCV.
5. Arbelaez, P.; Maire, M.; Fowlkes, C.; & Malik, J. (2009). From contours to regions: an empirical evaluation. In CVPR.
6. Bakin, J. S.; Nakayama, K.; & Gilbert, C. D. (2000). Visual responses in monkey areas v1 and v2 to three-dimensional surface configurations. The Journal of Neuroscience.
7. M. J. Black D. J. Fleet 2000 Probabilistic detection and tracking of motion discontinuities International Journal of Computer Vision 38 3 231 245 1012.68694 10.1023/A:1008195307933
8. J. Canny 1986 A computational approach to edge detection IEEE Transactions on Pattern Analysis and Machine Intelligence 8 6 679 698 10.1109/TPAMI.1986.4767851
9. Cao, L.; Liu, J.; & Tang, X. (2005). 3D object reconstruction from a single 2D line drawing without hidden lines. In ICCV.
10. M. Clowes 1971 On seeing things Artificial Intelligence 2 1 79 116 10.1016/0004-3702(71)90005-1
11. Collins, M.; Schapire, R.; & Singer, Y. (2002). Logistic regression, Adaboost and Bregman distances. Machine Learning, 48(1-3).
12. Cour, T.; Benezit, F.; & Shi, J. (2005). Spectral segmentation with multiscale graph decomposition. In CVPR.
13. S. Draper 1981 The use of gradient and dual space in line-drawing interpretation Artificial Intelligence 17 461 508 10.1016/0004-3702(81)90032-1 (Pubitemid 12462610)
14. Elder, J.; & Zucker, S. (1996). Computing contour closure. In ECCV.
15. Endres, I.; & Hoiem, D. (2010). Category independent object proposals. In ECCV.
16. Everingham, M.; Van Gool, L.; Williams, C. K. I.; Winn, J.; & Zisserman, A. (2008). The PASCAL visual object classes challenge 2008 (VOC2008) results. http://www.pascal-network.org/challenges/VOC/voc2008/workshop/index. html.
17. Farhadi, A.; Endres, I.; & Hoiem, D. (2010). Attribute-centric recognition for cross-category generalization. In CVPR.
18. Felzenszwalb, P.; & Huttenlocher, D. (2004). Efficient graph-based image segmentation. International Journal of Computer Vision, 59(2). http://dx.doi.org/10.1023/B:VISI.0000022288.19776.77.
19. Gibson, J. (1950). The perception of the visual world. Boston: Houghton Mifflin.
20. Gould, S.; Gao, T.; & Koller, D. (2009). Region-based segmentation and object detection. In NIPS.
21. Guzman, A. (1968). Computer recognition of three-dimensional objects in a visual scene. Technical report MAC-TR-59. MIT.
22. Herault, L.; & Horaud, R. (1993). Figure-ground discrimination: A combinatorial optimization approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15. http://dx.doi.org/10.1109/34.232076.
23. Heskes, T.; Albers, K.; & Kappen, B. (2003). Approximate inference and constrained optimization. In Proc. UAI.
24. Hoiem, D.; Efros, A. A.; & Hebert, M. (2005). Automatic photo pop-up. In ACM SIGGRAPH 2005.
25. D. Hoiem A. A. Efros M. Hebert 2007 Recovering surface layout from an image International Journal of Computer Vision 75 1 151 172 10.1007/s11263-006- 0031-y (Pubitemid 47120250)
26. Hoiem, D.; Efros, A. A.; & Hebert, M. (2008). Closing the loop on scene interpretation. In CVPR.
27. Hoiem, D.; Stein, A. N.; Efros, A. A.; & Hebert, M. (2007). Recovering occlusion boundaries from an image. In ICCV.
28. D. Huffman 1971 Impossible objects as nonsense sentences Machine Intelligence 6 295 323
29. D. Huffman 1977 Realizable configurations of lines in pictures of polyhedra Machine Intelligence 8 493 509
30. Jacobs, D. (1993). Robust and efficient detection of convex groups. In CVPR.
31. R. Jain J. Aggarwal 1979 Computer analysis of scenes with curved objects Proceedings of the IEEE 67 5 805 812 10.1109/PROC.1979.11329 (Pubitemid 9446711)
32. I. Jermyn H. Ishikawa 2001 Globally optimal regions and boundaries as minimum ratio weight cycles IEEE Transactions on Pattern Analysis and Machine Intelligence 23 10 1075 1088 10.1109/34.954599 (Pubitemid 33047947)
33. T. Kanade 1980 A theory of the Origami world Artificial Intelligence 13 279 311 0497.68059 10.1016/0004-3702(80)90004-1 581940
34. S.J. Kim K. Koh M. Lustig S. Boyd D. Gorinevsky 2007 An interior-point method for large-scale l1-regularized logistic regression Journal of Machine Learning Research 8 1519 1555 (Pubitemid 47210273)
35. Kovacs, I.; & Julesz, B. (1993). A closed curve is much more than an incomplete one: effect of closure in figure-ground discrimination. In Proc. Nat'l Academy of Science USA, 90.
36. M. P. Kumar P. Torr A. Zisserman 2010 Objcut: efficient segmentation using top-down and bottom-up cues IEEE Transactions on Pattern Analysis and Machine Intelligence 32 530 545 10.1109/TPAMI.2009.16
37. Lalonde, J.-F.; Hoiem, D.; Efros, A. A.; Rother, C.; Winn, J.; & Criminisi, A. (2007). Photo clip art. In ACM SIGGRAPH 2007.
38. Leclerc, Y.; & Fischler, M. (1992). An optimization-based approach to the interpretation of single line drawings as 3D wire frames. International Journal of Computer Vision, 9(2). http://dx.doi.org/10.1007/BF00129683.
39. 1-regularization. In NIPS.
40. Leichter, I.; & Lindenbaum, M. (2009). Boundary ownership by lifting to 2.1D. In NIPS.
41. Leung, T.; & Malik, J. (1998). Contour continuity in region based image segmentation. In ECCV.
42. Li, F.; Carreira, J.; & Sminchisescu, C. (2010). Object recognition as ranking holistic figure-ground hypotheses. In CVPR.
43. Lipson, H.; & Shpitalni, M. (1996). Optimization-based reconstruction of a 3D object from a single freehand line drawing. Computer-Aided Design, 28(8).
44. Lowe, D. (1985). Perceptual organization and visual recognition. Kluwer Academic: Norwell.
45. Mahamud, S.; Williams, L. R.; Thornber, K. K.; & Xu, K. (2003). Segmentation of multiple salient closed contours from real images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(4). http://dx.doi.org/10.1109/TPAMI.2003.1190570.
46. Maire, M.; Arbelaez, P.; Fowlkes, C.; & Malik, J. (2008). Using contours to detect and localize junctions in natural images. In CVPR.
47. J. Malik 1987 Interpreting line drawings of curved objects International Journal of Computer Vision 1 1 73 103 10.1007/BF00128527
48. Marill, T. (1991). Emulating the human interpretation of line-drawings as three-dimensional objects. International Journal of Computer Vision, 6(2). http://dx.doi.org/10.1007/BF00128154.
49. Martin, D.; Fowlkes, C.; & Malik, J. (2002). Learning to find brightness and texture boundaries in natural images. In NIPS.
50. Martin, D.; Fowlkes, C.; Tal, D.; & Malik, J. (2001). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In ICCV.
51. D. R. Martin C. C. Fowlkes J. Malik 2004 Learning to detect natural image boundaries using local brightness, color, and texture cues IEEE Transactions on Pattern Analysis and Machine Intelligence 26 5 530 549 10.1109/TPAMI.2004. 1273918
52. J. McDermott 2004 Psychophysics with junctions in real images Perception 33 9 1101 1127 10.1068/p5265 (Pubitemid 39558197)
53. 2 regularization, and rotational invariance. In ICML.
54. Nitzberg, M.; & Mumford, D. (1990). The 2.1-D sketch. In ICCV.
55. Perona, P.; & Freeman, W. (1998). A factorization approach to grouping. In ECCV.
56. Prasad, M.; Zisserman, A.; Fitzgibbon, A.; Kumar, M.; & Torr, P. (2006). Learning class-specific edges for object detection and segmentation. In ICCV.
57. Ren, X.; Fowlkes, C. C.; & Malik, J. (2006). Figure/ground assignment in natural images. In ECCV.
58. Ren, X.; & Malik, J. (2003). Learning a classification model for segmentation. In ICCV.
59. Roberts, L. (1965). Machine perception of 3-D solids. In OEOIP, pp. 159-197.
60. Russell, B. C.; Efros, A. A.; Sivic, J.; Freeman, W. T.; & Zisserman, A. (2006). Using multiple segmentations to discover objects and their extent in image collections. In CVPR.
61. Sarkar, S.; & Soundararajan, P. (2000). Supervised learning of large perceptual organization: graph spectral partitioning and learning automata. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(5). http://dx.doi.org/10.1109/34.857006.
62. Saund, E. (2006). Logic and MRF circuitry for labeling occluding and thinline visual contours. In NIPS.
63. Saxena, A.; Chung, S.; & Ng, A. Y. (2005). Learning depth from single monocular images. In NIPS.
64. Saxena, A.; Chung, S. H.; & Ng, A. Y. (2007). 3-d depth reconstruction from a single still image. International Journal of Computer Vision, 76. http://dx.doi.org/10.1007/s11263-007-0071-y.
65. Shi, J.; & Malik, J. (2000). Normalized cuts and image segmentation. IEEE Transactions on IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8). http://dx.doi.org/10.1109/34.868688.
66. Shoji, K.; Kato, K.; & Toyama, F. (2001). 3-D interpretation of single line drawings based on entropy minimization principle. In ICCV.
67. P. Smith T. Drummond R. Cipolla 2004 Layered motion segmentation and depth ordering by tracking edges IEEE Transactions on Pattern Analysis and Machine Intelligence 26 4 479 494 10.1109/TPAMI.2004.1265863
68. Stein, A. N.; & Hebert, M. (2006a). Local detection of occlusion boundaries in video. In BMVC.
69. Stein, A. N.; & Hebert, M. (2006b). Using spatio-temporal patches for simultaneous estimation of edge strength, orientation, and motion. In Beyond Patches Workshop at CVPR.
70. Stein, A. N.; Hoiem, D.; & Hebert, M. (2007). Learning to find object boundaries using motion cues. In ICCV.
71. K. Sugihara 1984 An algebraic approach to the shape-from-image-problem Artificial Intelligence 23 59 95 0537.68092 10.1016/0004-3702(84)90005-5 760322 (Pubitemid 14606719)
72. K. Sugihara 1984 A necessary and sufficient condition for a picture to represent a polyhedral scene IEEE Transactions on Pattern Analysis and Machine Intelligence 6 5 578 586 10.1109/TPAMI.1984.4767571 (Pubitemid 14642956)
73. R. Vaillant O. Faugeras 1992 Using extremal boundaries for 3D object modeling IEEE Transactions on Pattern Analysis and Machine Intelligence 14 2 157 173 10.1109/34.121787
74. Viola, P.; & Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2). http://dx.doi.org/10.1023/B: VISI.0000013087.49260.fb.
75. Waltz, D. L. (1975). Understanding line drawings of scenes with shadows. In P. Winston (Ed.), The psychology of computer vision (pp. 19-91). McGraw-Hill, New York.
76. Wertheimer, M. (1938). Laws of organization in perceptual forms. In W. D. Ellis (Ed.), A sourcebook of gestalt psychology. Routledge, London.
77. Yuille, A. L. (2002). CCCP algorithms to minimize the Bethe and Kikuchi free energies: convergent alternatives to belief propagation. Neural Computation, 14(7).