Sparse Multi-View Consistency for Object Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 9, 2015, Pages 1890-1903

  Djelouah, Abdelaziz ^a   Franco, Jean Sebastien ^b   Boyer, Edmond ^b   Le Clerc, Francois ^a   Perez, Patrick ^a  

^a Technicolor   (France)

^b INRIA RHÔNE ALPES   (France)

Author keywords

Scene analysis; Segmentation

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION;

BACKGROUND REGION; COMPUTATIONAL COSTS; FOREGROUND REGIONS; MULTI-VIEWS; MULTIPLE VIEWS; OBJECT SEGMENTATION; SCENE ANALYSIS; SEGMENTATION INFORMATIONS;

IMAGE SEGMENTATION;

EID: 84939226626     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2385704     Document Type: Article

References (36)

1. C. Rother, V. Kolmogorov, and A. Blake, "'Grabcut': Interactive foreground extraction using iterated graph cuts, " in Proc. ACM SIGGRAPH Papers, 2004, pp. 309-314.
2. C. Rother, T. Minka, A. Blake, and V. Kolmogorov, "Cosegmentation of image pairs by histogram matching-incorporating a global constraint into MRFs, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 993-1000.
3. N. D. F. Campbell, G. Vogiatzis, C. Hernandez, and R. Cipolla, "Automatic 3d object segmentation in multiple views using volumetric graph-cuts, " Image Vis. Comput., vol. 28, no. 1, pp. 4-25, 2010.
4. Y. M. Kim, C. Theobalt, J. Diebel, J. Kosecka, B. Micusik, and S. Thrun, "Multi-view image and tof sensor fusion for dense 3D reconstruction, " in Proc. IEEE Workshop 3-D Digital Imag. Model., 2009, pp. 1542-1549.
5. L. Wang, C. Zhang, R. Yang, and C. Zhang, "Tofcut: Towards robust real-Time foreground extraction using a time-of-flight camera, " in Proc. 5th Int. Symp. 3D Data Process., Vis. Transmission, 2010, pp. 1-8.
6. A. Djelouah, J.-S. Franco, E. Boyer, F. Leclerc, and P. Perez, "N-Tuple color segmentation for multi-view silhouette extraction, " in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 818-831.
7. C. Wen, A. Azarbayejani, T. Darrell, and A. Pentland, "Pfinder: Real-Time tracking of the human body, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 780-785, Jul. 1997.
8. C. Stauffer and E. Grimson, "Adaptive background mixture models for real-Time tracking, " presented at the Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Fort Collins, CO, USA, 1999.
9. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, "Wallflower: Principles and practice of background maintenance, " in Proc. 7th IEEE Int. Conf. Comput. Vis., 1999, pp. 255-261.
10. Y. Boykov and M.-P. Jolly, "Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images, " in Proc. 8th IEEE Int. Conf. Comput. Vis., 2001, pp. 105-112.
11. V. Kolmogorov, A. Criminisi, A. Blake, G. Cross, and C. Rother, "Bi-layer segmentation of binocular stereo video, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 407-414.
12. R. Crabb, C. Tracey, A. Puranik, and J. Davis, "Real-Time foreground segmentation via range and color imaging, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshop, 2008, pp. 1-5.
13. J. van Baar, P. Beardsley, M. Pollefeys, and M. Gross, "Interactive video segmentation supported by multiple modalities, with an application to depth maps, " in Proc. 3DTV-Conf.: True Vis.-Capture, Transmission Display 3D Video, 2012, pp. 1-4.
14. D. Batra, A. Kowdle, D. Parikh, J. Luo, and T. Chen, "icoseg: Interactive co-segmentation with intelligent scribble guidance, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3169-3176.
15. A. Joulin, F. R. Bach, and J. Ponce, "Discriminative clustering for image co-segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 1943-1950.
16. S. Vicente, C. Rother, and V. Kolmogorov, "Object cosegmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 2217-2224.
17. D. S. Hochbaum and V. Singh, "An efficient algorithm for cosegmentation, " in Proc. 9th IEEE Int. Conf. Comput. Vis., 2009, pp. 269-276.
18. J. M. Winn and N. Jojic, "Locus: Learning object classes with unsupervised segmentation, " in Proc. 10th IEEE Int. Conf. Comput. Vis., 2005, pp. 756-763.
19. D. Snow, P. Viola, and R. Zabih, "Exact voxel occupancy with graph cuts, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2000, pp. 345-352.
20. J.-S. Franco and E. Boyer, "Fusion of multi-view silhouette cues using a space occupancy grid, " in Proc. 10th IEEE Int. Conf. Comput. Vis., 2005, pp. 1747-1753.
21. K. Kolev, T. Brox, and D. Cremers, "Fast joint estimation of silhouettes and dense 3D geometry from multiple images, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 493-505, Mar. 2012.
22. K. Kutulakos and S. Seitz, "A theory of shape by space carving, " in Proc. 9th IEEE Int. Conf. Comput. Vis., 1999, pp. 307-314.
23. L. Guan, J.-S. Franco, and M. Pollefeys, "3D object reconstruction with heterogeneous sensor data, " in Proc. 5th Int. Symp. 3D Data Process., Vis. Transmission, 2008.
24. G. Zeng and L. Quan, "Silhouette extraction from multiple images of an unknown background, " in Proc. Asian Conf. Comput. Vis., 2004, pp. 628-633.
25. M. Sormann, C. Zach, and K. Karner, "Graph cut based multiple view segmentation for 3D reconstruction, " in Proc. 3rd Int. Symp. 3D Data Process., Vis. Transmission, 2006, pp. 1085-1092.
26. T. Feldmann, L. Diebelberg, and A. Worner, "Adaptive foreground/background segmentation using multiview silhouette fusion, " in Proc. 31st DAGM-Symp. Pattern Recog., 2009, pp. 522-531.
27. J. Gallego, J. Salvador, J. Casas, and M. Pards, "Joint multiview foreground segmentation and 3D reconstruction with tolerance loop, " in Proc. 18th IEEE Int. Conf. Image Process., 2011, pp. 997-1000.
28. C. Reinbacher, M. Rüther, and H. Bischof, "Fast variational multiview segmentation through backprojection of spatial constraints, " Image Vis. Comput., vol. 30, no. 11, pp. 797-807, 2012.
29. W. Lee, W. Woo, and E. Boyer, "Silhouette segmentation in multiple views, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 7, pp. 1429-1441, Jul. 2010.
30. A. Kowdle, S. N. Sinha, and R. Szeliski, "Multiple view object cosegmentation using appearance and stereo cues, " in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 789-803.
31. N. Campbell, G. Vogiatzis, C. Hernandez, and R. Cipolla, "Automatic object segmentation from calibrated images, " in Proc. Conf. Visual Media Production, 2011, pp. 126-137.
32. M. Sarim, A. Hilton, J.-Y. Guillemaut, H. Kim, and T. Takai, "Wide-baseline multi-view video segmentation for 3D reconstruction, " in Proc. 1st Int. Workshop 3D Video Process., 2010, pp. 13-18.
33. C. M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics). New York, NY, USA: Springer, 2006.
34. J. Bilmes, "A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models, " Int. Comput. Sci. Inst., U.C. Berkely, Berkeley, CA, USA, Tech. Rep. TR-97-021, 1997.
35. M. Lhuillier and L. Quan, "A quasi-dense approach to surface reconstruction from uncalibrated images, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 418-433, Mar. 2005.
36. G. Bradski, "The OpenCV Library, " Dr. Dobb's Journal of Software Tools, 2000.