Segmentation framework based on label field fusion

IEEE Transactions on Image Processing

Volumn 16, Issue 10, 2007, Pages 2535-2550

  Jodoin, Pierre Marc ^a   Mignotte, Max ^b   Rosenberger, Christophe ^c  

^a UNIVERSITÉ DE SHERBROOKE   (Canada)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

^c UNIVERSITÉ D'ORLÉANS   (France)

Author keywords

Color segmentation; Label fusion; Motion estimation; Motion segmentation; Occlusion

Indexed keywords

COMPUTER VISION; IMAGE FUSION; ITERATIVE METHODS; MOTION ESTIMATION; OPTIMIZATION;

ENERGY FUNCTION; LABEL FIELD FUSION; MOTION SEGMENTATION; OCCLUSION DETECTION;

IMAGE SEGMENTATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COLOR; COLORIMETRY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; EVALUATION; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; MATHEMATICAL COMPUTING; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COLOR; COLORIMETRY; COMPUTER GRAPHICS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE;

EID: 34648837353     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2007.903841     Document Type: Article

References (90)

1. H. Tao, H. Sawhney, and R. Kumar, "A global matching framework for stereo computation," in Proc. ICCV, 2001, pp. 532-539.
2. M. Black and A. Jepson, "Estimating optical flow in segmented images using variable-order parametric models with local deformations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 10, pp. 972-986, Oct. 1996.
3. Z. Kato, T. Pong, and S. Qiang, "Multicue MRF image segmentation: Combining texture and color features," in Proc. ICPR, 2002, vol. 1, pp. 660-663.
4. S. Khan and M. Shah, "Object based segmentation of video color, motion and spatial information," in Proc. CVPR, 2001, pp. 746-751.
5. A. Solberg and A. Jain, "Texture fusion and feature selection applied to SAR imagery," IEEE Trans. Geosci. Remote Sens., vol. 35, no. 2, pp. 475-479, Mar. 1997.
6. D. Clausi and H. Deng, "Design-based texture feature fusion using Gabor filters and co-occurrence probabilities," IEEE Trans. Image Process. vol. 14, no. 7, pp. 925-936, Jul. 2005.
7. O. Pichler, A. Teuner, and B. Hosticka, "An unsupervised texture segmentation algorithm with feature space reduction and knowledge feedback," IEEE Trans. Image Process., vol. 7, no. 1, pp. 53-61, Jan. 1998.
8. J. Bigun, "Unsupervised feature reduction in image segmentation by local transforms," Pattern Recognit. Lett., vol. 14, pp. 573-583, 1993.
9. R. Kanth, D. Agrawal, and A. Singh, "Dimensionality reduction for similarity searching in dynamic databases," in Proc. ACM SIGMOD Int. Conf. Management of Data, 1998, pp. 166-176.
10. W. Jiang, G. Er, Q. Dai, and J. Gu, "Similarity-based online feature selection in content-based image retrieval," IEEE Trans. Image Process., vol. 15, no. 3, pp. 702-712, Mar. 2006.
11. M. Turk and A. Pentland, "Face recognition using eigenfaces," in Proc. CVPR, 1991, pp. 586-591.
12. I. Dagher and R. Nachar, "Face recognition using IPCA-ICA algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 996-1000, Jun. 2006.
13. C. Liu, "Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 725-737, May 2006.
14. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1996.
15. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2000.
16. D. Donoho, "High-dimensional data analysis: The curses and blessings of dimensionality," Lecture, Amer. Math. Soc., Math Challenges of the 21st Century, 2000.
17. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, 2003.
18. A. Jain and F. Farrokhnia, "Unsupervised texture segmentation using Gabor filters," Pattern Recognit., vol. 24, no. 12, pp. 1167-1186, 1991.
19. V.-P. Onana, E. Trouve, G. Mauris, J.-P. Rudant, and E. Tonye, "Linear features extraction in rain forest context from interferometric SAR images by fusion of coherence and amplitude information," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 11, pp. 2540-2556, Nov. 1999.
20. H. Li, R. Deklerck, B. De Cuyper, A. Hermanus, E. Nyssen, and J. Cornelis, "Object recognition in brain ct-scans: Knowledge-based fusion of data from multiple feature extractors," IEEE Trans. Med. Imag. vol. 14, no. 2, pp. 212-229, Feb. 1995.
21. A. Filippidis, L. Jain, and N. Martin, "Using genetic algorithms and neural networks for surface land mine detection," IEEE Trans. Signal Process., vol. 47, no. 1, pp. 176-186, Jan. 1999.
22. F. Bujor, E. Trouve, L. Valet, J.-M. Nicolas, and J.-P. Rudant, "Application of log-cumulants to the detection of spatiotemporal discontinuities in multitemporal SAR images," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 10, pp. 2073-2084, Oct. 2004.
23. A. Bendjebbour, Y. Delignon, L. Fouque, V. Samson, and W. Pieczynski, "Multisensor image segmentation using Dempster-Shafer fusion in markov fields context," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 8, pp. 1789-1798, Aug. 2001.
24. W. Pieczynski and D. Benboudjema, "Multisensor triplet markov fields and theory of evidence," Image Vis. Comput., vol. 24, no. 1, pp. 61-69, 2006.
25. M. Black, "Combining intensity and motion for incremental segmentation and tracking over long image sequences," in Proc. ECCV, 1992, pp. 485-493.
26. J. Sun, Y. Li, S. Kang, and H.-Y. Shum, "Symmetric stereo matching for occlusion handling," in Proc. CVPR, 2005, pp. 399-406.
27. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, "High accuracy optical flow estimation based on a theory for warping," in Proc. ECCV, 2004, pp. 25-36.
28. F. Heitz and P. Bouthemy, "Multimodal estimation of discontinuous optical flow using markov random fields," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 12, pp. 1217-1232, Dec. 1993.
29. S.-H. Lai and B. Vemuri, "Reliable and efficient computation of optical flow," Int. J. Comput. Vis., vol. 29, no. 2, pp. 87-105, 1998.
30. S. Jabri, Z. Duric, H. Wechsler, and A. Rosenfeld, "Detection and location of people in video images using adaptive fusion of color and edge information," in Proc. ICPR, 2000, pp. 4627-4631.
31. J. Kittler, M. Hatef, R. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.
32. A. Kushki, P. Androutsos, K. Plataniotis, and A. Venetsanopoulos, "Retrieval of images from artistic repositories using a decision fusion framework," IEEE Trans. Image Process., vol. 13, no. 3, pp. 277-292, Mar. 2004.
33. S. Reed, I. R. Ruiz, C. Capus, and Y. Petillot, "The fusion of large scale classified side-scan sonar image mosaics," IEEE Trans. Image Process., vol. 15, no. 7, pp. 2049-2060, Jul. 2006.
34. M. Bleyer and M. Gelautz, "A layered stereo matching algorithm using image segmentation and global visibility constraints," ISPRS J. Photogr. Remote Sens., vol. 59, no. 3, pp. 128-150, 2005.
35. Y. Wei and L. Quan, "Region-based progressive stereo matching," in Proc. CVPR, 2004, pp. 106-113.
36. L. Hong and G. Chen, "Segment-based stereo matching using graph cuts," in Proc. CVPR, 2004, pp. 74-81.
37. P. Smith, T. Drummond, and R. Cipolla, "Layered motion segmentation and depth ordering by tracking edges," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 4, pp. 479-494, Apr. 2004.
38. W. Thompson, "Combining motion and contrast for segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 2, no. 6, pp. 543-549, Jun. 1980.
39. Y. Altunbasak, P. Eren, and M. Tekalp, "Region-based parametric motion segmentation using color information," Graph. Models Image Process. vol. 60, no. 1, pp. 13-23, 1998.
40. C. Fuh and P. Maragos, "Region-based optical flow estimation," in Proc. CVPR, 1989, pp. 130-135.
41. M. Mignotte, "A segmentation-based regularization term for image deconvolution," IEEE Trans. Image Process., vol. 15, no. 7, pp. 1973-1974, Jul. 2006.
42. P.-M. Jodoin and M. Mignotte, "Motion segmentation using a k-nearest-neighbor-based fusion procedure of spatial and temporal label cues," in Proc. ICIAR, 2005, pp. 778-785.
43. P.-M. Jodoin, C. Rosenberger, and M. Mignotte, "Detecting half-occlusion with a fast region-based fusion procedure," presented at the BMVC, 2006.
44. J. Besag, "On the statistical analysis of dirty pictures"" J. Roy. Statist. Soc., vol. 48, no. 3, pp. 259-302, 1986.
45. S. Geman and D. Geman, "Stochastic relaxation, gibbs distributions, and the bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 6, pp. 721-741, Jun. 1984.
46. P.-M. Jodoin and M. Mignotte, "Markovian segmentation and parameter estimation on graphics hardware," J. Electron. Imag., vol. 15, no. 3, p. 033005, 2006.
47. W. Pieczynski, "Statistical image segmentation," Mach. Graph. Vis. vol. 1, no. 1, pp. 261-268, 1992.
48. D. Zhang and G. Lu, "Segmentation of moving objects in image sequence: A review," Circ. Syst. Signal Process., vol. 20, no. 2, pp. 143-183, 2001.
49. R. Megret and D. DeMenthon, "A survey of spatio-temporal grouping techniques," Tech. Rep., Univ. Maryland, College Park, 2002.
50. L. Bergen and F. Meyer, "A novel approach to depth ordering in monocular image sequences," in Proc. CVPR, 2000, pp. 536-541.
51. J.-Y. Bouguet, "Pyramidal implementation of the Lucas Kanade feature tracker: Description of the algorithm," Tech. Rep., Intel Corporation, 1999.
52. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision (darpa)," in Proc. DARPA Image Unders. Workshop, 1981, pp. 121-130.
53. J. Barron, D. Fleet, and S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, 1994.
54. B. Horn and B. Schnuck, "Determining optical flow," Artif. Intell. vol. 17, pp. 185-203, 1981.
55. H. Nagel, "On the estimation of optical flow: Relations between different approaches and some new results," Artif. Intell., vol. 33, no. 3, pp. 298-324, 1987.
56. J. Weickert, "On discontinuity-preserving optic flow," in Proc. CVMR, 1998, pp. 115-122.
57. G. Aubert, R. Deriche, and P. Kornprobst, "Computing optical flow via variational techniques," SIAM J. Appl. Math., vol. 60, no. 1, 1999.
58. J. Weickert and C. Schnörr, "Variational optic flow computation with a spatio-temporal smoothness constraint," Int. J. Comput. Vis., vol. 14, no. 3, pp. 245-255, 2001.
59. L. Alvarez, J. Weickert, and J. Sanchez, "Reliable estimation of dense optical flow fields with large displacements," Int. J. Comput. Vis. vol. 39, no. 1, pp. 41-56, 2000.
60. E. Simoncelli, E. Adelson, and D. Heeger, "Probability distributions of optical flow," in Proc. CVPR, 1991, pp. 310-315.
61. J. Weber and J. Malik, "Robust computation of optical flow in a multiscale differential framework," Int. J. Comput. Vis., vol. 14, no. 1, pp. 67-81, 1995.
62. A. Bruhn, J. Weickert, and C. Schnörr, "Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods," Int. J. Comput. Vis., vol. 61, no. 3, pp. 211-231, 2005.
63. M. Langer and R. Mann, "Optical snow," Int. J. Comput. Vis., vol. 55, no. 1, pp. 55-71, 2003.
64. P. Anandan, "A computation framework and an algorithm for the measurement of visual motion," Int. J. Comput. Vis., vol. 2, pp. 219-232, 1989.
65. D. Fleet and A. Jepson, "Computation of component image velocity from local phase information," Int. J. Comput. Vis., vol. 5, no. 1, pp. 77-104, 1990.
66. J. Konrad and E. Dubois, "Bayesian estimation of motion vector fields," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 9, pp. 910-927, Sep. 1992.
67. E. Memin and P. Perez, "Hierarchical estimation and segmentation of dense motion fields," Int. J. Comput. Vis., vol. 46, no. 2, pp. 129-155, 2002.
68. C. Stiller and J. Konrad, "Estimating motion in image sequences: A tutorial on modeling and computation of 2D motion," IEEE Signal Process. Mag., vol. 16, no. 4, pp. 70-91, Jul. 1999.
69. P. Bouthemy and P. Lalande, "Recovery of moving object masks in an image sequence using local spatiotemporal contextual information," Opt. Eng., vol. 32, no. 6, pp. 1205-1212, 1993.
70. M. Chang, M. Tekalp, and I. Sezan, "Simultaneous motion estimation and segmentation," IEEE Trans. Image Process., vol. 6, no. 9, pp. 1326-1333, Sep. 1997.
71. C. Stiller, "Object-oriented video coding employing dense motion fields," in Proc. ICASSP, 1994, pp. 273-276.
72. J.-M. Odobez and P. Bouthemy, "Robust multiresolution estimation of parametric motion models," J. Vis. Commun. Image Represent., vol. 6, no. 4, pp. 348-365, 1995.
73. D. Murray and B. Buxton, "Scene segmentation from visual motion using global optimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 9, no. 2, pp. 220-228, Feb. 1987.
74. M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice-Hall, 1995.
75. A. Bovik, Ed., Handbook of Image and Video Processing. New York: Academic, 2000.
76. D. Scharstein, R. Szeliski, and R. Zabih, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," presented at the IEEE Workshop on Stereo and Multi-Baseline Vision, 2001.
77. R. Depommier and E. Dubois, "Motion estimation with detection of occlusion areas," in Proc. ICASSP, 1992, pp. 269-272.
78. S. Ince and J. Konrad, "Geometry-based estimation of occlusions from video frame pairs," in Proc. ICASSP, 2005, vol. 2, pp. 933-936.
79. A. Luo and H. Burkhardt, "An intensity-based cooperative bidirectional stereo matching with simultaneous detection of discontinuities and occlusions," Int. J. Comput. Vis., vol. 15, no. 3, pp. 171-188, 1995.
80. C. Strecha, R. Fransens, and L. Van Gool, "A probabilistic approach to large displacement optical flow and occlusion detection," in Proc. ECCV Workshop SMVP, 2004, pp. 71-82.
81. D. Geiger, B. Ladendorf, and A. Yuille, "Occlusions and binocular stereo," Int. J. Comput. Vis., vol. 14, no. 3, pp. 211-226, 1995.
82. P. Fua, "A parallel stereo algorithm that produces dense depth maps and preserves image features," Mach. Vis. Appl., vol. 6, pp. 35-49, 1993.
83. K. Lim, A. Das, and M. Chong, "Estimation of occlusion and dense motion fields in a bidirectional bayesian framework," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 712-718, May 2002.
84. G. Egnal and R. Wildes, "Detecting binocular half-occlusions: Empirical comparisons of five approaches," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 8, pp. 1127-1133, Aug. 2002.
85. C. Chang, S. Chatterjee, and P. Kube, "On an analysis of static occlusion in stereo vision," in Proc. CVPR, 1991, pp. 722-723.
86. L. Alvarez, R. Deriche, R. Papadopoulo, and J. Sanchez, "Symmetrical dense optical flow estimation with occlusion detection," in Proc. ECCV, 2002, pp. 721-735.
87. D. Marr and T. Poggio, "Cooperative computation of stereo disparity," Science, vol. 194, no. 4262, pp. 283-287, 1976.
88. V. Kolmogorov and R. Zabih, "Computing visual correspondence with occlusions via graph cuts," in Proc. ICCV, 1999, pp. 508-515.
89. [Online]. Available: http://www.middlebury.edu/stereo2007
90. [Online]. Available: http://www.gpgpu.org/2007