Colour, texture, and motion in level set based segmentation and tracking

Image and Vision Computing

Volumn 28, Issue 3, 2010, Pages 376-390

  Brox, Thomas ^a   Rousson, Mikaël ^b   Deriche, Rachid ^c   Weickert, Joachim ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Polar Rose Romix   (France)

^c UNIVERSITÉ PARIS EST   (France)

^d SAARLAND UNIVERSITY   (Germany)

Author keywords

Image segmentation; Level set methods; Motion; Nonlinear diffusion; Texture; Tracking

Indexed keywords

COLOR; DIFFUSION; DIGITAL IMAGE STORAGE; DROP BREAKUP; LEVEL MEASUREMENT; TEXTURES;

EDGE ENHANCING; FRONT PROPAGATION; IMAGE GREY VALUES; IMAGE SEQUENCE; INPUT FEATURES; LEVEL SET; LEVEL SET METHODS; MOTION; MULTIPLE OBJECTS; NONLINEAR DIFFUSION; OBJECT REGION; SEGMENTATION AND TRACKING; SPATIAL AND TEMPORAL VARIATION; TOTAL VARIATION FLOW; TWO-STEP APPROACH; VECTOR VALUED;

IMAGE SEGMENTATION;

EID: 70450257726     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2009.06.009     Document Type: Article

References (73)

1. Acar R., and Vogel C.R. Analysis of bounded variation penalty methods for ill-posed problems. Inverse Problems 10 (1994) 1217-1229
2. Adalsteinsson D., and Sethian J.A. A fast level set method for propagating interfaces. Journal of Computational Physics 118 2 (1995) 269-277
3. Andreu F., Ballester C., Caselles V., and Mazón J.M. Minimizing total variation flow. Differential and Integral Equations 14 3 (2001) 321-360
4. S. Baker, D. Scharstein, J.P. Lewis, S. Roth, M.J. Black, R. Szeliski, A database and evaluation methodology for optical flow, in: Proceedings of the International Conference on Computer Vision, 2007.
5. S. Belongie, C. Carson, H. Greenspan, J. Malik, Color- and texture-based image segmentation using the expectation-maximization algorithm and its application to content-based image retrieval, in: Proceedings of the Sixth International Conference on Computer Vision, Bombay, India, January 1998, pp. 675-682.
6. Bigün J., Granlund G.H., and Wiklund J. Multidimensional orientation estimation with applications to texture analysis and optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence 13 8 (1991) 775-790
7. Blake A., and Zisserman A. Visual Reconstruction (1987), MIT Press, Cambridge, MA
8. Brodatz P. Textures: A Photographic Album for Artists and Designers (1966), Dover, New York
9. T. Brox, From Pixels to Regions: Partial Differential Equations in Image Analysis. Ph.D. Thesis, Faculty of Mathematics and Computer Science, Saarland University, Germany, April 2005.
10. Brox T., Rousson M., Deriche R., and Weickert J. Unsupervised segmentation incorporating colour texture and motion. In: Petkov N., and Westenberg M.A. (Eds). Computer Analysis of Images and Patterns. Lecture Notes in Computer Science vol. 2756 (2003), Springer, Berlin 353-360
11. Brox T., van den Boomgaard R., Lauze F.B., van de Weijer J., Weickert J., Mrázek P., and Kornprobst P. Adaptive structure tensors and their applications. In: Weickert J., and Hagen H. (Eds). Visualization and Processing of Tensor Fields (2006), Springer, Berlin 17-42
12. Brox T., and Weickert J. Level set segmentation with multiple regions. IEEE Transactions on Image Processing 15 10 (2006) 3213-3218
13. Brox T., and Weickert J. A TV flow based local scale estimate and its application to texture discrimination. Journal of Visual Communication and Image Representation 17 5 (2006) 1053-1073
14. Brox T., Weickert J., Burgeth B., and Mrázek P. Nonlinear structure tensors. Image and Vision Computing 24 1 (2006) 41-55
15. T. Brox, M. Welk, G. Steidl, J. Weickert, Equivalence results for TV diffusion and TV regularisation, in: L.D. Griffin, M. Lillholm (Eds.), Scale-Space Methods in Computer Vision, LNCS, vol. 2695, Springer, Berlin, June 2003, pp. 86-100.
16. Caselles V., Catté F., Coll T., and Dibos F. A geometric model for active contours in image processing. Numerische Mathematik 66 (1993) 1-31
17. Caselles V., Kimmel R., and Sapiro G. Geodesic active contours. Proceedings of the Fifth International Conference on Computer Vision (1995), IEEE Computer Society Press, Cambridge, MA 694-699
18. Chan T., Sandberg B.Y., and Vese L. Active contours without edges for vector-valued images. Journal of Visual Communication and Image Representation 11 (2000) 130-141
19. Chan T., and Vese L. Active contours without edges. IEEE Transactions on Image Processing 10 2 (2001) 266-277
20. Chopp D. Computing minimal surfaces via level set curvature flow. Journal of Computational Physics 106 1 (1993) 77-91
21. Clark J.J., and Yuille A.L. Data Fusion for Sensory Information Processing (1990), Kluwer Academic Publishers, Dordrecht
22. D. Cremers, S. Osher, S. Soatto, Kernel density estimation and intrinsic alignment for knowledge-driven segmentation: teaching level sets to walk, in: C.-E. Rasmussen, H. Bülthoff, M. Giese, B. Schölkopf (Eds.), Pattern Recognition, LNCS, vol. 3175, Springer, Berlin, August 2004, pp. 36-44.
23. Cremers D., Rousson M., and Deriche R. A review of statistical approaches to level set segmentation: integrating color, texture, motion and shape. International Journal of Computer Vision 72 2 (2007) 195-215
24. Cross G.R., and Jain A.K. Markov random field texture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 5 (1983) 25-39
25. Deng Y., and Manjunath B.S. Unsupervised segmentation of color-texture regions in images and video. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 8 (2001) 800-810
26. Dervieux A., and Thomasset F. A finite element method for the simulation of Rayleigh-Taylor instability. In: Rautman R. (Ed). Approximation Methods for Navier-Stokes Problems. Lecture Notes in Mathematics vol. 771 (1979), Springer, Berlin 145-158
27. Di Zenzo S. A note on the gradient of a multi-image. Computer Vision, Graphics and Image Processing 33 (1986) 116-125
28. Dibos F., and Koepfler G. Global total variation minimization. SIAM Journal on Numerical Analysis 37 2 (2000) 646-664
29. Feng X., and Prohl A. Analysis of total variation flow and its finite element approximations. Mathematical Modelling and Numerical Analysis 37 3 (2003) 533-556
30. W. Förstner, E. Gülch, A fast operator for detection and precise location of distinct points, corners and centres of circular features, in: Proceedings of the ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland, June 1987, pp. 281-305.
31. Gabor D. Theory of communication. The Journal of the Institution of Electrical Engineers 93 (1946) 429-457
32. Gerig G., Kübler O., Kikinis R., and Jolesz F.A. Nonlinear anisotropic filtering of MRI data. IEEE Transactions on Medical Imaging 11 (1992) 221-232
33. E. Hayman, J.-O. Eklundh, Probabilistic and voting approaches to cue integration for figure-ground segmentation, in: Proceedings of the Seventh European Conference on Computer Vision, vol. 3, 2002, pp. 469-486.
34. Keeling S.L., and Stollberger R. Nonlinear anisotropic diffusion filters for wide range edge sharpening. Inverse Problems 18 (2002) 175-190
35. S. Khan, M. Shah, Object based segmentation of video using color motion and spatial information, in: Computer Vision and Pattern Recognition, CVPR 2001, December 2001, pp. 11-13.
36. Kichenassamy S., Kumar A., Olver P., Tannenbaum A., and Yezzi A. Gradient flows and geometric active contour models. Proceedings of the Fifth International Conference on Computer Vision (1995), IEEE Computer Society Press, Cambridge, MA 810-815
37. Kim J., Fisher J., Yezzi A., Cetin M., and Willsky A. A nonparametric statistical method for image segmentation using information theory and curve evolution. IEEE Transactions on Image Processing 14 10 (2005) 1486-1502
38. G. Kühne, J. Weickert, O. Schuster, S. Richter, A tensor-driven active contour model for moving object segmentation, in: Proceedings of the 2001 IEEE International Conference on Image Processing, vol. 2, Thessaloniki, Greece, October 2001, pp. 73-76.
39. B. Lucas, T. Kanade. An iterative image registration technique with an application to stereo vision, in: Proceedings of the Seventh International Joint Conference on Artificial Intelligence, Vancouver, Canada, August 1981, pp. 674-679.
40. Malladi R., Sethian J.A., and Vemuri B.C. Shape modeling with front propagation: a level set approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 17 2 (1995) 158-175
41. Martin D., Fowlkes C., and Malik J. Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 5 (2004) 530-549
42. Mitiche A., and Bouthemy P. Computation and analysis of image motion: a synopsis of current problems and methods. International Journal of Computer Vision 19 1 (1996) 29-55
43. Mumford D., and Shah J. Boundary detection by minimizing functionals, I. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1985), IEEE Computer Society Press, San Francisco, CA 22-26
44. In: Osher S., and Paragios N. (Eds). Geometric Level Set Methods in Imaging, Vision and Graphics (2003), Springer, New York
45. Osher S., and Sethian J.A. Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations. Journal of Computational Physics 79 (1988) 12-49
46. Ozyildiz E., Krahnstoever N., and Sharma R. Adaptive texture and color segmentation for tracking moving objects. Pattern Recognition 35 10 (2002)
47. Paragios N., and Deriche R. Geodesic active regions: a new paradigm to deal with frame partition problems in computer vision. Journal of Visual Communication and Image Representation 13 1/2 (2002) 249-268
48. Paragios N., and Deriche R. Geodesic active regions and level set methods for supervised texture segmentation. International Journal of Computer Vision 46 3 (2002) 223-247
49. Paragios N., and Deriche R. Geodesic active regions and level set methods for motion estimation and tracking. Computer Vision and Image Understanding 97 3 (2005) 259-282
50. Parzen E. On the estimation of a probability density function and the mode. Annals of Mathematical Statistics 33 (1962) 1065-1076
51. Peng D., Merriman B., Osher S., Zhao H., and Kang M. A PDE-based fast local level set method. Journal of Computational Physics 155 2 (1999) 410-438
52. Perona P., and Malik J. Scale space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (1990) 629-639
53. Rao A.R., and Schunck B.G. Computing oriented texture fields. CVGIP: Graphical Models and Image Processing 53 (1991) 157-185
54. M. Rousson, T. Brox, R. Deriche, Active unsupervised texture segmentation on a diffusion based feature space, in: Proceedings of the International Conference on Computer Vision and Pattern Recognition, Madison, WI, June 2003, pp. 699-704.
55. M. Rousson, R. Deriche, A variational framework for active and adaptive segmentation of vector-valued images, in: Proceedings of the IEEE Workshop on Motion and Video Computing, Orlando, Florida, December 2002, pp. 56-62.
56. Rousson M., and Paragios N. Shape priors for level set representations. In: Heyden A., Sparr G., Nielsen M., and Johansen P. (Eds). Computer Vision - ECCV 2002. LNCS vol. 2351 (2002), Springer, Berlin 78-92
57. Rudin L.I., Osher S., and Fatemi E. Nonlinear total variation based noise removal algorithms. Physica D 60 (1992) 259-268
58. C. Sagiv, N.A. Sochen, Y.Y. Zeevi, Texture segmentation via a diffusion-segmentation scheme in the Gabor feature space, in: Proceedings of the Texture 2002, Second International Workshop on Texture Analysis and Synthesis, Copenhagen, June 2002.
59. B. Sandberg, T. Chan, L. Vese, A level-set and Gabor-based active contour algorithm for segmenting textured images. Technical Report 39, Math. Dept. UCLA, Los Angeles, USA, July 2002.
60. Sethian J.A. Level Set Methods and Fast Marching Methods. second ed. (1999), Cambridge University Press, Cambridge, UK
61. M. Spengler, B. Schiele, Towards robust multi-cue integration for visual tracking, in: Proceedings of the Ninth International Workshop on Computer Vision Systems, LNCS, vol. 2095, 2001, pp. 93-106.
62. Stiller C., and Konrad J. Estimating motion in image sequences. IEEE Signal Processing Magazine 16 (1999) 70-91
63. Tschumperlé D., and Deriche R. Diffusion tensor regularization with constraints preservation. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition vol. 1 (2001), IEEE Computer Society Press, Kauai, HI 948-953
64. Tschumperlé D., and Deriche R. Orthonormal vector sets regularization with PDE's and applications. International Journal of Computer Vision (IJCV, Special Issue VLSM) 5 (2002) 237-252
65. Tschumperlé D., and Deriche R. Vector-valued image regularization with PDE's: a common framework for different applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 4 (2005) 506-517
66. Vese L., and Chan T. A multiphase level set framework for image segmentation using the Mumford and Shah model. International Journal of Computer Vision 50 3 (2002) 271-293
67. J. Weickert, A review of nonlinear diffusion filtering, in: B. ter Haar Romeny, L. Florack, J. Koenderink, M. Viergever (Eds.), Scale-Space Theory in Computer Vision, LNCS, vol. 1252, Springer, Berlin, 1997, pp. 3-28.
68. Weickert J. Design of nonlinear diffusion filters. In: Jähne B., and Haußecker H. (Eds). Computer Vision and Applications (2000), Academic Press, San Diego 439-458
69. Weickert J., and Benhamouda B. A semi-discrete nonlinear scale-space theory and its relation to the Perona-Malik paradox. In: Solina F., Kropatsch W.G., Klette R., and Bajcsy R. (Eds). Advances in Computer Vision (1997), Springer, Wien
70. J. Weickert, T. Brox, Diffusion and regularization of vector- and matrix-valued images, in: M.Z. Nashed, O. Scherzer (Eds.), Inverse Problems, Image Analysis, and Medical Imaging, Contemporary Mathematics, vol. 313, AMS, Providence, 2002, pp. 251-268.
71. Weickert J., ter Haar Romeny B.M., and Viergever M.A. Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Transactions on Image Processing 7 3 (1998) 398-410
72. Zhao H.K., Chan T., Merriman B., and Osher S. A variational level set approach to multiphase motion. Journal of Computational Physics 127 (1996) 179-195
73. Zhu S.-C., and Yuille A. Region competition: unifying snakes region growing and Bayes/MDL for multiband image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 9 (1996) 884-900