A compact harmonic code for early vision based on anisotropic frequency channels

Computer Vision and Image Understanding

Volumn 114, Issue 6, 2010, Pages 681-699

  Sabatini, Silvio P ^a   Gastaldi, Giulia ^a   Solari, Fabio ^a   Pauwels, Karl ^b   Van Hulle, Marc M ^b   Diaz, Javier ^c   Ros, Eduardo ^c   Pugeault, Nicolas ^d,f   Krüger, Norbert ^e  

^a UNIVERSITY OF GENOA   (Italy)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c UNIVERSITY OF GRANADA   (Spain)

^d UNIVERSITY OF EDINBURGH   (United Kingdom)

^e UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^f UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Bio inspired vision processing; Early vision; Image representations; Motion; Multichannel filtering; Phase based image analysis; Stereo

Indexed keywords

ANISOTROPY; FREQUENCY BANDS; HARMONIC ANALYSIS; STEREO IMAGE PROCESSING; STRUCTURE (COMPOSITION);

BIO-INSPIRED VISION; EARLY VISION; IMAGE REPRESENTATIONS; MOTION; MULTI-CHANNEL FILTERING; PHASE BASED; STEREO;

STEREO VISION;

EID: 77956437261     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.03.008     Document Type: Conference Paper

References (99)

1. J. Daugman, Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters, J. Opt. Soc. Am. A 2 (1985) 1160-1169.
2. S. Marcelja, Mathematical description of the responses of simple cortical cells, J. Opt. Soc. Am. A 70 (1980) 1297-1300.
3. D. Gabor, Theory of communication, J. Inst. Elect. Eng. 93 (1946) 429-459.
4. J. Koenderink, A. van Doorn, Representation of local geometry in the visual system, Biol. Cybern. 55 (1987) 367-375. (Pubitemid 17030735)
5. E. Adelson, J. Bergen, The plenoptic and the elements of early vision, in: M. Landy, J. Movshon (Eds.), Computational Models of Visual Processing, MIT Press, 1991, pp. 3-20.
6. J. Jones, L. Palmer, The two-dimensional spatial structure of simple receptive fields in cat striate cortex, J. Neurosci. 58 (1987) 1187-1211. (Pubitemid 18023457)
7. G. De Angelis, I. Ohzawa, R. Freeman, Spatiotemporal organization of simplecell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation, J. Neurophysiol. 69 (1993) 1118-1135. (Pubitemid 23118813)
8. M. Carandini, J. Demb, V. Mante, D. Tolhurst, Y. Dan, A. Olshausen, J. Gallant, N. Rust, Do we know what the early visual system does?, J Neurosci. 25 (2005) 10577-10597. (Pubitemid 41681906)
9. N. Krüger, M. Lappe, F. Wörgötter, Biologically motivated multi-modal processing of visual primitives, Interdiscipl. J. Artif. Intell. Simulat. Behav. 1 (5) (2004) 417-428.
10. J. Daugman, Spatial visual channels in the Fourier plane, Vision Res. 24 (1984) 891-910. (Pubitemid 15203570)
11. R. De Valois, K. De Valois, Spatial Vision, Oxford University Press, New York, 1990.
12. M. Felsberg, G. Sommer, The monogenic signal, IEEE Trans. Signal Process. 48 (12) (2001) 3136-3144. (Pubitemid 34035668)
13. R. Young, The Gaussian derivative theory of spatial vision: Analysis of cortical cell receptive field line-weighting profiles, Tech. Rep. GMR-4920, General Motors Research, 1985.
14. A. Watson, The cortex transform: Rapid computation of simulated neural images, Comput. Vison Graph. Image Process. 39 (1987) 311-327. (Pubitemid 17655928)
15. M. Hawken, A. Parker, Spatial properties of neurons in the monkey striate cortex, Proc. Roy. Soc. Lond. B 231 (1987) 251-288. (Pubitemid 17106475)
16. D. Field, Relations between the statistics of natural images and the response properties of cortical cells, J. Opt. Soc. Am. A 4 (1987) 2379-2394.
17. J. Martens, The Hermite transform - theory, IEEE Trans. Acoust., Speech, Signal Process. 38 (1990) 1595-1606.
18. D. Stork, H. Wilson, Do Gabor functions provide appropriate decriptions of visual cortical receptive fields?, J Opt. Soc. Am. A 7 (8) (1990) 1362-1373.
19. J. Yang, Do Gabor functions provide appropriate descriptions of visual cortical receptive fields?: Comment, J. Opt. Soc. Am. A 9 (2) (1992) 334-336.
20. S. Klein, B. Beutter, Minimizing and maximizing the joint space-spatial frequency uncertainty of Gabor-like functions: Comment, J. Opt. Soc. Am. A 9 (2) (1992) 337-340.
21. S. Mallat, A theory for multiresolution signal decomposition: The wavelet representation, IEEE Trans. Pattern Anal. Mach. Intell. 11 (7) (1989) 674-693.
22. T. Reed, H. Wechsler, Segmentation of textured images and Gestalt organization using spatial/spatial frequency representations, IEEE Trans. Pattern Anal. Mach. Intell. 12 (1990) 1-12. (Pubitemid 20653594)
23. W. Freeman, E. Adelson, The design and use of steerable filters, IEEE Trans. Pattern Anal. Mach. Intell. 13 (1991) 891-906. (Pubitemid 21703455)
24. P. Perona, Steerable-scalable kernels for edge detection and junction analysis, Image Vis. Comput. 10 (1992) 663-672.
25. E. Simoncelli, W. Freeman, E. Adelson, D. Heeger, Shiftable multiscale transforms, IEEE Trans. Inform. Theory 38 (2) (1992) 587-607.
26. M. Felsberg, G. Sommer, The monogenic scale-space: A unifying approach to phase-based image processing in scale-space, J. Math. Imag. Vision 21 (2004) 5-26.
27. L. Jacobson, H. Wechsler, Joint spatial/spatial-frequency representation, Signal Process. 14 (1988) 37-68.
28. H. Wechsler, Computational Vision, Academic Press, 1990.
29. R. Navarro, A. Tabernero, G. Cristobal, Image representation with Gabor wavelets and its applications, in: P.W. Hawkes (Ed.), Advances in Imaging and Electron Physics, Academic Press, San Diego CA, 1996, pp. 1-84.
30. E. Adelson, C. Anderson, J. Bergen, P. Burt, J. Ogden, Pyramid methods in image processing, RCA Eng. 29 (6) (1984) 33-41.
31. D.J. Fleet, A.D. Jepson, Computation of component image velocity from local phase information, Int. J. Comput. Vision 1 (1990) 77-104.
32. O. Nestares, R. Navarro, J. Portilla, A. Tabernero, Efficient spatial-domain implementation of a multiscale image representation based on Gabor functions, J. Elect. Imag. 7 (1) (1998) 166-173. (Pubitemid 128445954)
33. T. Huang, W. Bumett, G. Deczky, The importance of phase in image processing, IEEE Trans. Acoust., Speech, Signal Process. 23 (6) (1975) 529-542.
34. A. Oppenheim, J. Lim, The importance of phase in signals, Proc. IEEE 69 (1981) 529-541.
35. J. Behar, M. Porat, Y. Zeevi, The importance of localized phase in vision and image representation, in: Proceedings of SPIE 1001, Visual Communications and Image Processing, 1988, pp. 61-68.
36. M. Morrone, D. Burr, Feature detection in human vision: A phase-dependent energy model, Proc. Roy. Soc. Lond. B 235 (1988) 221-245.
37. D. Fleet, A. Jepson, Stability of phase information, IEEE Trans. Pattern Anal. Mach. Intell. 15 (12) (1993) 1253-1268.
38. L. Haglund, D. Fleet, Stable estimation of image orientation, in: Proceedings of IEEE-ICIP'94, Austin, Texas, 1994, pp. 68-72.
39. D. Fleet, Disparity from local weighted phase-correlation, in: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 1, 1994, pp. 48-54.
40. P. Kovesi, Invariant measures of image features from phase information, Ph.D. thesis, The University of Western Australia, 1996.
41. A. Cozzi, B. Crespi, F. Valentinotti, F. Woergoetter, Performance of phase-based algorithms for disparity estimation, Mach. Vision Appl. 9 (5-6) (1997) 334- 340. (Pubitemid 127561579)
42. P. Kovesi, Phase congruency: A low-level image invariant, Psychol. Res. 64 (2000) 136-148.
43. G. Carneiro, A. Jepson, Multi-scale phase-based local features, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), vol. 1, 2003, pp. 736-743.
44. A. Ogale, Y. Aloimonos, A roadmap to the integration of early visual modules, Int. J. Comput. Vision 72 (2007) 9-25. (Pubitemid 44876074)
45. T. Sanger, Stereo disparity computation using Gabor filters, Biol. Cybern. 59 (1988) 405-418.
46. D. Fleet, A. Jepson, M. Jenkin, Phase-based disparity measurement, CVGIP: Image Understan. 53 (2) (1991) 198-210.
47. W.M. Theimer, H.A. Mallot, Phase-based binocular vergence control and depth reconstruction using active vision, CVGIP: Image Understan. 60 (3) (1994) 343-358.
48. P. Kovesi, Image features from phase congruency, Videre: J. Comput. Vision Res., vol. 1, MIT Press, 1999. pp. 1-26.
49. M. Felsberg, G. Sommer, Image features based on a new approach to 2d rotation invariant quadrature filters, in: A. Heyden, G. Sparr, M. Nielsen, P. Johansen (Eds.), Computer Vision - ECCV 2002, Lecture Notes in Computer Science, vol. 2350, Springer, 2002, pp. 369-383.
50. M. Felsberg, Disparity from monogenic phase, in: L.V. Gool (Ed.), 24. DAGM Symposium Mustererkennung, Zürich, Lecture Notes in Computer Science, vol. 2449, Springer, Heidelberg, 2002, pp. 248-256.
51. T. Gautama, M. Van Hulle, A phase-based approach to the estimation of the optical flow field using spatial filtering, IEEE Trans. Neural Networks 13 (5) (2002) 1127-1136.
52. S. Sabatini, F. Solari, P. Cavalleri, G. Bisio, Phase-based binocular perception of motion in depth: Cortical-like operators and analog VLSI architectures, EURASIP J. Appl. Signal Process. 7 (2003) 690-702.
53. H. Foroosh, W. Hoge, Motion information in the phase domain, in: M. Shah, R. Kumar (Eds.), Video Registration, Kluwer Academic Publishers, 2003, pp. 36- 71.
54. M. Felsberg, Optical flow estimation from monogenic phase, in: Proceedings of 1st International Workshop on Complex Motion, Gn zburg, October 12-14, 2004.
55. D. Boukerroui, J.A. Noble, M. Brady, On the choice of band-pass quadrature filters, J. Math. Imag. Vison 21 (1) (2004) 53-80.
56. Z. Xiao, Z. Hou, C. Miao, J. Wang, Using phase information for symmetry detection, Pattern Recogn. Lett. 26 (13) (2005) 1985-1994. (Pubitemid 41252204)
57. K. Pauwels, M. Van Hulle, Optic flow from unstable sequences containing unconstrained scenes through local velocity constancy maximization, in: Proceedings of British Machine Vision Conference, Edinburgh, 4-7 September, 2006.
58. A. Darabiha, W. MacLean, J. Rose, Reconfigurable hardware implementation of a phase-correlation stereoalgorithm, Mach. Vision Appl. 17 (2) (2006) 116- 132.
59. I. Ulusoy, E. Hancock, A statistical approach to sparse multi-scale phase-based stereo, Pattern Recogn. 40 (2007) 2504-2520. (Pubitemid 46669576)
60. L. Zang, D. Wietzke, C. Schmaltz, G. Sommer, Dense optical flow estimation from the monogenic curvature tensor, in: Scale Space and Variational Methods in Computer Vision, Lecture Notes in Computer Science, vol. 4485, Springer, 2007, pp. 239-250. (Pubitemid 350269799)
61. R. Li, S. Sclarof, Multi-scale 3D scene flow from binocular stereo sequences, Comput. Vision Image Understan. 110 (2008) 75-90. (Pubitemid 351375438)
62. J. Monaco, A. Bovik, L. Cormack, Stereoscopic phase-differencing: multiscale synthesis, in: Proceedings of IEEE Southwest Symposium on Image Analysis and Interpretation, 2008, pp. 33-36.
63. X. Yang, Y. Zhou, T. Zhang, E. Zheng, J. Yang, Gabor phase based gait recognition, Electron. Lett. 44 (10) (2008) 620-621. (Pubitemid 351643227)
64. J. Diaz, E. Ros, R. Carrillo, A. Prieto, Real-time system for high-image-resolution disparity, IEEE Trans. Image Process. 16 (1) (2007) 280-285.
65. N. Krüger, M. Felsberg, A continuous formulation of intrinsic dimension, in: Proceedings of British Machine Vision Conference, 2003.
66. S. Venkatesh, R. Owens, An energy feature detection scheme, in: Proceedings of International Conference on Image Processing, 1989, pp. 553-557.
67. A. Jenkin, M. Jepson, The measurement of binocular disparity, in: Z. Pylyshyn (Ed.), Computational Processes in Human Vision, Ablex Publ., New Jersey, 1988.
68. F. Solari, S. Sabatini, G. Bisio, Fast technique for phase-based disparity estimation with no explicit calculation of phase, Elect. Lett. 37 (23) (2001) 1382-1383. (Pubitemid 33076149)
69. A. Jepson, M. Jenkin, The fast computation of disparity from phase differences, in: Procedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'89), 1989, pp. 398-403.
70. C.-J. Westelius, Preattentive gaze control for robot vision, Lic. Thesis LiU-Tek- Lic-1992:14, ISY, Linköping University, SE-581 83 Linköping, Sweden, Thesis No. 322, ISBN 91-7870-961-X (June 1992).
71. T. Lindeberg, Scale-Space Theory in Computer Vision, Kluwer Academic Publishers., 1994.
72. D. Marr, Vision, Freeman, New York, 1982.
73. L. Haglund, Adaptive multidimensional filtering, Tech. rep., Linköing University, Sweden, PhD Dissertation No. 284 1992.
74. G. Granlund, H. Knutsson, Signal Processing for Computer Vision, Kluwer Academic Publishers, 1995.
75. J. Bergen, P. Anandan, K. Hanna, R. Hingorani, Hierarchical model-based motion estimation, in: Proceedings of ECCV'92, 1992, pp. 237-252.
76. K. Pauwels, M. Van Hulle, Optic flow from unstable sequences through local velocity constancy maximization, Image Vision Comput. 27 (5) (2009) 579- 587.
77. M. Felsberg, Optical flow estimation from monogenic phase, in: B. Jähne, R. Mester, E. Barth, H. Scharr (Eds.), 1st International Workshop on Complex Motion (ICM04), LNCS, vol. 3417, 2007, pp. 1-13.
78. B. Horn, B. Schunck, Determining optical flow, Artif. Intell. 17 (1981) 185-203.
79. M. Tistarelli, Multiple constraints for optical flow, in: J.-O. Eklundh (Ed.), Lecture Notes in Computer Science, vol. 801, Springer, 1994, pp. 61-70.
80. A. Bruhn, Variational optic flow computation - Accurate modelling and efficient numerics, Ph.D. thesis, Fakultät für Mathematik und Informatik, Universität des Saarlandes, Saarbrücken, 2006.
81. T. Nir, A.M. Bruckstein, R. Kimmel, Over-parameterized variational optical flow, Int. J. Comput. Vision 76 (2) (2008) 205-216.
82. P.-E. Forssén, G. Granlund, Sparse feature maps in a scale hierarchy, in: AFPAC, Algebraic Frames for the Perception Action Cycle, Springer Verlag, 2000, pp. 186-196.
83. D. Scharstein, R. Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms, Int. J. Comput. Vision 47 (1-3) (2002) 7-42. (Pubitemid 34428419)
84. D. Scharstein, R. Szeliski, High-accuracy stereo depth maps using structured light, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), vol. 1, Madison, WI, 2003, pp. 195-202.
85. G. Egnal, R. Wildes, Detecting binocular half-occlusions: Empirical comparisons of five approaches, IEEE Trans. Pattern Anal. Mach. Intell. 24 (8) (2002) 1127-1133.
86. J. Barron, D. Fleet, S. Beauchemin, Performance of optical flow techniques, Int. J. Comput. Vision 12 (1994) 43-77.
87. E. Lindholm, J. Nickolls, J. Montrym, NVDIA Tesla: A unified graphics and computing architecture, IEEE Micro 28 (2008) 39-55. (Pubitemid 351796170)
88. C. Zetzsche, E. Barth, Fundamental limits of linear filter in the visual processing of two-dimensional signals, Vision Res. 30 (7) (1990) 1111-1117. (Pubitemid 20214876)
89. J. Bigun, Vision with Directions: A Systematic Introduction to Image Processing and Computer Vision, Springer-Verlag, Berlin Heidelberg, 2006.
90. F. Wörgötter, N. Krüger, N. Pugeault, D. Calow, M. Lappe, K. Pauwels, M.V. Hulle, S. Tan, A. Johnston, Early cognitive vision: using Gestalt-laws for taskdependent, active image-processing, Nat. Comput. 3 (3) (2004) 293-321. (Pubitemid 39140132)
91. G. Granlund, The complexity of vision, Signal Process. 74 (1999) 101-126.
92. P. König, N. Krüger, Perspectives: Symbols as self-emergent entities in an optimization process of feature extraction and predictions, Biol. Cybern. 94 (4) (2006) 325-334.
93. M. Felsberg, N. Krüger, A probabilistic definition of intrinsic dimensionality for images, in: Proceedings of DAGM Symposium Mustererkennung, 2003.
94. A. Felsberg, S. Kalkan, N. Krüger, Continuous dimensionality characterization of image structures, Image Vision Comput. 27 (6) (2009) 628-636.
95. J. Tsotsos, S. Culhane, W. Wai, Y. Lai, N. Davis, F. Nuflo, Modeling visual attention via selective tuning, Artif. Intell. 78 (1995) 507-547.
96. R. Crist, W. Li, C. Gilbert, Learning to see: Experience and attention in primary visual cortex, Nat. Neurosci. 4 (2001) 519-525. (Pubitemid 32397190)
97. J. Harris, S.N. Watamaniuk, Speed discrimination of motion-in-depth using binocular cues, Vision Res. 35 (7) (1995) 885-896.
98. J. Tsotsos, A 'complexity level' analysis of vision, in: Proceedings of ICCV'87 - Human and Machine Vision Workshop, London, 8-11 June, 1987, pp. 346-355.
99. M. Felsberg, Personal Communication, 2008.