Detecting natural occlusion boundaries using local cues

Journal of Vision

Volumn 12, Issue 13, 2012, Pages

  DiMattina, Christopher ^a   Fox, Sean A ^b   Lewicki, Michael S ^b  

^a GRINNELL COLLEGE   (United States)

^b Case Western Reserve University   (United States)

Author keywords

Edge detection; Natural images; Neural networks; Occlusions; Psychophysics

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; ASSOCIATION; COMPARATIVE STUDY; HUMAN; METHODOLOGY; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOPHYSICS;

ALGORITHMS; CUES; FORM PERCEPTION; HUMANS; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOPHYSICS;

EID: 84878344898     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/12.13.15     Document Type: Article

References (69)

1. Abdou, I., & Pratt, W. (1979). Quantitative design and evaluation of enhancement/thresholding edge detectors. Proceedings of the IEEE, 67, 753-763.
2. Acharya, T., & Ray, A. K. (2005). Image processing: Principles and applications. Hoboken, NJ: Wiley- Interscience.
3. Arsenault, E., Yoonessi, A., & Baker, C. L. (2011). Higher-order texture statistics impair contrast boundary segmentation. Journal of Vision, 11(10): 14, 1-15, http://www.journalofvision.org/content/11/10/14, doi:10.1167/11.10.14. [PubMed] [Article]
4. Baddeley, R. J., & Tatler, B. W. (2006). High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis. Vision Research, 46, 2824-2833.
5. Baker, C. L., & Mareschal, I. (2001). Processing of second-order stimuli in the visual cortex. Progress in Brain Research, 134, 1-21.
6. Balboa, R. M., & Grzywacz, N. M. (2000). Occlusionsand their relationship with the distribution of contrasts in natural images. Vision Research, 40, 2661-2669.
7. Bell, A. J., & Sejnowski, T. J. (1997). The 'independent components' of natural scenes are edge filters. Vision Research, 37, 3327-3338.
8. Bergen, J. R., & Landy, M. S. (1991). Computational modeling of visual texture segregation. In M. S. Landy & J. A. Movshon (Eds.), Computational models of visual processing, pp. 253-271. Cambridge, MA: MIT Press.
9. Bishop, C. M. (2006). Pattern recognition and machine learning. New York: Springer.
10. Cadieu, C., & Olshausen, B. A. (2012). Learning intermediate-level representations of form and motion from natural movies. Neural Computation, 24, 827-866.
11. Caywood, M. S., Willmore, B., & Tolhurst, D. J. (2004). Independent components of color natural scenes resemble v1 neurons in their spatial and color tuning. Journal of Neurophysiology, 91, 2859-2873.
12. Collins, D., Wright, W. A., & Greenway, P. (1999). The Sowerby image database. In Image processing and its applications (Seventh International Conference), (pp. 306-310). London: Institution of Electrical Engineers.
13. Cristianini, N., & Shawe-Taylor, J. (2000). An introduction to support vector machines and other kernel based learning methods. Cambridge, UK: Cambridge University Press.
14. Daugman, J. G. (1985). Uncertainty relation for resolution in space, spatial frequency and orientation optimized by two-dimensional visual cortical filters. Journal of the Optical Society of America A, 2, 1160-1169.
15. Doi, E., Inui, T., Lee, T. W., Wachtler, T., & Sejnowski, T. J. (2003). Spatiochromatic receptive field properties derived from information-theoretic analyses of cone mosaic responses to natural scenes. Neural Computation, 15, 397-417.
16. Duda, R. O., Hart, P. E., & Stork, D. G. (2000). Pattern classification (2nd ed.). New York: Wiley-Interscience.
17. Elder, J. H., & Zucker, S. W. (1998). Local scale control for edge detection and blur estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 699-716.
18. Field, D. J. (1987). Relations between the statistics of natural images and the response properties of cortical cells. Journal of the Optical Society of America A, 4, 2379-2394.
19. Fine, I., MacLeod, D. I. A., & Boynton, G. M. (2003). Surface segmentation based on the luminance and color statistics of natural scenes. Journal of the Optical Society of America A, 20, 1283-1291.
20. Fowlkes, C. C.,Martin, D. R., &Malik, J. (2007). Local figure-ground cues are valid for natural images. Journal of Vision, 7(8):2, 1-9, http://www.journalofvision.org/content/7/8/2, doi:10.1167/7.8.2. [PubMed] [Article]
21. Geisler, W. S., Perry, J. S., Super, B. J., & Gallogly, D. P. (2001). Edge co-occurrence in natural images predicts contour grouping performance. Vision Research, 41, 711-724.
22. Goldberg, A. V., & Kennedy, R. (1995). An efficient cost scaling algorithm for the assignment problem. Mathematical Programming, 71, 153-177.
23. Graham, N. (1991). Complex channels, early local nonlinearities and normalization in texture segregation. In M. S. Landy & J. A. Movshon (Eds.), Computational models of visual processing, pp. 274-290. Cambridge, MA: MIT Press.
24. Graham, N., & Sutter, A. (1998). Spatial summation in simple (Fourier) and complex (non-Fourier) texture channels. Vision Research, 38, 231-257.
25. Guzman, A. (1969). Decomposition of a visual scene into three-dimensional bodies. In A. Griselli (Ed.), Automatic interpretation and classification of images, pp. 291-304. New York: Academic Press.
26. Heeger, D. J., & Bergen, J. R. (1995). Pyramid-based texture analysis/synthesis. In Proceedings of ACM SIGGRAPH, 229-238.
27. Hess, R. F., & Field, D. J. (1999). Integration of contours: New insights. Trends in Cognitive Sciences, 3, 480-486.
28. Hoiem, D., Efros, A. A., & Hebert, M. (2011). Recovering occlusion boundaries from an image. International Journal of Computer Vision, 91(3): 328-346.
29. Ing, A. D., Wilson, J. A., & Geisler, W. S. (2010). Region grouping in natural foliage scenes: Image statistics and human performance. Journal of Vision, 10(4):10, 1-19, http://www.journalofvision.org/content/10/4/10, doi:10.1167/10.4.10. [PubMed] [Article]
30. Jones, J. P., & Palmer, L. A. (1987). The twodimensional spatial structure of simple receptive fields in cat striate cortex. Journal of Neurophysiology, 58, 1187-1211.
31. Karklin, Y., & Lewicki, M. S. (2003). Learning higher-order structures in natural images. Network, 14, 483-499.
32. Karklin, Y., & Lewicki, M. S. (2009). Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457, 83-86.
33. Kersten, D. (2000). High-level vision as statistical inference. In M. S. Gazzaniga (Ed.), The new cognitive neurosciences, pp. 353-363. Cambridge, MA: MIT Press.
34. Kingdom, F. A. A., Field, D. J., & Olmos, A. (2007). Does spatial invariance result from insensitivity to change? Journal of Vision, 7(14):11, 1-13, http://www.journalofvision.org/content/7/14/11, doi:10. 1167/7.14.11. [PubMed] [Article]
35. Knill, D. C., & Saunders, J. A. (2003). Do humans optimally integrate stereo and texture information for judgments of slant? Vision Research, 43, 2539-2558.
36. Konishi, S., Yuille, A. L., Coughlin, J. M., & Zhu, S. C. (2003). Statistical edge detection: Learning and evaluating edge cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 57-74.
37. Landy, M. S. (1991). Texture segregation and orientation gradient. Vision Research, 31, 679-691.
38. Landy, M. S., & Graham, N. (2003). Visual perception of texture. In L. M. Chalupa & J. S. Werner (Eds.), The visual neurosciences, pp. 1106-1118. Cambridge, MA: MIT Press.
39. Landy, M. S., & Kojima, H. (2001). Ideal cue combination for localizing texture-defined edges. Journal of the Optical Society of America A, 18, 2307-2320.
40. Lee, H.-C., & Choe, Y. (2003). Detecting salient contours using orientation energy distribution. In International Joint Conference on Neural Networks (pp. 206-211). IEEE Conference Publications.
41. Lee, T. S., & Mumford, D. (2003). Hierarchical bayesian inference in the visual cortex. Journal of the Optical Society of America A, 20, 1434-1448.
42. Malik, J., & Perona, P. (1990). Preattentive texture discrimination with early vision mechanisms. Journal of the Optical Society of America A, 7, 923-932.
43. Marr, D., & Hildreth, E. (1980). Theory of edge detection. Proceedings of the Royal Society of London, Series B, 29, 187-217.
44. Martin, D., Fowlkes, C. C., Tal, D., & Malik, J. (2001). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Proceedings of the 8th International Conference on Computer Vision, 2, 416-423.
45. Martin, D. R., Fowlkes, C. C., & Malik, J. (2004). Learning to detect natural image boundaries using local brightness, color and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 530-549.
46. McDermott, J. (2004). Psychophysics with junctions in real images. Perception, 33, 1101-1127.
47. McGraw, P. V., Whitaker, D., Badcock, D. R., & Skillen, J. (2003). Neither here nor there: Localizing conflicting visual attributes. Journal of Vision, 3(4): 2, 265-273, http://www.journalofvision.org/content/3/4/2, doi:10.1167/3.4.2. [PubMed] [Article]
48. Nakayama, K., He, Z. J., & Shimojo, S. (1995). Visual surface representation: A critical link between lower-level and higher-level vision. In D. N. Osherson, S. M. Kosslyn, & L. R. Gleitman (Eds.), An invitation to cognitive science: Visual cognition, pp. 1-70. Cambridge, MA: MIT Press.
49. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175.
50. Olmos, A., & Kingdom, F. A. A. (2004). McGill calibrated colour image database. Internet site: http://tabby.vision.mcgill.ca (Accessed November 20, 2012).
51. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive-field properties by learning a sparse code for natural images. Nature, 381, 607-609.
52. Ott, R. L. (1993). An introduction to statistical methods and data analysis (4th ed.). Belmont, CA: Wadsworth, Inc.
53. Perona, P. (1992). Steerable-scalable kernels for edge detection and junction analysis. Image and Vision Computing, 10, 663-672.
54. Pollen, D. A., & Ronner, S. F. (1983). Visual cortical neurons as localized spatial frequency filters. IEEE Transactions on Systems, Man and Cybernetics, 13, 907-916.
55. Portilla, J., & Simoncelli, E. P. (2000). A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision, 40, 4971.
56. Rajashekar, U., van der Linde, I., Bovik, A. C., & Cormack, L. K. (2007). Foveated analysis of image features at fixations. Vision Research, 47, 3160-3172.
57. Reinagel, P., & Zador, A. M. (1999). Natural scene statistics at the centre of gaze. Network, 10, 341-350.
58. Rijsbergen, C. V. (1979). Information retrieval. London: Butterworths.
59. Rivest, J., & Cavanagh, P. (1996). Localizing contours defined by more than one attribute. Vision Research, 36, 53-66.
60. Schwartz, O., & Simoncelli, E. P. (2001). Natural signal statistics and sensory gain control. Nature Neuroscience, 4, 819-825.
61. Sigman, M., Cecchi, G. A., Gilbert, C. D., & Magnasco, M. O. (2001). On a common circle: Natural scenes and gestalt rules. Proceedings of the National Academy of Sciences, 98, 1935-1940.
62. Todd, J. T. (2004). The visual perception of 3D shape. Trends in Cognitive Science, 8, 115-121.
63. Torralba, A. (2009). How many pixels make an image? Visual Neuroscience, 26, 123-131.
64. Torralba, A., & Oliva, A. (2003). Statistics of natural image categories. Network: Computation in Neural Systems, 14, 391-412.
65. Voorhees, H., & Poggio, T. (1988). Computing texture boundaries from images. Nature, 333, 364-367.
66. Zetzsche, C., & Rohrbein, F. (2001). Nonlinear and extra-classical receptive field properties and the statistics of natural scenes. Network, 12, 331-350.
67. Zhou, C., & Mel, B. W. (2008). Cue combination and color edge detection in natural scenes. Journal of Vision, 8(4):4, 1-25, http://www.journalofvision.org/content/8/4/4, doi:10.1167/8.4.4. [PubMed] [Article]
68. Zhu, S. C., Wu, Y. N., & Mumford, D. (1997). Minimax entropy principle and its application to texture modeling. Neural Computation, 9, 1627-1660.
69. Ziegaus, C., & Lang, E. W. (2003). Independent component analysis of natural and urban image ensembles. Neural Information Processing Letters, 1, 89-95.