ARTSCENE: A neural system for natural scene classification

Journal of Vision

Volumn 9, Issue 4, 2009, Pages

  Grossberg, Stephen ^a   Huang, Tsung Ren ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

ARTMAP; Attentional shroud; Coarse to fine processing; Gist; Multiple scale processing; Scene classification; Spatial attention; Texture

Indexed keywords

ARTICLE; ATTENTION; BIOLOGICAL MODEL; COLOR VISION; CONTRAST SENSITIVITY; HUMAN; METHODOLOGY; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOPHYSICS;

ATTENTION; COLOR PERCEPTION; CONTRAST SENSITIVITY; FORM PERCEPTION; HUMANS; MODELS, NEUROLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOPHYSICS;

EID: 64949143219     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/9.4.6     Document Type: Article

References (71)

1. Amis, G., & Carpenter, G. (2007). Default ARTMAP 2. Proceedings of the International Joint Conference on Neural Networks (IJCNN'07) (pp. 777-782). Orlando, Florida: IEEE Press.
2. Bar, M. (2004). Visual objects in context. Nature Reviews, Neuroscience, 5, 617-629.
3. Bhatt, R., Carpenter, G. A., & Grossberg, S. (2007). Texture segregation by visual cortex: Perceptual grouping, attention, and learning. Vision Research, 47, 3173-3211.
4. Bosch, A., Zisserman, A., & Muñoz, X. (2006). Scene classification via pLSA. Proceedings of the European Conference on Computer Vision, 4, 517-530.
5. Cao, Y., & Grossberg, S. (2005). A laminar cortical model of stereopsis and 3D surface perception: Closure and da Vinci stereopsis. Spatial Vision, 18, 515-578.
6. Carpenter, G. A. (1997). Distributed learning, recognition, and prediction by ART and ARTMAP neural networks. Neural Networks, 10, 1473-1494.
7. Carpenter, G. A., & Grossberg, S. (1991). Pattern recognition by self-organizing neural networks. Cambridge: The MIT Press.
8. Carpenter, G. A., Martens, S., & Ogas, O. J. (2005). Self-organizing information fusion and hierarchical knowledge discovery: A new framework using ARTMAP neural networks. Neural Networks, 18, 287-295.
9. Carpenter, G. A., Milenova, B. L., & Noeske, B. W. (1998). Distributed ARTMAP: A neural network for fast distributed supervised learning. Neural Networks, 11, 793-813.
10. Daugman, J. G. (1980). Two-dimensional spectral analysis of cortical receptive field profiles. Vision Research, 20, 847-856.
11. Eriksen, C. W., & Yeh, Y. Y. (1985). Allocation of attention in the visual field. Journal of Experimental Psychology: Human Perception and Performance, 11, 583-597.
12. Everingham, M., Zisserman, A., Williams, C., & Van Gool, L. (2006). The PASCAL visual object classes challenge 2006 (VOC2006) results. Retrieved from http://pascallin.ecs.soton.ac.uk/challenges/VOC/voc2006/ results.pdf.
13. Fazl, A., Grossberg, S., & Mingolla, E. (2009). View-invariant object category learning, recognition, and search: How spatial and object attention are coordinated using surface-based attentional shrouds. Cognitive Psychology, 58, 1-48.
14. Fei-Fei, L., & Perona, P. (2005). A Bayesian hierarchical model for learning natural scene categories. Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR'97) Conference, 2, 524-531.
15. Field, D. J. (1987). Relations between the statistics of natural images and the response properties of cortical cells. Journal of the Optical Society of America A, Optics and Image Science, 4, 2379-2394.
16. Gabor, D. (1946). Theory of communication. Institution of Electrical Engineers, 93, 429-457.
17. Gorkani, M. M., & Picard, R. W. (1994). Texture orientation for sorting photos at a glance. Proceedings of the IEEE Computer Vision and Pattern Recognition, 1, 459-464.
18. Greene, M. R., & Oliva, A. (2006). Natural scene categorization from conjunctions of ecological global properties. Proceedings of the 28th Annual Conference of the Cognitive Science Society, 291-296.
19. Grossberg, S. (1976a). Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biological Cybernetics, 23, 121-134.
20. Grossberg, S. (1976b). Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions. Biological Cybernetics, 23, 187-202.
21. Grossberg, S. (1990). Neural FACADEs: Visual representations of static and moving Form-And-Color-and-DEpth. Mind and Language, 5, 411-456.
22. Grossberg, S. (1994). 3-D vision and figure-ground separation by visual cortex. Perception & Psychophysics, 55, 48-121.
23. Grossberg, S. (2000). The complementary brain: Unifying brain dynamics and modularity. Trends in Cognitive Sciences, 4, 233-246.
24. Grossberg, S. (2003a). Filling-in the forms: Surface and boundary interactions in visual cortex. In L. Pessoa & P. DeWeerd (Eds.), Filling-in: From perceptual completion to skill learning (pp. 13-37). New York: Oxford University Press.
25. Grossberg, S. (2003b). How does the cerebral cortex work? Development, learning, attention, and 3-D vision by laminar circuits of visual cortex. Behavioral and Cognitive Neuroscience Reviews, 2, 47-76.
26. Grossberg, S., & Hong, S. (2006). A neural model of surface perception: Lightness, anchoring, and filling-in. Spatial Vision, 19, 263-321.
27. Grossberg, S., Kuhlmann, L., & Mingolla, E. (2007). A neural model of 3D shape-from-texture: Multiple-scale filtering, boundary grouping, and surface filling-in. Vision Research, 47, 634672.
28. Grossberg, S., & Mingolla, E. (1985a). Neural dynamics of form perception: Boundary completion, illusory figures, and neon color spreading. Psychological Review, 92, 173211.
29. Grossberg, S., & Mingolla, E. (1985b). Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations. Perception & Psychophysics, 38, 141171.
30. Grossberg, S., & Swaminathan, G. (2004). A laminar cortical model for 3D perception of slanted and curved surfaces and of 2D images: Development, attention, and bistability. Vision Research, 44, 11471187.
31. Grossberg, S., & Todorović, D. (1988). Neural dynamics of 1-D and 2-D brightness perception: A unified model of classical and recent phenomena. Perception & Psychophysics, 43, 241-277.
32. Grossberg, S., & Williamson, J. R. (1999). A self-organizing neural system for learning to recognize textured scenes. Vision Research, 39, 1385-1406.
33. Grossberg, S., & Yazdanbakhsh, A. (2005). Laminar cortical dynamics of 3D surface perception: Stratification, transparency, and neon color spreading. Vision Research, 45, 1725-1743.
34. Hirsch, J. A., Alonso, J. M., Reid, R. C., & Martinez, L. M. (1998). Synaptic integration in striate cortical simple cells. Journal of Neuroscience, 18, 9517-9528.
35. Huang, J., Kumar, S. R., Mitra, M., Zhu, W. J., & Zabih, R. (1997). Image indexing using color correlograms. Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR'97).
36. Hubel, D. H., & Wiesel, T. N. (1959). Receptive fields of single neurones in the cat's striate cortex. The Journal of Physiology, 148, 574-591.
37. Hubel, D. H., & Wiesel, T. N. (1961). Integrative action in the cat's lateral geniculate body. The Journal of Physiology, 155, 385-398.
38. Hubel, D. H., & Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. The Journal of Physiology, 160, 106-154.
39. Keim, D. A., & Kriegel, H. P. (1995). Issues in visualizing large databases. Proc. Conf. on Visual Database Systems (VDB-3), Lausanne, Schweiz, März 1995. In Visual database systems (pp. 203-214). London: Chapman & Hall Ltd.
40. LaBerge, D. (1995). Attentional processing: The brain's art of mindfulness. Cambridge, MA: Harvard University Press.
41. Lowe, D. G. (1999). Object recognition from local scale-invariant features. International Conference on Computer Vision, 2, 1150-1157.
42. Moran, J., & Desimone, R. (1985). Selective attention gates visual processing in the extrastriate cortex. Science, 229, 782-784.
43. Navon, D. (1977). Forest before trees: The precedence of global features in visual perception. Cognitive Psychology, 9, 353-383.
44. Ohta, Y., Kanade, T., & Sakai, T. (1980). Color information for region segmentation. Computer Graphics and Image Processing, 13, 222-241.
45. Oliva, A., & Schyns, P. G. (2000). Diagnostic colors mediate scene recognition. Cognitive Psychology, 41, 176-210.
46. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175.
47. Parker, A. J., & Hawken, M. J. (1988). Two-dimensional spatial structure of receptive fields in monkey striate cortex. Journal of the Optical Society of America A, Optics and Image Science, 5, 598-605.
48. Pass, G., Zabih, R., & Miller, J. (1997). Comparing images using color coherence vectors. Proceedings of the Fourth ACM International Conference on Multimedia, 65-73.
49. Picard, R. W., & Gorkani, M. (1994). Finding perceptually dominant orientations in natural textures. Spatial Vision, 8, 221-253.
50. Posner, M. I., & Petersen, S. E. (1990). The attention system of the human brain. Annual Review of Neuroscience, 13, 25-42.
51. Potter, M. C. (1975). Meaning in visual search. Science, 187, 965-966.
52. Pratt, W. K. (2007). Digital image processing: PIKS scientific inside (4th ed.). Hoboken, NJ: Wiley-Interscience.
53. Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (2007). Numerical recipes: The art of scientific computing (3rd ed.). Cambridge, UK: Cambridge University Press.
54. Raizada, R. D., & Grossberg, S. (2003). Towards a theory of the laminar architecture of cerebral cortex: Computational clues from the visual system. Cerebral Cortex, 13, 100-113.
55. Reid, R. C., & Alonso, J. M. (1995). Specificity of monosynaptic connections from thalamus to visual cortex. Nature, 378, 281-284.
56. Renninger, L. W., & Malik, J. (2004). When is scene identification just texture recognition. Vision Research, 44, 2301-2311.
57. Rensink, R. A. (2000). Seeing, sensing, and scrutinizing. Vision Research, 40, 1469-1487.
58. Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2005). LabelMe: A database and web-based tool for image annotation. MIT AI Lab Memo AIM-2005-025.
59. Schyns, P. G., & Oliva, A. (1994). From blobs to boundary edges: Evidence for time-and spatial-scale-dependent scene recognition. Psychological Science, 5, 195-200.
60. Simoncelli, E. P., & Freeman, W. T. (1995). The steerable pyramid: A flexible architecture for multi-scale derivative computation. Proceedings of International Conference on Image Processing, 3, 444-447.
61. Simons, D. J., & Levin, D. T. (1997). Change blindness. Trends in Cognitive Sciences, 1, 261-267.
62. Smith, A. R. (1978). Color gamut transform pairs. Proceedings of the 5th Annual Conference on Computer Graphics and Interactive Techniques, 12-19.
63. Swain, M. J., & Ballard, D. H. (1991). Color indexing. International Journal of Computer Vision, 7, 11-32.
64. Szummer, M., & Picard, R. W. (1998). Indoor-outdoor image classification. IEEE International Workshop on Content-based Access of Image and Video Databases, 98, 42-51.
65. Tyler, C. W., & Kontsevich, L. L. (1995). Mechanisms of stereoscopic processing: Stereoattention and surface perception in depth reconstruction. Perception, 24, 127-153.
66. Vailaya, A., Figueiredo, M. T., Jain, A. K., & Zhang, H. J. (2001). Image classification for content-based indexing. IEEE Transactions on Image Processing, 10, 117-130.
67. Vailaya, A. J., Jain, A. K., & Zhang, H. J. (1998). On image classification: City vs. landscape. Proceedings of the IEEE Workshop on Content-Based Access of Image and Video Libraries, 3-8.
68. Vogel, J., & Schiele, B. (2007). Semantic scene modeling and retrieval for content-based image retrieval. International Journal of Computer Vision, 72, 133-157.
69. Vogel, J., Schwaninger, A., Wallraven, C., & Bülthoff, H. H. (2006). Categorization of natural scenes: Local vs. global information. Proceedings of the 3rd Symposium on Applied Perception in Graphics and Visualization, 153, 33-40.
70. Young, R. A. (1986). Simulation of human retinal function with the Gaussian derivative model. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'86), 564-569.
71. Young, R. A. (1987). The Gaussian derivative model for spatial vision: I. Retinal mechanisms. Spatial Vision, 2, 273-293.