Categorization of Natural Scenes: Local Versus Global Information and the Role of Color

ACM Transactions on Applied Perception

Volumn 4, Issue 3, 2007, Pages 19-

  Vogel, Julia ^a   Schwaninger, Adrian ^b   Wallraven, Christian ^b   Bülthoff, Heinrich H ^c  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Algorithms; computational modeling; computationalgist; global configural information; Human perception; local region based information; scene classification; Scene perception; semantic modeling

Indexed keywords

EID: 85010289707     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1278387.1278393     Document Type: Article

References (35)

1. Biederman, I. 1972. Perceiving real-world scenes. Science 177, 43, 77-80.
2. Bosch, A., Zisserman, A., and Munoz, X. 2006. Scene classification via pLSA. In European Conference on Computer Vision ECCV'06. Graz, Austria.
3. Chang, C.-C. and Lin, C.-J. 2001. LIBSVM: a library for support vector machines. Software available at: http://www.csie.ntu.edu.tw.
4. Delorme, A., Richard, G., and Fabre-Thorpe, M. 2000. Rapid categorization of natural scenes is color blind: A study in monkeys and humans. Vision Research 40, 16, 2187-2200.
5. Fei-Fei, L. and Perona, P. 2005. A bayesian hierarchical model for learning natural scene categories. In IEEE Conf on Computer Vision and Pattern Recogntion CVPR'05. San Diego, CA.
6. Fei-Fei, L., Van Rullen, R., Koch, C., and Perona, P. 2005. Why does natural scene categorization require little attention? exploring attentional requirements for natural and synthetic stimuli. Visual Cognition 12, 6, 893-924.
7. Fei-Fei, L., Iyer, A., Koch, C., and Perona, P. 2007. What do we perceive in a glance of a real-world scene? Journal of Vision 7, 1, 1-29.
8. Goffaux, V., Jacques, C., Mouraux, A., Oliva, A., Schyns, P., and Rossion, B. 2005. Diagnostic colours contribute to the early stages of scene categorization: Behavioural and neurophysiological evidence. Visual Cognition 12, 6, 878-892.
9. Hayward, W. 2003. After the viewpoint debate: where next in object recognition? Trends in Cognitive Sciences 7, 10, 425-427.
10. Hayward, W., Rhodes, G., and Schwaninger, A. 2007. An own-race advantage for components as well as configurations in face recognition. Cognition. DOI: 10.1016/j.cognition.2007.04.002.
11. Henderson, J. 2005a. Introduction to real-world scene perception. Visual Cognition: Special Issue on Real-World Scene Perception 12, 849-851.
12. Henderson, J., Ed. 2005b. Visual Cognition: Special Issue on Real-World Scene Perception, Vol. 12.
13. Jain, R., Kasturi, R., and Schunck, B. 1995. Machine Vision. McGraw-Hill, New York.
14. Mccotter, M., Gosselin, F., Sowden, P., and Schyns, P. 2005. The use of visual information in natural scenes. Visual Cogni tion 12, 6, 938-953.
15. Mojsilovic, A., Gomes, J., and Rogowitz, B. 2004. Semantic-friendly indexing and querying of images based on the extraction of the objective semantic cues. International Journal of Computer Vision 56, 1/2 (Jan.), 79-107.
16. Oliva, A. 2005. Gist of a scene. In Neurobiology of Attention., L. Itti, G. Rees, and J. Tsotsos, Eds. Academic Press, and Elsevier, New York. 251-256.
17. Oliva, A. and Schyns, P. 2000. Diagnostic color blobs mediate scene recognition. Cognitive Psychology 41, 176-210.
18. Oliva, A. and Torralba, A. 2001. Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision 42, 3 (Mar.), 145-175. Matlab code from http://people.csail.mit.edu/torralba/code/spatialenvelope/.
19. Oliva, A. and Torralba, A. 2006. Building the gist of a scene: the role of global image features in recognition. Progress in Brain Research 155, 23-39.
20. Rogowitz, B., Frese, T., Smith, J., Bouman, C., and Kalin, E. 1997. Perceptual image similarity experiments. In SPIE Conference on Human Vision and Electronic Imaging. San Jose, CA. 576-590.
21. Rosch, E., Simpson, C., and Miller, R. 1976. Structural bases of typicality effects. Journal of Experimental Psychology: Human Perception and Performance 2, 491-502.
22. Schwaninger, A., Lobmaier, J. S., and Collishaw, S. M. 2002. Role of featural and configural information in familiar and unfamiliar face recognition. In 2nd Conference on Biologically Motivated Computer Vision BMCV. Springer, Lecture Notes in Computer Science, 2525, Tubingen, Germany.
23. Schwaninger, A., Carbon, C., and Leder, H. 2003. Expert face processing: Specialization and constraints. In Development of face processing, G. Schwarzer and H. Leder, Eds. Hogrefe & Huber Publishers, Inc., Cambridge, MA. 81-97.
24. Schwaninger, A., Vogel, J., Hofer, F., and Schiele, B. 2006. A psychophysically plausible model for typicality ranking of natural scenes. Transactions of Applied Perception 3, 4 (Oct.), 333-353.
25. Schyns, P and Oliva, A. 1994. From blobs to boundary edges: evidence for time- and spatial-scale dependent scene recognition. Psychological Science 5, 195-200.
26. Szummer, M. and Picard, R. 1998. Indoor-outdoor image classification. In Workshop on Content-based Access of Image and Video Databases. Bombay, India.
27. Thorpe, S., Fize, D., and Marlot, C. 1996. Speed of processing in the human visual system. Nature (London) 381, 520-522.
28. Torralba, A., Murphy, K. P., and Freeman, W. T. 2004. Contextual models for object detection using boosted random fields. Tech. Rep. AIM-2004-008, MIT, AI Lab. (Apr.).
29. Tversky, B. and Hemenway, K. 1983. Categories of environmental scenes. Cognitive Psychology 15, 121-149.
30. Vailaya, A., Figueiredo, M., Jain, A., and Zhang, H. 2001. Image classification for content-based indexing. IEEE Transactions on Image Processing 10, 1 (Jan.), 117-130.
31. Vogel, J. and Schiele, B. 2007. Semantic modeling of natural scenes for content-based image retrieval. International Journal of Computer Vision 72, 2 (Apr.), 133-157.
32. Walker Renninger, L. and Malik, J. 2004. When is scene identification just texture recognition? Vision Research 44, 4 (Apr.), 2301-2311.
33. Wallraven, C., Schwaninger, A., and Bulthoff, H. 2005. Learning from humans: computational modeling of face recognition. Network: Computation in Neural Systems 16, 4, 401-418.
34. Wichmann, F., Sharpe, L., and Gegenfurtner, K. 2002. The contribution of color to recognition memory for natural scenes. Journal of Experimental Psychology: Learning, Memory and Cognition 28, 3, 509-520.
35. Wolfe, J. 1998. Visual memory: What do you know about what you saw? Current Biology 8, R303-R304.