Visual scenes are categorized by function

Journal of Experimental Psychology: General

Volumn 145, Issue 1, 2016, Pages 82-94

  Greene, Michelle R ^a,b   Baldassano, Christopher ^a   Esteva, Andre ^a   Beck, Diane M ^c   Fei Fei, Li ^a  

^a Stanford University   (United States)

^b Department of Computational Sciences   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Categorization; Scene understanding; Similarity

Indexed keywords

ADULT; COMPREHENSION; CONCEPT FORMATION; DECISION MAKING; DISCRIMINATION LEARNING; DISTANCE PERCEPTION; FEMALE; HUMAN; LEARNING; MALE; PATTERN RECOGNITION; PSYCHOLOGICAL MODEL; SEMANTICS; SOCIAL ENVIRONMENT; STATISTICS;

ADULT; ASSOCIATION LEARNING; COMPREHENSION; CONCEPT FORMATION; DECISION MAKING; DISCRIMINATION LEARNING; DISTANCE PERCEPTION; FEMALE; HUMANS; MALE; MODELS, PSYCHOLOGICAL; PATTERN RECOGNITION, VISUAL; SEMANTICS; SOCIAL ENVIRONMENT; STATISTICS AS TOPIC;

EID: 84952802314     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/xge0000129     Document Type: Article

References (59)

1. Aggarwal, J. K., & Ryoo, M. S. (2011). Human activity analysis: A review. ACM Computer Survey, 43, 16:1:43-16. http://doi.org/10.1145/1922649.1922653
2. Attneave, F. (1950). Dimensions of similarity. The American Journal of Psychology, 63, 516-556. http://dx.doi.org/10.2307/1418869
3. Bar, M. (2004). Visual objects in context. Nature Reviews Neuroscience, 5, 617-629. http://dx.doi.org/10.1038/nrn1476
4. Bar-Joseph, Z., Gifford, D. K., & Jaakkola, T. S. (2001). Fast optimal leaf ordering for hierarchical clustering. Bioinformatics, 17(Suppl. 1), S22-S29. http://dx.doi.org/10.1093/bioinformatics/17.suppl_1.S22
5. Biederman, I. (1987). Recognition-by-components: A theory of human image understanding. Psychological Review, 94, 115-147. http://dx.doi.org/10.1037/0033-295X.94.2.115.
6. Buja, A., Swayne, D. F., Littman, M. L., Dean, N., Hofmann, H., & Chen, L. (2008). Data visualization with multidimensional scaling. Journal of Computational and Graphical Statistics, 17, 444-472. http://dx.doi.org/10.1198/106186008X318440
7. Bülthoff, H. H., Edelman, S. Y., & Tarr, M. J. (1995). How are threedimensional objects represented in the brain? Cerebral Cortex, 5, 247-260. http://dx.doi.org/10.1093/cercor/5.3.247
8. Deng, J., & Dong, W. Socher, R., Li-Jia, Li, Kai, Li, & Li Fei-Fei. (2009). ImageNet: A large-scale hierarchical image database. IEEE Conference on Computer Vision and Pattern Recognition, 2009. CVPR 2009 (pp. 248-255). IEEE Computer Society, Miami, FL. http://doi.org/10.1109/CVPR.2009.5206848
9. Ehinger, K. A., Torralba, A., & Oliva, A. (2010). A taxonomy of visual scenes: Typicality ratings and hierarchical classification. Journal of Vision, 10, 1237. http://dx.doi.org/10.1167/10.7.1237
10. Fei-Fei, L., Iyer, A., Koch, C., & Perona, P. (2007). What do we perceive in a glance of a real-world scene? Journal of Vision, 7, 1-29.
11. Fei-Fei, L., & Perona, P. (2005). A Bayesian Hierarchical Model for Learning Natural Scene Categories. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05)-Vol. 2 (pp. 524-531). IEEE Computer Society, Miami, FLA. Retrieved from http://portal.acm.org/citation.cfm?id=1069129. http://dx.doi.org/10.1109/CVPR.2005.16
12. Gibson, J. J. (1950). The perception of the visual world (Vol. xii). Oxford, England: Houghton Mifflin.
13. Gibson, J. J. (1986). The ecological approach to visual perception. Hillsdale, NJ: Erlbaum.
14. Goodman, N. (1972). Seven strictures on similarity. In N. Goodman (Ed.), Problems and projects. New York, NY: Bobs-Merril.
15. Greene, M. R., & Oliva, A. (2009a). Recognition of natural scenes from global properties: Seeing the forest without representing the trees. Cognitive Psychology, 58, 137-176. http://dx.doi.org/10.1016/j.cogpsych.2008.06.001.
16. Greene, M. R., & Oliva, A. (2009b). The briefest of glances: The time course of natural scene understanding. Psychological Science, 20, 464-472. http://dx.doi.org/10.1111/j.1467-9280.2009.02316.x
17. Greene, M. R., & Oliva, A. (2010). High-level aftereffects to global scene properties. Journal of Experimental Psychology: Human Perception and Performance, 36, 1430-1442. http://dx.doi.org/10.1037/a0019058
18. Hafri, A., Papafragou, A., & Trueswell, J. C. (2013). Getting the gist of events: Recognition of two-participant actions from brief displays. Journal of Experimental Psychology: General, 142, 880-905. http://dx.doi.org/10.1037/a0030045.
19. Henderson, J. M., Larson, C. L., & Zhu, D. C. (2007). Cortical activation to indoor versus outdoor scenes: An fMRI study. Experimental Brain Research, 179, 75-84. http://dx.doi.org/10.1007/s00221-006-0766-2
20. Huth, A. G., Nishimoto, S., Vu, A. T., & Gallant, J. L. (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron, 76, 1210-1224. http://dx.doi.org/10.1016/j.neuron.2012.10.014
21. Iordan, M. C., Greene, M. R., Beck, D. M., & Fei-Fei, L. (2015). Basic level category structure emerges gradually across human ventral visual cortex. Journal of Cognitive Neuroscience, 27, 1427-1446. http://dx.doi.org/10.1162/jocn_a_00790.
22. Jolicoeur, P., Gluck, M. A., & Kosslyn, S. M. (1984). Pictures and names: Making the connection. Cognitive Psychology, 16, 243-275. http://dx.doi.org/10.1016/0010-0285(84)90009-4.
23. Joubert, O. R., Rousselet, G. A., Fize, D., & Fabre-Thorpe, M. (2007). Processing scene context: Fast categorization and object interference. Vision Research, 47, 3286-3297. http://dx.doi.org/10.1016/j.visres.2007.09.013.
24. Julesz, B. (2006). Foundations of cyclopean perception. Cambridge: MIT Press.
25. Kadar, I., & Ben-Shahar, O. (2012). A perceptual paradigm and psychophysical evidence for hierarchy in scene gist processing. Journal of Vision, 12, 16. http://dx.doi.org/10.1167/12.13.16
26. Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature, 452, 352-355. http://dx.doi.org/10.1038/nature06713
27. Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104, 211-240. http://dx.doi.org/10.1037/0033-295X.104.2.211
28. Lazebnik, S., Schmid, C., & Ponce, J. (2006). Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Vol. 2 (pp. 2169-2178). IEEE Computer Society, Miami, FLA. Retrieved from http://portal.acm.org/citation.cfm?id=1153171.1153549
29. Loschky, L. C., & Larson, A. M. (2010). The natural/man-made distinction is made before basic-level distinctions in scene gist processing. Visual Cognition, 18, 513-536. http://dx.doi.org/10.1080/13506280902937606
30. Marr, D. (1982). Vision. New York, NY: Freeman.
31. Medin, D. L., Goldstone, R. L., & Gentner, D. (1993). Respects for similarity. Psychological Review, 100, 254-278. http://dx.doi.org/10.1037/0033-295X.100.2.254.
32. Micallef, L., & Rodgers, P. (2014). eulerAPE: Drawing area-proportional 3-Venn diagrams using ellipses. PLoS ONE, 9, e101717. http://dx.doi.org/10.1371/journal.pone.0101717.
33. Miller, G. A. (1995). WordNet:Alexical database for English. Communications of the ACM, 38, 39-41. http://dx.doi.org/10.1145/219717.219748
34. Oliva, A., & Schyns, P. G. (2000). Diagnostic colors mediate scene recognition. Cognitive Psychology, 41, 176-210. http://dx.doi.org/10.1006/cogp.1999.0728.
35. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175. http://dx.doi.org/10.1023/A:1011139631724.
36. Park, S., Konkle, T., & Oliva, A. (2014). Parametric coding of the size and clutter of natural scenes in the human brain. [Advance online publication]. Cerebral Cortex.
37. Patterson, G., & Hays, J. (2012). SUN attribute database: Discovering, annotating, and recognizing scene attributes. In Proceeding of the 25th Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2751-2758), Providence, RI.
38. Patterson, G., Xu, C., Su, H., & Hays, J. (2014). The SUN attribute database: Beyond categories for deeper scene understanding. International Journal of Computer Vision, 108, 59-81. http://dx.doi.org/10.1007/s11263-013-0695-z.
39. Pedersen, T., Patwardhan, S., & Michelizzi, J. (2004). WordNet:Similarity: Measuring the relatedness of concepts. In Demonstration Papers at HLT-NAACL 2004 (pp. 38-41). Stroudsburg, PA: Association for Computational Linguistics. Retrieved from http://dl.acm.org/citation. cfm?id=1614025.1614037. http://dx.doi.org/10.3115/1614025.1614037
40. Potter, M. C. (1976). Short-term conceptual memory for pictures. Journal of Experimental Psychology: Human Learning and Memory, 2, 509-522. http://dx.doi.org/10.1037/0278-7393.2.5.509
41. Quattoni, A., & Torralba, A. (2009). Recognizing indoor scenes. In 2014 IEEE Conference on Computer Vision and Pattern Recognition (Vol. 0, pp. 413-420). Los Alamitos, CA: IEEE Computer Society. http://doi.org/10.1109/CVPRW.2009.5206537.
42. Ramachandran, V. S. (1988). Perception of shape from shading. Nature, 331, 163-166. http://dx.doi.org/10.1038/331163a0
43. Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014). CNN Features off-the-shelf: An astounding baseline for recognition. Columbus, OH. Retrieved from http://arxiv.org/abs/1403.6382.http://dx.doi.org/10.1109/CVPRW.2014.131.
44. Renninger, L. W., & Malik, J. (2004). When is scene identification just texture recognition? Vision Research, 44, 2301-2311. http://dx.doi.org/10.1016/j.visres.2004.04.006
45. Rensink, R. A. (2002). Change detection. Annual Review of Psychology, 53, 245-277. http://dx.doi.org/10.1146/annurev.psych.53.100901.135125
46. Riesenhuber, M., & Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience, 2, 1019-1025. http://dx.doi.org/10.1038/14819.
47. Rosch, E., Mervis, C. B., Gray, W. D., Johnson, D. M., & Boyes-Braem, P. (1976). Basic objects in natural categories. Cognitive Psychology, 8, 382-439. http://dx.doi.org/10.1016/0010-0285(76)90013-X
48. Russell, B., Torralba, A., Murphy, K., & Freeman, W. (2008). LabelMe: A database and web-based tool for image annotation. International Journal of Computer Vision, 77, 157-173. http://dx.doi.org/10.1007/s11263-007-0090-8
49. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013). OverFeat: Integrated recognition, localization and detection using convolutional networks. arXiv:1312.6229[cs]. Retrieved from http://arxiv.org/abs/1312.6229
50. Shelley, K. J. (2005). Developing the American time use survey activity classification system. Monthly Labor Review, 128, 3-15.
51. Stansbury, D. E., Naselaris, T., & Gallant, J. L. (2013). Natural scene statistics account for the representation of scene categories in human visual cortex. Neuron, 79, 1025-1034. http://dx.doi.org/10.1016/j.neuron.2013.06.034.
52. Szummer, M., & Picard, R. W. (1998). Indoor-outdoor image classification. In Workshop on Content-Based Access of Image and Video Databases (Vol. 0, p. 42). Los Alamitos, CA: IEEE Computer Society. http://doi.org/10.1109/CAIVD.1998.646032
53. Torralba, A., Fergus, R., & Freeman, W. T. (2008). 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 1958-1970. http://dx.doi.org/10.1109/TPAMI.2008.128
54. Tversky, B., & Hemenway, K. (1983). Categories of environmental scenes. Cognitive Psychology, 15, 121-149. http://dx.doi.org/10.1016/0010-0285(83)90006-3.
55. Vogel, J., & Schiele, B. (2007). Semantic modeling of natural scenes for content-based image retrieval. International Journal of Computer Vision, 72, 133-157. http://dx.doi.org/10.1007/s11263-006-8614-1
56. Wiggett, A. J., & Downing, P. E. (2011). Representation of action in occipito-temporal cortex. Journal of Cognitive Neuroscience, 23, 1765-1780. http://dx.doi.org/10.1162/jocn.2010.21552
57. Wittgenstein, L. (2010). Philosophical investigations. New York, NY: Wiley.
58. Xiao, J., Ehinger, K. A., Hays, J., Torralba, A., & Oliva, A. (2014). SUN database: Exploring a large collection of scene categories. International Journal of Computer Vision, 1-20.
59. Yao, B., & Fei-Fei, L. (2010). Modeling mutual context of object and human pose in human-object interaction activities. In 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 17-24). Miami, FL. http://doi.org/10.1109/CVPR.2010.5540235