What you see is what you expect: rapid scene understanding benefits from prior experience

Attention, Perception, and Psychophysics

Volumn 77, Issue 4, 2015, Pages 1239-1251

  Greene, Michelle R ^a   Botros, Abraham P ^a   Beck, Diane M ^b   Fei Fei, Li ^a  

^a Stanford University   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Free response; Prior probability; Scene understanding

Indexed keywords

ADULT; FEMALE; HUMAN; MALE; MEMORY; PROBABILITY; SEMANTICS; VISION; YOUNG ADULT;

ADULT; FEMALE; HUMANS; MALE; MEMORY; PROBABILITY; SEMANTICS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84939951252     PISSN: 19433921     EISSN: 1943393X     Source Type: Journal    
DOI: 10.3758/s13414-015-0859-8     Document Type: Article

References (51)

1. Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmid, A. M., Dale, A. M., … Halgren, E. (2006). Top-down facilitation of visual recognition. Proceedings of the National Academy of Sciences, 103, 449–454. doi:10.1073/pnas.0507062103
2. Becker, M. W., Pashler, H., & Lubin, J. (2007). Object-intrinsic oddities draw early saccades. Journal of Experimental Psychology: Human Perception and Performance, 33, 20–30. doi:10.1037/0096-1523.33.1.20
3. Biederman, I., Mezzanotte, R. J., & Rabinowitz, J. C. (1982). Scene perception: Detecting and judging objects undergoing relational violations. Cognitive Psychology, 14, 143–177. doi:10.1016/0010-0285(82)90007-X
4. Brady, T. F., Konkle, T., & Alvarez, G. A. (2009). Compression in visual working memory: Using statistical regularities to form more efficient memory representations. Journal of Experimental Psychology. General, 138, 487–502. doi:10.1037/a0016797
5. Brady, T. F., Konkle, T., & Alvarez, G. A. (2011). A review of visual memory capacity: Beyond individual items and toward structured representations. Journal of Vision, 11(5), 4. doi:10.1167/11.5.4
6. Brewer, W. F., & Treyans, J. (1981). Role of schemata in memory for places. Cognitive Psychology, 13, 207–230.
7. Davenport, J. L., & Potter, M. C. (2004). Scene consistency in object and background perception. Psychological Science, 15, 559–564. doi:10.1111/j.0956-7976.2004.00719.x
8. Dilks, D. D., Julian, J. B., Kubilius, J., Spelke, E. S., & Kanwisher, N. (2011). Mirror-image sensitivity and invariance in object and scene processing pathways. Journal of Neuroscience, 31, 11305–11312. doi:10.1523/JNEUROSCI. 1935-11.2011
9. Eger, E., Henson, R. N., Driver, J., & Dolan, R. J. (2007). Mechanisms of top-down facilitation in perception of visual objects studied by fMRI. Cerebral Cortex, 17, 2123–2133. doi:10.1093/cercor/bhl119
10. Ehinger, K. A., Xiao, J., Torralba, A., & Oliva, A. (2011). Estimating scene typicality from human rankings and image features. In L. Carlson, C. Hölscher, & T. F. Shipley (Eds.), Expanding the space of cognitive science: Proceedings of the 33rd Annual Conference of the Cognitive Science Society (pp. 2562–2567). Austin, TX: Cognitive Science Society.
11. Esterman, M., & Yantis, S. (2010). Perceptual expectation evokes category-selective cortical activity. Cerebral Cortex, 20, 1245–1253. doi:10.1093/cercor/bhp188
12. Evans, K. K., & Treisman, A. (2005). Perception of objects in natural scenes: Is it really attention free? Journal of Experimental Psychology: Human Perception and Performance, 31, 1476–1492. doi:10.1037/0096-1523.31.6.1476
13. Fei-Fei, L., Iyer, A., Koch, C., & Perona, P. (2007). What do we perceive in a glance of a real-world scene? Journal of Vision, 7(1), 10:1–29.
14. Gajewski, D. A., Philbeck, J. W., Pothier, S., & Chichka, D. (2010). From the most fleeting of glimpses: On the time course for the extraction of distance information. Psychological Science, 21, 1446–1453. doi:10.1177/0956797610381508
15. Greene, M. R., & Oliva, A. (2009). The briefest of glances: The time course of natural scene understanding. Psychological Science, 20, 464–472. doi:10.1111/j.1467-9280.2009.02316.x
16. Grill-Spector, K., & Kanwisher, N. (2005). Visual recognition: As soon as you know it is there, you know what it is. Psychological Science, 16, 152–160. doi:10.1111/j.0956-7976.2005.00796.x
17. Groen, I. I. A., Ghebreab, S., Prins, H., Lamme, V. A. F., & Scholte, H. S. (2013). From image statistics to scene gist: Evoked neural activity reveals transition from low-level natural image structure to scene category. Journal of Neuroscience, 33, 18814–18824. doi:10.1523/JNEUROSCI. 3128-13.2013
18. Henderson, J. M., Weeks, P. A., Jr., & Hollingworth, A. (1999). The effects of semantic consistency on eye movements during complex scene viewing. Journal of Experimental Psychology: Human Perception and Performance, 25, 210–228. doi:10.1037/0096-1523.25.1.210
19. Isola, P., Xiao, J., Parikh, D., Torralba, A., & Oliva, A. (2013). What makes a photograph memorable? IEEE Transactions on Pattern Analysis and Machine Intelligence, 36, 1469–1482. doi:10.1109/TPAMI.2013.200
20. Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489–1506. doi:10.1016/S0042-6989(99)00163-7
21. Johnson, J. S., & Olshausen, B. A. (2003). Timecourse of neural signatures of object recognition. Journal of Vision, 3(7), 4. doi:10.1167/3.7.4
22. Joubert, O. R., Fize, D., Rousselet, G. A., & Fabre-Thorpe, M. (2008). Early interference of context congruence on object processing in rapid visual categorization of natural scenes. Journal of Vision, 8(13), 11:1–18. doi:10.1167/8.13.11
23. Kaplan, S. (1992). Environmental preference in a knowledge-seeking, knowledge-using organism. In J. H. Barkow, L. Cosmides, & J. Tooby (Eds.), The adapted mind: Evolutionary psychology and the generation of culture (pp. 581–598). New York, NY: Oxford University Press.
24. Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature, 452, 352–355. doi:10.1038/nature06713
25. Lampinen, J. M., Copeland, S. M., & Neuschatz, J. S. (2001). Recollections of things schematic: Room schemas revisited. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27, 1211–1222. doi:10.1037/0278-7393.27.5.1211
26. Liu, K., & Jiang, Y. (2005). Visual working memory for briefly presented scenes. Journal of Vision, 5(7), 650–658. doi:10.1167/5.7.5
27. Loftus, G. R., & Mackworth, N. H. (1978). Cognitive determinants of fixation location during picture viewing. Journal of Experimental Psychology. Human Perception and Performance, 4, 565–572. doi:10.1037/0096-1523.4.4.565
28. Mack, M., Gauthier, I., Sadr, J., & Palmeri, T. (2008). Object detection and basic-level categorization: Sometimes you know it is there before you know what it is. Psychonomic Bulletin & Review, 15, 28–35. doi:10.3758/PBR.15.1.28
29. McCotter, M., Gosselin, F., Sowden, P., & Schyns, P. G. (2005). The use of visual information in natural scenes. Visual Cognition, 12, 938–953. doi:10.1080/13506280444000599
30. Oliva, A., & Schyns, P. G. (2000). Diagnostic colors mediate scene recognition. Cognitive Psychology, 41, 176–210.
31. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145–175. doi:10.1023/A:1011139631724
32. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607–609. doi:10.1038/381607a0
33. Portilla, J., & Simoncelli, E. (2000). A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision, 40, 49–71.
34. Potter, M. C. (1976). Short-term conceptual memory for pictures. Journal of Experimental Psychology: Human Learning and Memory, 2, 509–522. doi:10.1037/0278-7393.2.5.509
35. Potter, M. C., Wyble, B., Hagmann, C. E., & McCourt, E. S. (2014). Detecting meaning in RSVP at 13 ms per picture. Attention, Perception, & Psychophysics, 76, 270–279. doi:10.3758/s13414-013-0605-z
36. Rao, R. P. N., & Ballard, D. H. (1999). Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2, 79–87. doi:10.1038/4580
37. Rayner, K., Castelhano, M. S., & Yang, J. (2009). Eye movements when looking at unusual/weird scenes: Are there cultural differences? Journal of Experimental Psychology. Learning, Memory, and Cognition, 35, 254–259. doi:10.1037/a0013508
38. Rayner, K., & Pollatsek, A. (1992). Eye movements and scene perception. Canadian Journal of Psychology, 46, 342–376. doi:10.1037/h0084328
39. Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014). CNN Features off-the-shelf: An astounding baseline for recognition. Retrieved from arxiv.org/abs/1403.6382
40. Rémy, F., Saint-Aubert, L., Bacon-Macé, N., Vayssière, N., Barbeau, E., & Fabre-Thorpe, M. (2013). Object recognition in congruent and incongruent natural scenes: A life-span study. Vision Research, 91, 36–44. doi:10.1016/j.visres.2013.07.006
41. Scholte, H. S., Ghebreab, S., Waldorp, L., Smeulders, A. W. M., & Lamme, V. A. F. (2009). Brain responses strongly correlate with Weibull image statistics when processing natural images. Journal of Vision, 9(4), 29. doi:10.1167/9.4.29
42. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013). OverFeat: Integrated recognition, localization and detection using convolutional networks. Retrieved from arxiv.org/abs/1312.6229
43. Summerfield, C., Egner, T., Greene, M., Koechlin, E., Mangels, J., & Hirsch, J. (2006). Predictive codes for forthcoming perception in the frontal cortex. Science, 314, 1311–1314. doi:10.1126/science.1132028
44. Thorpe, S., Fize, D., & Marlot, C. (1996). Speed of processing in the human visual system. Nature, 381, 520–522. doi:10.1038/381520a0
45. Torralba, A., & Oliva, A. (2003). Statistics of natural image categories. Network, 14, 391–412. doi:10.1088/0954-898X_14_3_302
46. Torralbo, A., Walther, D. B., Chai, B., Caddigan, E., Fei-Fei, L., & Beck, D. M. (2013). Good exemplars of natural scene categories elicit clearer patterns than bad exemplars but not greater BOLD activity. PLoS ONE, 8, e58594. doi:10.1371/journal.pone.0058594
47. Underwood, G., Templeman, E., Lamming, L., & Foulsham, T. (2008). Is attention necessary for object identification? Evidence from eye movements during the inspection of real-world scenes. Consciousness and Cognition, 17, 159–170. doi:10.1016/j.concog.2006.11.008
48. Võ, M. L.-H., & Henderson, J. M. (2009). Does gravity matter? Effects of semantic and syntactic inconsistencies on the allocation of attention during scene perception. Journal of Vision, 9(3), 24. doi:10.1167/9.3.24
49. Walther, D. B., Caddigan, E., Fei-Fei, L., & Beck, D. M. (2009). Natural scene categories revealed in distributed patterns of activity in the human brain. Journal of Neuroscience, 29, 10573–10581. doi:10.1523/JNEUROSCI. 0559-09.2009
50. Walther, D., & Koch, C. (2006). Modeling attention to salient proto-objects. Neural Networks: The Official Journal of the International Neural Network Society, 19(9) 1395–407. doi:10.1016/j.neunet.2006.10.001
51. Zelinsky, G. J. (2013). Understanding scene understanding. Frontiers in Psychology, 4, 954. doi:10.3389/fpsyg.2013.00954