Automatic computation of an image's statistical surprise predicts performance of human observers on a natural image detection task

Vision Research

Volumn 49, Issue 13, 2009, Pages 1620-1637

  Mundhenk, T Nathan ^a   Einhäuser, Wolfgang ^b   Itti, Laurent ^a  

^a University of Southern California   (United States)

^b PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

Attention; Computer vision; Detection; Masking; Modeling; Natural image; RSVP; Saliency; Statistics; Surprise

Indexed keywords

ARTICLE; ATTENTIONAL BLINK; AUTOMATION; BAYES THEOREM; COMPUTER MODEL; CONTROLLED STUDY; HUMAN; ILLUMINATION; IMAGE DISPLAY; PREDICTION; PRIORITY JOURNAL; RETINA IMAGE; SPATIAL DISCRIMINATION; TIME PERCEPTION; VISION; VISUAL FIELD; VISUAL MASKING; VISUAL MEMORY;

ATTENTION; COMPUTER SIMULATION; HUMANS; MODELS, PSYCHOLOGICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, VISUAL; PERCEPTUAL MASKING; PHOTIC STIMULATION; PSYCHOPHYSICS;

EID: 67349221479     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.visres.2009.03.025     Document Type: Article

References (69)

1. Breitmeyer B.G. Visual masking (1984), Oxford University Press, New York
2. Breitmeyer B.G., and Öǧmen H. Visual Masking: Time slices through conscious and unconscious vision (2006), Oxford University Press, New York
3. Choi S.C., and Wette R. Maximum likelihood estimation of the parameters of the gamma distribution and their bias. Technometrics 11 4 (1969) 683-690
4. Chun M.M., and Potter M.C. A two-stage model for the multiple target detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance 21 (1995) 109-127
5. Cox S., and Dember W.N. U-shaped metacontrast functions with a detection task. Journal of Experimental Psychology 95 (1972) 327-333
6. Crick F. Function of the thalamic reticular complex: the searchlight hypothesis. PNAS 81 (1984) 4586-4590
7. Crick F., and Koch C. A framework for consciousness. Nature Neuroscience 6 2 (2003) 119-126
8. Dehaene S., Changeux J.-P., Naccache L., Sackur J., and Sergent C. Conscious, preconscious, and subliminal processing: a testable taxonomy. Trends in Cognitive Sciences 10 5 (2006) 204-211
9. Di Lollo V., Enns J.T., and Rensink R.A. Competition for consciousness among visual events: the psychophysics of reentrant visual processes. Journal of Experimental Psychology: General 129 4 (2000) 481-507
10. Didday R.L. A model of visuomotor mechanisms in the frog optic tectum. Mathematical Biosciences 30 (1976) 169-180
11. Duncan J. Selective attention and the organization of visual information. Journal of Experimental Psychology: General 113 4 (1984) 501-517
12. Duncan J., Ward R., and Shapiro K. Direct measurement of attentional dwell time in human vision. Nature 369 26 (1994) 313-315
13. Einhäuser W., Koch C., and Makeig S. The duration of the attentional blink in natural scenes depends on stimulus category. Vision Research 47 (2007) 597-607
14. Einhäuser W., Mundhenk T.N., Baldi P., Koch C., and Itti L. A bottom-up model of spatial attention predicts human error patterns in rapid scene recognition. Journal of Vision 7 10 (2007) 1-13
15. Evans K.K., and Treisman A. Perception of objects in natural scenes: is it really attention free?. Journal of Experimental Psychology: Human Perception and Performance 31 6 (2005) 1476-1492
16. Ghorashi S.M.S., Smilek D., and Di Lollo V. Visual search is postponed during the attentional blink until the system is suitably reconfigured. Journal of Experimental Psychology: Human Perception and Performance 33 1 (2007) 124-136
17. Hoffman J.E., Nelson B., and Houck M.R. The role of attentional resources in automatic detection. Cognitive Psychology 15 3 (1983) 379-410
18. Hogben J., and Di Lollo V. Effects of duration of masking stimulus and dark interval on the detection of a test disk. Journal of Experimental Psychology 95 2 (1972) 245-250
19. Itti L. Automatic foveation for video compression using a neurobiological model of visual attention. IEEE Transactions on Image Processing 13 10 (2004)
20. Itti, L., & Baldi, P. (2005). A principled approach to detecting surprising events in video. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 631-637).
21. Itti, L., & Baldi, P. (2006). Bayesian surprise attracts human attention. In Advances in 1215 Neural Information Processing Systems (NIPS) (Vol. 19, pp. 547-554): MIT Press.
22. Itti L., and Koch C. Computational modeling of visual attention. Nature Reviews Neuroscience 2 3 (2001) 194-203
23. Itti L., Koch C., and Braun J. Revisiting spatial vision. Towards a unifying model. JOSA-A 17 11 (2000) 1899-1917
24. Itti L., Koch C., and Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 11 (1998) 1254-1259
25. Jollife I.T. Principle component analysis (1986), Springer-Verlag, New York
26. Keysers C., and Perrett D.I. Visual masking and RSVP reveal neural competition. Trends in Cognitive Sciences 6 3 (2002) 120-125
27. Kullback S., and Leibler R.A. On information and sufficiency. Annals of Mathematical Statistics 22 (1951) 79-86
28. Lamme V.A.F. Separate neural definitions of visual consciousness and visual attention; a case for phenomenal awareness. Neural Networks 17 (2004) 861-872
29. Lee S.-H., and Blake R. Neural synergy in visual grouping: when good continuation meets common fate. Vision Research 41 (2001) 2057-2064
30. Li F.F., VanRullen R., Koch C., and Perona P. Rapid natural scene categorization in the near absence of attention. PNAS 99 14 (2002) 9596-9601
31. Li W., and Gilbert C.D. Global contour saliency and local colinear interactions. Journal of Neurophysiology 88 (2002) 2846-2856
32. Li Z. A neural model of contour integration in the primary visual cortex. Neural Computation 10 (1998) 903-940
33. Li Z. A saliency map in primary visual cortex. Trends in Cognitive Sciences 6 1 (2002) 9-16
34. Mack A., and Rock I. Inattentional blindness (1998), MIT Press, Cambridge, MA
35. Maki W.S., and Mebane M.W. Attentional capture triggers an attentional blink. Psychonomic Bulletin and Review 13 1 (2006) 125-131
36. Marois R., Yi D.-J., and Chun M.M. The neural fate of consciously perceived and missed events in the attentional blink. Neuron 41 (2004) 465-472
37. McMains S.A., and Somers D.C. Multiple selection of attentional selection in human visual cortex. Neuron 42 (2004) 677-686
38. Mounts J.R.W., and Gavett B.E. The role of salience in localized attentional interference. Vision Research 44 (2004) 1575-1588
39. Mundhenk, T. N., Everist, J., Landauer, C., Itti, L., & Bellman, K. (2005). Distributed biologically based real time tracking in the absence of prior target information. In SPIE (Vol. 6006, pp. 330-341): Boston, MA.
40. Mundhenk T.N., and Itti L. Computational modeling and exploration of contour integration for visual saliency. Biological Cybernetics 93 3 (2005) 188-212
41. Mundhenk, T. N., Landauer, C., Bellman, K., Arbib, M.A., & Itti, L. (2004). Teaching the computer subjective notions of feature connectedness in a visual scene for real time vision. In: SPIE (Vol. 5608, pp. 136-147): Philadelphia, PA.
42. Navalpakkam V., and Itti L. Optimal cue selection strategy. Advances in Neural Information Processing Systems (NIPS) (2006) 987-994
43. Navalpakkam V., and Itti L. Search goal tunes visual features optimally. Neuron 53 4 (2007) 605-617
44. Neisser U., and Becklen R. Selective looking: attending to visually specified event. Cognitive Psychology 7 4 (1975) 480-494
45. Parkhurst D.J., and Niebur E. Scene content selected by active vision. Spatial Vision 16 2 (2003) 125-154
46. Plaut, D., Nowlan, S., & Hinton, G.E. (1986). Experiments on learning by back propagation. Technical Report CMU-CS-86-126. Pittsburgh, PA: Department of Computer Science, Carnegie Mellon University.
47. Potter M.C., Staub A., and O'Conner D.H. The time course of competition for attention: attention is initially labile. Journal of Experimental Psychology 28 5 (2002) 1149-1162
48. Raab D.H. Backward masking. Psychological Bulletin 60 2 (1963) 118-129
49. Raymond J.E., Shapiro K.L., and Arnell K.M. Temporary suppression of visual processing in an RSVP task: an attentional blink?. Journal of Experimental Psychology: Human Perception and Performance 18 (1992) 849-860
50. Reeves A. Visual imagery in backward masking. Perception and Psychophysics 28 (1980) 118-124
51. Reeves A. Metacontrast U-shaped functions derive from two monotonic functions. Perception 11 (1982) 415-426
52. Ricciardi L.M. Diffusion models of neuron activity. In: Arbib M.A. (Ed). The handbook of brain theory and neural networks (1995), The MIT Press, Cambridge, MA 299-304
53. Rousselet G.A., Fabre-Thorpe M., and Thorpe S.J. Parallel processing in high-level categorization of natural images. Nature Neuroscience 5 7 (2002) 629-630
54. Rousselet G.A., Thorpe S.J., and Fabre-Thorpe M. Processing of one, two or four natural scenes in humans: the limit of parallelism. Vision Research 44 (2004) 877-894
55. Schmolesky M.T., Wang Y., Hanes D.P., Thompson K.G., Leutgeb S., Schall J.D., et al. Signal timing across the macaque visual system. Journal of Neurophysiology 79 6 (1998) 3272-3278
56. Sergent C., Baillet S., and Dehaene S. Timing of the brain events underlying access to consciousness during the attentional blink. Nature Neuroscience 8 10 (2005) 1391-1400
57. Serre T., Oliva A., and Poggio T. A feedforward architecture accounts for rapid categorization. PNAS 104 15 (2007) 6424-6429
58. Shih S.-I. Recall of two visual targets embedded in RSVP streams of distractors depends on their temporal and spatial relationship. Perception and Psychophysics 62 7 (2000) 1348-1355
59. Shih S.-I., and Reeves A. Attention capture in rapid serial visual presentation. Spatial Vision 20 4 (2007) 301-315
60. Shih S.-I., and Sperling G. Measuring and modeling the trajectory of visual spatial attention. Psychological Review 109 2 (2002) 260-305
61. Sperling G., Reeves A., Blaser E., Lu Z.-L., and Weichselgartner E. Two computational models of attention. In: Braun J., Koch C., and Davis J.L. (Eds). Visual attention and cortical circuits (2001), MIT Press, Cambridge, MA 177-214
62. Tanaka Y., and Sagi D. Attention and short-term memory in contrast detection. Vision Research 40 (2000) 1089-1100
63. VanRullen R., and Koch C. Competition and selection during visual processing of natural scenes and objects. Journal of Vision 3 (2003) 75-85
64. VanRullen R., and Koch C. Visual selective behavior can be triggered by a feed-forward process. Journal of Cognitive Neuroscience 15 2 (2003) 209-217
65. VanRullen R., Reddy L., and Koch C. Visual search and dual tasks reveal two distinct attentional resources. Journal of Cognitive Neuroscience 16 1 (2004) 4-14
66. Visser T.A.W., Zuvic S.M., Bischof W.F., and Di Lollo V. The attentional blink with targets in different spatial locations. Psychonomic Bulletin and Review 6 3 (1999) 432-436
67. Weisstein N., and Haber R.N. A U-shaped backward masking function in vision. Psychonomic Science 2 (1965) 75-76
68. Wolfe J.M., Horowitz T.S., and Michod K.O. Is visual attention required for robust picture memory?. Vision Research 47 (2007) 955-964
69. Yen S., and Fenkel L.H. Extraction of perceptually salient contours by striate cortical networks. Vision Research 38 5 (1998) 719-741