Attention: Bits versus wows

Proceedings of 2005 International Conference on Neural Networks and Brain Proceedings, ICNNB'05

Volumn 1, Issue , 2005, Pages

  Baldi, Pierre ^a   Itti, Laurent ^b  

^a Irvine   (United States)

^b University of Southern California ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN DEFINITIONS; MATHEMATICAL THEORY; NEURONS; SENSORY PROCESSING;

DECISION MAKING; LARGE SCALE SYSTEMS; LEARNING SYSTEMS; NEUROLOGY; NUMERICAL METHODS; SENSORY PERCEPTION;

BINARY CODES;

EID: 33847147657     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. W. James, The Principles of Psychology (Harvard University Press, Cambridge, MA, 1890/1981).
2. J. K. Tsotsos, Behav Brain Sci 14, 506 (1991).
3. L. Itti, C. Koch, Nat Rev Neurosci 2, 194 (2001).
4. B. C. Motter, E. J. Belky, Vision Res 38, 1805 (1998).
5. J. Shen, E. M. Reingold, M. Pomplun, Perception 29, 241 (2000).
6. P. Reinagel, A. M. Zador, Network 10, 341 (1999).
7. C. M. Privitera, L. W. Stark, IEEE Trans Patt Anal Mach Intell 22, 970 (2000).
8. E. Barth, C. Zetzsche, I. Rentschler, J. Opt. Soc. Am. A Opt. Image. Sci. Vis. 15, 1723 (1998).
9. D. Parkhurst, K. Law, E. Niebur, Vision Res 42, 107 (2002).
10. J. Theeuwes, Percept Psychophys 57, 637 (1995).
11. R. A. Abrams, S. E. Christ, Psychol Sci 14, 427 (2003).
12. S. L. Franconeri, A. Hollingworth, D. J. Simons, Psychological Science (in press).
13. S. Kuliback, Information Theory and Statistics (Wiley, New York:New York, 1959).
14. P. Baldi, in Information, Coding, and Mathematics, M. Blaum Editor, Kluwer, 1-25, 2002.
15. P. Baldi, in Neurobiology of Attention, L. Itti, G. Rees, and J. Tsotsos Editors, Elsevier, San Diego, CA, 24-28, 2005.
16. L. D. Brown, Fundamentals of Statistical Exponential Families (Institute of Mathematical Statistics, Hayward, CA, 1986).
17. Saccades were defined by a velocity threshold of θ °/s and amplitude threshold of 2°.
18. Computing the master maps for all models tested here and evaluating them against human eye movement traces required in excess of seven CPU-months, which we distributed over the high-performance computation clusters available at UCI and USC.
19. Computing the Kullback-Leibler distance between empirical distributions of metric values at human and random saccade endppoints presents several definitive advantages over simpler scoring schemes used previously. These include its agnosticity to putative mechanisms for generating saccades based on the instantaneous distribution of metric responses over visual space, and its invariance to reparameterizations, so that applying any continuous nonlinearity to master map values would not affect scoring.
20. R. B. Goldstein, E. Peli, S. Lerner, G. Luo, J Vision 4, 643a (2004).
21. D. J. Parkhurst, E. Niebur, Spat Vis 16, 125 (2003).
22. J. Wolfe, Attention, H. Pashler, ed. (University College London Press, London, UK, 1998).
23. Two humans were considered in agreement on an important location at a given time if their sampling apertures (diameter 5.6°) intersected.
24. Indeed, it is well known that continuous flicker does not continually attract attention [?].
25. H. B. Barlow, Proc. Symposium on the Mechanization of Thought Processes, D. V. Blake, A. M. Utlley, eds. (HM Stationery Office, London, 1959), vol. 2, pp. 537-574.
26. J. J. Atick, Network 3, 213 (1992).
27. E. P. Simoncelli, B. A. Olshausen, Annu Rev Neurosci 24, 1193 (2001).
28. Eearly sensory neurons are known to rapidly adapt and signal novel stimuli more vigorously, in a manner compatible with our surprise metric's behaviour (Müller et al., 1999). Less evidence exists that single neurons may compute variance or Shannon entropy over spatially extended patches of inputs.
29. C. E. Shannon, Bell Syst Tech J 27, 379 (1948).
30. This readily suggests a dynamic compression algorithm where fewer bits are used to encode unsurprising regions, and more bits are used to encode surprising regions.
31. R. T. Cox, Am. J. Phys. 14, 1 (1964).
32. L. J. Savage, The foundations of statistics (Dover, New York, 1972). (First Edition in 1954).
33. E. T. Jaynes, Probability Theory. The Logic of Science (Cambridge University Press, 2003).
34. M. Markou, S. Singh, Signal Processing 83, 2481 (2003).
35. N. Friedman, S. Russell, Annual Conference on Uncertainty in Artificial Intelligence (1997), pp. 175-181.
36. C. Ranganath, G. Rainer, Nat Rev Neurosci 4, 193 (2003).
37. L. Itti, C. Koch, E. Niebur, IEEE Trans Patt Anal Mach Intell 20, 1254 (1998).
38. J. H. Fecteau and D. P. Munoz, Nat Rev Neurosci 4, 435 (2003).
39. J. M. Wolfe and T. S. Horowitz, Nat Rev Neurosci 5, 495 (2004).
40. L. Itti and P. Baldi, Proceedings of IEEE CVPR, in press, (2005).