Modeling fixation locations using spatial point processes

Journal of Vision

Volumn 13, Issue 12, 2013, Pages

  Barthelmé, Simon ^a   Trukenbrod, Hans ^b   Engbert, Ralf ^b,c,d   Wichmann, Felix ^e  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b UNIVERSITY OF POTSDAM   (Germany)

^c UNIVERSITY OF TÜBINGEN   (Germany)

^d Bernstein Center Tübingen   (Germany)

^e MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

Eye movements; Fixation locations; Modeling; Point process; Saliency; Spatial statistics

Indexed keywords

EID: 84886280179     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/13.12.1     Document Type: Article

References (82)

1. A̧ik, A., Sarwary, A., Schultze-Kraft, R., Onat, S., & König, P. (2010). Developmental changes in natural viewing behavior: Bottom-up and top-down differences between children, young adults and older adults. Frontiers in Psychology, 1.
2. Baddeley, A., Berman, M., Fisher, N. I., Hardegen, A., Milne, R. K., Schuhmacher, D., et al. (2010). Spatial logistic regression and change-of-support in poisson point processes. Electronic Journal of Statistics, 4(0), 1151-1201.
3. Baddeley, A., Turner, R., Møller, J., & Hazelton, M. (2005). Residual analysis for spatial point processes (with discussion). Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67(5), 617-666.
4. Berman, M., & Turner, T. R. (1992). Approximating point process likelihoods with GLIM. Applied Statistics, 41(1), 31-38.
5. Bishop, C. M. (2007). Pattern recognition and machine learning (Information science and statistics) (2nd ed.). New York: Springer.
6. Borji, A., & Itti, L. (2013). State-of-the-art in visual attention modeling. IEEE Transactions On Pattern Analysis And Machine Intelligence, 35(1), 185-207.
7. Bruce, N. D., & Tsotsos, J. K. (2009). Saliency, attention, and visual search: An information theoretic approach. Journal of Vision, 9(3):5, 1-24, http://www.journalofvision.org/content/9/3/5, doi: 10.1167/9.3.5. [PubMed] [Article]
8. Cerf, M., Harel, J., Einhäuser, W., & Koch, C. (2008). Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing Systems, 20.
9. Ciuffreda, K. J., & Tannen, B. (1995). Eye movement basics for the clinician. St. Louis, MO: Mosby.
10. Dayan, P., & Abbott, L. F. (2001). Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (1st ed.). Cambridge, MA: MIT Press.
11. Deubel, H., & Schneider, W. X. (1996). Saccade target selection and object recognition: Evidence for a common attentional mechanism. Vision Research, 36, 1827-1837.
12. Diggle, P. J. (2002). Statistical analysis of spatial point patterns (2nd ed.). Oxon, UK: Hodder Education Publishers.
13. Duda, R. O., Hart, P. E., & Stork, D. G. (2000).Pattern classification (2nd ed.). Hoboken, NJ: Wiley-Interscience.
14. Ehinger, K. A., Hidalgo-Sotelo, B., Torralba, A., & Oliva, A. (2009). Modeling search for people in 900 scenes: A combined source model of eye guidance. Visual Cognition, 17(6-7), 945-978.
15. Einhäuser, W., & König, P. (2003). Does luminancecontrast contribute to a saliency map for overt visual attention? The European Journal of Neuroscience, 17(5), 1089-1097.
16. Einhäuser, W., Spain, M., & Perona, P. (2008). Objects predict fixations better than early saliency. Journal of Vision, 8(14):18, 1-26, http://www. journalofvision.org/content/8/14/18, doi:10.1167/8.
17. Engbert, R., & Mergenthaler, K. (2006). Microsaccades are triggered by low retinal image slip. Proceedings of the National Academy of Sciences, USA, 103(18), 7192-7197.
18. Engbert, R., Nuthmann, A., Richter, E. M., & Kliegl, R. (2005). SWIFT: A dynamical model of saccade generation during reading. Psychological Review, 112(4), 777-813.
19. Fecteau, J. H., & Munoz, D. P. (2006). Salience, relevance, and firing: A priority map for target selection. Trends in Cognitive Sciences, 10(8), 382- 390.
20. Fei-Fei, L., Iyer, A., Koch, C., & Perona, P. (2007). What do we perceive in a glance of a real-world scene? Journal of Vision, 7(1):10, 1-29, http://www. journalofvision.org/content/7/1/10, doi:10.1167/7.
21. Fründ, I., Haenel, N. V., & Wichmann, F. A. (2011). Inference for psychometric functions in the presence of nonstationary behavior. Journal of Vision, 11(6):16, 1-19, http://www.journalofvision.org/ content/11/6/16, doi:10.1167/11.6.16. [PubMed] [Article]
22. Gelman, A., & Hill, J. (2006). Data analysis using regression and multilevel/hierarchical models. Cambridge, UK: Cambridge University Press.
23. Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. Hoboken, NJ: John Wiley and Sons.
24. Haran, M., & Tierney, L. (2012). On automating markov chain monte carlo for a class of spatial models. Retrieved from Haran & Tierney, Tech. report: http://arxiv.org/abs/1205.0499.
25. Hastie, T., Tibshirani, R., & Friedman, J. H. (2003). The elements of statistical learning (Corrected ed.). New York: Springer.
26. Henderson, J. M. (2003). Human gaze control during real-world scene perception. Trends in Cognitive Sciences, 7(11), 498-504.
27. Henderson, J. M. (2011). Eye movements and scene perception. In S. P. Liversedge, I. D. Gilchrist, & S. Everling (Eds.), The Oxford handbook of eye movements (pp. 593-606). Oxford, UK: Oxford University Press.
28. Henderson, J. M., Brockmole, J., Castelhano, M., & Mack, M. (2007). Visual saliency does not account for eye movements during search in real-world scenes (pp. 537-562). Amsterdam: Elsevier.
29. Henderson, J. M., & Ferreira, F. (2004). Scene perception for psycholinguists. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision, & action (pp. 1-58). Hove, NY: Psychology Press.
30. Illian, J., Møller, J., & Waagepetersen, R. (2009). Hierarchical spatial point process analysis for a plant community with high biodiversity. Environmental and Ecological Statistics, 16(3), 389-405.
31. Illian, J., Penttinen, A., Stoyan, H., & Stoyan, D. (2008). Statistical analysis and modelling of spatial point patterns (Statistics in practice) (1st ed.). Hoboken, NJ: Wiley-Interscience.
32. Itti, L. (2004). Automatic foveation for video compression using a neurobiological model of visual attention. IEEE Transactions on Image Processing, 13(10), 1304-1318.
33. Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews Neuroscience, 2(3), 194-203.
34. Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009). Learning to predict where humans look. Presented at IEEE 12th International Conference on Computer Vision (pp. 2106-2113), Kyoto, Japan.
35. Kanan, C., Tong, M. H., Zhang, L., & Cottrell, G. W. (2009). SUN: Top-down saliency using natural statistics. Visual Cognition, 17(6-7), 979-1003.
36. Kaspar, K., & König, P. (2011). Viewing behavior and the impact of low-level image properties across repeated presentations of complex scenes. Journal of Vision, 11(13):26, 1-29, http://www. journalofvision.org/content/11/13/26, doi:10.1167/ 11.13.26. [PubMed] [Article]
37. Kienzle, W., Franz, M. O., Schölkopf, B., & Wichmann, F. A. (2009). Center-surround patterns emerge as optimal predictors for human saccade targets. Journal of Vision, 9(5):7, 1-15, http://www. journalofvision.org/content/9/5/7, doi:10.1167/9.5.
38. [PubMed] [Article] Kliegl, R., Nuthmann, A., & Engbert, R. (2006). Tracking the mind during reading: The influence of past, present, and future words on fixation durations. Journal of Experimental Psychology: General, 135(1), 12-35.
39. Koch, C., & Ullman, S. (1985). Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4(4), 219-227.
40. Kollmorgen, S., Nortmann, N., Schröder, S., & König, P. (2010). Influence of low-level stimulus features, task dependent factors, and spatial biases on overt visual attention. PLoS Computational Biology, 6(5), e1000791p.
41. Krieger, G., Rentschler, I., Hauske, G., Schill, K., & Zetzsche, C. (2000). Object and scene analysis by saccadic eye-movements: An investigation with higher-order statistics. Spatial Vision, 13(2-3), 201- 214.
42. Kruschke, J. K. (2010). Doing Bayesian data analysis: A tutorial with R and BUGS (1st ed.). Waltham, MA: Academic Press.
43. Land, M. F., & Tatler, B. W. (2009). Looking and acting: Vision and eye movements in natural behaviour. New York, NY: Oxford University Press.
44. Lewis, P. A. W., & Shedler, G. S. (1979). Simulation of nonhomogeneous poisson processes by thinning. Naval Research Logistics, 26(3), 403-413.
45. Mannan, S. K., Ruddock, K. H., & Wooding, D. S. (1996). The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. Spatial Vision, 10(3), 165-188.
46. Matin, E. (1974). Saccadic suppression: A review and an analysis. Psychological Bulletin, 81(12), 899-917.
47. McCullagh, P., & Nelder, J. A. (1989). Generalized linear models (Chapman & Hall/CRC Monographs on Statistics & Applied Probability) (2nd ed.). London: Chapman and Hall/CRC.
48. Mergenthaler, K., & Engbert, R. (2010). Microsaccades are different from saccades in scene perception. Experimental Brain Research, 203(4), 753-757.
49. Nuñez Garcia, J., Kutalik, Z., Cho, K.-H., & Wolkenhauer, O. (2003). Level sets and minimum volume sets of probability density functions. International Journal of Approximate Reasoning, 34(1), 25-47.
50. Nuthmann, A., & Henderson, J. M. (2010). Objectbased attentional selection in scene viewing. Journal of Vision, 10(8):20, 1-19, http://www. journalofvision.org/content/10/8/20, doi:10.1167/ 10.8.20. [PubMed] [Article
51. Nuthmann, A., Smith, T. J., Engbert, R., & Henderson, J. M. (2010). CRISP: A computational model of fixation durations in scene viewing. Psychological Review, 117(2), 382-405.
52. Park, M., Horwitz, G., & Pillow, J. W. (2011). Activelearning of neural response functions with gaussian processes. In J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, & K. Weinberger (Eds.), Advances in Neural Information Processing Systems, 24, 2043-2051.
53. Parkhurst, D. J., & Niebur, E. (2003). Scene content selected by active vision. Spatial Vision, 16(2), 125- 154.
54. Parkhurst, D. J., & Niebur, E. (2004). Texture contrast attracts overt visual attention in natural scenes. The European Journal of Neuroscience, 19(3), 783-789.
55. Pitt, M. A., Myung, I. J. J., & Zhang, S. (2002). Toward a method of selecting among computational models of cognition. Psychological Review, 109(3), 472-491.
56. Rasmussen, C. E., & Williams, C. K. I. (2005). Gaussian processes for machine learning (Adaptive computation and machine learning series). Cambridge, MA: MIT Press.
57. Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62(8), 1457-1506.
58. Reinagel, P., & Zador, A. M. (1999). Natural scene statistics at the centre of gaze. Network (Bristol, England), 10(4), 341-350.
59. Robert, C. P. (2007). The Bayesian choice: From decision-theoretic foundations to computational implementation (Springer texts in statistics) (2nd ed.). New York, NY: Springer Verlag.
60. Rodrigues, A., & Diggle, P. J. (2012). Bayesian estimation and prediction for inhomogeneous spatiotemporal log-Gaussian cox processes using low-rank models, with application to criminal surveillance. Journal of the American Statistical Association, 107(497), 93-101.
61. Rue, H., & Held, L. (2005). Gaussian Markov random fields: Theory and applications (Chapman & Hall/ CRC monographs on statistics & applied probability) (1st ed.). London: Chapman and Hall/CRC.
62. Rue, H., Martino, S., & Chopin, N. (2009). Approximate bayesian inference for latent gaussian models by using integrated nested laplace approximations. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 71(2), 319-392.
63. Schönfelder, V. H., & Wichmann, F. A. (2013). Identification of stimulus cues in narrow-band tone-in-noise detection using sparse observer models. Journal of the Acoustical Society of America, 134(1), 447-463.
64. Schütz, A. C., Braun, D. I., & Gegenfurtner, K. R. (2011). Eye movements and perception: A selectivereview. Journal of Vision, 11(5):9, 1-30, http:// www.journalofvision.org/content/11/5/9, doi:10.
65. Sparks, D. L. (2002). The brainstem control of saccadic eye movements. Nature Reviews Neuroscience, 3(12), 952-964.
66. Steinwart, I. (2005). Consistency of support vector machines and other regularized kernel classifiers. IEEE Trans. Inf. Theor, 51(1), 128-142.
67. Stoyan, D., Kendall, W. S., and Mecke, J. (1996).Stochastic geometry and its applications (2nd ed.). Hoboken, NJ: Wiley.
68. Tatler, B., & Vincent, B. (2009). The prominence of behavioural biases in eye guidance. Visual Cognition, 17(6), 1029-1054.
69. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14):4, 1-17, http://www.journalofvision.org/content/7/14/4, doi:10.1167/7.14.4. [PubMed] [Article]
70. Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: Effects of scale and time. Vision Research, 45(5), 643-659.
71. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113(4), 766-786.
72. Underwood, G., Foulsham, T., van Loon, E., Humphreys, L., & Bloyce, J. (2006). Eye movements during scene inspection: A test of the saliency map hypothesis. European Journal of Cognitive Psychology, 18(3), 321-342.
73. Van Der Linde, I., Rajashekar, U., Bovik, A. C., & Cormack, L. K. (2009). DOVES: A database of visual eye movements. Spatial Vision, 22(2), 161- 177.
74. Vincent, B., Baddeley, R., Correani, A., Troscianko, T., & Leonards, U. (2009). Do we look at lights? Using mixture modelling to distinguish between low- and high-level factors in natural image viewing. Visual Cognition, 17(6-7), 856-879.
75. Walther, D., & Koch, C. (2006). Modeling attention to salient proto-objects. Neural Networks, 19(9), 1395-1407.
76. Wasserman, L. (2003). All of statistics: A concise course in statistical inference (Springer texts in statistics). New York: Springer.
77. Wilming, N., Betz, T., Kietzmann, T. C., & König, P. (2011). Measures and limits of models of fixation selection. PLoS ONE, 6(9), e24038p.
78. Wolfe, J. M., & Horowitz, T. S. (2004). What attributes guide the deployment of visual attention and how do they do it? Nature Reviews Neuroscience, 5(6), 495-501.
79. Yarbus, A. L. (1967). Eye movements and vision. New York: Plenum Press.
80. Zammit-Mangion, A., Dewar, M., Kadirkamanathan, V., & Sanguinetti, G. (2012). Point process modelling of the afghan war diary. Proceedings of the National Academy of Sciences, USA, 109(31), 12414-12419.
81. Zelinsky, G. J. (2008). A theory of eye movements during target acquisition. Psychological Review, 115(4), 787-835.
82. Zhao, Q., & Koch, C. (2011). Learning a saliency map using fixated locations in natural scenes. Journal of Vision, 11(3):9, 1-15, http://www.journalofvision. org/content/11/3/9, doi:10.1167/11.3.9. [PubMed] [Article]