Optimal and human eye movements to clustered low value cues to increase decision rewards during search

Vision Research

Volumn 113, Issue , 2015, Pages 137-154

  Eckstein, Miguel P ^a   Schoonveld, Wade ^a   Zhang, Sheng ^a   Mack, Stephen C ^a   Akbas, Emre ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayesian; Eye movements; Ideal searcher; Optimal; Rewards; Visual search

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; EYE MOVEMENT; FUNCTIONAL ASSESSMENT; HUMAN; HUMAN EXPERIMENT; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; SACCADIC EYE MOVEMENT; STIMULUS RESPONSE; TASK PERFORMANCE; VISUAL STIMULATION; VISUAL SYSTEM FUNCTION; ADOLESCENT; ATTENTION; BAYES THEOREM; DECISION MAKING; EYE FIXATION; FEMALE; MALE; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REWARD; VISUAL FIELD; YOUNG ADULT;

ADOLESCENT; ADULT; ATTENTION; BAYES THEOREM; CHOICE BEHAVIOR; CUES; EYE MOVEMENTS; FEMALE; FIXATION, OCULAR; HUMANS; MALE; PSYCHOMOTOR PERFORMANCE; REWARD; SACCADES; VISUAL FIELDS; YOUNG ADULT;

EID: 84938292291     PISSN: 00426989     EISSN: 18785646     Source Type: Journal    
DOI: 10.1016/j.visres.2015.05.016     Document Type: Article

References (85)

1. Abrams J., Nizam A., Carrasco M. Isoeccentric locations are not equivalent: The extent of the vertical meridian asymmetry. Vision Research 2012, 52(1):70-78. 10.1016/j.visres.2011.10.016.
2. Ackermann J.F., Landy M.S. Suboptimal choice of saccade endpoint in search with unequal payoffs. Journal of Vision 2010, 10(7):530. 10.1167/10.7.530.
3. Ackermann J.F., Landy M.S. Choice of saccade endpoint under risk. Journal of Vision 2013, 13(3). 10.1167/13.3.27.
4. Ackermann J.F., Landy M.S. Suboptimal decision criteria are predicted by subjectively weighted probabilities and rewards. Attention, Perception & Psychophysics 2014, 10.3758/s13414-014-0779-z.
5. Anderson B.A., Laurent P.A., Yantis S. Value-driven attentional capture. Proceedings of the National Academy of Sciences 2011, 10.1073/pnas.1104047108.
6. Anderson B.A., Yantis S. Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing. Attention, Perception & Psychophysics 2012, 74(8):1644-1653. 10.3758/s13414-012-0348-2.
7. Araujo C., Kowler E., Pavel M. Eye movements during visual search: The costs of choosing the optimal path. Vision Research 2001, 41(25-26):3613-3625.
8. Barrett H.H. Objective assessment of image quality: effects of quantum noise and object variability. Journal of the Optical Society of America A 1990, 7:1266-1278.
9. Beutter B.R., Eckstein M.P., Stone L.S. Saccadic and perceptual performance in visual search tasks. I. Contrast detection and discrimination. Journal of the Optical Society of America. A, Optics, Image Science, and Vision 2003, 20(7):1341-1355.
10. Bisley J.W., Goldberg M.E. Attention, intention, and priority in the parietal lobe. Annual Review of Neuroscience 2010, 33:1-21. 10.1146/annurev-neuro-060909-152823.
11. Bisley J.W., Mirpour K., Arcizet F., Ong W.S. The role of the lateral intraparietal area in orienting attention and its implications for visual search. The European Journal of Neuroscience 2011, 33(11):1982-1990. 10.1111/j.1460-9568.2011.07700.x.
12. Brockmole J.R., Castelhano M.S., Henderson J.M. Contextual cueing in naturalistic scenes: Global and local contexts. Journal of Experimental Psychology: Learning, Memory, and Cognition 2006, 32(4):699-706. 10.1037/0278-7393.32.4.699.
13. Burgess A.E., Wagner R.F., Jennings R.J., Barlow H.B. Efficiency of human visual signal discrimination. Science 1981, 214:93-94.
14. Burgess A.E., Colborne B. Visual signal detection. IV. Observer inconsistency. Journal of the Optical Society of America. A, Optics and Image Science 1988, 5(4):617-627.
15. Carrasco M., Evert D.L., Chang I., Katz S.M. The eccentricity effect: Target eccentricity affects performance on conjunction searches. Perception & Psychophysics 1995, 57:1241-1261. 10.3758/BF03208380.
16. Caspi A., Beutter B.R., Eckstein M.P. The time course of visual information accrual guiding eye movement decisions. Proceedings of the National Academy of Sciences of the United States of America 2004, 101(35):13086-13090. 10.1073/pnas.0305329101.
17. Castelhano M.S., Heaven C. The relative contribution of scene context and target features to visual search in scenes. Attention, Perception & Psychophysics 2010, 72(5):1283-1297. 10.3758/APP.72.5.1283.
18. Castelhano M.S., Heaven C. Scene context influences without scene gist: Eye movements guided by spatial associations in visual search. Psychonomic Bulletin & Review 2011, 10.3758/s13423-011-0107-8.
19. Chelazzi L., Eštočinová J., Calletti R., Gerfo E.L., Sani I., Libera C.D., et al. Altering spatial priority maps via reward-based learning. The Journal of Neuroscience 2014, 34(25):8594-8604. 10.1523/JNEUROSCI.0277-14.2014.
20. Chen X., Zelinsky G.J. Real-world visual search is dominated by top-down guidance. Vision Research 2006, 46(24):4118-4133. 10.1016/j.visres.2006.08.008.
21. Chun M.M., Jiang Y. Contextual cueing: implicit learning and memory of visual context guides spatial attention. Cognitive Psychology 1998, 36(1):28-71. 10.1006/cogp.1998.0681.
22. Dassonville P., Bala J.K. Perception, action, and Roelofs effect: A mere illusion of dissociation. PLoS Biology 2004, 2(11):e364. 10.1371/journal.pbio.0020364.
23. Droll J.A., Abbey C.K., Eckstein M.P. Learning cue validity through performance feedback. Journal of Vision 2009, 9(2):18.1-18.23. 10.1167/9.2.18.
24. Eckstein M.P., Abbey C.K., Bochud F.O. A practical guide to model observers for visual detection in synthetic and natural noisy images. Physics and Psychophysics 2000, 1:593-628. SPIE Press, Bellingham. J. Beutel, H.L. Kundel, R.L. Van Metter (Eds.).
25. Eckstein M.P., Beutter B.R., Pham B.T., Shimozaki S.S., Stone L.S. Similar neural representations of the target for saccades and perception during search. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2007, 27(6):1266-1270. 10.1523/JNEUROSCI.3975-06.2007.
26. Eckstein M.P., Beutter B.R., Stone L.S. Quantifying the performance limits of human saccadic targeting during visual search. Perception 2001, 30(11):1389-1401.
27. Eckstein M.P., Drescher B.A., Shimozaki S.S. Attentional cues in real scenes, saccadic targeting, and Bayesian priors. Psychological Science 2006, 17(11):973-980. 10.1111/j.1467-9280.2006.01815.x.
28. Eckstein M.P., Schoonveld W., Zhang S. Optimizing eye movements in search for rewards. Journal of Vision 2010, 10(7):33. 10.1167/10.7.33.
29. Findlay J.M. Saccade target selection during visual search. Vision Research 1997, 37(5):617-631. 10.1016/S0042-6989(96)00218-0.
30. Gegenfurtner K.R., Xing D., Scott B.H., Hawken M.J. A comparison of pursuit eye movement and perceptual performance in speed discrimination. Journal of Vision 2003, 3(11):865-876. 10.1167/3.11.19.
31. Ghahghaei S., Verghese P. Efficient saccade planning requires time and clear choices. Journal of Vision 2014, 14(10):1197. 10.1167/14.10.1197.
32. Gold J.I., Shadlen M.N. Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward. Neuron 2002, 36(2):299-308.
33. Goodale M.A., Milner A.D. Separate visual pathways for perception and action. Trends in Neurosciences 1992, 15(1):20-25.
34. Green D.M., Swets J.A. Signal detection theory and psychophysics 1989, Peninsula Pub.
35. Hayhoe M., Ballard D. Eye movements in natural behavior. Trends in Cognitive Sciences 2005, 9(4):188-194. http://dx.doi.org/16/j.tics.2005.02.009.
36. He P.Y., Kowler E. The role of location probability in the programming of saccades: Implications for "center-of-gravity" tendencies. Vision Research 1989, 29(9):1165-1181.
37. Hikosaka K., Watanabe M. Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cerebral Cortex 2000, 10(3):263-271. 10.1093/cercor/10.3.263.
38. Janssen C.P., Verghese P. Towards a better understanding of eye-movement strategies in multiple target search. Journal of Vision 2013, 13(9):526. 10.1167/13.9.526.
39. Jovancevic-Misic J., Hayhoe M. Adaptive gaze control in natural environments. The Journal of Neuroscience 2009, 29(19):6234-6238. 10.1523/JNEUROSCI.5570-08.2009.
40. Kowler E. Eye movements: The past 25years. Vision Research 2011, 51(13):1457-1483. 10.1016/j.visres.2010.12.014.
41. Krauzlis R.J. The control of voluntary eye movements: New perspectives. The Neuroscientist: A Review Journal Bringing Neurobiology, Neurology and Psychiatry 2005, 11(2):124-137. 10.1177/1073858404271196.
42. Krauzlis R.J., Stone L.S. Tracking with the mind's eye. Trends in Neurosciences 1999, 22(12):544-550.
43. Land M.F., Nilsson D.-E. Animal eyes 2002, Oxford University Press, USA.
44. Legge G.E., Hooven T.A., Klitz T.S., Stephen Mansfield J.S., Tjan B.S. Mr. Chips 2002: New insights from an ideal-observer model of reading. Vision Research 2002, 42(18):2219-2234.
45. Legge G.E., Klitz T.S., Tjan B.S. Mr. Chips: An ideal-observer model of reading. Psychological Review 1997, 104(3):524-553.
46. Leon M.I., Shadlen M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 1999, 24(2):415-425. 10.1016/S0896-6273(00)80854-5.
47. Liston D.B., Stone L.S. Effects of prior information and reward on oculomotor and perceptual choices. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2008, 28(51):13866-13875. 10.1523/JNEUROSCI.3120-08.2008.
48. Louie K., Grattan L.E., Glimcher P.W. Reward value-based gain control: Divisive normalization in parietal cortex. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2011, 31(29):10627-10639. 10.1523/JNEUROSCI.1237-11.2011.
49. Ludwig C.J.H. Temporal integration of sensory evidence for saccade target selection. Vision Research 2009, 49(23):2764-2773. 10.1016/j.visres.2009.08.012.
50. Mack S.C., Eckstein M.P. Object co-occurrence serves as a contextual cue to guide and facilitate visual search in a natural viewing environment. Journal of Vision 2011, 11(9). 10.1167/11.9.9.
51. Malcolm G.L., Henderson J.M. The effects of target template specificity on visual search in real-world scenes: Evidence from eye movements. Journal of Vision 2009, 9(11):8.1-8.13. 10.1167/9.11.8.
52. Michel M., Geisler W.S. Intrinsic position uncertainty explains detection and localization performance in peripheral vision. Journal of Vision 2011, 11(1):18. 10.1167/11.1.18.
53. Morvan C., Maloney L.T. Human visual search does not maximize the post-saccadic probability of identifying targets. PLoS Computational Biology 2012, 8(2):e1002342. 10.1371/journal.pcbi.1002342.
54. Murray R.F., Bennett P.J., Sekuler A.B. Classification images predict absolute efficiency. Journal of Vision 2005, 5:139-149.
55. Najemnik J., Geisler W.S. Optimal eye movement strategies in visual search. Nature 2005, 434(7031):387-391. 10.1038/nature03390.
56. Najemnik J., Geisler W.S. Eye movement statistics in humans are consistent with an optimal search strategy. Journal of Vision 2008, 8(3). 10.1167/8.3.4.
57. Najemnik J., Geisler W.S. Simple summation rule for optimal fixation selection in visual search. Vision Research 2009, 49(10):1286-1294. 10.1016/j.visres.2008.12.005.
58. Navalpakkam V., Koch C., Rangel A., Perona P. Optimal reward harvesting in complex perceptual environments. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(11):5232-5237. 10.1073/pnas.0911972107.
59. Neider M.B., Zelinsky G.J. Scene context guides eye movements during visual search. Vision Research 2006, 46(5):614-621. 10.1016/j.visres.2005.08.025.
60. Peelen M.V., Kastner S. A neural basis for real-world visual search in human occipitotemporal cortex. Proceedings of the National Academy of Sciences of the United States of America 2011, 108(29):12125-12130. 10.1073/pnas.1101042108.
61. Pelli D.G. Crowding: A cortical constraint on object recognition. Current Opinion in Neurobiology 2008, 18(4):445-451. 10.1016/j.conb.2008.09.008.
62. Peterson M.F., Eckstein M.P. Looking just below the eyes is optimal across face recognition tasks. Proceedings of the National Academy of Sciences 2012, 109(48):E3314-E3323. 10.1073/pnas.1214269109.
63. Peterson M.F., Eckstein M.P. Individual differences in eye movements during face identification reflect observer-specific optimal points of fixation. Psychological Science 2013, 10.1177/0956797612471684.
64. Peterson M.F., Eckstein M.P. Learning optimal eye movements to unusual faces. Vision Research 2014, 99:57-68.
65. Peterson M.S., Kramer A.F. Attentional guidance of the eyes by contextual information and abrupt onsets. Perception & Psychophysics 2001, 63(7):1239-1249.
66. Platt M.L., Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 1999, 400(6741):233-238. 10.1038/22268.
67. Preston T.J., Guo F., Das K., Giesbrecht B., Eckstein M.P. Neural representations of contextual guidance in visual search of real-world scenes. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2013, 33(18):7846-7855. 10.1523/JNEUROSCI.5840-12.2013.
68. Rao R.P.N., Zelinsky G.J., Hayhoe M.M., Ballard D.H. Eye movements in iconic visual search. Vision Research 2002, 42(11):1447-1463.
69. Renninger L.W., Coughlan J., Verghese P., Malik J. An information maximization model of eye movements. Advances in Neural Information Processing Systems 2005, 17:1121-1128.
70. Rovamo J., Leinonen L., Laurinen P., Virsu V. Temporal integration and contrast sensitivity in foveal and peripheral vision. Perception 1984, 13(6):665-674. 10.1068/p130665.
71. Schoonveld W.A., Eckstein M.P. Models of eye movement strategies: Optimal searcher vs. optimal saccadic targeting. Journal of Vision 2006, 6(6):455. 10.1167/6.6.455.
72. Schoonveld W., Eckstein M. Optimal searcher, saccadic targeting model, and human eye movements during search: Effects of target visibility maps. Journal of Vision 2007, 7(9):635. 10.1167/7.9.635.
73. Schütz A.C., Trommershäuser J., Gegenfurtner K.R. Dynamic integration of information about salience and value for saccadic eye movements. Proceedings of the National Academy of Sciences of the United States of America 2012, 109(19):7547-7552. 10.1073/pnas.1115638109.
74. Shimozaki S.S., Schoonveld W.A., Eckstein M.P. A unified Bayesian observer analysis for set size and cueing effects on perceptual decisions and saccades. Journal of Vision 2012, 12(6). 10.1167/12.6.27.
75. Stritzke M., Trommershäuser J., Gegenfurtner K.R. Effects of salience and reward information during saccadic decisions under risk. Journal of the Optical Society of America. A, Optics, Image Science, and Vision 2009, 26(11):B1-B13.
76. Sugrue L.P., Corrado G.S., Newsome W.T. Matching behavior and the representation of value in the parietal cortex. Science (New York, N.Y.) 2004, 304(5678):1782-1787. 10.1126/science.1094765.
77. Sullivan B.T., Johnson L., Rothkopf C.A., Ballard D., Hayhoe M. The role of uncertainty and reward on eye movements in a virtual driving task. Journal of Vision 2012, 12(13):19. 10.1167/12.13.19.
78. Tavassoli A., van der Linde I., Bovik A.C., Cormack L.K. Eye movements selective for spatial frequency and orientation during active visual search. Vision Research 2009, 49(2):173-181. 10.1016/j.visres.2008.10.005.
79. Theeuwes J., Belopolsky A.V. Reward grabs the eye: Oculomotor capture by rewarding stimuli. Vision Research 2012, 74:80-85. 10.1016/j.visres.2012.07.024.
80. Torralba A., Oliva A., Castelhano M.S., Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review 2006, 113(4):766-786. 10.1037/0033-295X.113.4.766.
81. Trommershäuser J., Glimcher P.W., Gegenfurtner K.R. Visual processing, learning and feedback in the primate eye movement system. Trends in Neurosciences 2009, 32(11):583-590. 10.1016/j.tins.2009.07.004.
82. Verghese P. Active search for multiple targets is inefficient. Vision Research 2012, 74:61-71.
83. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 1996, 382(6592):629-632. 10.1038/382629a0.
84. Zelinsky G.J. Using eye saccades to assess the selectivity of search movements. Vision Research 1996, 36(14):2177-2187.
85. Zhang S., Eckstein M.P. Evolution and optimality of similar neural mechanisms for perception and action during search. PLoS Computational Biology 2010, 6(9). 10.1371/journal.pcbi.1000930.