Dynamic integration of information about salience and value for saccadic eye movements

Proceedings of the National Academy of Sciences of the United States of America

Volumn 109, Issue 19, 2012, Pages 7547-7552

  Schütz, Alexander C ^a   Trommershäuser, Julia ^b   Gegenfurtner, Karl R ^a  

^a JUSTUS LIEBIG UNIVERSITY   (Germany)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

Cue combination; Decision making; Neuroeconomics; Visual perception

Indexed keywords

ARTICLE; DYNAMICS; HUMAN; INFORMATION PROCESSING; PRIORITY JOURNAL; RELATIVE DENSITY; SACCADIC EYE MOVEMENT; TOPOGRAPHY; VISUAL ADAPTATION; VISUAL FIELD; VISUAL INFORMATION;

FIXATION, OCULAR; HUMANS; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; NEURAL PATHWAYS; PHOTIC STIMULATION; PUNISHMENT; REACTION TIME; REWARD; SACCADES; VISUAL PERCEPTION;

EID: 84860827192     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1115638109     Document Type: Article

References (66)

1. Munoz DP (2002) Commentary: Saccadic eye movements: Overview of neural circuitry. Prog Brain Res 140:89-96.
2. Sparks DL (2002) The brainstem control of saccadic eye movements. Nat Rev Neurosci 3:952-964.
3. Itti L, Koch C (2001) Computational modelling of visual attention. Nat Rev Neurosci 2: 194-203. (Pubitemid 33673372)
4. Tatler BW, Hayhoe MM, Land MF, Ballard DH (2011) Eye guidance in natural vision: Reinterpreting salience. J Vis 11(5):5:1-23.
5. Schütz AC, Braun DI, Gegenfurtner KR (2011) Eye movements and perception: A selective review. J Vis 11(5):9:1-30.
6. Tatler BW, Baddeley RJ, Gilchrist ID (2005) Visual correlates of fixation selection: Effects of scale and time. Vision Res 45:643-659. (Pubitemid 40037974)
7. Peters RJ, Iyer A, Itti L, Koch C (2005) Components of bottom-up gaze allocation in natural images. Vision Res 45:2397-2416. (Pubitemid 40848284)
8. Williams LG (1966) Effect of target specification on objects fixated during visual search. Percept Psychophys 1:315-318.
9. Johansson RS, Westling G, Bäckström A, Flanagan JR (2001) Eye-hand coordination in object manipulation. J Neurosci 21:6917-6932. (Pubitemid 32781134)
10. Land MF (2006) Eye movements and the control of actions in everyday life. Prog Retin Eye Res 25:296-324.
11. Jovancevic-Misic J, Hayhoe M (2009) Adaptive gaze control in natural environments. J Neurosci 29:6234-6238.
12. Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233-238. (Pubitemid 29334132)
13. Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304:1782-1787. (Pubitemid 38787891)
14. Leon MI, Shadlen MN (2003) Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron 38:317-327. (Pubitemid 36555656)
15. Ikeda T, Hikosaka O (2003) Reward-dependent gain and bias of visual responses in primate superior colliculus. Neuron 39:693-700. (Pubitemid 36993585)
16. Markowitz DA, Shewcraft RA, Wong YT, Pesaran B (2011) Competition for visual selection in the oculomotor system. J Neurosci 31:9298-9306.
17. Glimcher PW (2009) Choice: towards a standard back-pocket model. Neuroeconomics: Decision Making and the Brain, eds Glimcher PW, Camerer C, Poldrack RA, Fehr E (Academic, New York), pp 501-519.
18. Trommershäuser J, Maloney LT, Landy MS (2008) Decision making, movement planning and statistical decision theory. Trends Cogn Sci 12:291-297.
19. Stritzke M, Trommershäuser J, Gegenfurtner KR (2009) Effects of salience and reward information during saccadic decisions under risk. J Opt Soc Am A Opt Image Sci Vis 26:B1-B13.
20. Körding KP, Wolpert DM (2006) Bayesian decision theory in sensorimotor control. Trends Cogn Sci 10:319-326. (Pubitemid 44094227)
21. Becker W, Fuchs AF (1969) Further properties of the human saccadic system: Eye movements and correction saccades with and without visual fixation points. Vision Res 9:1247-1258.
22. Van der Stigchel S (2010) Recent advances in the study of saccade trajectory deviations. Vision Res 50:1619-1627.
23. Li Z (2002) A saliency map in primary visual cortex. Trends Cogn Sci 6:9-16.
24. Mazer JA, Gallant JL (2003) Goal-related activity in V4 during free viewing visual search. Evidence for a ventral stream visual salience map. Neuron 40:1241-1250. (Pubitemid 38032798)
25. Goldberg ME, Bisley JW, Powell KD, Gottlieb J (2006) Saccades, salience and attention: The role of the lateral intraparietal area in visual behavior. Prog Brain Res 155:157-175. (Pubitemid 44485197)
26. Thompson KG, Bichot NP (2005) A visual salience map in the primate frontal eye field. Prog Brain Res 147:251-262.
27. McPeek RM, Keller EL (2002) Saccade target selection in the superior colliculus during a visual search task. J Neurophysiol 88:2019-2034. (Pubitemid 35191200)
28. Robinson DA (1972) Eye movements evoked by collicular stimulation in the alert monkey. Vision Res 12:1795-1808.
29. Robinson DA, Fuchs AF (1969) Eye movements evoked by stimulation of frontal eye fields. J Neurophysiol 32:637-648.
30. Thier P, Andersen RA (1998) Electrical microstimulation distinguishes distinct saccade-related areas in the posterior parietal cortex. J Neurophysiol 80:1713-1735. (Pubitemid 28489106)
31. Buschman TJ, Miller EK (2007) Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315:1860-1862.
32. Serences JT (2008) Value-based modulations in human visual cortex. Neuron 60:1169-1181.
33. Ipata AE, Gee AL, Bisley JW, Goldberg ME (2009) Neurons in the lateral intraparietal area create a priority map by the combination of disparate signals. Exp Brain Res 192:479-488.
34. Bisley JW, Krishna BS, Goldberg ME (2004) A rapid and precise on-response in posterior parietal cortex. J Neurosci 24:1833-1838. (Pubitemid 38292794)
35. Gottlieb J, Kusunoki M, Goldberg ME (2005) Simultaneous representation of saccade targets and visual onsets in monkey lateral intraparietal area. Cereb Cortex 15:1198-1206. (Pubitemid 41373613)
36. Ipata AE, Gee AL, Goldberg ME, Bisley JW (2006) Activity in the lateral intraparietal area predicts the goal and latency of saccades in a free-viewing visual search task. J Neurosci 26:3656-3661.
37. Ganguli S, et al. (2008) One-dimensional dynamics of attention and decision making in LIP. Neuron 58:15-25. (Pubitemid 351467033)
38. Bisley JW, Goldberg ME (2010) Attention, intention, and priority in the parietal lobe. Annu Rev Neurosci 33:1-21.
39. Kawagoe R, Takikawa Y, Hikosaka O (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1:411-416.
40. De Martino B, Camerer CF, Adolphs R (2010) Amygdala damage eliminates monetary loss aversion. Proc Natl Acad Sci USA 107:3788-3792.
41. Yacubian J, et al. (2006) Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci 26:9530-9537. (Pubitemid 44396866)
42. Basten U, Biele G, Heekeren HR, Fiebach CJ (2010) How the brain integrates costs and benefits during decision making. Proc Natl Acad Sci USA 107:21767-21772.
43. Hare TA, Schultz W, Camerer CF, O'Doherty JP, Rangel A (2011) Transformation of stimulus value signals into motor commands during simple choice. Proc Natl Acad Sci USA 108:18120-18125.
44. Milstein DM, Dorris MC (2007) The influence of expected value on saccadic preparation. J Neurosci 27:4810-4818. (Pubitemid 46699057)
45. Sohn JW, Lee D (2006) Effects of reward expectancy on sequential eye movements in monkeys. Neural Netw 19:1181-1191.
46. Shadmehr R, Orban de Xivry JJ, Xu-Wilson M, Shih TY (2010) Temporal discounting of reward and the cost of time in motor control. J Neurosci 30:10507-10516.
47. Xu-Wilson M, Zee DS, Shadmehr R (2009) The intrinsic value of visual information affects saccade velocities. Exp Brain Res 196:475-481.
48. Bahill AT, Clark MR, Stark L (1975) The main sequence: A tool for studying eye movements. Math Biosci 24:191-204.
49. Zelinsky GJ (2008) A theory of eye movements during target acquisition. Psychol Rev 115:787-835.
50. Eckstein MP (2011) Visual search: A retrospective. J Vis 11(5):14:1-36.
51. Najemnik J, Geisler WS (2005) Optimal eye movement strategies in visual search. Nature 434:387-391. (Pubitemid 40469182)
52. Renninger LW, Verghese P, Coughlan J (2007) Where to look next? Eye movements reduce local uncertainty. J Vis 7(3):6:1-17.
53. Trommershäuser J, Glimcher PW, Gegenfurtner KR (2009) Visual processing, learning and feedback in the primate eye movement system. Trends Neurosci 32:583-590.
54. Findlay JM (1997) Saccade target selection during visual search. Vision Res 37:617-631.
55. Morvan C, Maloney LT (2012) Human visual search does not maximize the post-saccadic probability of identifying targets. PLOS Comput Biol 8:e1002342.
56. Beutter BR, Eckstein MP, Stone LS (2003) Saccadic and perceptual performance in visual search tasks. I. Contrast detection and discrimination. J Opt Soc Am A Opt Image Sci Vis 20:1341-1355.
57. Blohm G, Missal M, Lefèvre P (2005) Processing of retinal and extraretinal signals for memory-guided saccades during smooth pursuit. J Neurophysiol 93:1510-1522. (Pubitemid 40283738)
58. Schreiber C, Missal M, Lefèvre P (2006) Asynchrony between position and motion signals in the saccadic system. J Neurophysiol 95:960-969. (Pubitemid 44699098)
59. Liston DB, Stone LS (2008) Effects of prior information and reward on oculomotor and perceptual choices. J Neurosci 28:13866-13875.
60. Navalpakkam V, Koch C, Rangel A, Perona P (2010) Optimal reward harvesting in complex perceptual environments. Proc Natl Acad Sci USA 107:5232-5237.
61. Kastner S, Ungerleider LG (2000) Mechanisms of visual attention in the human cortex. Annu Rev Neurosci 23:315-341. (Pubitemid 30350046)
62. Adam RJ, Manohar SG (2007) Does reward modulate actions or bias attention? J Neurosci 27:10919-10921. (Pubitemid 47574148)
63. Anderson BA, Laurent PA, Yantis S (2011) Value-driven attentional capture. Proc Natl Acad Sci USA 108:10367-10371.
64. Sperling G, Dosher B (1986) Strategy and optimization in human information processing. Handbook of Perception and Human Performance, eds Boff KR, Kaufman L, Thomas JP (Wiley, New York), Vol 1, pp 2-1-2-65.
65. Findlay JM (1982) Global visual processing for saccadic eye movements. Vision Res 22:1033-1045.
66. Chou IH, Sommer MA, Schiller PH (1999) Express averaging saccades in monkeys. Vision Res 39:4200-4216. (Pubitemid 29490939)