Saccade selection when reward probability is dynamically manipulated using Markov chains

Experimental Brain Research

Volumn 187, Issue 2, 2008, Pages 321-330

  Nummela, Samuel U ^a,b   Lovejoy, Lee P ^a,b   Krauzlis, Richard J ^a  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Eye movement; Markov; Probability; Saccade; Selection

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; FEEDBACK SYSTEM; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NORMAL HUMAN; PRIORITY JOURNAL; PROBABILITY; REWARD; SACCADIC EYE MOVEMENT; TASK PERFORMANCE; VISUAL STIMULATION;

ADULT; FEMALE; HUMANS; MALE; MARKOV CHAINS; PHOTIC STIMULATION; PROBABILITY LEARNING; REACTION TIME; REINFORCEMENT SCHEDULE; REWARD; SACCADES;

EID: 42649102975     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-008-1306-z     Document Type: Article

References (32)

1. DJ Barraclough ML Conroy D Lee 2004 Prefrontal cortex and decision making in a mixed-strategy game Nat Neurosci 7 404 410 15004564 10.1038/nn1209 1:CAS:528:DC%2BD2cXisFCis7c%3D Barraclough DJ, Conroy ML, Lee D (2004) Prefrontal cortex and decision making in a mixed-strategy game. Nat Neurosci 7:404–410
2. MA Basso RH Wurtz 1998 Modulation of neuronal activity in superior colliculus by changes in target probability J Neurosci 18 7519 7534 9736670 1:CAS:528:DyaK1cXmt1Sjurg%3D Basso MA, Wurtz RH (1998) Modulation of neuronal activity in superior colliculus by changes in target probability. J Neurosci 18:7519–7534
3. DH Brainard 1997 The psychophysics toolbox Spat Vis 10 433 436 9176952 10.1163/156856897X00357 1:STN:280:DyaK2szitVSlug%3D%3D Brainard DH (1997) The psychophysics toolbox. Spat Vis 10:433–436
4. RHS Carpenter MLL Williams 1995 Neural computation of log likelihood in control of saccadic eye movements Nature 377 59 62 7659161 10.1038/377059a0 1:CAS:528:DyaK2MXnvFektLY%3D Carpenter RHS, Williams MLL (1995) Neural computation of log likelihood in control of saccadic eye movements. Nature 377:59–62
5. TM Cover JA Thomas 1991 Elements of information theory 2nd edn Wily-Interscience New York 12 19 Cover TM, Thomas JA (1991) Elements of information theory, 2nd edn. Wily-Interscience, New York, pp 12–19
6. MC Dorris PW Glimcher 2004 Activity in posterior parietal cortex is correlated with the relative subjective desirability of action Neuron 44 365 378 15473973 10.1016/j.neuron.2004.09.009 1:CAS:528:DC%2BD2cXpslOgtrs%3D Dorris MC, Glimcher PW (2004) Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44:365–378
7. MC Dorris DP Munoz 1998 Saccadic probability influences motor preparation signals and time to saccadic initiation J Neurosci 18 7015 7026 9712670 1:CAS:528:DyaK1cXls1Ojsb0%3D Dorris MC, Munoz DP (1998) Saccadic probability influences motor preparation signals and time to saccadic initiation. J Neurosci 18:7015–7026
8. MC Dorris M Pare DP Munoz 2000 Immediate neural plasticity shapes motor performance J Neurosci 20 RC52 10627629 1:STN:280:DC%2BD3c3ns1eksg%3D%3D Dorris MC, Pare M, Munoz DP (2000) Immediate neural plasticity shapes motor performance. J Neurosci 20:RC52
9. B Efron RJ Tibshirani 1998 An introduction to the bootstrap CRC Press LLC Boca Raton 168 176 Efron B, Tibshirani RJ (1998) An introduction to the bootstrap. CRC Press LLC, Boca Raton, pp 168–176
10. JH Fecteau DP Munoz 2003 Exploring the consequences of the previous trial Nat Rev 4 1 9 Fecteau JH, Munoz DP (2003) Exploring the consequences of the previous trial. Nat Rev 4:1–9
11. MA Gluck GH Bower 1998 From conditioning to category learning: an adaptive network model J Exp Psychol Gen 117 227 247 10.1037/0096-3445.117.3.227 Gluck MA, Bower GH (1998) From conditioning to category learning: an adaptive network model. J Exp Psychol Gen 117:227–247
12. MA Gluck D Shohamy C Myers 2002 How do people solve the “weather prediction” task?: individual variability in strategies for probabilistic category learning Learn Mem 9 408 418 12464701 10.1101/lm.45202 Gluck MA, Shohamy D, Myers C (2002) How do people solve the “weather prediction” task?: individual variability in strategies for probabilistic category learning. Learn Mem 9:408–418
13. SA Hackley F Valle-Inclan 2003 Which stages of processing are speeded by a warning signal? Biol Psychol 64 27 45 14602354 10.1016/S0301-0511(03)00101-7 Hackley SA, Valle-Inclan F (2003) Which stages of processing are speeded by a warning signal? Biol Psychol 64:27–45
14. JM Herbers 1981 Time resources and laziness in animals Oecologia 49 252 262 10.1007/BF00349198 Herbers JM (1981) Time resources and laziness in animals Oecologia 49:252–262
15. T Ikeda O Hikosaka 2003 Reward-dependent gain and bias of visual responses in primate superior colliculus Neuron 39 693 700 12925282 10.1016/S0896-6273(03)00464-1 1:CAS:528:DC%2BD3sXmslOmu7s%3D Ikeda T, Hikosaka O (2003) Reward-dependent gain and bias of visual responses in primate superior colliculus. Neuron 39:693–700
16. R Kawagoe Y Takikawa O Hikosaka 1998 Expectation of reward modulates cognitive signal in the basal ganglia Nat Neurosci 1 411 416 10196532 10.1038/1625 1:CAS:528:DyaK1MXitVCgtLc%3D Kawagoe R, Takikawa Y, Hikosaka O (1998) Expectation of reward modulates cognitive signal in the basal ganglia. Nat Neurosci 1:411–416
17. BJ Knowlton LR Squire MA Gluck 1994 Probabilistic classification learning in amnesia Learn Mem 1 106 120 10467589 1:STN:280:DyaK1Mzps12hsg%3D%3D Knowlton BJ, Squire LR, Gluck MA (1994) Probabilistic classification learning in amnesia. Learn Mem 1:106–120
18. S Kornblum 1968 Serial-choice reaction time: inadequacies of the information hypothesis Science 159 432 434 5634661 10.1126/science.159.3813.432 1:STN:280:DyaF1c%2FptVOqtA%3D%3D Kornblum S (1968) Serial-choice reaction time: inadequacies of the information hypothesis. Science 159:432–434
19. S Kornblum 1969 Sequential determinants of information processing in serial and discrete choice reaction time Psychol Rev 76 113 131 10.1037/h0027245 Kornblum S (1969) Sequential determinants of information processing in serial and discrete choice reaction time. Psychol Rev 76:113–131
20. RJ Krauzlis FA Miles 1996 Decreases in the latency of smooth pursuit and saccadic eye movements produced by the “gap paradigm” in the monkey Vis Res 36 1973 1985 8759437 10.1016/0042-6989(95)00307-X 1:STN:280:DyaK28zjs1aksg%3D%3D Krauzlis RJ, Miles FA (1996) Decreases in the latency of smooth pursuit and saccadic eye movements produced by the “gap paradigm” in the monkey. Vis Res 36:1973–1985
21. DW Macdonald PD Stewart P Stopka N Yamaguchi 2000 Measuring the dynamics of mammalian societies: an ecologist’s guide to ethological methods L Boitani TK Fuller Research techniques in animal ecology: controversies and consequences Columbia Press New York 332 388 Macdonald DW, Stewart PD, Stopka P, Yamaguchi N (2000) Measuring the dynamics of mammalian societies: an ecologist’s guide to ethological methods. In: Boitani L, Fuller TK (eds) Research techniques in animal ecology: controversies and consequences. Columbia Press, New York, pp 332–388
22. DM Milstein MC Dorris 2007 The influence of expected value on saccadic preparation J Neurosci 27 4810 4818 17475788 10.1523/JNEUROSCI.0577-07.2007 1:CAS:528:DC%2BD2sXlsV2rsbg%3D Milstein DM, Dorris MC (2007) The influence of expected value on saccadic preparation. J Neurosci 27:4810–4818
23. RJ Peters A Iyer L Itti C Koch 2005 Components of bottom-up gaze allocation in natural images Vis Res 45 2397 2416 15935435 10.1016/j.visres.2005.03.019 Peters RJ, Iyer A, Itti L, Koch C (2005) Components of bottom-up gaze allocation in natural images. Vis Res 45:2397–2416
24. DG Pelli 1997 The Video Toolbox software for visual psychophysics: Transforming numbers into movies Spat Vis 10 437 442 9176953 10.1163/156856897X00366 1:STN:280:DyaK2szitVSluw%3D%3D Pelli DG (1997) The Video Toolbox software for visual psychophysics: Transforming numbers into movies. Spat Vis 10:437–442
25. ML Platt PW Glimcher 1999 Neural correlates of decision variables in parietal cortex Nature 400 233 238 10421364 10.1038/22268 1:CAS:528:DyaK1MXkvFWlsb0%3D Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233–238
26. P Reinagel AM Zador 1999 Natural scene statistics at the centre of gaze Network 10 341 350 10695763 1:STN:280:DC%2BD3c7lvVeisg%3D%3D 10.1088/0954-898X/10/4/304 Reinagel P, Zador AM (1999) Natural scene statistics at the centre of gaze. Network 10:341–350
27. JD Schall KG Thompson 1999 Neural selection and control of visually guided eye movements Annu Rev Neurosci 22 241 259 10202539 10.1146/annurev.neuro.22.1.241 1:CAS:528:DyaK1MXhvFemsrc%3D Schall JD, Thompson KG (1999) Neural selection and control of visually guided eye movements. Annu Rev Neurosci 22:241–259
28. LP Sugrue GS Corrado WT Newsome 2004 Matching behavior and the representation of value in the parietal cortex Science 304 1782 1787 15205529 10.1126/science.1094765 1:CAS:528:DC%2BD2cXkvVersbk%3D Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304:1782–1787
29. A Tversky D Kahneman 1971 Belief in the law of small numbers Psychol Bull 2 105 110 10.1037/h0031322 Tversky A, Kahneman D (1971) Belief in the law of small numbers. Psychol Bull 2:105–110
30. N Vulkan 2000 An economist’s perspective on probability matching J Econ Surv 14 101 118 10.1111/1467-6419.00106 Vulkan N (2000) An economist’s perspective on probability matching. J Econ Surv 14:101–118
31. T Yang MN Shadlen 2007 Probabilistic reasoning by neurons Nature 447 1075 1080 17546027 10.1038/nature05852 1:CAS:528:DC%2BD2sXmvFKmurg%3D Yang T, Shadlen MN (2007) Probabilistic reasoning by neurons. Nature 447:1075–1080
32. AL Yarbus 1967 Eye movements and vision Plenum Press New York Yarbus AL (1967) Eye movements and vision. Plenum Press, New York