A match made by modafinil: Probability matching in choice decisions and spatial attention

Journal of Cognitive Neuroscience

Volumn 25, Issue 5, 2013, Pages 657-669

  Geng, Joy J ^a   Soosman, Steffan ^a   Sun, Yile ^a   di Quattro, Nicholas E ^a   Stankevitch, Beth ^a   Minzenberg, Michael J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CATECHOLAMINE; MODAFINIL;

ADULT; ARTICLE; ATTENTION; BRAIN FUNCTION; COGNITION; CONTROLLED STUDY; DECISION MAKING; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SELECTIVE ATTENTION; TASK PERFORMANCE; VISION;

EID: 84875507847     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00333     Document Type: Article

References (104)

1. Andersen, M. L., Kessler, E., Murnane, K. S., McClung, J. C., Tufik, S., & Howell, L. L. (2010). Dopamine transporterrelated effects of modafinil in rhesus monkeys. Psychopharmacology, 210, 439-448.
2. Anderson, B. A., & Folk, C. L. (2010). Variations in the magnitude of attentional capture: Testing a two-process model. Attention, Perception & Psychophysics, 72, 342-352.
3. Aston-Jones, G., & Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience, 28, 403-450.
4. Basso, M. A., & Wurtz, R. H. (1997). Modulation of neuronal activity by target uncertainty. Nature, 389, 66-69.
5. Baum, W. M. (1979). Matching, undermatching, and overmatching in studies of choice. Journal of the Experimental Analysis of Behavior, 32, 269-281.
6. Behrens, T. E., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10, 1214-1221.
7. Behrens, T. E., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. (2008). Associative learning of social value. Nature, 456, 245-249.
8. Behrmann, M., & Tipper, S. P. (1999). Attention accesses multiple reference frames: Evidence from visual neglect. Journal of Experimental Psychology: Human Perception and Performance, 25, 83-101.
9. Béracochéa, D., Cagnard, B., Célérier, A., le Merrer, J., Pérès, M., & Piérard C. (2001). First evidence of a delay-dependent working memory-enhancing effect of modafinil in mice. NeuroReport, 12, 375-378.
10. Berridge, C. W., & Abercrombie, E. D. (1999). Relationship between locus coeruleus discharge rates and rates of norepinephrine release within neocortex as assessed by in vivo microdialysis. Neuroscience, 93, 1263-1270.
11. Biederman, I., Glass, A. L., & Stacy, E. W., Jr. (1973). Searching for objects in real-world scenes. Journal of Experimental Psychology, 97, 22-27.
12. Brascamp, J. W., Blake, R., & Kristjánsson, A. (2011). Deciding where to attend: Priming of pop-out drives target selection. Journal of Experimental Psychology: Human Perception and Performance, 37, 1700-1707.
13. Bubic, A., von Cramon, D. Y., & Schubotz, R. I. (2010). Prediction, cognition and the brain. Frontiers in Human Neuroscience, 4, 25.
14. Buzsáki, G. (1996). The hippocampo-neocortical dialogue. Cerebral Cortex, 6, 81-92.
15. Carboni, E., & Silvagni, A. (2004). Dopamine reuptake by norepinephrine neurons: Exception or rule? Critical Reviews in Neurobiology, 16, 121-128.
16. Chun, M. M., & Jiang, Y. (1998). Contextual cueing: Implicit learning and memory of visual context guides spatial attention. Cognitive Psychology, 36, 28-71.
17. Chun, M. M., & Jiang, Y. (2003). Implicit, long-term spatial contextual memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 224-234.
18. Ciaramitaro, V. M., Cameron, E. L., & Glimcher, P. W. (2001). Stimulus probability directs spatial attention: An enhancement of sensitivity in humans and monkeys. Vision Research, 41, 57-75.
19. Cohen, J. D., McClure, S. M., & Yu, A. J. (2007). Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 362, 933-942.
20. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704-1711.
21. Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193-222.
22. DiQuattro, N. E., & Geng, J. J. (2011). Contextual knowledge configures attentional control networks. Journal of Neuroscience, 31, 18026-18035.
23. Doll, B. B., Jacobs, W. J., Sanfey, A. G., & Frank, M. J. (2009). Instructional control of reinforcement learning: A behavioral and neurocomputational investigation. Brain Research, 1299, 74-94.
24. Doya, K. (2002). Metalearning and neuromodulation. Neural Networks: The Official Journal of the International Neural Network Society, 15, 495-506.
25. Druker, M., & Anderson, B. (2010). Spatial probability AIDS visual stimulus discrimination. Frontiers in Human Neuroscience, 4, 1-10.
26. Duncan, J. (1986). Disorganisation of behaviour after frontal lobe damage. Cognitive Neuropsychology, 3, 271-290.
27. Eckhoff, P., Wong-Lin, K. F., & Holmes, P. (2009). Optimality and robustness of a biophysical decision-making model under norepinephrine modulation. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 29, 4301-4311.
28. Eckstein, M. P., Shimozaki, S. S., & Abbey, C. K. (2002). The footprints of visual attention in the Posner cueing paradigm revealed by classification images. Journal of Vision, 2, 25-45.
29. Eriksen, C. W., & Yeh, Y. Y. (1985). Allocation of attention in the visual field. Journal of Experimental Psychology: Human Perception and Performance, 11, 583-597.
30. Estes, W. K. (1976). The cognitive side of probability learning. Psychological Review, 83, 37-64.
31. Everling, S., Tinsley, C. J., Gaffan, D., & Duncan, J. (2006). Selective representation of task-relevant objects and locations in the monkey prefrontal cortex. European Journal of Neuroscience, 23, 2197-2214.
32. Fantino, E., & Esfandiari, A. (2002). Probability matching: Encouraging optimal responding in humans. Canadian Journal of Experimental Psychology = Revue Canadienne de Psychologie Expérimentale, 56, 58-63.
33. Fecteau, J. H., Korjoukov, I., & Roelfsema, P. R. (2009). Location and color biases have different influences on selective attention. Vision Research, 49, 996-1005.
34. Finke, K., Dodds, C. M., Bublak, P., Regenthal, R., Baumann, F., Manly, T., et al. (2010). Effects of modafinil and methylphenidate on visual attention capacity: A TVA-based study. Psychopharmacology, 210, 317-329.
35. Florin-Lechner, S. M., Druhan, J. P., Aston-Jones, G., & Valentino, R. J. (1996). Enhanced norepinephrine release in prefrontal cortex with burst stimulation of the locus coeruleus. Brain Research, 742, 89-97.
36. Frank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience, 12, 1062-1068.
37. Frey, J. U. (2001). Long-lasting hippocampal plasticity: Cellular model for memory consolidation? Results and Problems in Cell Differentiation, 34, 27-40.
38. Friedman, D., & Massaro, D. W. (1998). Understanding variability in binary and continuous choice. Psychonomic Bulletin & Review, 5, 370-389.
39. Gaissmaier, W., & Schooler L J. (2008). The smart potential behind probability matching. Cognition, 109, 416-422.
40. Gardner, B. Y. R. A. (1958). Multiple-choice decision-behavior. The American Journal of Psychology, 71, 710-717.
41. Gazzaley, A., Rissman, J., Cooney, J., Rutman, A., Seibert, T., Clapp, W., et al. (2007). Functional interactions between prefrontal and visual association cortex contribute to topdown modulation of visual processing. Cerebral Cortex, 17(Suppl. 1), i125-i135.
42. Geng, J. J., & Behrmann, M. (2002). Probability cuing of target location facilitates visual search implicitly in normal participants and patients with hemispatial neglect. Psychological Science, 13, 520-525.
43. Geng, J. J., & Behrmann, M. (2005). Spatial probability as an attentional cue in visual search. Perception & Psychophysics, 67, 1252-1268.
44. Geng, J. J., & Behrmann, M. (2006). Competition between simultaneous stimuli modulated by location probability in hemispatial neglect. Neuropsychologia, 44, 1050-1060.
45. Gould, I. C., Rushworth, M. F., & Nobre, A. C. (2011). Indexing the graded allocation of visuospatial attention using anticipatory alpha oscillations. Journal of Neurophysiology, 105, 1318-1326.
46. Herrnstein, R. J. (1970). On the law of effect 1. Journal of the Experimental Analysis of Behavior, 13, 243-266.
47. Herrnstein, R. J. (1974). Formal properties of the matching law. Journal of the Experimental Analysis of Behavior, 21, 159-164.
48. Huettel, S. A., Mack, P. B., & McCarthy, G. (2002). Perceiving patterns in random series: Dynamic processing of sequence in prefrontal cortex. Nature Neuroscience, 5, 485-490.
49. Ishii, S., Yoshida, W., & Yoshimoto, J. (2002). Control of exploitation-exploration meta-parameter in reinforcement learning. Neural Networks: The Official Journal of the International Neural Network Society, 15, 665-687.
50. Izquierdo, I., Bevilaqua, L. R., Rossato, J. I., Bonini, J. S., Medina, J. H., & Cammarota, M. (2006). Different molecular cascades in different sites of the brain control memory consolidation. Trends in Neurosciences, 29, 496-505.
51. Jonides, J. (1980). Towards a model of the minds eyes movement. Canadian Journal of Psychology, 34, 103-112.
52. Jonides, J. (1983). Further toward a model of the minds eyes movement. Bulletin of the Psychonomic Society, 21, 247-250.
53. Kable, J. W., & Glimcher, P. W. (2009). The neurobiology of decision: Consensus and controversy. Neuron, 63, 733-745.
54. Kahneman, D. (1973). Attention and effort. Englewood Cliffs, NJ: Prentice-Hall.
55. Kandel, E. R. (2001). The molecular biology of memory storage: A dialogue between genes and synapses. Science (New York, N.Y.), 294, 1030-1038.
56. Kasanova, Z., Waltz, J. A., Strauss, G. P., Frank, M. J., & Gold, J. M. (2011). Optimizing vs. matching: Response strategy in a probabilistic learning task is associated with negative symptoms of schizophrenia. Schizophrenia Research, 127, 215-222.
57. Kennerley, S. W., & Wallis, J. D. (2009). Reward-dependent modulation of working memory in lateral prefrontal cortex. Journal of Neuroscience, 29, 3259-3270.
58. Koehler, D. J., & James, G. (2009). Probability matching in choice under uncertainty: Intuition versus deliberation. Cognition, 113, 123-127.
59. Lanni, C., Lenzken, S. C., Pascale, A., Del Vecchio, I., Racchi, M., Pistoia, F., et al. (2008). Cognition enhancers between treating and doping the mind. Pharmacological Research: The Official Journal of the Italian Pharmacological Society, 57, 196-213.
60. Loewenstein, Y., & Seung, H. S. (2006). Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity. Proceedings of the National Academy of Sciences, U.S.A., 103, 15224-15229.
61. Madras, B. K., Xie, Z., Lin, Z., Jassen, A., Panas, H., Lynch, L., et al. (2006). Modafinil occupies dopamine and norepinephrine transporters in vivo and modulates the transporters and trace amine activity in vitro. The Journal of Pharmacology and Experimental Therapeutics, 319, 561-569.
62. Marchant, N. L., Kamel, F., Echlin, K., Grice, J., Lewis, M., & Rusted, J. M. (2009). Modafinil improves rapid shifts of attention. Psychopharmacology, 202, 487-495.
63. Mercado, E. (2008). Neural and cognitive plasticity: From maps to minds. Psychological Bulletin, 134, 109-137.
64. Miller, E. K. (2000). The prefrontal cortex and cognitive control. Nature Reviews Neuroscience, 1, 59-65.
65. Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167-202.
66. Miller, E. K., Freedman, D. J., & Wallis, J. D. (2002). The prefrontal cortex: Categories, concepts and cognition. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 357, 1123-1136.
67. Miller, J. (1988). Components of the location probability effect in visual search tasks. Journal of Experimental Psychology: Human Perception and Performance, 14, 453-471.
68. Miller, M. B., Valsangkar-Smyth, M., Newman, S., Dumont, H., & Wolford, G. (2005). Brain activations associated with probability matching. Neuropsychologia, 43, 1598-1608.
69. Minzenberg, M. J., Watrous, A. J., Yoon, J. H., Ursu, S., & Carter, C. S. (2008). Modafinil shifts human locus coeruleus to low-tonic, high-phasic activity during functional MRI. Science, 322, 1700-1702.
70. Minzenberg, M. J., & Carter, C. S. (2008). Modafinil: A review of neurochemical actions and effects on cognition. Neuropsychopharmacology, 33, 1477-1502.
71. Morgan, R. E., Crowley, J. M., Smith, R. H., LaRoche, R. B., & Dopheide, M. M. (2007). Modafinil improves attention, inhibitory control, and reaction time in healthy, middle-aged rats. Pharmacology, Biochemistry, and Behavior, 86, 531-541.
72. Morrison, J. H., & Foote, S. L. (1986). Noradrenergic and serotoninergic innervation of cortical, thalamic, and tectal visual structures in Old and New World monkeys. The Journal of Comparative Neurology, 243, 117-138
73. Neisser, U., & Becklen, R. (1975). Selective looking: Attending to visually specified events. Cognitive Psychology, 7, 480-494.
74. Piérard, C., Liscia, P., Valleau, M., Drouet, I., Chauveau, F., Huart, B., et al. (2006). Modafinil-induced modulation of working memory and plasma corticosterone in chronicallystressed mice. Pharmacology, Biochemistry, and Behavior, 83, 1-8.
75. Posner, M. I. (1980). Orienting of attention. The Quarterly Journal of Experimental Psychology, 32, 3-25.
76. Posner, M. I., Nissen, M. J., & Ogden, W. C. (1978). Attended and unattended processing modes: The role of set for spatial location. Hillsdale, NJ: Erlbaum.
77. Posner, M. I., Snyder, C. R., & Davidson, B. J. (1980). Attention and the detection of signals. Journal of Experimental Psychology, 109, 160-174.
78. Reeves, A., & Sperling, G. (1986). Attention gating in short-term visual memory. Psychological Review, 93, 180-206.
79. Repantis, D., Schlattmann, P., Laisney, O., & Heuser, I. (2010). Modafinil and methylphenidate for neuroenhancement in healthy individuals: A systematic review. Pharmacological Research: The Official Journal of the Italian Pharmacological Society, 62, 187-206.
80. Robertson, P., & Hellriegel, E. T. (2003). Clinical pharmacokinetic profile of modafinil. Clinical Pharmacokinetics, 42, 123-137.
81. Rossi, A. F., Pessoa, L., Desimone, R., & Ungerleider, L. G. (2009). The prefrontal cortex and the executive control of attention. Experimental Brain Research, 192, 489-497.
82. Seamans, J. K., & Yang, C. R. (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Progress in Neurobiology, 74, 1-58.
83. Shanks, D. R., Tunney, R. J., & McCarthy, J. D. (2002). A re-examination of probability matching and rational choice. Journal of Behavioral Decision Making, 15, 233-250.
84. Shaw, M. L., & Shaw, P. (1977). Optimal allocation of cognitive resources to spatial locations. Journal of Experimental Psychology: Human Perception and Performance, 3, 201-211.
85. Shimamura, A. P. (2000). The role of the prefrontal cortex in dynamic filtering. Psychobiology, 28, 207-218.
86. Shulman, G. L., Astafiev, S. V., Franke, D., Pope, D. L., Snyder, A. Z., McAvoy, M. P., et al. (2009). Interaction of stimulus-driven reorienting and expectation in ventral and dorsal frontoparietal and basal ganglia-cortical networks. Journal of Neuroscience, 29, 4392-4407.
87. Soltani, A., & Wang, X.-J. (2010). Synaptic computation underlying probabilistic inference. Nature Neuroscience, 13, 112-119.
88. Sperling, G. (1960). The information available in brief visual presentations. Psychological Monographs: General and Applied, 74, 1-29.
89. Sperling, G. (1986). Strategy and optimization in human information processing. In K. R. Boff, L. Kauffman, & J. P. Thomas (Eds.), Handbook of perception and human performance (Vol. 1, pp. 1-65). New York: Wiley.
90. Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science, 304, 1782-1787.
91. Sylvester, C. M., Shulman, G. L., Jack, A. I., & Corbetta, M. (2007). Asymmetry of anticipatory activity in visual cortex predicts the locus of attention and perception. The Journal of Neuroscience, 27, 14424-14433.
92. Turner, D. C., Robbins, T. W., Clark, L., Aron, A. R., Dowson, J., & Sahakian, B. J. (2003). Cognitive enhancing effects of modafinil in healthy volunteers. Psychopharmacology, 165, 260-269.
93. van der Heijden, A. H. (1989). Probability matching in visual selective attention. Canadian Journal of Psychology, 43, 45-52.
94. Verguts, T., & Notebaert, W. (2009). Adaptation by binding: A learning account of cognitive control. Trends in Cognitive Sciences, 13, 252-257.
95. Volkow, N. D., Fowler, J. S., Logan, J., Alexoff, D., Zhu, W., Telang, F., et al. (2009). Effects of modafinil on dopamine and dopamine transporters in the male human brain: Clinical implications. JAMA: The Journal of the American Medical Association, 301, 1148-1154.
96. Vossel, S., Thiel, C. M., & Fink, G. R. (2006). Cue validity modulates the neural correlates of covert endogenous orienting of attention in parietal and frontal cortex. Neuroimage, 32, 1257-1264.
97. Vul, E., Hanus, D., & Kanwisher, N. (2009). Attention as inference: Selection is probabilistic; responses are all-or-none samples. Journal of Experimental Psychology: General, 138, 546-560.
98. Wallis, J. D., Anderson, K. C., & Miller, E. K. (2001). Single neurons in prefrontal cortex encode abstract rules. Nature, 411, 953-956.
99. Ward, C. P., Harsh, J. R., York, K. M., Stewart, K. L., & McCoy, J. G. (2004). Modafinil facilitates performance on a delayed nonmatching to position swim task in rats. Pharmacology, Biochemistry, and Behavior, 78, 735-741.
100. Waters, K. A., Burnham, K. E., O'Connor, D., Dawson, G. R., Dias, R. (2005). Assessment of modafinil on attentional processes in a five-choice serial reaction time test in the rat. Journal of Psychopharmacology (Oxford, England), 19, 149-158.
101. Winder-Rhodes, S. E., Chamberlain, S. R., Idris, M. I., Robbins, T. W., Sahakian, B. J., & Müller, U. (2009). Effects of modafinil and prazosin on cognitive and physiological functions in healthy volunteers. Journal of Psychopharmacology, 24, 1649-1657.
102. Wolford, G. L., Miller, M. B., & Gazzaniga, M. S. (2000). The left hemispheres role in hypothesis formation. The Journal of Neuroscience, 20, 1-4.
103. Wozny, D. R., Beierholm, U. R., & Shams, L. (2010). Probability matching as a computational strategy used in perception. PLoS Computational Biology, 6, 1-7. doi:10.1371/journal. pcbi.1000871.
104. Yu, A. J., & Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron, 46, 681-692.