The Central Executive as a Search Process: Priming Exploration and Exploitation Across Domains

Journal of Experimental Psychology: General

Volumn 139, Issue 4, 2010, Pages 590-609

  Hills, Thomas T ^a   Todd, Peter M ^b   Goldstone, Robert L ^b  

^a UNIVERSITY OF BASEL   (Switzerland)

^b INDIANA UNIVERSITY   (United States)

Author keywords

Central executive; Foraging; Priming; Search; Working memory

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; ARTICLE; ATTENTION; EXECUTIVE FUNCTION; EXPLORATORY BEHAVIOR; HUMAN; INHIBITION (PSYCHOLOGY); MOTIVATION; NEUROPSYCHOLOGICAL TEST; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; SHORT TERM MEMORY;

ADULT; ANALYSIS OF VARIANCE; ATTENTION; EXECUTIVE FUNCTION; EXPLORATORY BEHAVIOR; GOALS; HUMANS; INHIBITION (PSYCHOLOGY); MEMORY, SHORT-TERM; MODELS, PSYCHOLOGICAL; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION;

EID: 78349267951     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0020666     Document Type: Article

References (106)

1. 11C]FLB 457. The Journal of Neuroscience 2005, 25:2471-2477.
2. Anderson H., Braestrup C., Randrup A. Apomorphine-induced stereotyped biting in the tortoise in relation to dopaminergic mechanisms. Brain Behavior and Evolution 1975, 11:365-373.
3. Anderson J.R. Rules of the mind 1993, Erlbaum, Hillsdale, NJ.
4. Aston-Jones G., Cohen J.D. An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience 2005, 28:403-450.
5. Bäckman L., Farde L. The role of dopamine systems in cognitive aging. Cognitive neuroscience of aging: Linking cognitive and cerebral aging 2005, 58-84. Oxford University Press, New York, NY. R. Cabeza, L. Nyberg, D. Park (Eds.).
6. Baddeley A.D. Working memory 1986, Oxford University Press, Oxford, England.
7. Baddeley A.D. Exploring the central executive. Quarterly Journal of Experimental Psychology 1996, 49(A):5-28.
8. Baddeley A. Random generation and the executive control of working memory. Quarterly Journal of Experimental Psychology 1998, 51:819-852.
9. Baddeley A.D. Working memory, thought, and action 2007, Oxford University Press, Oxford, England.
10. Baddeley A.D., Hitch G.J. Working memory. The psychology of learning and motivation: Advances in research and theory 1974, 8:47-89. Academic Press, New York, NY. G.H. Bower (Ed.).
11. Badyaev A.V. Stress-induced variation in evolution: From behavioral plasticity to genetic assimilation. Proceedings of the Royal Society B 2005, 272:877-886.
12. Baldwin J.M. A new factor in evolution. American Naturalist 1896, 30:441-451.
13. Barnard P.J. Interacting cognitive subsystems: A psycholinguistic approach to short term memory. Progress in the psychology of language 1985, 2:197-258. Erlbaum, London, England. A. Ellis (Ed.).
14. Barnard P.J. Interacting cognitive subsystems: Modeling working memory phenomena within a multiprocessor architecture. Models of working memory: Mechanisms of active maintenance and executive control 1999, 298-339. Cambridge University Press, New York, NY. A. Miyake, P. Shah (Eds.).
15. Barrett H.C., Kurzban R. Modularity in cognition: Framing the debate. Psychological Review 2006, 113:628-647.
16. Baumann O., Dames P., Kühnel D., Walz B. Distribution of serotonergic and dopaminergic nerve fibers in the salivary gland complex of the cockroach Periplaneta americana. BMC Physiology 2002, 2:1-15.
17. Bedau M.A., Packard N.H. Evolution and evolvability via adaptation of mutation rates. Biosystems 2003, 69:143-162.
18. Berg A.E. A simple objective technique for measuring flexibility in thinking. Journal of General Psychology 1948, 39:15-22.
19. Bonate P.L. Analysis of pretest-posttest designs 2000, Chapman & Hall/CRC Press, Boca Raton, FL.
20. Botvinick M.M. Hierarchical models of behavior and prefrontal function. Trends in Cognitive Science 2008, 12:201-208.
21. Braver T.S., Bongiolatti S.R. The role of the frontopolar cortex in subgoal processing in working memory. NeuroImage 2002, 15:523-536.
22. Braver T.S., Cohen J.D. Dopamine, cognitive control, and schizophrenia: The gating model. Progress in Brain Research 1999, 121:327-349.
23. Braver T.S., Cohen J.D. On the control of control: The role of dopamine in regulating prefrontal function and working memory. Attention and performance XVIII 2000, 713-738. MIT Press, Cambridge, MA. S. Monsell, J. Driver (Eds.).
24. Braver T.S., Gray J.R., Burgess G.C. Explaining the many varieties of working memory variation: Dual mechanisms of cognitive control. Variation in working memory 2008, 76-106. Oxford University Press, New York, NY. A.R.A. Conway, C. Jarrold, M.J. Kane, A. Miyake, J.N. Towse (Eds.).
25. Charnov E.L. Optimal foraging: The marginal value theorem. Theoretical and Population Biology 1976, 9:129-136.
26. Cohen J.D., Braver T.S., Brown J.W. Computational perspectives on dopamine function in prefrontal cortex. Current Opinion in Neurobiology 2002, 12:223-229.
27. Cohen J.D., McClure S.M., Yu A.J. Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philosophical Transactions of the Royal Society of London B: Biological Science 2007, 362:933-942.
28. Conway A.R.A., Cowan N., Bunting M.F. The cocktail party phenomenon revisited: The importance of working memory capacity. Psychonomic Bulletin and Review 2001, 8:331-335.
29. Cools R., Gibbs S.E., Miyakawa A., Jagust W., D'Esposito M. Working memory capacity predicts dopamine synthesis capacity in the human straitum. The Journal of Neuroscience 2008, 28:1208-1212.
30. Cosmides L., Tooby J. Origins of domain specificity: The evolution of functional organization. Mapping the mind 1994, 85-116. Cambridge University Press, Cambridge, England. L. Hirschfeld, S. Gelman (Eds.).
31. Cowan N. Working memory capacity 2005, Psychology Press, New York, NY.
32. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879.
33. D'Esposito M., Detre J.A., Alsop D.C., Shin R.K., Atlas S., Grossman M. The neural basis of the central executive system of working memory. Nature 1995, 378:279-281.
34. Dougherty M.R., Harbison J.I. Motivated to retrieve: How often are you willing to go back to the well when the well is dry?. Journal of Experimental Psychology: Learning, Memory, and Cognition 2007, 33:1108-1117.
35. Due M.R., Jing J., Klaudiusz R.W. Dopaminergic contributions to modulatory functions of a dual-transmitter interneuron in Aplysia. Neuroscience Letters 2004, 358:53-57.
36. Durstewitz D., Kelc M., Güntürkün O. A neurocomputational theory of the dopoaminergic modulation of working memory functions. Journal of Neuroscience 1999, 19:2807-2822.
37. Durstewitz D., Seamans J.K., Sejnowski T.J. Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. Journal of Neurophysiology 2000, 83:1733-1750.
38. Engle R.W., Kane M.J. Executive attention, working memory capacity, and a two-factor theory of cognitive control. The psychology of learning and motivation 2004, 44:145-199. Elsevier, New York, NY. B. Ross (Ed.).
39. Engle R.W., Kane M.J., Tuholski S.W. Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. Models of working memory: Mechanisms of active maintenance and executive control 1999, 102-134. Cambridge University Press, New York, NY. A. Miyake, P. Shah (Eds.).
40. Fodor J.A. The modularity of mind 1983, MIT Press, Cambridge, MA.
41. Garavan H. Serial attention within working memory. Memory & Cognition 1998, 26:263-276.
42. Gavurin E.I., Zangrillo R.L. Effect of bigram cues on the solution of monosyllabic and bisyllabic solution-word anagrams. Journal of General Psychology 1975, 92:225-229.
43. Gick M.L., Holyoak K.J. Schema induction and analogical transfer. Cognitive Psychology 1983, 14:1-38.
44. Gigerenzer G., Todd P.M. Simple heuristics that make us smart 1999, the ABC Research Group, Oxford University Press, New York, NY.
45. Goldstone R.L., Landy D.H., Son J.Y. The education of perception. Topics in Cognitive Science 2010, 2:265-284.
46. Goto Y., Otani S., Grace A.A. The yin and yang of dopamine release: A new perspective. Neuropharmacology 2007, 53:583-587.
47. Grace A.A. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis of the etiology of schizophrenia. Neuroscience 1991, 41:1-24.
48. Grace A.A. The tonic/phasic model of dopamine system regulation and its implications for understanding alchohol and psychostimulant craving. Addiction 2000, 95:S119-S128.
49. Hale S., Myerson J., Emery L.J., Lawrence B.M., Dufault C. Variation in working memory across the lifespan. Variation in working memory 2008, 194-224. Oxford University Press, New York, NY. A.R.A. Conway, C. Jarrold, M.J. Kane, A. Miyake, J.N. Towse (Eds.).
50. Harbison J.I., Dougherty M.R., Davelaar E.J., Fayyad B. On the lawfulness of the decision to terminate memory search. Cognition 2009, 111:397-402.
51. Hasher L., Lustig C., Zacks R. Inhibitory mechanisms and the control of attention. Variation in working memory 2008, 227-249. Oxford University Press, New York, New York. A.R.A. Conway, C. Jarrold, M.J. Kane, A. Miyake, J.N. Towse (Eds.).
52. Hasher L., Zacks R.T. Working memory, comprehension, and aging: A review and a new view. The psychology of learning and motivation: Advances in research and theory 1988, 22:193-225. Academic Press, San Diego, CA. G.H. Bower (Ed.).
53. Hazy T.E., Frank M.J., O'Reilly R.C. Banishing the homunculus: Making working memory work. Neuroscience 2006, 139:105-118.
54. Hertwig R., Barron G., Weber E.U., Erev I. Decisions from experience and the effect of rare events in risky choice. Psychological Science 2004, 15:534-539.
55. Hills T.T. Animal foraging and the evolution of goal-directed cognition. Cognitive Science 2006, 30:3-41.
56. Hills T.T., Adler F.R. Time's crooked arrow: Optimal foraging and rate-biased time perception. Animal Behavior 2001, 63:589-597.
57. Hills T.T., Brockie P.J., Maricq A.V. Dopamine and glutamate control area-restricted search behavior in Caenorhabditis elegans. Journal of Neuroscience 2004, 24:1217-1225.
58. Hills T.T., Todd P.M., Goldstone R.G. Search in external and internal spaces: Evidence for generalized cognitive search processes. Psychological Science 2008, 19:676-682.
59. Hills, T. T., Todd, P. M., & Jones, M. (2009). Optimal foraging in semantic memory. In N. A. Taatgen & H. van Rijn (Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society. Retrieved from http://www.indiana.edu/~clcl/Papers/HTJ_Foraging.pdf.
60. Houk J.C., Davis J.L., Beiser D.G. Models of information processing in the basal ganglia 1995, MIT Press, Cambridge, MA.
61. Iwasa Y., Higashi M., Yanamura N. Prey distribution as a factor determining the choice of optimal foraging strategy. American Naturalist 1981, 117:710-723.
62. Kane M.J., Bleckley M.K., Conway A.R.A., Engle R.W. A controlled-attention view of working-memory capacity. Journal of Experimental Psychology: General 2001, 130:169-183.
63. Kane M.J., Conway A.R.A., Hambrick D.Z., Engle R.W. Variation in working memory capacity as variation in executive attention and control. Variation in working memory 2008, 21-48. Oxford University Press, New York, NY. A.R.A. Conway, C. Jarrold, M.J. Kane, A. Miyake, J.N. Towse (Eds.).
64. Kane M.J., Engle R.W. Working memory capacity, proactive interference, and divided attention: Limits on long-term memory retrieval. Journal of Experimental Psychology: Learning, Memory, Cognition 2000, 26:333-358.
65. Kane M.J., Engle R.W. Working-memory capacity and the control of attention: The contributions of goal neglect, response competition, and task set to Stroop interference. Journal of Experimental Psychology: General 2003, 132:47-70.
66. Kieras D.E., Meyer D.E., Mueller S., Seymour T. Insights into working memory from the perspective of the EPIC architecture for modeling skilled percpetual-motor and cognitive human performance. Models of working memory: Mechanisms of active maintenance and executive control 1999, 183-223. Cambridge University Press, New York, NY. A. Miyake, P. Shah (Eds.).
67. Laird J.E., Newell A., Rosenbloom P.S. SOAR: An architecture for general intelligence. Artificial Intelligence 1987, 33:1-64.
68. Laird N.M., Ware J.H. Random-effects models for longitudinal data. Biometrics 1982, 38:963-974.
69. Ljungberg T., Apicella P., Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of Neurophysiology 1992, 67:145-163.
70. Logan G.D. Working memory, task switching, and executive control in the task span procedure. Journal of Experimental Psychology: General 2004, 133:218-236.
71. Logie R.H., Zucco G.M., Baddeley A.D. Interference with visual short-term memory. Acta Psychologica 1990, 75:55-74.
72. Lovett M.C., Reder L.M., Lebere C. Modeling working memory in a unified architecture: An ACT-R perspective. Models of working memory: Mechanisms of active maintenance and executive control 1999, 135-182. Cambridge University Press, New York, NY. A. Miyake, P. Shah (Eds.).
73. Maricq A.V., Church R.M. The differential effects of haloperidol and methamphetamine on time estimation in the rat. Psychopharmacology (Berl.) 1983, 79:10-15.
74. Mayzner M.S., Tresselt M.E., Helbock H. An exploratory study of meditational responses in anagram problem solving. Journal of Psychology 1964, 57:263-274.
75. McClure S., Gilzenrat M., Cohen J. An exploration-exploitation model based on norepinephrine and dopamine activity. Advances in neural information processing systems 2006, 18:867-874. MIT Press, Cambridge, MA. Y. Weiss, B. Sholkopf, J. Platt (Eds.).
76. Meck W.H. Selective adjustment of the speed of internal clock and memory processes. Journal of Experimental Psychology: Animal and Behavioral Processes 1983, 9:171-201.
77. Mendelsohn G.A. An hypothesis approach to the solution of anagrams. Memory & Cognition 1976, 4:637-642.
78. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annual Review of Neuroscience 2001, 24:167-202.
79. Miller G.A., Galanter E., Pribram K.H. Plans and the structure of behavior 1960, Holt, New York, NY.
80. Miyake A., Shah P. Models of working memory: Mechanisms of active maintenance and executive control 1999, Cambridge University Press, New York, NY.
81. Munakata Y., Morton J.B., O'Reilly R.C. Developmental and computational approaches to variation in working memory. Variation in working memory 2008, 162-193. Oxford University Press, New York, NY. A.R.A. Conway, C. Jarrold, M.J. Kane, A. Miyake, J.N. Towse (Eds.).
82. Nash J.C. Compact numerical methods for computers: Linear algebra and function minimisation 1990, Adam Hilger, Bristol, England.
83. Newell A., Simon H. Human problem solving 1972, Prentice-Hall, Englewood Cliffs, NJ.
84. Nieoullon A. Dopamine and the regulation of cognition and attention. Progress in Neurobiology 2002, 67:53-83.
85. Niv Y., Daw N.D., Joel D., Dayan P. Tonic dopamine: Opportunity costs and the control of response vigor. Psychopharmacology 2006, 191:507-520.
86. Norman D.A., Shallice T. Attention to action: Willed and automatic control of behavior. Consciousness and self-regulation 1986, 1-18. Plenum Press, New York, NY. T. Shallice, D.A. Norman (Eds.).
87. Novick L.R., Sherman S.J. The effects of superficial and structural information on online problem solving for good versus poor anagram solvers. The Quarterly Journal of Experimental Psychology 2008, 61:1098-1120.
88. Oberauer K., Süss H., Wilhelm O., Sander N. Individual differences in working memory capacity and reasoning ability. Variation in working memory 2008, 49-75. Oxford University Press, New York, NY. A.R.A. Conway, C. Jarrold, M.J. Kane, A. Miyake, J.N. Towse (Eds.).
89. O'Reilly R.C., Braver T.S., Cohen J.D. A biologically based computational model of working memory. Models of working memory: Mechanisms of active maintenance and executive control 1999, 375-411. Cambridge University Press, New York, NY. A. Miyake, P. Shah (Eds.).
90. O'Reilly R.C., Frank M.J. Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation 2006, 18:283-328.
91. Reiner A., Medina L., Veenman C.L. Structural and functional evolution of the basal ganglia in vertebrates. Brain Research Reviews 1998, 28:235-285.
92. Robbins H. Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society 1952, 58:527-535.
93. Rosen V.M., Engle R.W. Working memory capacity and suppression. Journal of Memory and Language 1998, 39:418-436.
94. Rougier N.P., Noelle D.C., Braver T.S., Cohen J.D., O'Reilly R.C. Prefrontal cortex and flexible cognitive control: Rules without symbols. Proceedings of the National Academy of Sciences 2005, 102:7338-7343.
95. Salas C., Broglio C., Rodriquez F. Evolution of forebrain and spatial cognition in vertebrates: Conservation across diversity. Brain, Behavior, and Evolution 2003, 62:72-82.
96. Samuels R. Evolutionary psychology and the massive modularity hypothesis. The British Journal for the Philosophy of Science 1998, 49:575-602.
97. Sankoff D., Kruskal J.B. Time warps, string edits, and macromolecules: The theory and practice of sequence comparison 1983, Addison-Wesley, Reading, MA.
98. Schneider W., Shiffrin R.M. Controlled and automatic human information processing: I. Detection, search and attention. Psychological Review 1977, 84:1-66.
99. Schultz W. Multiple dopamine functions at different time scales. Annual Review of Neuroscience 2007, 30:259-288.
100. Stephens D.W. Change, regularity, and value in the evolution of animal learning. Behavioral Ecology 1991, 2:77-89.
101. Sternberg S. High-speed scanning in human memory. Science 1966, 153:652-654.
102. Szczypka M.S., Rainey M.A., Kim D.S., Alaynick W.A., Marck B.T., Matsumoto A.M., Palmiter R.D. Feeding behavior in dopamine-deficient mice. Proceedings of the National Academy of Sciences USA 1999, 96:12138-12143.
103. Troyer A.K., Moscovitch M., Winocur G., Alexander M.P., Stuss D. Clustering and switching on verbal fluency: The effects of focal frontal- and temporal-lobe lesions. Neuropsychologia 1998, 36:499-504.
104. Unsworth N., Heitz R.P., Engle R.W. Working memory capacity and the control of attention. Cognitive limitations in aging and psychopathology: Attention, working memory, and executive functions 2004, Oxford University Press, New York, NY. R.W. Engle, G. Sedek, U. Hecker, D.N. McIntosh (Eds.).
105. Volkow N.D., Gur R.C., Wang G., Fowler J.A., Moberg P.J., Ding Y., Logan J. Association between decline in brain dopamine activity with age and cognitive and motor impairment in healthy individuals. American Journal of Psychiatry 1998, 155:344-349.
106. Wilke A. Evolved responses to an uncertain world (Doctoral thesis, Free University of Berlin, Germany) 2006, Retrieved from http://www.diss.fu-berlin.de/2006/14/indexe.html.