The foraging brain

Current Opinion in Behavioral Sciences

Volumn 5, Issue , 2015, Pages 24-31

  Calhoun, Adam J ^a   Hayden, Benjamin Y ^b  

^a PRINCETON UNIVERSITY   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; CAENORHABDITIS ELEGANS; COORDINATION; DECISION MAKING; DORSAL ANTERIOR CINGULATE CORTEX; FORAGING; FORAGING BEHAVIOR; HAPLORHINI; HUMAN; MAMMAL; NEMATODE; NEUROSCIENCE; NONHUMAN; REVIEW; THEORY;

EID: 84937931406     PISSN: None     EISSN: 23521546     Source Type: Journal    
DOI: 10.1016/j.cobeha.2015.07.003     Document Type: Review

References (72)

1. Stephens D.W., Krebs J.R. Foraging Theory 1986, Princeton University Press, Princeton, NJ.
2. Stephens D.W., Brown J.S., Ydenberg R.C. Foraging: Behavior and Ecology 2007, University of Chicago Press, Chicago, IL.
3. Giraldeau L.A., Caraco T. Social Foraging Theory 2000, Princeton University Press, Princeton, NJ.
4. Wikenheiser A.M., Stephens D.W., Redish A.D. Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task. Proc Natl Acad Sci U S A 2013, 110:8308-8313. 10.1073/pnas.1220738110.
5. Kvitsiani D., Ranade S., Hangya B., Taniguchi H., Huang J.Z., Kepecs A. Distinct behavioural and network correlates of two interneuron types in prefrontal cortex. Nature 2013, 498:363-366. 10.1038/nature12176.
6. Kolling N., Behrens T.E., Mars R.B., Rushworth M.F. Neural mechanisms of foraging. Science 2012, 336:95-98. 10.1126/science.1216930.
7. Hills T.T. Animal foraging and the evolution of goal-directed cognition. Cogn Sci 2006, 30:3-41.
8. Mobbs D., Hassabis D., Yu R., Chu C., Rushworth M.F.S., Boorman E., Dagliesh T. Foraging under competition: the neural basis of input-matching in humans. J Neurosci 2013, 33:9866-9872.
9. McNamara J.M., Houston A.I. The common currency for behavioral decisions. Am Nat 1986, 127:358-378.
10. Schoener T.W. Theory of feeding strategies. Annu Rev Ecol Syst 1971, 2:369-404.
11. Pyke G.H., Pulliam H.R., Charnov E.L. Optimal foraging: a selective review of theory and tests. Q R Biol 1977, 52:137-154.
12. Smith E.A., Winterhalder B. Evolutionary Ecology and Human Behabior 1992, de Gruyer, New York.
13. Hills T.T., Jones M.N., Todd P.M. Optimal foraging in semantic memory. Psychol Rev 2012, 119:431-440. 10.1037/a0027373.
14. McNickle G.G., Cahill J.F. Plant root growth and the marginal value theorem. Proc Natl Acad Sci U S A 2009, 106:4747-4751. 10.1073/pnas.0807971106.
15. Stephens D.W., Anderson D. The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behavl Ecol 2001, 12:330-339.
16. Pearson J.M., Watson K.K., Platt M.L. Decision making: the neuroethological turn. Neuron 2014, 82:950-965. 10.1016/j.neuron.2014.04.037.
17. Cisek P. Making decisions through a distributed consensus. Curr Opin Neurobiol 2012, 22:1-10.
18. Passingham R.E., Wise S.P. The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight 2012, Oxford University Press, Oxford, UK.
19. Passino K.M. Biomimicry for Optimization, Control, and Automation 2004, Springer, London.
20. Freidin E., Aw J., Kacelnik A. Sequential and simultaneous choices: testing the diet selection and sequential choice models. Behav Processes 2009, 80:218-223. 10.1016/j.beproc.2008.12.001.
21. Stephens D.W., Kerr B., Fernández-Juricic E. Impulsiveness without discounting: the ecological rationality hypothesis. Proc Biol Sci 2004, 271:2459-2465. 10.1098/rspb.2004.2871.
22. Blanchard T.C., Hayden B.Y. Monkeys are more patient in a foraging task than in a standard intertemporal choice task. PLoS One 2015, 10:e0117057. 10.1371/journal.pone.0117057.
23. Boorman E.D., Rushworth M.F., Behrens T.E. Ventromedial prefrontal and anterior cingulate cortex adopt choice and default reference frames during sequential multi-alternative choice. J Neurosci 2013, 33:2242-2253. 10.1523/JNEUROSCI.3022-12.2013.
24. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62:733-743. 10.1016/j.neuron.2009.05.014.
25. Blanchard T.C., Pearson J.M., Hayden B.Y. Postreward delays and systematic biases in measures of animal temporal discounting. Proc Natl Acad Sci U S A 2013, 110:15491-15496. 10.1073/pnas.1310446110.
26. Kacelnik A., Vasconcelos M., Monteiro T., Aw J. Darwin's "tug-of-war" vs. starlings' "horse-racing": how adaptations for sequential encounters drive simultaneous choice. Behav Ecol Sociobiol 2011, 10.1007/s00265-010-1101-2.
27. Kacelnik A. The evolution of patience. Time and Decision: Economic and Psychological Perspectives on Intertemporal Choice 2003, Russell Sage, New York. G.F. Loewenstein, D. Read, R.F. Baumeister (Eds.).
28. Pearson J.M., Hayden B.Y., Platt M.L. Explicit information reduces discounting behavior in monkeys. Front Psychol 2010, 1:237. 10.3389/fpsyg.2010.00237.
29. Hayden B.Y. Time discounting and time preference in animals: a critical review. Psychon Bull Rev 2015, 10.3758/s13423-015-0879-3.
30. Hayden B.Y., Pearson J.M., Platt M.L. Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 2011, 14:933-939. 10.1038/nn.2856.
31. Shenhav A., Botvinick M.M., Cohen J.D. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 2013, 79:217-240. 10.1016/j.neuron.2013.07.007.
32. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069. 10.1016/j.neuron.2011.05.014.
33. Hayden B.Y., Heilbronner S.R., Pearson J.M., Platt M.L. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J Neurosci 2011, 31:4178-4187. 10.1523/JNEUROSCI. 4652-10.2011.
34. Quilodran R., Rothe M., Procyk E. Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 2008, 57:314-325.
35. Gold J.I., Shadlen M.N. The neural basis of decision making. Annu Rev Neurosci 2007, 30:525-574.
36. Calhoun A.J., Tong A., Pokala N., Fitzpatrick A.J., Sharpee T.O., Chalasani S.H. Neural mechanisms for evaluating environmental variability in Caenorhabditis elegans. Neuron 2015, 86:1-14.
37. Blanchard T.C., Hayden B.Y. Neurons in dorsal anterior cingulate cortex signal postdecisional variables in a foraging task. J Neurosci 2014, 34:646-655. 10.1523/JNEUROSCI.3151-13.2014.
38. Shenhav A., Straccia M.A., Cohen J.D., Botvinick M.M. Anterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value. Nat Neurosci 2014, 16:1249-1254.
39. Kolling N., Wittmann M., Rushworth M.F.S. Multiple neural mechanisms of decision making and their competition under changing risk pressure. Neuron 2014, 81:1190-1202. 10.1016/j.neuron.2014.01.033.
40. Krebs J.R., Erichsen J.T., Webber M.I., Charnov E.L. Optimal prey selection in the great tit (Parus major). Anim Behav 1977, 10.1016/0003-3472(77)90064-1.
41. Steiner A.P., Redish A.D. Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task. Nat Neurosci 2014, 17:995-1002. 10.1038/nn.3740.Behavioral.
42. Abe H., Lee D. Distributed coding of actual and hypothetical outcomes in the oribital and dorsolateral prefrontal cortex. Neuron 2011, 70:731-741.
43. Hayden B.Y., Pearson J.M., Platt M.L. Fictive reward signals in the anterior cingulate cortex. Science 2009, 324:948-950.
44. DiLeone R.J. The influence of leptin on the dopamine system and the implications for ingestive behavior. Int J Obes 2009, 33:S25-S29.
45. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879. 10.1038/nature04766.
46. Pearson J.M., Hayden B.Y., Raghavachari S., Platt M.L. Neurons in posterior cingulate cortex signal exploratory decisions in a dynamic multi-option choice task. Curr Biol 2009, 19:1-6.
47. Wittmann B.C., Daw N.D., Seymour B., Dolan R.J. Striatal activity underlies novelty-based choice in humans. Neuron 2008, 58:967-973. 10.1016/j.neuron.2008.04.027.
48. Blanchard T.C., Hayden B.Y., Bromberg-Martin E.S. Orbitofrontal cortex uses distinct codes for different choice attributes in decisions motivated by curiosity. Neuron 2015, 85:602-614. 10.1016/j.neuron.2014.12.050.
49. Gruber M.J., Gelman B.D., Ranganath C. States of curiosity modulate hippocampus-dependent learning via the dopaminergic circuit. Neuron 2014, 84:486-496.
50. Kang M.J., Hsu M., Krajbich I.M., Loewenstein G., McClure S.M., Wang J.T., Camerer C.F. The wick in the candle of learning: epistemic curiosity activates reward circuitry and enhances memory. Psychol Sci 2009, 20:963-973. 10.1111/j.1467-9280.2009.02402.x.
51. Lipton J., Kleemann G., Ghosh R., Lints R., Emmons S.W. Mate searching in Caenorhabditis elegans: a genetic model for sex drive in a simple invertebrate. J Neurosci 2004, 24:7427-7434. 10.1523/JNEUROSCI.1746-04.2004.
52. Shtonda B.B., Avery L. Dietary choice behavior in Caenorhabditis elegans. J Exp Biol 2006, 209(Pt 1):89-102. 10.1242/jeb.01955.
53. Gloria-Soria A., Azevedo R.B.R. npr-1 regulates foraging and dispersal strategies in Caenorhabditis elegans. Curr Biol 2008, 18:1694-1699. 10.1016/j.cub.2008.09.043.
54. Milward K., Emanuel K., Joseph R., De Bono M., Olofsson B. Neuronal and molecular substrates for optimal foraging in Caenorhabditis elegans. Proc Natl Acad Sci U S A 2011, 108:20672-20677. 10.1073/pnas.1106134109.
55. Li C., Kim K. Neuropeptides. Wormbook 2008, 25:1-36.
56. Alkema M.J., Hunter-Ensor M., Ringstad N., Horvitz H.R. Tyramine functions independently of octopamine in the Caenorhabditis elegans nervous system. Neuron 2005, 46:247-260. 10.1016/j.neuron.2005.02.024.
57. Gallagher T., Kim J., Oldenbroek M., Kerr R., You Y.-J. ASI regulates satiety quiescence in C. elegans. J Neurosci 2013, 33:9716-9724. 10.1523/JNEUROSCI.4493-12.2013.
58. Gray J.M., Hill J.J., Bargmann C.I. A circuit for navigation in Caenorhabditis elegans. Proc Natl Acad Sci U S A 2005, 102:3184-3191.
59. Cousins M.S., Salamone J.D. Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost/benefit procedure. Pharmacol Biochem Behav 1994, 49:85-91.
60. Flavell S.W., Pokala N., Macosko E.Z., Albrecht D.R., Larsch J., Bargmann C.I. Serotonin and the neuropeptide PDF initiate and extend opposing behavioral states in C. elegans. Cell 2013, 154:1023-1035. 10.1016/j.cell.2013.08.001.
61. Fonseca M.S., Murakami M., Mainen Z.F. Activation of dorsal raphe serotonergic neurons promotes waiting but is not reinforcing. Curr Biol 2015, 25:306-315.
62. Cohen J.Y., Amoroso M.W., Uchida N. Serotonergic neurons signal reward and punishment on multiple timescales. eLife 2015, 4:e06346.
63. Wolkow C.A., Kimura K.D., Lee M., Ruvkun G. Regulation of C. elegans life-span by insulinlike signaling in the nervous system. Science 2000, 290:147-150.
64. De Bono M., Tobin D.M., Davis M.W., Avery L., Bargmann C.I. Social feeding in Caenorhabditis elegans is induced by neurons that detect aversive stimuli. Nature 2002, 419:899-903.
65. Bendesky A., Tsunozaki M., Rockman M.V., Kruglyak L., Bargmann C.I. Catecholamine receptor polymorphisms affect decision-making in C. elegans. Nature 2011, 10.1038/nature09821.
66. Calhoun A.J., Chalasani S.H., Sharpee T.O. Maximally informative foraging by Caenorhabditis elegans. eLife 2014, 3:1-13. 10.7554/eLife.04220.
67. Salvador L.C.M., Bartumeus F., Levin S.A., Ryu W.S., Valle C. Mechanistic analysis of the search behaviour of Caenorhabditis elegans. J R Soc Interface 2014, 11:20131092.
68. Aston-Jones G., Cohen J.D. An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu Rev Neurosci 2005, 28:403-450.
69. Williams S.M., Goldman-Rakic P.S. Widespread origin of the primate mesofrontal dopamine system. Cereb Cortex 1998, 8:321-345.
70. Roeder T. Octopamine in invertebrates. Progr Neurobiol 1999, 59:533-561.
71. Blanchard T.C., Wilke A., Hayden B.Y. Hot hand bias in rhesus monkeys. J Exp Psychol Anim Learn Cogn 2014, 40:280-286.
72. Constantino Sara M., Daw Nathaniel D. Learning the opportunity cost of time in a patch-foraging task. Cognitive, Affect & Behav Neurosci 2015, 10.3758/s13415-015-0350-y.