Brain Systems for Probabilistic and Dynamic Prediction: Computational Specificity and Integration

PLoS Biology

Volumn 11, Issue 9, 2013, Pages

  O'Reilly, Jill X ^a   Jbabdi, Saad ^a   Rushworth, Matthew F S ^a,b   Behrens, Timothy E J ^a,c  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACCELERATION; ADULT; ANGULAR GYRUS; ARTICLE; BAYES THEOREM; BRAIN FUNCTION; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LEARNING; MALE; MOTOR CONTROL; PREDICTION; PROBABILITY; REINFORCEMENT; STATISTICAL ANALYSIS; STATISTICAL MODEL; TASK PERFORMANCE;

ADULT; BEHAVIOR CONTROL; BRAIN; BRAIN MAPPING; BRAIN WAVES; DECISION MAKING; DOMINANCE, CEREBRAL; FEMALE; FORECASTING; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; YOUNG ADULT;

EID: 84884552049     PISSN: 15449173     EISSN: 15457885     Source Type: Journal    
DOI: 10.1371/journal.pbio.1001662     Document Type: Article

References (65)

1. Friston K, Kiebel S, (2009) Predictive coding under the free-energy principle. Philos Trans R Soc Lond B Biol Sci 364: 1211-1221.
2. Doya K, (2000) Complementary roles of basal ganglia and cerebellum in learning and motor control. Curr Opin Neurobiol 10: 732-739.
3. Courville AC, Daw ND, Touretzky DS, (2006) Bayesian theories of conditioning in a changing world. Trends Cogn Sci 10: 294-300.
4. Schubotz RI, (2007) Prediction of external events with our motor system: towards a new framework. Trends Cogn Sci 11: 211-218.
5. Behrens TE, Woolrich MW, Walton ME, Rushworth MF, (2007) Learning the value of information in an uncertain world. Nat Neurosci 10: 1214-1221.
6. Schultz W, (2002) Getting formal with dopamine and reward. Neuron 36: 241-263.
7. Schultz W, Dayan P, Montague PR, (1997) A neural substrate of prediction and reward. Science 275: 1593-1599.
8. den Ouden HE, Friston KJ, Daw ND, McIntosh AR, Stephan KE, (2009) A dual role for prediction error in associative learning. Cereb Cortex 19: 1175-1185.
9. Rushworth MF, Mars RB, Summerfield C, (2009) General mechanisms for making decisions? Curr Opin Neurobiol 19: 75-83.
10. Summerfield C, Koechlin E, (2008) A neural representation of prior information during perceptual inference. Neuron 59: 336-347.
11. Daw ND, Niv Y, Dayan P, (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8: 1704-1711.
12. Payzan-LeNestour E, Bossaerts P, (2011) Risk, unexpected uncertainty, and estimation uncertainty: Bayesian learning in unstable settings. PLoS Comput Biol 7: e1001048 doi:10.1371/journal.pcbi.1001048.
13. Knight FH (1921) Risk, uncertainty and profit. Boston: Hart, Schaffner and Marx.
14. Assmus A, Marshall JC, Ritzl A, Noth J, Zilles K, et al. (2003) Left inferior parietal cortex integrates time and space during collision judgments. Neuroimage 20 (Suppl 1) (): S82-88.
15. O'Reilly JX, Mesulam MM, Nobre AC, (2008) The cerebellum predicts the timing of perceptual events. J Neurosci 28: 2252-2260.
16. Miall RC, Weir DJ, Wolpert DM, Stein JF, (1993) Is the cerebellum a smith predictor? J Mot Behav 25: 203-216.
17. Miall RC, (1998) The cerebellum, predictive control and motor coordination. Novartis Found Symp 218: 272-284; discussion 284-290.
18. Noonan MP, Kolling N, Walton ME, Rushworth MF, (2012) Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement. Eur J Neurosci 35: 997-1010.
19. Noonan MP, Walton ME, Behrens TE, Sallet J, Buckley MJ, et al. (2010) Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci U S A 107: 20547-20552.
20. Walton ME, Behrens TE, Noonan MP, Rushworth MF, (2011) Giving credit where credit is due: orbitofrontal cortex and valuation in an uncertain world. Ann N Y Acad Sci 1239: 14-24.
21. Coull JT, Vidal F, Nazarian B, Macar F, (2004) Functional anatomy of the attentional modulation of time estimation. Science 303: 1506-1508.
22. Vandenberghe R, Gitelman DR, Parrish TB, Mesulam MM, (2001) Location- or feature-based targeting of peripheral attention. Neuroimage 14: 37-47.
23. Lau HC, Rogers RD, Haggard P, Passingham RE, (2004) Attention to intention. Science 303: 1208-1210.
24. O'Craven KM, Downing PE, Kanwisher N, (1999) fMRI evidence for objects as the units of attentional selection. Nature 401: 584-587.
25. Serences JT, Schwarzbach J, Courtney SM, Golay X, Yantis S, (2004) Control of object-based attention in human cortex. Cereb Cortex 14: 1346-1357.
26. Clower DM, Dum RP, Strick PL, (2005) Basal ganglia and cerebellar inputs to 'AIP'. Cereb Cortex 15: 913-920.
27. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ, (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38: 329-337.
28. Rangel A, Camerer C, Montague PR, (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9: 545-556.
29. Rushworth MF, Behrens TE, (2008) Choice, uncertainty and value in prefrontal and cingulate cortex. Nat Neurosci 11: 389-397.
30. Summerfield C, Egner T, Greene M, Koechlin E, Mangels J, et al. (2006) Predictive codes for forthcoming perception in the frontal cortex. Science 314: 1311-1314.
31. Summerfield C, Trittschuh EH, Monti JM, Mesulam MM, Egner T, (2008) Neural repetition suppression reflects fulfilled perceptual expectations. Nat Neurosci 11: 1004-1006.
32. Kok P, Jehee JF, de Lange FP, (2012) Less is more: expectation sharpens representations in the primary visual cortex. Neuron 75: 265-270.
33. Grill-Spector K, Kushnir T, Edelman S, Avidan G, Itzchak Y, et al. (1999) Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24: 187-203.
34. Kourtzi Z, Kanwisher N, (2001) Representation of perceived object shape by the human lateral occipital complex. Science 293: 1506-1509.
35. Lestou V, Pollick FE, Kourtzi Z, (2008) Neural substrates for action understanding at different description levels in the human brain. J Cogn Neurosci 20: 324-341.
36. Dehaene S, Naccache L, Cohen L, Bihan DL, Mangin JF, et al. (2001) Cerebral mechanisms of word masking and unconscious repetition priming. Nat Neurosci 4: 752-758.
37. Naccache L, Dehaene S, (2001) The priming method: imaging unconscious repetition priming reveals an abstract representation of number in the parietal lobes. Cereb Cortex 11: 966-974.
38. Cavada C, Goldman-Rakic PS, (1989) Posterior parietal cortex in rhesus monkey: I. Parcellation of areas based on distinctive limbic and sensory corticocortical connections. J Comp Neurol 287: 393-421.
39. Lewis JW, Van Essen DC, (2000) Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J Comp Neurol 428: 112-137.
40. Cavada C, Goldman-Rakic PS, (1989) Posterior parietal cortex in rhesus monkey: II. Evidence for segregated corticocortical networks linking sensory and limbic areas with the frontal lobe. J Comp Neurol 287: 422-445.
41. Diedrichsen J, Hashambhoy Y, Rane T, Shadmehr R, (2005) Neural correlates of reach errors. J Neurosci 25: 9919-9931.
42. Duhamel JR, Colby CL, Goldberg ME, (1992) The updating of the representation of visual space in parietal cortex by intended eye movements. Science 255: 90-92.
43. Cerminara NL, Apps R, Marple-Horvat DE, (2009) An internal model of a moving visual target in the lateral cerebellum. J Physiol 587: 429-442.
44. Noonan MP, Mars RB, Rushworth MF, (2011) Distinct roles of three frontal cortical areas in reward-guided behavior. J Neurosci 31: 14399-14412.
45. Vilares I, Howard JD, Fernandes HL, Gottfried JA, Kording KP, (2012) Differential representations of prior and likelihood uncertainty in the human brain. Curr Biol 22: 1641-1648.
46. Singer W, Freeman B, Rauschecker J, (1981) Restriction of visual experience to a single orientation affects the organization of orientation columns in cat visual cortex. A study with deoxyglucose. Exp Brain Res 41: 199-215.
47. Thompson ID, Kossut M, Blakemore C, (1983) Development of orientation columns in cat striate cortex revealed by 2-deoxyglucose autoradiography. Nature 301: 712-715.
48. Mesgarani N, David SV, Fritz JB, Shamma SA, (2008) Phoneme representation and classification in primary auditory cortex. J Acoust Soc Am 123: 899-909.
49. Steinschneider M, Fishman YI, Arezzo JC, (2003) Representation of the voice onset time (VOT) speech parameter in population responses within primary auditory cortex of the awake monkey. J Acoust Soc Am 114: 307-321.
50. David SV, Fritz JB, Shamma SA, (2012) Task reward structure shapes rapid receptive field plasticity in auditory cortex. Proc Natl Acad Sci U S A 109: 2144-2149.
51. Sul JH, Jo S, Lee D, Jung MW, (2011) Role of rodent secondary motor cortex in value-based action selection. Nat Neurosci 14: 1202-1208.
52. Wunderlich K, Rangel A, O'Doherty JP, (2009) Neural computations underlying action-based decision making in the human brain. Proc Natl Acad Sci U S A 106: 17199-17204.
53. Culham JC, Valyear KF, (2006) Human parietal cortex in action. Curr Opin Neurobiol 16: 205-212.
54. Mulliken GH, Musallam S, Andersen RA, (2008) Forward estimation of movement state in posterior parietal cortex. Proc Natl Acad Sci U S A 105: 8170-8177.
55. Louie K, Glimcher PW, (2010) Separating value from choice: delay discounting activity in the lateral intraparietal area. J Neurosci 30: 5498-5507.
56. Platt ML, Glimcher PW, (1999) Neural correlates of decision variables in parietal cortex. Nature 400: 233-238.
57. Sugrue LP, Corrado GS, Newsome WT, (2004) Matching behavior and the representation of value in the parietal cortex. Science 304: 1782-1787.
58. Yang T, Shadlen MN, (2007) Probabilistic reasoning by neurons. Nature 447: 1075-1080.
59. Glascher J, Daw N, Dayan P, O'Doherty JP, (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66: 585-595.
60. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ, (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69: 1204-1215.
61. Deichmann R, Gottfried JA, Hutton C, Turner R, (2003) Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19: 430-441.
62. Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, et al. (2004) Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 23 (Suppl 1) (): S208-219.
63. Worsley KJ (2001) Statistical analysis of activation images. In: Jezzard P, Matthews PM, Smith SM, editors. Functional MRI: An introduction to methods. Oxford: Oxford University Press.
64. Cox RW, (1996) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29: 162-173.
65. Kringelbach ML, Rolls ET, (2004) The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog Neurobiol 72: 341-372.