Model averaging, optimal inference, and habit formation

Frontiers in Human Neuroscience

Volumn 8, Issue JUNE, 2014, Pages

  FitzGerald, Thomas H B ^a   Dolan, Raymond J ^a   Friston, Karl J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Active inference; Bayesian inference; Habit; Interference effect; Predictive coding

Indexed keywords

ACCURACY; ARTICLE; BAYES THEOREM; BRAIN FUNCTION; COGNITION; CONCEPTUAL FRAMEWORK; HABIT; HUMAN; INFORMATION PROCESSING; MATHEMATICAL MODEL; MOTIVATION; PREDICTION;

EID: 84903463632     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00457     Document Type: Article

References (125)

1. Acuña, D. E., and Schrater, P. (2010). Structure learning in human sequential decision-making. PLoS Comput. Biol. 6:e1001003. doi: 10.1371/jour-nal.pcbi.1001003
2. Adams, C., and Dickinson, A. (1981). Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. 33, 109-121. doi: 10.1080/14640748108400816
3. Adams, R. A., Stephan, K. E., Brown, H. R., Frith, C. D., and Friston, K. J. (2013). The computational anatomy of psychosis. Front. Psychiatry 4:47. doi: 10.3389/fpsyt.2013.00047
4. Attias, H. (2000). A variational Bayesian framework for graphical models. Adv. Neural Inf. Process. Syst. 12, 209-215.
5. Bach, D. R., and Dolan, R. J. (2012). Knowing how much you don't know: a neural organization of uncertainty estimates. Nat. Rev. Neurosci. 13, 572-586. doi: 10.1038/nrn3289
6. Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., and Friston, K. J. (2012). Canonical microcircuits for predictive coding. Neuron 76, 695-711. doi: 10.1016/j.neuron.2012.10.038
7. Beal, M. J. (2003). Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, University of London, London.
8. Beal, M. J., and Ghahramani, Z. (2003). The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures. Bayesian Stat. 7, 453-464.
9. Berkes, P., Orban, G., Lengyel, M., and Fiser, J. (2011). Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331, 83-87. doi: 10.1126/science.1195870
10. Bernácer, J., Balderas, G., Martinez-Valbuena, I., Pastor, M. A., and Murillo, J. I. (2014). The problem of consciousness in habitual decision making. Behav. Brain Sci. 37, 21-22. doi: 10.1017/S0140525X13000642
11. Bernácer, J., and Giménez-Amaya, J. (2013). "On habit learning in neuroscience and free will," in Is Science Compatible with Free Will? eds A. Suarez and P. Adams (New York, NY: Springer New York), 177-193. doi: 10.1007/978-1-4614-5212-6_12
12. Bertelson, P., Vroomen, J., de Gelder, B., and Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept. Psychophys. 62, 321-332. doi: 10.3758/BF03205552
13. Bishop, C. M. (2006). Pattern Recognition and Machine Learning. New York, NY: Springer.
14. Blum, K., and Abbott, L. (1996). A model of spatial map formation in the hippocampus of the rat. Neural Comput. 8, 85-93. doi: 10.1162/neco.1996.8.1.85
15. Braun, D. A., Mehring, C., and Wolpert, D. D. M. (2010). Structure learning in action. Behav. Brain Res. 206, 157-165. doi: 10.1016/j.bbr.2009.08.031
16. Brown, A., and Kane, M. (1988). Preschool children can learn to transfer: learning to learn and learning from example. Cogn. Psychol. 20, 493-523.
17. Brown, H., Adams, R. A., Parees, I., Edwards, M., and Friston, K. (2013). Active inference, sensory attenuation and illusions. Cogn. Process 14, 411-427. doi: 10.1007/s10339-013-0571-3
18. Brown, H., and Friston, K. J. (2012). Free-energy and illusions: the cornsweet effect. Front. Psychol. 3:43. doi: 10.3389/fpsyg.2012.00043
19. Camerer, C. F., Ho, T.-H., and Chong, J.-K. (2004). A cognitive hierarchy model of games. Q. J. Econ. 119, 861-898. doi: 10.1162/0033553041502225
20. Clark, A. (2012). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 36, 181-204. doi: 10.1017/S0140525X12000477
21. Collins, A., and Koechlin, E. (2012). Reasoning, learning, and creativity: frontal lobe function and human decision-making. PLoS Biol. 10:e1001293. doi:10.1371/journal.pbio.1001293
22. Coricelli, G., and Nagel, R. (2009). Neural correlates of depth of strategic reasoning in medial prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 106, 9163-9168. doi:10.1073/pnas.0807721106
23. Courville, A., Daw, N. D., and Touretzky, D. S. (2005). Similarity and discrimination in classical conditioning: a latent variable account. Adv. Neural Inf. Process. Syst. 17, 313-320.
24. Courville, A., Daw, N. D., Touretzky, D. S., and Gordon, G. J. (2003). Model uncertainty in classical conditioning. Adv. Neural Inf. Process. Syst. 16, 977-984.
25. Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., and Dolan, R. J. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron 69, 1204-1215. doi: 10.1016/j.neuron.2011.02.027
26. Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711. doi: 10.1038/nn1560
27. Dayan, P. (1998). A hierarchical model of binocular rivalry. Neural Comput. 10, 1119-1135. doi: 10.1162/089976698300017377
28. Dayan, P. (2008). "The role of value systems in decision making," in Better than Conscious? Decision Making, the Human Mind, and Implications for Institutions, eds C. Engel and W. Singer (Frankfurt: MIT Press), 51-70.
29. Dayan, P., Hinton, G. E., Neal, R., and Zemel, R. (1995). The Helmholtz machine. Neural Comput. 7, 889-904. doi: 10.1162/neco.1995.7.5.889
30. Deneve, S., and Pouget, A. (2004). Bayesian multisensory integration and cross-modal spatial links. J. Physiol. Paris 98, 249-258. doi:10.1016/j.jphysparis.2004.03.011
31. Dolan, R. J., and Dayan, P. (2013). Goals and habits in the brain. Neuron 80, 312-325. doi: 10.1016/j.neuron.2013.09.007
32. Duncan, C. (1960). Description of learning to learn in human subjects. Am. J. Psychol. 73, 108-114. doi: 10.2307/1419121
33. Dyson, F., Eddington, A., and Davidson, C. (1920). A determination of the deflection of light by the sun's gravitational field, from observations made at the total eclipse of May 29, 1919. Philos. Trans. R. Soc. Lond. A 220, 291-333. doi:10.1098/rsta.1920.0009
34. Efron, B., and Morris, C. (1973). Stein's estimation rule and its competitors-an empirical Bayes approach. J. Am. Stat. Assoc. 68, 117-130. doi: 10.1080/01621459.1973.10481350
35. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and hap-tic information in a statistically optimal fashion. Nature 415, 429-433. doi:10.1038/415429a
36. Feldman, H., and Friston, K. J. (2010). Attention, uncertainty, and free-energy. Front. Hum. Neurosci. 4:215. doi: 10.3389/fnhum.2010.00215
37. Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1-47. doi: 10.1093/cercor/1.1.1
38. Feynman, R. P. (1964). "The principle of least action," in The Feynman Lectures on Physics, Vol. 2, eds R. P. Feynman, R. B. Leighton, and M. Sands (Reading, MA: Addison-Wesley), 19-1-19-14.
39. Fiser, J., Berkes, P., Orbán, G., and Lengyel, M. (2010). Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn. Sci. 14, 119-130. doi: 10.1016/j.tics.2010.01.003
40. Fletcher, P., and Frith, C. (2008). Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia. Nat. Rev. Neurosci. 10, 48-58. doi: 10.1038/nrn2536
41. Friston, K. (2005). A theory of cortical responses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 815-836. doi: 10.1098/rstb.2005.1622
42. Friston, K. (2008). Hierarchical models in the brain. PLoS Comput. Biol. 4:e1000211. doi: 10.1371/journal.pcbi.1000211
43. Friston, K. (2011). What is optimal about motor control? Neuron 72, 488-498. doi: 10.1016/j.neuron.2011.10.018
44. Friston, K. (2012). A free energy principle for biological systems. Entropy 14, 2100-2121. doi: 10.3390/e14112100
45. Friston, K., Adams, R., Perrinet, L., and Breakspear, M. (2012a). Perceptions as hypotheses: saccades as experiments. Front. Psychol. 3:151. doi: 10.3389/fpsyg.2012.00151
46. Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., and Penny, W. (2007). Variational free energy and the Laplace approximation. Neuroimage 34, 220-234. doi: 10.1016/j.neuroimage.2006.08.035
47. Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., and Dolan, R. J. (2013). The anatomy of choice: active inference and agency. Front. Hum. Neurosci. 7:598. doi: 10.3389/fnhum.2013.00598
48. Friston, K., Trujillo-Barreto, N., and Daunizeau, J. (2008). DEM: a vari-ational treatment of dynamic systems. Neuroimage 41, 849-885. doi: 10.1016/j.neuroimage.2008.02.054
49. Friston, K. J. (2010). The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127-138. doi: 10.1038/nrn2787
50. Friston, K. J., Shiner, T., FitzGerald, T., Galea, J. M., Adams, R., Brown, H., et al. (2012b). Dopamine, affordance and active inference. PLoS Comput. Biol. 8:e1002327. doi: 10.1371/journal.pcbi.1002327
51. Gershman, S., and Blei, D. (2012). A tutorial on Bayesian nonparametric models. J. Math. Psychol. 56, 1-12. doi: 10.1016/j.jmp.2011.08.004
52. Gershman, S. J., and Niv, Y. (2012). Exploring a latent cause theory of classical conditioning. Learn. Behav. 40, 255-268. doi: 10.3758/s13420-012-0080-8
53. Gershman, S. J., Vul, E., and Tenenbaum, J. B. (2012). Multistability and perceptual inference. Neural Comput. 24, 1-24. doi: 10.1162/NECO_a_00226
54. Graybiel, A. (2008). Habits, rituals, and the evaluative brain. Annu. Rev. Neurosci. 31, 359-387. doi: 10.1146/annurev.neuro.29.051605.112851
55. Gregory, R. L. (1980). Perceptions as hypotheses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 290, 181-197. doi: 10.1098/rstb.1980.0090
56. Guitart-Masip, M., Fuentemilla, L., Bach, D. R., Huys, Q. J. M., Dayan, P., Dolan, R. J., et al. (2011). Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain. J. Neurosci. 31, 7867-7875. doi:10.1523/JNEUROSCI.6376-10.2011
57. Halford, G., Bain, J., Maybery, M., and Andrews, G. (1998). Induction of relational schemas: common processes in reasoning and complex learning. Cogn. Psychol. 35, 201-245. doi: 10.1006/cogp.1998.0679
58. Harlow, H. (1949). The formation of learning sets. Psychol. Rev. 56, 51-65. doi: 10.1037/h0062474
59. Haruno, M., Wolpert, D. M., and Kawato, M. (2001). MOSAIC model for sensorimotor learning and control. Neural Comput. 13, 2201-2220. doi: 10.1162/089976601750541778
60. Hatfield, T., and Han, J. (1996). Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforce devaluation effects. J. Neurosci. 16, 5256-5265.
61. Heckerman, D. (1998). "A tutorial on learning with Bayesian networks," in Learning in Graphical Models, ed M. I. Jordan (Dordrecht: Kluwer Academic), 301-354.
62. Hobson, J. A., and Friston, K. J. (2012). Waking and dreaming consciousness: neurobiological and functional considerations. Prog. Neurobiol. 98, 82-98. doi: 10.1016/j.pneurobio.2012.05.003
63. Hoeting, J., Madigan, D., Raftery, A., and Volinsky, C. (1999). Bayesian model averaging: a tutorial. Stat. Sci. 14, 382-417.
64. Hohwy, J., Roepstorff, A., and Friston, K. (2008). Predictive coding explains binocular rivalry: an epistemological review. Cognition 108, 687-701. doi: 10.1016/j.cognition.2008.05.010
65. Hultsch, D. (1974). Learning to learn in adulthood. J. Gerontol. 29, 302-309. doi: 10.1093/geronj/29.3.302
66. Huys, Q. J. M., Cools, R., Gölzer, M., Friedel, E., Heinz, A., Dolan, R. J., et al. (2011). Disentangling the roles of approach, activation and valence in instrumental and Pavlovian responding. PLoS Comput. Biol. 7:e1002028. doi: 0.1371/jour-nal.pcbi.1002028
67. Izquierdo, A., Suda, R., and Murray, E. (2004). Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24, 7540-7548. doi: 10.1523/JNEUROSCI. 1921-04.2004
68. Jacobs, R. A. (1995). Methods for combining experts' probability assessments. Neural Comput. 7, 867-888. doi: 10.1162/neco.1995.7.5.867
69. Jacobs, R. A., Jordan, M. I., and Barto, A. G. (1991a). Task decomposition through competition in a modular connectionist architecture: the what and where vision tasks. Cogn. Sci. 15, 219-250. doi: 10.1207/s15516709cog1502_2
70. Jacobs, R. A., Jordan, M. I., Nowlan, S. J., and Hinton, G. E. (1991b). Adaptive mixtures of local experts. Neural Comput. 3, 79-87. doi: 10.1162/neco.1991.3.1.79
71. Jefferys, W., and Berger, J. (1992). Ockham's razor and Bayesian analysis. Am. Sci. 80, 64-72.
72. Jordan, M. I., and Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Comput. 6, 181-214. doi: 10.1162/neco.1994.6.2.181
73. Kahneman, D. (2003). Maps of bounded rationality: psychology for behavioral economics. Am. Econ. Rev. 93, 1449-1475. doi: 10.1257/000282803322 655392
74. Kaila, V. R., and Annila, A. (2008). Natural selection for least action. Proc. R. Soc. A Math. Phys. Eng. Sci. 464, 3055-3070. doi: 10.1098/rspa.2008.0178
75. Kemp, C., and Tenenbaum, J. B. (2008). The discovery of structural form. Proc. Natl. Acad. Sci. U.S.A. 105, 10687-10692. doi: 10.1073/pnas.0802631105
76. Kiebel, S. J., Daunizeau, J., and Friston, K. J. (2008). A hierarchy of time-scales and the brain. PLoS Comput. Biol. 4:e1000209. doi: 10.1371/journal.pcbi.1000209
77. Koechlin, E., and Summerfield, C. (2007). An information theoretical approach to prefrontal executive function. Trends Cogn. Sci. 11, 229-235. doi: 10.1016/j.tics. 2007.04.005
78. Langbein, J., and Siebert, K. (2007). Learning to learn during visual discrimination in group housed dwarf goats (Capra hircus). J. Comp. Psychol. 121, 447-456. doi: 10.1037/0735-7036.121.4.447
79. Laughlin, S., van Steveninck, R., and Anderson, J. (1998). The metabolic cost of neural information. Nat. Neurosci. 1, 36-41. doi: 10.1038/236
80. Lee, A., Duman, R., and Pittenger, C. (2008). A double dissociation revealing bidirectional competition between striatum and hippocampus during learning. Proc. Natl. Acad. Sci. U.S.A. 105, 17163-17168. doi: 10.1073/pnas.0807749105
81. Lee, S. W., Shimojo, S., and O'Doherty, J. P. (2014). Neural computations underlying arbitration between model-based and model-free learning. Neuron 81, 687-699. doi: 10.1016/j.neuron.2013.11.028
82. MacKay, D. (1992). Bayesian interpolation. Neural Comput. 4, 415-447. doi: 10.1162/neco.1992.4.3.415
83. Madigan, D., and Raftery, A. (1994). Model selection and accounting for model uncertainty in graphical models using Occam's window. J. Am. Stat. Assoc. 89, 153. doi: 10.1080/01621459.1994.10476894
84. Markov, N. T., and Kennedy, H. (2013). The importance of being hierarchical. Curr. Opin. Neurobiol. 23, 194-187. doi: 10.1016/j.conb.2012.12.008
85. McGurk, H., and MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748. doi: 10.1038/264746a0
86. Monsell, S. (2003). Task switching. Trends Cogn. Sci. 7, 134-140. doi: 10.1016/S1364-6613(03)00028-7
87. Moors, A., and De Houwer, J. (2006). Automaticity: a theoretical and conceptual analysis. Psychol. Bull. 132, 297-326. doi: 10.1037/0033-2909.132.2.297
88. Moran, R. J., Campo, P., Symmonds, M., Stephan, K. E., Dolan, R. J., and Friston, K. J. (2013). Free energy, precision and learning: the role of cholinergic neu-romodulation. J. Neurosci. 33, 8227-8236. doi: 10.1523/JNEUROSCI.4255-12.2013
89. Mumford, D. (1992). On the computational architecture of the neocortex. Biol. Cybern. 66, 241-251. doi: 10.1007/BF00198477
90. Needham, C. J., Bradford, J. R., Bulpitt, A. J., and Westhead, D. R. (2007). A primer on learning in Bayesian networks for computational biology. PLoS Comput. Biol. 3:e129. doi: 10.1371/journal.pcbi.0030129
91. Ortega, P., and Braun, D. (2013). Thermodynamics as a theory of decision-making with information-processing costs. Proc. R. Soc. A 469. doi: 10.1098/rspa.2012.0683
92. Otto, A. R., Gershman, S. J., Markman, A. B., and Daw, N. D. (2013). The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol. Sci. 24, 751-761. doi: 10.1177/09567976 12463080
93. Penny, W. D., Mattout, J., and Trujillo-Barreto, N. (2007). "Bayesian model selection and averaging," in Statistical Parametric Mapping: The Analysis of Functional Brain Images, eds K. J. Friston, J. T. Ashburner, S. J. Kiebel, T. E. Nichols, and W. D. Penny (London: Elsevier), 454-470.
94. Penny, W. D., Zeidman, P., and Burgess, N. (2013). Forward and backward inference in spatial cognition. PLoS Comput. Biol. 9:e1003383. doi: 10.1371/jour-nal.pcbi.1003383
95. Pickens, C. L., Saddoris, M. P., Setlow, B., Gallagher, M., Holland, P. C., and Schoenbaum, G. (2003). Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J. Neurosci. 23, 11078-11084.
96. Rao, R. P., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87. doi: 10.1038/4580
97. Rasmussen, C., and Ghahramani, Z. (2002). Infinite mixtures of Gaussian process experts. Adv. Neural Inf. Process. Syst. 14, 881-888.
98. Salat, D. H., Buckner, R. L., Snyder, A. Z., Greve, D. N., Desikan, R. S. R., Busa, E., et al. (2004). Thinning of the cerebral cortex in aging. Cereb. Cortex 14, 721-730. doi: 10.1093/cercor/bhh032
99. Schrier, A. (1984). Learning how to learn: the significance and current status of learning set formation. Primates 25, 95-102. doi: 10.1007/BF02382299
100. Sengupta, B., Stemmler, M. B., and Friston, K. J. (2013). Information and efficiency in the nervous system-a synthesis. PLoS Comput. Biol. 9:e1003157. doi: 10.1371/journal.pcbi.1003157
101. Shams, L., Ma, W. J., and Beierholm, U. (2005). Sound-induced flash illusion as an optimal percept. Neuroreport 16, 1923-1927. doi: 10.1097/01.wnr.0000187634.68504.bb
102. Simon, H. (1972). Theories of bounded rationality. Decis. Organ. 1, 161-176.
103. Simon, J., Proctor, R., and Reeve, T. (1990). "The effects of an irrelevant directional cue on human information processing," in Stimulus-Response Compatibility: An Integrated Perspective, eds R. Proctor and T. Reeve (Amsterdam: Elsevier), 31-86.
104. Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N., and Dolan, R. J. (2013). Disruption of dorsolateral prefrontal cortex decreases model-based in favour of model-free control in humans. Neuron 80, 914-919. doi: 10.1016/j.neuron.2013.08.009
105. Stahl, D. O., and Wilson, P. W. (1995). On players' models of other players: theory and experimental evidence. Games Econ. Behav. 10, 218-254. doi: 10.1006/game.1995.1031
106. Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., and Friston, K. J. (2009). Bayesian model selection for group studies. Neuroimage 46, 1004-1017. doi:10.1016/j.neuroimage.2009.03.025
107. Sterzer, P., Kleinschmidt, A., and Rees, G. (2009). The neural bases of multistable perception. Trends Cogn. Sci. 13, 310-318. doi: 10.1016/j.tics.2009.04.006
108. Stroop, J. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643-662. doi: 10.1037/h0054651
109. Summerfield, C., Behrens, T. E., and Koechlin, E. (2011). Perceptual classification in a rapidly changing environment. Neuron 71, 725-736. doi: 10.1016/j.neuron.2011.06.022
110. Summerfield, C., and Egner, T. (2009). Expectation (and attention) in visual cognition. Trends Cogn. Sci. 13, 403-409. doi: 10.1016/j.tics.2009.06.003
111. Tenenbaum, J. B., Kemp, C., Griffiths, T. L., and Goodman, N. D. (2011). How to grow a mind: statistics, structure, and abstraction. Science 331, 1279-1285. doi: 10.1126/science.1192788
112. Tipper, S. P., Howard, L. A., and Jackson, S. R. (1997). Selective reaching to grasp: evidence for distractor interference effects. Vis. Cogn. 4, 1-38. doi: 10.1080/713756749
113. Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., et al. (2007). Schemas and memory consolidation. Science 316, 76-82. doi: 10.1126/science.1135935
114. Tucker, M., and Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychol. (Amst.) 116, 185-203. doi: 10.1016/j.actpsy.2004.01.004
115. van Kesteren, M. T. R., Ruiter, D. J., Fernández, G., and Henson, R. N. (2012). How schema and novelty augment memory formation. Trends Neurosci. 35, 211-219. doi: 10.1016/j.tins.2012.02.001
116. Wallis, J., Anderson, K., and Miller, E. (2001). Single neurons in prefrontal cortex encode abstract rules. Nature 411, 953-956. doi: 10.1038/35082081
117. Weiss, Y., Simoncelli, E. P., and Adelson, E. H. (2002). Motion illusions as optimal percepts. Nat. Neurosci. 5, 598-604. doi: 10.1038/nn0602-858
118. Welsh, T., and Elliott, D. (2004). Movement trajectories in the presence of a distracting stimulus: evidence for a response activation model of selective reaching. Q. J. Exp. Psychol. A 57, 1031-1057. doi: 10.1080/02724980343000666
119. Wunderlich, K., Dayan, P., and Dolan, R. J. (2012a). Mapping value based planning and extensively trained choice in the human brain. Nat. Neurosci. 15, 786-791. doi: 10.1038/nn.3068
120. Wunderlich, K., Smittenaar, P., and Dolan, R. (2012b). Dopamine enhances model-based over model-free choice behavior. Neuron 75, 418-424. doi: 10.1016/j.neuron.2012.03.042
121. Yin, H., and Knowlton, B. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476. doi: 10.1038/nrn1919
122. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 19, 181-189. doi: 10.1111/j.1460-9568.2004. 03095.x
123. Yoshida, W., Dolan, R. J., and Friston, K. J. (2008). Game theory of mind. PLoS Comput. Biol. 4:e1000254. doi: 10.1371/journal.pcbi.1000254
124. Yu, A. J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681-692. doi: 10.1016/j.neuron.2005.04.026
125. Zeki, S., Watson, J., and Lueck, C. (1991). A direct demonstration of functional specialization in human visual cortex. J. Neurosci. 11, 641-649.