Transcranial direct current stimulation over the left prefrontal cortex increases randomness of choice in instrumental learning

Cortex

Volumn 63, Issue , 2015, Pages 145-154

  Turi, Zsolt ^a   Mittner, Matthias ^b   Opitz, Alexander ^a   Popkes, Miriam ^a   Paulus, Walter ^a   Antal, Andrea ^a  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

^b UNIVERSITY OF TROMSØ   (Norway)

Author keywords

Dorsolateral prefrontal cortex; Exploitation; Exploration; Probabilistic learning task; Transcranial direct current stimulation; Working memory

Indexed keywords

SEX HORMONE;

ADAPTIVE BEHAVIOR; ADULT; ARTICLE; BAYES THEOREM; CHOICE RANDOMNESS; CONTROLLED STUDY; DECISION MAKING; DOUBLE BLIND PROCEDURE; FACIAL EXPRESSION; FINITE ELEMENT ANALYSIS; HUMAN; HUMAN EXPERIMENT; INSTRUMENTAL LEARNING; LEARNING; MALE; MENTAL TASK; NEGATIVE FEEDBACK; NEUROMODULATION; NORMAL HUMAN; POSITIVE FEEDBACK; PREFRONTAL CORTEX; PUNISHMENT; QUESTIONNAIRE; RESPONSE TIME; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE; TRANSCRANIAL DIRECT CURRENT STIMULATION; WORKING MEMORY; INSTRUMENTAL CONDITIONING; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; YOUNG ADULT;

ADULT; CHOICE BEHAVIOR; CONDITIONING, OPERANT; DOUBLE-BLIND METHOD; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; PREFRONTAL CORTEX; TRANSCRANIAL DIRECT CURRENT STIMULATION; YOUNG ADULT;

EID: 84907710763     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2014.08.026     Document Type: Article

References (40)

1. Ambrus G.G., Al-Moyed H., Chaieb L., Sarp L., Antal A., Paulus W. The fade-in - short stimulation - fade out approach to sham tDCS - reliable at 1 mA for naive and experienced subjects, but not investigators. Brain Stimulation 2012, 5(4):499-504.
2. Ambrus G.G., Zimmer M., Kincses Z.T., Harza I., Kovács G., Paulus W., et al. The enhancement of cortical excitability over the DLPFC before and during training impairs categorization in the prototype distortion task. Neuropsychologia 2011, 49:1974-1980.
3. Beeler J.A., Daw N.D., Frazier C.R.M., Zhuang X. Tonic dopamine modulates exploitation of reward learning. Frontiers in Behavioral Neuroscience 2010, 4:170.
4. Chib V.S., Yun K., Takahashi H., Shimojo S. Noninvasive remote activation of the ventral midbrain by transcranial direct current stimulation of prefrontal cortex. Translational Psychiatry 2013, 3(6):e268. 10.1038/tp.2013.44.
5. Cho S.S., Strafella A.P. rTMS of the left dorsolateral prefrontal cortex modulates dopamine release in the ipsilateral anterior cingulate cortex and orbitofrontal cortex. PloS One 2009, 4(8):e6725.
6. Collins A.G., Frank M.J. How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis. European Journal of Neuroscience 2012, 35(7):1024-1035.
7. Datta A., Elwassif M., Battaglia F., Bikson M. Transcranial current stimulation focality using disc and ring electrode configurations: FEM analysis. Journal of Neural Engineering 2008, 5(2):163-174.
8. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69(6):1204-1215.
9. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 2005, 8(12):1704-1711.
10. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441(7095):876-879.
11. Dayan P., Balleine B.W. Reward, motivation, and reinforcement learning. Neuron 2002, 36(2):285-298. 10.1002/0471214426.pas0303.
12. Dolan R.J., Dayan P. Goals and habits in the brain. Neuron 2013, 80(2):312-325.
13. Dreher J.-C., Schmidt P.J., Kohn P., Furman D., Rubinow D., Berman K.F. Menstrual cycle phase modulates reward-related neural function in women. Proceedings of the National Academy of Sciences 2007, 104(7):2465-2470.
14. Faria P., Hallett M., Miranda P.C. A finite element analysis of the effect of electrode area and inter-electrode distance on the spatial distribution of the current density in tDCS. Journal of Neural Engineering 2011, 8(6):066017. 10.1088/1741-2560/8/6/066017.
15. Frank M.J., Doll B.B., Oas-Terpstra J., Moreno F. Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience 2009, 12(8):1062-1068.
16. Frank M.J., Moustafa A.A., Haughey H.M., Curran T., Hutchison K.E. Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of the National Academy of Sciences 2007, 104(41):16311-16316.
17. Frank M.J., Seeberger L.C., O'Reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004, 306(5703):1940-1943.
18. Gandiga P.C., Hummel F.C., Cohen L.G. Transcranial DC stimulation (tDCS): a tool for double-blind sham-controlled clinical studies in brain stimulation. Clinical Neurophysiology 2006, 117(4):845-850.
19. Holm S. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics 1979, 6(2):65-70.
20. Hunt L.T., Kolling N., Soltani A., Woolrich M.W., Rushworth M.F.S., Behrens T.E.J. Mechanisms underlying cortical activity during value-guided choice. Nature Neuroscience 2012, 15(3):470-476.
21. Jacobson L., Koslowsky M., Lavidor M. tDCS polarity effects in motor and cognitive domains: a meta-analytical review. Experimental Brain Research 2012, 216(1):1-10.
22. Jocham G., Hunt L.T., Near J., Behrens T.E.J. A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex. Nature Neuroscience 2012, 15(7):960-961.
23. Jocham G., Klein T.A., Ullsperger M. Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. The Journal of Neuroscience 2011, 31(5):1606-1613.
24. Ko J.H., Monchi O., Ptito A., Bloomfield P., Houle S., Strafella A.P. Theta burst stimulation-induced inhibition of dorsolateral prefrontal cortex reveals hemispheric asymmetry in striatal dopamine release during a set-shifting task-a TMS-[11C] raclopride PET study. European Journal of Neuroscience 2008, 28(10):2147-2155.
25. Mylius V., Ayache S.S., Ahdab R., Farhat W.H., Zouari H.G., Belke M., et al. Definition of DLPFC and M1 according to anatomical landmarks for navigated brain stimulation: inter-rater reliability, accuracy, and influence of gender and age. NeuroImage 2013, 78:224-232. 10.1016/j.neuroimage.2013.03.061.
26. Nelder J.A., Mead R. A simplex method for function minimization. The Computer Journal 1965, 7(4):308-313. 10.1093/comjnl/7.4.308.
27. Nitsche M.A., Paulus W. Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. The Journal of Physiology 2000, 527(3):633.
28. Nitsche M.A., Paulus W. Sustained excitability elevations induced by transcranial DC motor cortex stimulation in humans. Neurology 2001, 57(10):1899-1901.
29. Opitz A., Windhoff M., Heidemann R.M., Turner R., Thielscher A. How the brain tissue shapes the electric field induced by transcranial magnetic stimulation. NeuroImage 2011, 58(3):849-859. 10.1016/j.neuroimage.2011.06.069.
30. Radman T., Ramos R.L., Brumberg J.C., Bikson M. Role of cortical cell type and morphology in subthreshold and suprathreshold uniform electric field stimulation invitro. Brain Stimulation 2009, 2(4):215-228. 10.1016/j.brs.2009.03.007.
31. Reato D., Gasca F., Datta A., Bikson M., Marshall L., Parra L.C. Transcranial electrical stimulation accelerates human sleep homeostasis. PLoS Computational Biology 2013, 9(2):e1002898. 10.1371/journal.pcbi.1002898.
32. Rutledge R.B., Lazzaro S.C., Lau B., Myers C.E., Gluck M.A., Glimcher P.W. Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. The Journal of Neuroscience 2009, 29(48):15104-15114.
33. Samson R.D., Frank M.J., Fellous J.-M. Computational models of reinforcement learning: the role of dopamine as a reward signal. Cognitive Neurodynamics 2010, 4(2):91-105.
34. Smittenaar P., FitzGerald T.H.B., Romei V., Wright N.D., Dolan R.J. Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron 2013, 80(4):914-919.
35. Stagg C.J., Best J.G., Stephenson M.C., O'Shea J., Wylezinska M., Kincses Z.T., et al. Polarity-sensitive modulation of cortical neurotransmitters by transcranial stimulation. The Journal of Neuroscience 2009, 29(16):5202-5206.
36. Strafella A.P., Paus T., Barrett J., Dagher A. Repetitive transcranial magnetic stimulation of the human prefrontal cortex induces dopamine release in the caudate nucleus. The Journal of Neuroscience 2001, 21(15):RC157.
37. Windhoff M., Opitz A., Thielscher A. Electric field calculations in brain stimulation based on finite elements: an optimized processing pipeline for the generation and usage of accurate individual head models. Human Brain Mapping 2013, 34(4):923-935.
38. Wunderlich K., Smittenaar P., Dolan R.J. Dopamine enhances model-based over model-free choice behavior. Neuron 2012, 75(3):418-424.
39. Xue G., Juan C.H., Chang C.F., Lu Z.L., Dong Q. Lateral prefrontal cortex contributes to maladaptive decisions. Proceedings of the National Academy of Sciences 2012, 109(12):4401-4406.
40. Zaehle T., Sandmann P., Thorne J.D., Jäncke L., Herrmann C.S. Transcranial direct current stimulation of the prefrontal cortex modulates working memory performance: combined behavioural and electrophysiological evidence. BMC Neuroscience 2011, 12(1):2.