Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning

PLoS ONE

Volumn 7, Issue 1, 2012, Pages

  Kim, Yunbok ^a   Wood, Jesse ^a   Moghaddam, Bita ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

4 AMINOBUTYRIC ACID; DOPAMINE;

ADAPTIVE BEHAVIOR; ADAPTIVE LEARNING; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; AVERSIVE BEHAVIOR; AVERSIVE LEARNING; BRAIN REGION; CONTROLLED STUDY; DOPAMINERGIC NERVE CELL; FUNCTIONAL ANATOMY; LEARNING; LOCAL FIELD POTENTIAL; MALE; NERVE POTENTIAL; NEUROANATOMY; NONHUMAN; RAT; REWARD; SINGLE UNIT ACTIVITY; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; TASK PERFORMANCE; THETA RHYTHM; VENTRAL TEGMENTUM; ADAPTATION; ANIMAL; APPETITE; AVOIDANCE BEHAVIOR; BIOLOGICAL MODEL; CYTOLOGY; PHYSIOLOGY; SPRAGUE DAWLEY RAT;

RATTUS;

ADAPTATION, BIOLOGICAL; ANIMALS; APPETITE; APPETITIVE BEHAVIOR; ASSOCIATION LEARNING; AVOIDANCE LEARNING; BEHAVIOR, ANIMAL; DOPAMINERGIC NEURONS; LEARNING; MALE; MODELS, BIOLOGICAL; RATS; RATS, SPRAGUE-DAWLEY; REWARD; VENTRAL TEGMENTAL AREA;

EID: 84855420897     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0029766     Document Type: Article

References (62)

1. Schultz W, (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27.
2. Schultz W, Dayan P, Montague PR, (1997) A neural substrate of prediction and reward. Science 275: 1593-1599.
3. Wise RA, (2004) Dopamine, learning and motivation. Nat Rev Neurosci 5: 483-494.
4. Montague PR, Hyman SE, Cohen JD, (2004) Computational roles for dopamine in behavioural control. Nature 431: 760-767.
5. Lisman JE, Grace AA, (2005) The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46: 703-713.
6. Noudoost B, Moore T, (2011) Control of visual cortical signals by prefrontal dopamine. Nature 474: 372-375.
7. Seamans JK, Yang CR, (2004) The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog Neurobiol 74: 1-58.
8. Volkow ND, Fowler JS, Wang GJ, Swanson JM, Telang F, (2007) Dopamine in drug abuse and addiction: results of imaging studies and treatment implications. Arch Neurol 64: 1575-1579.
9. van Os J, Kapur S, (2009) Schizophrenia. Lancet 374: 635-645.
10. Nieoullon A, (2002) Dopamine and the regulation of cognition and attention. Prog Neurobiol 67: 53-83.
11. Lisman JE, Pi HJ, Zhang Y, Otmakhova NA, (2010) A thalamo-hippocampal-ventral tegmental area loop may produce the positive feedback that underlies the psychotic break in schizophrenia. Biol Psychiatry 68: 17-24.
12. Ljungberg T, Apicella P, Schultz W, (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67: 145-163.
13. Horvitz JC, (2000) Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96: 651-656.
14. Pan WX, Schmidt R, Wickens JR, Hyland BI, (2005) Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci 25: 6235-6242.
15. Matsumoto M, Hikosaka O, (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841.
16. Ungless MA, Magill PJ, Bolam JP, (2004) Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303: 2040-2042.
17. Panzeri S, Schultz SR, Treves A, Rolls ET, (1999) Correlations and the encoding of information in the nervous system. Proc Biol Sci 266: 1001-1012.
18. Womelsdorf T, Fries P, (2006) Neuronal coherence during selective attentional processing and sensory-motor integration. J Physiol Paris 100: 182-193.
19. Gawne TJ, Richmond BJ, (1993) How independent are the messages carried by adjacent inferior temporal cortical neurons? J Neurosci 13: 2758-2771.
20. Peters Y, Barnhardt NE, O'Donnell P, (2004) Prefrontal cortical up states are synchronized with ventral tegmental area activity. Synapse 52: 143-152.
21. Fujisawa S, Buzsaki G, (2011) A 4 Hz oscillation adaptively synchronizes prefrontal, VTA, and hippocampal activities. Neuron 72: 153-165.
22. Kim YB, Matthews M, Moghaddam B, (2010) Putative gamma-aminobutyric acid neurons in the ventral tegmental area have a similar pattern of plasticity as dopamine neurons during appetitive and aversive learning. Eur J Neurosci 32: 1564-1572.
23. Zohary E, Shadlen MN, Newsome WT, (1994) Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 370: 140-143.
24. Shadlen MN, Britten KH, Newsome WT, Movshon JA, (1996) A computational analysis of the relationship between neuronal and behavioral responses to visual motion. J Neurosci 16: 1486-1510.
25. Abbott LF, Dayan P, (1999) The effect of correlated variability on the accuracy of a population code. Neural Comput 11: 91-101.
26. Sompolinsky H, Yoon H, Kang K, Shamir M, (2001) Population coding in neuronal systems with correlated noise. Phys Rev E Stat Nonlin Soft Matter Phys 64: 051904.
27. Averbeck BB, Lee D, (2006) Effects of noise correlations on information encoding and decoding. J Neurophysiol 95: 3633-3644.
28. Cohen MR, Kohn A, (2011) Measuring and interpreting neuronal correlations. Nat Neurosci 14: 811-819.
29. van Kan PL, Scobey RP, Gabor AJ, (1985) Response covariance in cat visual cortex. Exp Brain Res 60: 559-563.
30. Jung MW, Qin Y, Lee D, Mook-Jung I, (2000) Relationship among discharges of neighboring neurons in the rat prefrontal cortex during spatial working memory tasks. J Neurosci 20: 6166-6172.
31. Shadlen MN, Newsome WT, (1998) The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci 18: 3870-3896.
32. Kim MJ, Kim YB, Kang KJ, Huh N, Oh JH, et al. (2003) Neuronal interactions are higher in the cortex than thalamus in the somatosensory pathway. Neuroscience 118: 205-216.
33. Fries P, (2005) A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn Sci 9: 474-480.
34. Mirenowicz J, Schultz W, (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379: 449-451.
35. Brischoux F, Chakraborty S, Brierley DI, Ungless MA, (2009) Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc Natl Acad Sci U S A 106: 4894-4899.
36. Bayer HM, Glimcher PW, (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129-141.
37. Matsumoto M, Hikosaka O, (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447: 1111-1115.
38. Glimcher PW, (2011) Quantification of Behavior Sackler Colloquium: Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis. Proc Natl Acad Sci U S A.
39. Wang HP, Spencer D, Fellous JM, Sejnowski TJ, (2010) Synchrony of thalamocortical inputs maximizes cortical reliability. Science 328: 106-109.
40. Narayanan NS, Kimchi EY, Laubach M, (2005) Redundancy and synergy of neuronal ensembles in motor cortex. J Neurosci 25: 4207-4216.
41. Montague PR, Dayan P, Sejnowski TJ, (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16: 1936-1947.
42. Swanson L, (1982) The projection of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Research Bulletin 9: 321-353.
43. Raghavachari S, Kahana MJ, Rizzuto DS, Caplan JB, Kirschen MP, et al. (2001) Gating of human theta oscillations by a working memory task. J Neurosci 21: 3175-3183.
44. van Wingerden M, Vinck M, Lankelma J, Pennartz CM, (2010) Theta-band phase locking of orbitofrontal neurons during reward expectancy. J Neurosci 30: 7078-7087.
45. Paz R, Bauer EP, Pare D, (2008) Theta synchronizes the activity of medial prefrontal neurons during learning. Learn Mem 15: 524-531.
46. DeCoteau WE, Thorn C, Gibson DJ, Courtemanche R, Mitra P, et al. (2007) Learning-related coordination of striatal and hippocampal theta rhythms during acquisition of a procedural maze task. Proc Natl Acad Sci U S A 104: 5644-5649.
47. Huerta PT, Lisman JE, (1993) Heightened synaptic plasticity of hippocampal CA1 neurons during a cholinergically induced rhythmic state. Nature 364: 723-725.
48. Pavlides C, Greenstein YJ, Grudman M, Winson J, (1988) Long-term potentiation in the dentate gyrus is induced preferentially on the positive phase of theta-rhythm. Brain Res 439: 383-387.
49. Greenstein YJ, Pavlides C, Winson J, (1988) Long-term potentiation in the dentate gyrus is preferentially induced at theta rhythm periodicity. Brain Res 438: 331-334.
50. Buzsaki G, Draguhn A, (2004) Neuronal oscillations in cortical networks. Science 304: 1926-1929.
51. Siapas AG, Lubenov EV, Wilson MA, (2005) Prefrontal phase locking to hippocampal theta oscillations. Neuron 46: 141-151.
52. Shi WX, (2005) Slow oscillatory firing: a major firing pattern of dopamine neurons in the ventral tegmental area. J Neurophysiol 94: 3516-3522.
53. Gao M, Liu CL, Yang S, Jin GZ, Bunney BS, et al. (2007) Functional coupling between the prefrontal cortex and dopamine neurons in the ventral tegmental area. J Neurosci 27: 5414-5421.
54. Redgrave P, Gurney K, (2006) The short-latency dopamine signal: a role in discovering novel actions? Nat Rev Neurosci 7: 967-975.
55. Schultz W, (2002) Getting formal with dopamine and reward. Neuron 36: 241-263.
56. Dommett E, Coizet V, Blaha CD, Martindale J, Lefebvre V, et al. (2005) How visual stimuli activate dopaminergic neurons at short latency. Science 307: 1476-1479.
57. Xia Y, Driscoll JR, Wilbrecht L, Margolis EB, Fields HL, et al. (2011) Nucleus accumbens medium spiny neurons target non-dopaminergic neurons in the ventral tegmental area. J Neurosci 31: 7811-7816.
58. Fearnley JM, Lees AJ, (1991) Ageing and Parkinson's disease: substantia nigra regional selectivity. Brain 114 (Pt 5): 2283-2301.
59. Uhlhaas PJ, Singer W, (2010) Abnormal neural oscillations and synchrony in schizophrenia. Nat Rev Neurosci 11: 100-113.
60. Paxinos G, Watson C, (1998) The rat brain in stereotaxic coordinates San Diego Academic Press.
61. Rieke F, Warland D, DeRuyter R, Stevenick V, Bialek W, (1997) Spikes. Exploring the neural code Cambridge MIT Press.
62. Bokil H, Andrews P, Kulkarni JE, Mehta S, Mitra PP, (2010) Chronux: a platform for analyzing neural signals. J Neurosci Methods 192: 146-151.