In vivo two-photon Ca2+ imaging reveals selective reward effects on stimulus-specific assemblies in mouse visual cortex

Journal of Neuroscience

Volumn 33, Issue 28, 2013, Pages 11540-11555

  Goltstein, Pieter M ^a,b   Coffey, Emily B J ^a   Roelfsema, Pieter R ^c   Pennartz, Cyriel M A ^a,b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CALCIUM ION; CALCIUM;

ACTION POTENTIAL; ANIMAL EXPERIMENT; ARTICLE; CONDITIONING; CONTROLLED STUDY; ELECTROPHYSIOLOGY; EVOKED VISUAL RESPONSE; FLUORESCENCE MICROSCOPY; IN VIVO STUDY; MALE; MOUSE; NONHUMAN; PHOTON; PRIORITY JOURNAL; SCANNING ELECTRON MICROSCOPY; TUNING CURVE; VISUAL CORTEX; VISUAL FIELD; VISUAL ORIENTATION; VISUAL STIMULATION; ANIMAL; C57BL MOUSE; CHEMISTRY; CONFOCAL MICROSCOPY; INSTRUMENTAL CONDITIONING; METABOLISM; METHODOLOGY; MULTIPHOTON MICROSCOPY; PHOTOSTIMULATION; PHYSIOLOGY; RANDOMIZATION; REWARD;

ANIMALS; CALCIUM; CONDITIONING, OPERANT; MALE; MICE; MICE, INBRED C57BL; MICROSCOPY, CONFOCAL; MICROSCOPY, FLUORESCENCE, MULTIPHOTON; PHOTIC STIMULATION; RANDOM ALLOCATION; REWARD; VISUAL CORTEX; VISUAL FIELDS;

EID: 84880421709     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1341-12.2013     Document Type: Article

References (76)

1. Andermann ML, Kerlin AM, Roumis DK, Glickfeld LL, Reid RC (2011) Functional specialization of mouse higher visual cortical areas. Neuron 72:1025-1039. CrossRef Medline
2. Bao S, Chan VT, Merzenich MM (2001) Cortical remodelling induced by activity of ventral tegmental dopamine neurons. Nature 412:79-83. CrossRef Medline
3. Blake DT, Heiser MA, Caywood M, Merzenich MM (2006) Experiencedependent adult cortical plasticity requires cognitive association between sensation and reward. Neuron 52:371-381. CrossRef Medline
4. Bock DD, Lee WC, Kerlin AM, Andermann ML, Hood G, Wetzel AW, Yurgenson S, Soucy ER, Kim HS, Reid RC (2011) Network anatomy and in vivo physiology of visual cortical neurons. Nature 471:177-182. CrossRef Medline
5. Bonin V, Histed MH, Yurgenson S, Reid RC (2011) Local diversity and fine-scale organization of receptive fields in mouse visual cortex. J Neurosci 31:18506-18521. CrossRef Medline
6. Cleland GG, Davey GC (1983) Autoshaping in the rat: the effects of localizable visual and auditory signals for food. J Exp Anal Behav 40:47-56. CrossRef Medline
7. Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36:285-298. CrossRef Medline
8. Dräger UC (1978) Observations on monocular deprivation in mice. J Neurophysiol 41:28-42. Medline
9. Dragoi V, Sharma J, Sur M (2000) Adaptation-induced plasticity of orientation tuning in adult visual cortex. Neuron 28:287-298. CrossRef Medline
10. Dragoi V, Rivadulla C, Sur M (2001) Foci of orientation plasticity in visual cortex. Nature 411:80-86. CrossRef Medline
11. Ekstrom LB, Roelfsema PR, Arsenault JT, Bonmassar G, Vanduffel W (2008) Bottom-up dependent gating of frontal signals in early visual cortex. Science 321:414-417. CrossRef Medline
12. Febvret A, Berger B, Gaspar P, Verney C (1991) Further indication that distinct dopaminergic subsets project to the rat cerebral cortex: lack of colocalization with neurotensin in the superficial dopaminergic fields of the anterior cingulate, motor, retrosplenial and visual cortices. Brain Res 547:37-52. Medline
13. FrankóE, Seitz AR, Vogels R (2010) Dissociable neural effects of long-term stimulus-reward pairing in macaque visual cortex. J Cogn Neurosci 22:1425-1439. CrossRef Medline
14. Frenkel MY, Sawtell NB, Diogo AC, Yoon B, Neve RL, Bear MF (2006) Instructive effect of visual experience in mouse visual cortex. Neuron 51:339-349. CrossRef Medline
15. Garaschuk O, Milos RI, Konnerth A (2006) Targeted bulk-loading of fluorescent indicators for two-photon brain imaging in vivo. Nat Protoc 1:380-386. CrossRef Medline
16. Gavornik JP, Shuler MG, Loewenstein Y, Bear MF, Shouval HZ (2009) Learning reward timing in cortex through reward dependent expression of synaptic plasticity. Proc Natl Acad Sci U S A 106:6826-6831. CrossRef Medline
17. Ghose GM, Yang T, Maunsell JH (2002) Physiological correlates of perceptual learning in monkey v1 and v2. J Neurophysiol 87:1867-1888. Medline
18. Gilbert CD, Li W, Piech V (2009) Perceptual learning and adult cortical plasticity. J Physiol 587:2743-2751. CrossRef Medline
19. Gordon JA, Stryker MP (1996) Experience-dependent plasticity of binocular responses in the primary visual cortex of the mouse. J Neurosci 16: 3274-3286. Medline
20. Guizar-Sicairos M, Thurman ST, Fienup JR (2008) Efficient subpixel image registration algorithms. Opt Lett 33:156-158. CrossRef Medline
21. Harris KD (2005) Neural signatures of cell assembly organization. Nat Rev Neurosci 6:399-407. Medline
22. Hebb DO (1949) The organization of behavior. Wiley, New York.
23. Hernandez-Peon R (1961) Reticular mechanisms of sensory control. In: Sensory communication (Rosenblith WA, ed), pp 497-520. New York: Wiley.
24. Hirsch HV, Spinelli DN (1970) Visual experience modifies distribution of horizontally and vertically oriented receptive fields in cats. Science 168: 869-871. CrossRef Medline
25. Hofer SB, Mrsic-Flogel TD, Bonhoeffer T, Hubener M (2006) Lifelong learning: ocular dominance plasticity in mouse visual cortex. Curr Opin Neurobiol 16:451-459. CrossRef Medline
26. Hofer SB, Mrsic-Flogel TD, Bonhoeffer T, Hubener M (2009) Experience leaves a lasting structural trace in cortical circuits. Nature 457:313-317. CrossRef Medline
27. Hofer SB, Ko H, Pichler B, Vogelstein J, Ros H, Zeng H, Lein E, Lesica NA, Mrsic-Flogel TD (2011) Differential connectivity and response dynamics of excitatory and inhibitory neurons in visual cortex. Nat Neurosci 14:1045-1052. CrossRef Medline
28. Hubel DH, Wiesel TN (1959) Receptive fields of single neurones in the cat's striate cortex. J Physiol 148:574-591. Medline
29. Hubel DH, Wiesel TN (1962) Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J Physiol 160:106-154. Medline
30. Kaas JH, Merzenich MM, Killackey HP (1983) The reorganization of somatosensory cortex following peripheral nerve damage in adult and developing mammals. Annu Rev Neurosci 6:325-356. CrossRef Medline
31. Kaas JH, Krubitzer LA, Chino YM, Langston AL, Polley EH, Blair N (1990) Reorganization of retinotopic cortical maps in adult mammals after lesions of the retina. Science 248:229-231. CrossRef Medline
32. Kalenscher T, Pennartz CM (2008) Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol 84:284-315. CrossRef Medline
33. Kalenscher T, Windmann S, Diekamp B, Rose J, Gunturkun O, Colombo M (2005) Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr Biol 15:594-602. CrossRef Medline
34. Keck T, Mrsic-Flogel TD, Vaz Afonso M, Eysel UT, Bonhoeffer T, Hubener M (2008) Massive restructuring of neuronal circuits during functional reorganization of adult visual cortex. Nat Neurosci 11:1162-1167. CrossRef Medline
35. Kerlin AM, Andermann ML, Berezovskii VK, Reid RC (2010) Broadly tuned response properties of diverse inhibitory neuron subtypes in mouse visual cortex. Neuron 67:858-871. CrossRef Medline
36. Ko H, Hofer SB, Pichler B, Buchanan KA, Sjöström PJ, Mrsic-Flogel TD (2011) Functional specificity of local synaptic connections in neocortical networks. Nature 473:87-91. CrossRef Medline
37. Kreile AK, Bonhoeffer T, Hubener M (2011) Altered visual experience induces instructive changes of orientation preference in mouse visual cortex. J Neurosci 31:13911-13920. CrossRef Medline
38. Lamme VA, Zipser K, Spekreijse H (1998) Figure-ground activity in primary visual cortex is suppressed by anesthesia. Proc Natl Acad Sci U S A 95:3263-3268. CrossRef Medline
39. Li Y, Van Hooser SD, Mazurek M, White LE, Fitzpatrick D (2008) Experience with moving visual stimuli drives the early development of cortical direction selectivity. Nature 456:952-956. CrossRef Medline
40. Li Y, Lu H, Cheng PL, Ge S, Xu H, Shi SH, Dan Y (2012) Clonally related visual cortical neurons show similar stimulus feature selectivity. Nature 486:118-121. Medline
41. Lissek S, Biggs AL, Rabin SJ, Cornwell BR, Alvarez RP, Pine DS, Grillon C (2008) Generalization of conditioned fear-potentiated startle in humans: experimental validation and clinical relevance. Behav Res Ther 46:678-687. CrossRef Medline
42. Liu CH, Heynen AJ, Shuler MG, Bear MF (2008) Cannabinoid receptor blockade reveals parallel plasticity mechanisms in different layers of mouse visual cortex. Neuron 58:340-345. CrossRef Medline
43. Lovibond PF (1983) Facilitation of instrumental behavior by a pavlovian appetitive conditioned stimulus. J Exp Psychol Anim Behav Process 9:225-247. CrossRef Medline
44. Marshel JH, Garrett ME, Nauhaus I, Callaway EM (2011) Functional specialization of seven mouse visual cortical areas. Neuron 72:1040-1054. CrossRef Medline
45. Maunsell JH, Treue S (2006) Feature-based attention in visual cortex. Trends Neurosci 29:317-322. CrossRef Medline
46. Mrsic-Flogel TD, Hofer SB, Ohki K, Reid RC, Bonhoeffer T, Hubener M (2007) Homeostatic regulation of eye-specific responses in visual cortex during ocular dominance plasticity. Neuron 54:961-972. CrossRef Medline
47. Muller CP, Huston JP (2007) Dopamine activity in the occipital and temporal cortices of rats: dissociating effects of sensory but not pharmacological stimulation. Synapse 61:254-258. CrossRef Medline
48. Niell CM, Stryker MP (2008) Highly selective receptive fields in mouse visual cortex. J Neurosci 28:7520-7536. CrossRef Medline
49. Nimmerjahn A, Kirchhoff F, Kerr JN, Helmchen F (2004) Sulforhodamine 101 as a specific marker of astroglia in the neocortex in vivo. Nat Methods 1:31-37. CrossRef Medline
50. Ohki K, Reid RC (2007) Specificity and randomness in the visual cortex. Curr Opin Neurobiol 17:401-407. CrossRef Medline
51. Ohki K, Chung S, Ch'ng YH, Kara P, Reid RC (2005) Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex. Nature 433:597-603. CrossRef Medline
52. Pennartz CM (1997) Reinforcement learning by hebbian synapses with adaptive thresholds. Neuroscience 81:303-319. CrossRef Medline
53. Pennartz CM, McNaughton BL, Mulder AB (2000) The glutamate hypothesis of reinforcement learning. Prog Brain Res 126:231-253. CrossRef Medline
54. Rachlin H, Green L (1972) Commitment, choice and self-control. J Exp Anal Behav 17:15-22. CrossRef Medline
55. Ringach DL, Shapley RM, Hawken MJ (2002) Orientation selectivity in macaque v1: diversity and laminar dependence. J Neurosci 22:5639-5651. Medline
56. Rivera A, Peñafiel A, Megías M, Agnati LF, López-Téllez JF, Gago B, Gutiérrez A, de la Calle A, Fuxe K (2008) Cellular localization and distribution of dopamine d(4) receptors in the rat cerebral cortex and their relationship with the cortical dopaminergic and noradrenergic nerve terminal networks. Neuroscience 155:997-1010. CrossRef Medline
57. Rochefort NL, Narushima M, Grienberger C, Marandi N, Hill DN, Konnerth A (2011) Development of direction selectivity in mouse cortical neurons. Neuron 71:425-432. CrossRef Medline
58. Roelfsema PR (2006) Cortical algorithms for perceptual grouping. Annu Rev Neurosci 29:203-227. CrossRef Medline
59. Roelfsema PR, van Ooyen A (2005) Attention-gated reinforcement learning of internal representations for classification. Neural Comput 17:2176-2214. CrossRef Medline
60. Roelfsema PR, van Ooyen A, Watanabe T (2010) Perceptual learning rules based on reinforcers and attention. Trends Cogn Sci 14:64-71. CrossRef Medline
61. Sawtell NB, Frenkel MY, Philpot BD, Nakazawa K, Tonegawa S, Bear MF (2003) Nmda receptor-dependent ocular dominance plasticity in adult visual cortex. Neuron 38:977-985. CrossRef Medline
62. Schoenbaum G, Chiba AA, Gallagher M (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci 1:155-159. CrossRef Medline
63. Schoups A, Vogels R, Qian N, Orban G (2001) Practising orientation identification improves orientation coding in v1 neurons. Nature 412:549-553. CrossRef Medline
64. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599. CrossRef Medline
65. Seitz AR, Kim D, Watanabe T (2009) Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron 61:700-707. CrossRef Medline
66. Shah RD, Crair MC (2008) Mechanisms of response homeostasis during retinocollicular map formation. J Physiol 586:4363-4369. CrossRef Medline
67. Shuler MG, Bear MF (2006) Reward timing in the primary visual cortex. Science 311:1606-1609. CrossRef Medline
68. Stosiek C, Garaschuk O, Holthoff K, Konnerth A (2003) In vivo two-photon calcium imaging of neuronal networks. Proc Natl Acad Sci US A 100:7319-7324. CrossRef Medline
69. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction, Vol. 28. Cambridge: MIT Press.
70. Svoboda K, Helmchen F, Denk W, Tank DW (1999) Spread of dendritic excitation in layer 2/3 pyramidal neurons in rat barrel cortex in vivo. Nat Neurosci 2:65-73. CrossRef Medline
71. Tropea D, Majewska AK, Garcia R, Sur M (2010) Structural dynamics of synapses in vivo correlate with functional changes during experience-dependent plasticity in visual cortex. J Neurosci 30: 11086-11095. CrossRef Medline
72. van Duuren E, van der Plasse G, Lankelma J, Joosten RN, Feenstra MG, Pennartz CM (2009) Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J Neurosci 29:8965-8976. CrossRef Medline
73. Weinberger NM, Javid R, Lepan B (1993) Long-term retention of learninginduced receptive-field plasticity in the auditory cortex. Proc Natl Acad Sci U S A 90:2394-2398. CrossRef Medline
74. Xu S, Jiang W, Poo MMM, Dan Y (2012) Activity recall in a visual cortical ensemble. Nat Neurosci 15:449-455, S1-2.
75. Yang T, Maunsell JH (2004) The effect of perceptual learning on neuronal responses in monkey visual area v4. J Neurosci 24:1617-1626. CrossRef Medline
76. Zhang X, Zhaoping L, Zhou T, Fang F (2012) Neural activities in v1 create a bottom-up saliency map. Neuron 73:183-192. CrossRef Medline