메뉴 건너뛰기




Volumn , Issue JAN, 2014, Pages

Time representation in reinforcement learning models of the basal ganglia

Author keywords

Basal ganglia; Dopamine; Interval timing; Parkinson's disease; Reinforcement learning

Indexed keywords

ACTION SELECTION; ACTION SELECTION MECHANISM; BASAL GANGLIA; COMPUTATIONAL SYSTEM; DOPAMINE; INTERVAL TIMING; PARKINSON'S DISEASE; REINFORCEMENT LEARNING MODELS;

EID: 84892185669     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2013.00194     Document Type: Article
Times cited : (56)

References (75)
  • 1
    • 84857078082 scopus 로고    scopus 로고
    • Temporal convergence of dynamic cell assemblies in the striato-pallidal network
    • doi: 10.1523/JNEUROSCI.4830-11.2012
    • Adler, A., Katabi, S., Finkes, I., Israel, Z., Prut, Y., and Bergman, H. (2012). Temporal convergence of dynamic cell assemblies in the striato-pallidal network. J. Neurosci. 32, 2473-2484. doi: 10.1523/JNEUROSCI.4830-11.2012
    • (2012) J. Neurosci , vol.32 , pp. 2473-2484
    • Adler, A.1    Katabi, S.2    Finkes, I.3    Israel, Z.4    Prut, Y.5    Bergman, H.6
  • 2
    • 0026517853 scopus 로고
    • Temporal discrimination is abnormal in Parkinson's disease
    • doi: 10.1093/brain/115.1.199
    • Artieda, J., Pastor, M. A., Lacruz, F., and Obeso, J. A. (1992). Temporal discrimination is abnormal in Parkinson's disease. Brain 115, 199-210. doi: 10.1093/brain/115.1.199
    • (1992) Brain , vol.115 , pp. 199-210
    • Artieda, J.1    Pastor, M.A.2    Lacruz, F.3    Obeso, J.A.4
  • 3
    • 77949917656 scopus 로고    scopus 로고
    • Motivational effects on interval timing in dopamine transporter (DAT) knockdown mice
    • doi: 10.1016/j.brainres.2010.02.034
    • Balci, F., Ludvig, E. A., Abner, R., Zhuang, X., Poon, P., and Brunner, D. (2010). Motivational effects on interval timing in dopamine transporter (DAT) knockdown mice. Brain Res. 1325, 89-99. doi: 10.1016/j.brainres.2010.02.034
    • (2010) Brain Res , vol.1325 , pp. 89-99
    • Balci, F.1    Ludvig, E.A.2    Abner, R.3    Zhuang, X.4    Poon, P.5    Brunner, D.6
  • 4
    • 54049126896 scopus 로고    scopus 로고
    • Pharmacological manipulations of interval timing using the peak procedure in male C3H mice
    • doi: 10.1007/s00213-008-1248-y
    • Balci, F., Ludvig, E. A., Gibson, J. M., Allen, B. D., Frank, K. M., Kapustinski, B. J., et al. (2008). Pharmacological manipulations of interval timing using the peak procedure in male C3H mice. Psychopharmacology (Berl.) 201, 67-80. doi: 10.1007/s00213-008-1248-y
    • (2008) Psychopharmacology (Berl.) , vol.201 , pp. 67-80
    • Balci, F.1    Ludvig, E.A.2    Gibson, J.M.3    Allen, B.D.4    Frank, K.M.5    Kapustinski, B.J.6
  • 5
    • 21544435722 scopus 로고    scopus 로고
    • Midbrain dopamine neurons encode a quantitative reward prediction error signal
    • doi: 10.1016/j.neuron.2005.05.020
    • Bayer, H. M., and Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141. doi: 10.1016/j.neuron.2005.05.020
    • (2005) Neuron , vol.47 , pp. 129-141
    • Bayer, H.M.1    Glimcher, P.W.2
  • 6
    • 34548778113 scopus 로고    scopus 로고
    • Statistics of midbrain dopamine neuron spike trains in the awake primate
    • doi: 10.1152/jn.01140.2006
    • Bayer, H. M., Lau, B., and Glimcher, P. W. (2007). Statistics of midbrain dopamine neuron spike trains in the awake primate. J. Neurophysiol. 98, 1428-1439. doi: 10.1152/jn.01140.2006
    • (2007) J. Neurophysiol , vol.98 , pp. 1428-1439
    • Bayer, H.M.1    Lau, B.2    Glimcher, P.W.3
  • 7
    • 84859297479 scopus 로고    scopus 로고
    • Dissociating hippocampal and striatal contributions to sequential prediction learning
    • doi: 10.1111/j.1460-9568.2011.07920.x
    • Bornstein, A. M., and Daw, N. D. (2012). Dissociating hippocampal and striatal contributions to sequential prediction learning. Eur. J. Neurosci. 35, 1011-1023. doi: 10.1111/j.1460-9568.2011.07920.x
    • (2012) Eur. J. Neurosci , vol.35 , pp. 1011-1023
    • Bornstein, A.M.1    Daw, N.D.2
  • 8
    • 27944431681 scopus 로고    scopus 로고
    • What makes us tick? Functional and neural mechanisms of interval timing
    • doi: 10.1038/nrn1764
    • Buhusi, C. V., and Meck, W. H. (2005). What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 6, 755-765. doi: 10.1038/nrn1764
    • (2005) Nat. Rev. Neurosci , vol.6 , pp. 755-765
    • Buhusi, C.V.1    Meck, W.H.2
  • 9
    • 78649443168 scopus 로고    scopus 로고
    • Population clocks: Motor timing with neural dyanmics
    • doi: 10.1016/j.tics.2010.09.002
    • Buonomano, D. V., and Laje, R. (2010). Population clocks: motor timing with neural dyanmics. Trends Cogn. Sci. 14, 520-527. doi: 10.1016/j.tics.2010.09.002
    • (2010) Trends Cogn. Sci , vol.14 , pp. 520-527
    • Buonomano, D.V.1    Laje, R.2
  • 10
    • 0001838576 scopus 로고
    • Reinforcement schedules and psychophysical judgements
    • ed W. N. Schoenfeld (New York, NY: Appleton-Century Crofts)
    • Catania, R. A. (1970). "Reinforcement schedules and psychophysical judgements," in The Theory of Reinforcement Schedules, ed W. N. Schoenfeld (New York, NY: Appleton-Century Crofts), 1-42.
    • (1970) The Theory of Reinforcement Schedules , pp. 1-42
    • Catania, R.A.1
  • 11
    • 34447330394 scopus 로고    scopus 로고
    • Ketamine "unlocks" the reduced clock-speed effects of cocaine following extended training: Evidence for dopamine-glutamate interactions in timing and time perception
    • doi: 10.1016/j.nlm.2007.04.005
    • Cheng, R. K., Ali, Y. M., and Meck, W. H. (2007). Ketamine "unlocks" the reduced clock-speed effects of cocaine following extended training: evidence for dopamine-glutamate interactions in timing and time perception. Neurobiol. Learn. Mem. 88, 149-159. doi: 10.1016/j.nlm.2007.04.005
    • (2007) Neurobiol. Learn. Mem , vol.88 , pp. 149-159
    • Cheng, R.K.1    Ali, Y.M.2    Meck, W.H.3
  • 12
    • 0017511587 scopus 로고
    • The bisection of temporal intervals
    • doi: 10.1037/0097-7403.3.3.216
    • Church, R. M., and Deluty, H. Z. (1977). The bisection of temporal intervals. J. Exp. Psychol. Anim. Behav. Process. 3, 216-228. doi: 10.1037/0097-7403.3.3.216
    • (1977) J. Exp. Psychol. Anim. Behav. Process , vol.3 , pp. 216-228
    • Church, R.M.1    Deluty, H.Z.2
  • 13
    • 61349185088 scopus 로고    scopus 로고
    • Neurocomputational models of basal ganglia function in learning, memory and choice
    • doi: 10.1016/j.bbr.2008.09.029
    • Cohen, M. X., and Frank, M. J. (2009). Neurocomputational models of basal ganglia function in learning, memory and choice. Behav. Brain Res. 199, 141-156. doi: 10.1016/j.bbr.2008.09.029
    • (2009) Behav. Brain Res , vol.199 , pp. 141-156
    • Cohen, M.X.1    Frank, M.J.2
  • 14
    • 78649643866 scopus 로고    scopus 로고
    • Neuroanatomical and neurochemical substrates of timing
    • doi: 10.1038/npp.2010.113
    • Coull, J. T., Cheng, R. K., and Meck, W. H. (2011). Neuroanatomical and neurochemical substrates of timing. Neuropsychopharmacology 36, 3-25. doi: 10.1038/npp.2010.113
    • (2011) Neuropsychopharmacology , vol.36 , pp. 3-25
    • Coull, J.T.1    Cheng, R.K.2    Meck, W.H.3
  • 15
    • 33745787929 scopus 로고    scopus 로고
    • Representation and timing in theories of the dopamine system
    • doi: 10.1162/neco.2006.18.7.1637
    • Daw, N. D., Courville, A. C., and Touretzky, D. S. (2006). Representation and timing in theories of the dopamine system. Neural Comput. 18, 1637-1677. doi: 10.1162/neco.2006.18.7.1637
    • (2006) Neural Comput , vol.18 , pp. 1637-1677
    • Daw, N.D.1    Courville, A.C.2    Touretzky, D.S.3
  • 16
    • 0036592008 scopus 로고    scopus 로고
    • Opponent interactions between serotonin and dopamine
    • doi: 10.1016/S0893-6080(02)00052-7
    • Daw, N. D., Kakade, S., and Dayan, P. (2002). Opponent interactions between serotonin and dopamine. Neural Netw. 15, 603-616. doi: 10.1016/S0893-6080(02)00052-7
    • (2002) Neural Netw , vol.15 , pp. 603-616
    • Daw, N.D.1    Kakade, S.2    Dayan, P.3
  • 17
    • 0037959771 scopus 로고    scopus 로고
    • Effects of dopamine antagonists on the timing of two intervals
    • doi: 10.1016/S0091-3057(03)00036-4
    • Drew, M. R., Fairhurst, S., Malapani, C., Horvitz, J. C., and Balsam, P. D. (2003). Effects of dopamine antagonists on the timing of two intervals. Pharmacol. Biochem. Behav. 75, 9-15. doi: 10.1016/S0091-3057(03)00036-4
    • (2003) Pharmacol. Biochem. Behav , vol.75 , pp. 9-15
    • Drew, M.R.1    Fairhurst, S.2    Malapani, C.3    Horvitz, J.C.4    Balsam, P.D.5
  • 18
    • 48149101941 scopus 로고    scopus 로고
    • The temporal precision of reward prediction in dopamine neurons
    • doi: 10.1038/nn.2159
    • Fiorillo, C. D., Newsome, W. T., and Schultz, W. (2008). The temporal precision of reward prediction in dopamine neurons. Nat. Neurosci. 11, 966-973. doi: 10.1038/nn.2159
    • (2008) Nat. Neurosci , vol.11 , pp. 966-973
    • Fiorillo, C.D.1    Newsome, W.T.2    Schultz, W.3
  • 19
    • 84875417827 scopus 로고    scopus 로고
    • A role for the medial temporal lobe in feedback-driven learning: Evidence from amnesia
    • doi: 10.1523/JNEUROSCI.5217-12.2013
    • Foerde, K., Race, E., Verfaellie, M., and Shohamy, D. (2013). A role for the medial temporal lobe in feedback-driven learning: evidence from amnesia. J. Neurosci. 33, 5698-5704. doi: 10.1523/JNEUROSCI.5217-12.2013
    • (2013) J. Neurosci , vol.33 , pp. 5698-5704
    • Foerde, K.1    Race, E.2    Verfaellie, M.3    Shohamy, D.4
  • 20
    • 0026587422 scopus 로고
    • The neostriatal mosaic: Multiple levels of compartmen-tal organization in the basal ganglia
    • doi: 10.1146/annurev.ne.15.030192.001441
    • Gerfen, C. R. (1992). The neostriatal mosaic: multiple levels of compartmen-tal organization in the basal ganglia. Annu. Rev. Neurosci. 15, 285-320. doi: 10.1146/annurev.ne.15.030192.001441
    • (1992) Annu. Rev. Neurosci , vol.15 , pp. 285-320
    • Gerfen, C.R.1
  • 21
    • 0344787262 scopus 로고
    • Scalar expectancy theory and Weber's law in animal timing
    • doi: 10.1037/0033-295X.84.3.279
    • Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychol. Rev. 84, 279-325. doi: 10.1037/0033-295X.84.3.279
    • (1977) Psychol. Rev , vol.84 , pp. 279-325
    • Gibbon, J.1
  • 23
    • 0030989710 scopus 로고    scopus 로고
    • Towards a neuro-biology of temporal cognition: Advances and challenges
    • doi: 10.1016/S0959-4388(97)80005-0
    • Gibbon, J., Malapani, C., Dale, C. L., and Gallistel, C. R. (1997). Towards a neuro-biology of temporal cognition: advances and challenges. Curr. Opin. Neurobiol. 7, 170-184. doi: 10.1016/S0959-4388(97)80005-0
    • (1997) Curr. Opin. Neurobiol , vol.7 , pp. 170-184
    • Gibbon, J.1    Malapani, C.2    Dale, C.L.3    Gallistel, C.R.4
  • 24
    • 0024775767 scopus 로고
    • Neural dynamics of adaptive timing and temporal discrimination during associative learning
    • doi: 10.1016/0893-6080(89)90026-9
    • Grossberg, S., and Schmajuk, N. A. (1989). Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Netw. 2, 79-102. doi: 10.1016/0893-6080(89)90026-9
    • (1989) Neural Netw , vol.2 , pp. 79-102
    • Grossberg, S.1    Schmajuk, N.A.2
  • 25
    • 33644688754 scopus 로고    scopus 로고
    • Dopamine neurons report an error in the temporal prediction of reward during learning
    • doi: 10.1038/1124
    • Hollerman, J. R., and Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1, 304-309. doi: 10.1038/1124
    • (1998) Nat. Neurosci , vol.1 , pp. 304-309
    • Hollerman, J.R.1    Schultz, W.2
  • 26
    • 0002861883 scopus 로고
    • A model of how the basal ganglia generate and use neural signals that predict reinforcement
    • eds J. C. Houk, J. L. Davis, and D. G. Beiser (Cambridge, MA: MIT Press)
    • Houk, J. C., Adams, J. L., and Barto, A. G. (1995). "A model of how the basal ganglia generate and use neural signals that predict reinforcement," in Models of information Processing in the Basal Ganglia, eds J. C. Houk, J. L. Davis, and D. G. Beiser (Cambridge, MA: MIT Press), 249-270.
    • (1995) Models of Information Processing In the Basal Ganglia , pp. 249-270
    • Houk, J.C.1    Adams, J.L.2    Barto, A.G.3
  • 27
    • 73149116646 scopus 로고    scopus 로고
    • Neural representation of time in cortico-basal ganglia circuits
    • doi: 10.1073/pnas.0909881106
    • Jin, D. Z., Fujii, N., and Graybiel, A. M. (2009). Neural representation of time in cortico-basal ganglia circuits. Proc. Natl. Acad. Sci. U.S.A. 106, 19156-19161. doi: 10.1073/pnas.0909881106
    • (2009) Proc. Natl. Acad. Sci. U.S.A , vol.106 , pp. 19156-19161
    • Jin, D.Z.1    Fujii, N.2    Graybiel, A.M.3
  • 28
    • 0036592026 scopus 로고    scopus 로고
    • Actor-critic models of the basal ganglia: New anatomical and computational perspectives
    • doi: 10.1016/S0893-6080(02)00047-3
    • Joel, D., Niv, Y., and Ruppin, E. (2002). Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural Netw. 15, 535-547. doi: 10.1016/S0893-6080(02)00047-3
    • (2002) Neural Netw , vol.15 , pp. 535-547
    • Joel, D.1    Niv, Y.2    Ruppin, E.3
  • 29
    • 77952297939 scopus 로고    scopus 로고
    • The substantia nigra, the basal ganglia, dopamine and temporal processing
    • doi: 10.1007/978-3-211-92660-4_13
    • Jones, C. R., and Jahanshahi, M. (2009). The substantia nigra, the basal ganglia, dopamine and temporal processing. J. Neural Transm. Suppl. 73, 161-171. doi: 10.1007/978-3-211-92660-4_13
    • (2009) J. Neural Transm. Suppl , vol.73 , pp. 161-171
    • Jones, C.R.1    Jahanshahi, M.2
  • 30
    • 50349093022 scopus 로고    scopus 로고
    • Influence of reward delays on responses of dopamine neurons
    • doi: 10.1523/JNEUROSCI.1600-08.2008
    • Kobayashi, S., and Schultz, W. (2008). Influence of reward delays on responses of dopamine neurons. J. Neurosci. 28, 7837-7846. doi: 10.1523/JNEUROSCI.1600-08.2008
    • (2008) J. Neurosci , vol.28 , pp. 7837-7846
    • Kobayashi, S.1    Schultz, W.2
  • 32
    • 0038664386 scopus 로고    scopus 로고
    • Representation of time by neurons in the posterior parietal cortex of the macaque
    • doi: 10.1016/S0896-6273(03)00185-5
    • Leon, M. I., and Shadlen, M. N. (2003). Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron 38, 317-327. doi: 10.1016/S0896-6273(03)00185-5
    • (2003) Neuron , vol.38 , pp. 317-327
    • Leon, M.I.1    Shadlen, M.N.2
  • 33
    • 84856544020 scopus 로고    scopus 로고
    • A primer on reinforcement learning in the brain: Psychological, computational, and neural perspectives
    • Methods and Applications, eds E. Alonso and E. Mondragon (Hershey, PA: IGI Global)
    • Ludvig, E. A., Bellemare, M. G., and Pearson, K. G. (2011). "A primer on reinforcement learning in the brain: psychological, computational, and neural perspectives," in Computational Neuroscience for Advancing Artificial Intelligence: Models, Methods and Applications, eds E. Alonso and E. Mondragon (Hershey, PA: IGI Global), 111-144.
    • (2011) Computational Neuroscience For Advancing Artificial Intelligence: Models , pp. 111-144
    • Ludvig, E.A.1    Bellemare, M.G.2    Pearson, K.G.3
  • 34
    • 57349130536 scopus 로고    scopus 로고
    • Stimulus representation and the timing of reward-prediction errors in models of the dopamine system
    • doi: 10.1162/neco.2008.11-07-654
    • Ludvig, E. A., Sutton, R. S., and Kehoe, E. J. (2008). Stimulus representation and the timing of reward-prediction errors in models of the dopamine system. Neural Comput. 20, 3034-3054. doi: 10.1162/neco.2008.11-07-654
    • (2008) Neural Comput , vol.20 , pp. 3034-3054
    • Ludvig, E.A.1    Sutton, R.S.2    Kehoe, E.J.3
  • 35
    • 84870910490 scopus 로고    scopus 로고
    • Evaluating the TD model of classical conditioning
    • doi: 10.3758/s13420-012-0082-6
    • Ludvig, E. A., Sutton, R. S., and Kehoe, E. J. (2012). Evaluating the TD model of classical conditioning. Learn. Behav. 40, 305-319. doi: 10.3758/s13420-012-0082-6
    • (2012) Learn. Behav , vol.40 , pp. 305-319
    • Ludvig, E.A.1    Sutton, R.S.2    Kehoe, E.J.3
  • 37
    • 26844538140 scopus 로고    scopus 로고
    • Differential effects of clozapine and haloperidol on interval timing in the supraseconds range
    • doi: 10.1007/s00213-005-0074-8
    • Macdonald, C. J., and Meck, W. H. (2005). Differential effects of clozapine and haloperidol on interval timing in the supraseconds range. Psychopharmacology (Berl.) 182, 232-244. doi: 10.1007/s00213-005-0074-8
    • (2005) Psychopharmacology (Berl.) , vol.182 , pp. 232-244
    • Macdonald, C.J.1    Meck, W.H.2
  • 38
    • 0031110595 scopus 로고    scopus 로고
    • Learning the temporal dynamics of behavior
    • doi: 10.1037/0033-295X.104.2.241
    • Machado, A. (1997). Learning the temporal dynamics of behavior. Psychol. Rev. 104, 241-265. doi: 10.1037/0033-295X.104.2.241
    • (1997) Psychol. Rev , vol.104 , pp. 241-265
    • Machado, A.1
  • 39
    • 72449166356 scopus 로고    scopus 로고
    • Reinforcement learning, conditioning, and the brain: Successes and challenges
    • doi: 10.3758/CABN.9.4.343
    • Maia, T. (2009). Reinforcement learning, conditioning, and the brain: successes and challenges. Cogn. Affect. Behav. Neurosci. 9, 343-364. doi: 10.3758/CABN.9.4.343
    • (2009) Cogn. Affect. Behav. Neurosci , vol.9 , pp. 343-364
    • Maia, T.1
  • 40
    • 0031807124 scopus 로고    scopus 로고
    • Coupled temporal memories in Parkinson's disease: A dopamine-related dysfunction
    • doi: 10.1162/089892998562762
    • Malapani, C., Rakitin, B., Levy, R., Meck, W. H., Deweer, B., Dubois, B., et al. (1998). Coupled temporal memories in Parkinson's disease: a dopamine-related dysfunction. J. Cogn. Neurosci. 10, 316-331. doi: 10.1162/089892998562762
    • (1998) J. Cogn. Neurosci , vol.10 , pp. 316-331
    • Malapani, C.1    Rakitin, B.2    Levy, R.3    Meck, W.H.4    Deweer, B.5    Dubois, B.6
  • 41
    • 0020701507 scopus 로고
    • The differential effects of haloperidol and methamphetamine on time estimation in the rat
    • doi: 10.1007/BF00433008
    • Maricq, A. V., and Church, R. M. (1983). The differential effects of haloperidol and methamphetamine on time estimation in the rat. Psychopharmacology (Berl.) 79, 10-15. doi: 10.1007/BF00433008
    • (1983) Psychopharmacology (Berl.) , vol.79 , pp. 10-15
    • Maricq, A.V.1    Church, R.M.2
  • 43
    • 33645515667 scopus 로고    scopus 로고
    • Single-trials analyses demonstrate that increases in clock speed contribute to the methamphetamine-induced horizontal shifts in peak-interval timing functions
    • doi: 10.1007/s00213-006-0489-x
    • Matell, M. S., Bateson, M., and Meck W. H. (2006). Single-trials analyses demonstrate that increases in clock speed contribute to the methamphetamine-induced horizontal shifts in peak-interval timing functions. Psychopharmacology (Berl.) 188, 201-212. doi: 10.1007/s00213-006-0489-x
    • (2006) Psychopharmacology (Berl.) , vol.188 , pp. 201-212
    • Matell, M.S.1    Bateson, M.2    Meck, W.H.3
  • 44
    • 1242269333 scopus 로고    scopus 로고
    • Differential modulation of clock speed by the administration of intermittent versus continuous cocaine
    • doi: 10.1037/0735-7044.118.1.150
    • Matell, M. S., King, G. R., and Meck, W. H. (2004). Differential modulation of clock speed by the administration of intermittent versus continuous cocaine. Behav. Neurosci. 118, 150-156. doi: 10.1037/0735-7044.118.1.150
    • (2004) Behav. Neurosci , vol.118 , pp. 150-156
    • Matell, M.S.1    King, G.R.2    Meck, W.H.3
  • 45
    • 4644233344 scopus 로고    scopus 로고
    • Cortico-striatal circuits and interval timing: Coincidence detection of oscillatory processes
    • doi: 10.1016/j.cogbrainres.2004.06.012
    • Matell, M. S., and Meck, W. H. (2004). Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Cogn. Brain Res. 21, 139-170. doi: 10.1016/j.cogbrainres.2004.06.012
    • (2004) Cogn. Brain Res , vol.21 , pp. 139-170
    • Matell, M.S.1    Meck, W.H.2
  • 46
    • 21744456539 scopus 로고    scopus 로고
    • Effects of d-amphetamine on temporal discrimination in pigeons
    • doi: 10.1097/01.fbp.0000171773.69292.bd
    • McClure, E. A., Saulsgiver, K. A., and Wynne, C. D. L. (2005). Effects of d-amphetamine on temporal discrimination in pigeons. Behav. Pharmacol. 16, 193-208. doi: 10.1097/01.fbp.0000171773.69292.bd
    • (2005) Behav. Pharmacol , vol.16 , pp. 193-208
    • McClure, E.A.1    Saulsgiver, K.A.2    Wynne, C.D.L.3
  • 47
    • 0022931012 scopus 로고
    • Affinity for the dopamine D2 receptor predicts neuroleptic potency in decreasing the speed of an internal clock
    • doi: 10.1016/0091-3057(86)90109-7
    • Meck, W. H. (1986). Affinity for the dopamine D2 receptor predicts neuroleptic potency in decreasing the speed of an internal clock. Pharmacol. Biochem. Behav. 25, 1185-1189. doi: 10.1016/0091-3057(86)90109-7
    • (1986) Pharmacol. Biochem. Behav , vol.25 , pp. 1185-1189
    • Meck, W.H.1
  • 48
    • 84880282695 scopus 로고    scopus 로고
    • Neural basis of the perception and estimation of time
    • doi: 10.1146/annurev-neuro-062012-170349
    • Merchant, H., Harrington, D. L., and Meck, W. H. (2013). Neural basis of the perception and estimation of time. Annu. Rev. Neurosci. 36, 313-336. doi: 10.1146/annurev-neuro-062012-170349
    • (2013) Annu. Rev. Neurosci , vol.36 , pp. 313-336
    • Merchant, H.1    Harrington, D.L.2    Meck, W.H.3
  • 49
    • 0000329484 scopus 로고
    • The storage of time intervals using oscillating neurons
    • doi: 10.1162/neco.1989.1.3.359
    • Miall, C. (1989). The storage of time intervals using oscillating neurons. Neural Comput. 1, 359-371. doi: 10.1162/neco.1989.1.3.359
    • (1989) Neural Comput , vol.1 , pp. 359-371
    • Miall, C.1
  • 50
    • 0029981543 scopus 로고    scopus 로고
    • A framework for mesen-cephalic dopamine systems based on predictive Hebbian learning
    • Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesen-cephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936-1947.
    • (1996) J. Neurosci , vol.16 , pp. 1936-1947
    • Montague, P.R.1    Dayan, P.2    Sejnowski, T.J.3
  • 51
    • 0024377677 scopus 로고
    • Adaptively timed conditioned responses and the cerebellum: A neural network approach
    • doi: 10.1007/BF00217657
    • Moore, J. W., Desmond, J. E., and Berthier, N. E. (1989). Adaptively timed conditioned responses and the cerebellum: a neural network approach. Biol. Cybern. 62, 17-28. doi: 10.1007/BF00217657
    • (1989) Biol. Cybern , vol.62 , pp. 17-28
    • Moore, J.W.1    Desmond, J.E.2    Berthier, N.E.3
  • 52
    • 58149379028 scopus 로고    scopus 로고
    • A role for dopamine in temporal decision making and reward maximization in Parkinsonism
    • doi: 10.1523/JNEUROSCI.3116-08.2008
    • Moustafa, A. A., Cohen, M. X., Sherman, S. J., and Frank, M. J. (2008). A role for dopamine in temporal decision making and reward maximization in Parkinsonism. J. Neurosci. 28, 12294-12304. doi: 10.1523/JNEUROSCI.3116-08.2008
    • (2008) J. Neurosci , vol.28 , pp. 12294-12304
    • Moustafa, A.A.1    Cohen, M.X.2    Sherman, S.J.3    Frank, M.J.4
  • 53
    • 78649667137 scopus 로고    scopus 로고
    • Internal-time temporal difference model for neural value-based decision making
    • doi: 10.1162/NECO_a_00049
    • Nakahara, H., and Kaveri, S. (2010). Internal-time temporal difference model for neural value-based decision making. Neural Comput. 22, 3062-3106. doi: 10.1162/NECO_a_00049
    • (2010) Neural Comput , vol.22 , pp. 3062-3106
    • Nakahara, H.1    Kaveri, S.2
  • 54
    • 67349283062 scopus 로고    scopus 로고
    • Reinforcement learning in the brain
    • doi: 10.1016/j.jmp.2008.12.005
    • Niv, Y. (2009). Reinforcement learning in the brain. J. Math. Psychol. 53, 139-154. doi: 10.1016/j.jmp.2008.12.005
    • (2009) J. Math. Psychol , vol.53 , pp. 139-154
    • Niv, Y.1
  • 55
    • 0036725675 scopus 로고    scopus 로고
    • Effects of D-amphetamine in a temporal discrimination procedure: Selective changes in timing or rate dependency
    • doi: 10.1901/jeab.2002.78-195
    • Odum, A. L., Lieving, L. M., and Schaal, D. W. (2002). Effects of D-amphetamine in a temporal discrimination procedure: selective changes in timing or rate dependency? J. Exp. Anal. Behav. 78, 195-214. doi: 10.1901/jeab.2002.78-195
    • (2002) J. Exp. Anal. Behav , vol.78 , pp. 195-214
    • Odum, A.L.1    Lieving, L.M.2    Schaal, D.W.3
  • 56
    • 0026546085 scopus 로고
    • Time estimation and reproduction is abnormal in Parkinson's disease
    • doi: 10.1093/brain/115.1.211
    • Pastor, M. A., Artieda, J., Jahanshahi, M., and Obeso, J. A. (1992). Time estimation and reproduction is abnormal in Parkinson's disease. Brain 115, 211-225. doi: 10.1093/brain/115.1.211
    • (1992) Brain , vol.115 , pp. 211-225
    • Pastor, M.A.1    Artieda, J.2    Jahanshahi, M.3    Obeso, J.A.4
  • 57
    • 0027279597 scopus 로고
    • On dopaminergic modulation of temporal information processing
    • doi: 10.1016/0301-0511(93)90018-4
    • Rammsayer, T. H. (1993). On dopaminergic modulation of temporal information processing. Biol. Psychol. 36, 209-222. doi: 10.1016/0301-0511(93)90018-4
    • (1993) Biol. Psychol , vol.36 , pp. 209-222
    • Rammsayer, T.H.1
  • 58
    • 49449095638 scopus 로고    scopus 로고
    • What is reinforced by phasic dopamine signals?
    • doi: 10.1016/j.brainresrev.2007.10.007
    • Redgrave, P., Gurney, K., and Reynolds, J. (2008). What is reinforced by phasic dopamine signals? Brain Res. Rev. 58, 322-339. doi: 10.1016/j.brainresrev.2007.10.007
    • (2008) Brain Res. Rev , vol.58 , pp. 322-339
    • Redgrave, P.1    Gurney, K.2    Reynolds, J.3
  • 59
    • 0002109138 scopus 로고
    • A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement
    • eds A. H. Black and W. F. Prokasy (New York, NY: Appleton-Century Crofts)
    • Rescorla, R. A., and Wagner, A. R. (1972). "A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement," in Classical Conditioning II: Current Research and Theory, eds A. H. Black and W. F. Prokasy (New York, NY: Appleton-Century Crofts), 64-69.
    • (1972) Classical Conditioning II: Current Research and Theory , pp. 64-69
    • Rescorla, R.A.1    Wagner, A.R.2
  • 60
    • 0036592025 scopus 로고    scopus 로고
    • Dopamine-dependent plasticity of corticostriatal synapses
    • doi: 10.1016/S0893-6080(02)00045-X
    • Reynolds, J. N. J., and Wickens, J. R. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw. 15, 507-521. doi: 10.1016/S0893-6080(02)00045-X
    • (2002) Neural Netw , vol.15 , pp. 507-521
    • Reynolds, J.N.J.1    Wickens, J.R.2
  • 61
    • 77549088745 scopus 로고    scopus 로고
    • Alternative time representation in dopamine models
    • doi: 10.1007/s10827-009-0191-1
    • Rivest, F., Kalaska, J. F., and Bengio, Y. (2010). Alternative time representation in dopamine models. J. Comput. Neurosci. 28, 107-130. doi: 10.1007/s10827-009-0191-1
    • (2010) J. Comput. Neurosci , vol.28 , pp. 107-130
    • Rivest, F.1    Kalaska, J.F.2    Bengio, Y.3
  • 62
    • 0019596148 scopus 로고
    • Isolation of an internal clock
    • doi: 10.1037/0097-7403.7.3.242
    • Roberts, S. (1981). Isolation of an internal clock. J. Exp. Psychol. Anim. Behav. Process. 7, 242-268. doi: 10.1037/0097-7403.7.3.242
    • (1981) J. Exp. Psychol. Anim. Behav. Process , vol.7 , pp. 242-268
    • Roberts, S.1
  • 63
    • 0030896968 scopus 로고    scopus 로고
    • A neural substrate of prediction and reward
    • doi: 10.1126/science.275.5306.1593
    • Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599. doi: 10.1126/science.275.5306.1593
    • (1997) Science , vol.275 , pp. 1593-1599
    • Schultz, W.1    Dayan, P.2    Montague, P.R.3
  • 64
    • 83455164025 scopus 로고    scopus 로고
    • A scale-invariant internal representation of time
    • doi: 10.1162/NECO_a_00212
    • Shankar, K. H., and Howard, M. W. (2012). A scale-invariant internal representation of time. Neural Comput. 24, 134-193. doi: 10.1162/NECO_a_00212
    • (2012) Neural Comput , vol.24 , pp. 134-193
    • Shankar, K.H.1    Howard, M.W.2
  • 65
    • 79959659622 scopus 로고    scopus 로고
    • A model of interval timing by neural integration
    • doi: 10.1523/JNEUROSCI.3121-10.2011
    • Simen, P., Balci, F., deSouza, L., Cohen, J. D., and Holmes, P. (2011). A model of interval timing by neural integration. J. Neurosci. 31, 9238-9253. doi: 10.1523/JNEUROSCI.3121-10.2011
    • (2011) J. Neurosci , vol.31 , pp. 9238-9253
    • Simen, P.1    Balci, F.2    Desouza, L.3    Cohen, J.D.4    Holmes, P.5
  • 66
    • 84979983620 scopus 로고    scopus 로고
    • Timescale invariance in the pacemaker-accumulator family of timing models
    • doi: 10.1163/22134468-00002018
    • Simen, P., Rivest, F., Ludvig, E. A., Balci, F., and Killeen, P. (2013). Timescale invariance in the pacemaker-accumulator family of timing models. Timing Time Percept. 1, 159-188. doi: 10.1163/22134468-00002018
    • (2013) Timing Time Percept , vol.1 , pp. 159-188
    • Simen, P.1    Rivest, F.2    Ludvig, E.A.3    Balci, F.4    Killeen, P.5
  • 67
    • 18844370397 scopus 로고    scopus 로고
    • Comparison of patients with Parkinson's disease or cerebellar lesions in the production of periodic movements involving event-based or emergent timing
    • doi: 10.1016/j.bandc.2004. 09.010
    • Spencer, R. M., and Ivry, R. B. (2005). Comparison of patients with Parkinson's disease or cerebellar lesions in the production of periodic movements involving event-based or emergent timing. Brain Cogn. 58, 84-93. doi: 10.1016/j.bandc.2004. 09.010
    • (2005) Brain Cogn , vol.58 , pp. 84-93
    • Spencer, R.M.1    Ivry, R.B.2
  • 68
    • 0033089272 scopus 로고    scopus 로고
    • Time and memory: Towards a pacemaker-free theory of interval timing
    • doi: 10.1901/jeab.1999.71-215
    • Staddon, J. E. R., and Higa, J. J. (1999). Time and memory: towards a pacemaker-free theory of interval timing. J. Exp. Anal. Behav. 71, 215-251. doi: 10.1901/jeab.1999.71-215
    • (1999) J. Exp. Anal. Behav , vol.71 , pp. 215-251
    • Staddon, J.E.R.1    Higa, J.J.2
  • 69
  • 70
    • 84891681994 scopus 로고    scopus 로고
    • A causal link between prediction errors, dopamine neurons and learning
    • doi: 10.1038/nn.3413
    • Steinberg, E. E., Keiflin, R., Bolvin, J. R., Witten, I. B., Deisseroth, K., and Janak, P. H. (2013). A causal link between prediction errors, dopamine neurons and learning. Nat. Neurosci. 16, 966-973. doi: 10.1038/nn.3413
    • (2013) Nat. Neurosci , vol.16 , pp. 966-973
    • Steinberg, E.E.1    Keiflin, R.2    Bolvin, J.R.3    Witten, I.B.4    Deisseroth, K.5    Janak, P.H.6
  • 71
    • 0032930935 scopus 로고    scopus 로고
    • A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task
    • doi: 10.1016/S0306-4522(98)00697-6
    • Suri, R. E., and Schultz, W. (1999). A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91, 871-890. doi: 10.1016/S0306-4522(98)00697-6
    • (1999) Neuroscience , vol.91 , pp. 871-890
    • Suri, R.E.1    Schultz, W.2
  • 74
  • 75
    • 77955362035 scopus 로고    scopus 로고
    • Neurocomputational models of motor and cognitive deficits in Parkinson's disease
    • doi: 10.1016/S0079-6123(10)83014-6
    • Wiecki, T. V., and Frank, M. J. (2010). Neurocomputational models of motor and cognitive deficits in Parkinson's disease. Prog. Brain Res. 183, 275-297. doi: 10.1016/S0079-6123(10)83014-6
    • (2010) Prog. Brain Res , vol.183 , pp. 275-297
    • Wiecki, T.V.1    Frank, M.J.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.