Dissecting neural responses to temporal prediction, attention, and memory: Effects of reward learning and interoception on time perception

Cerebral Cortex

Volumn 25, Issue 10, 2015, Pages 3856-3867

  Tomasi, Dardo ^a   Wang, Gene Jack ^a   Studentsova, Yana ^a   Volkow, Nora D ^a,b  

^a NATIONAL INSTITUTE ON ALCOHOL ABUSE AND ALCOHOLISM   (United States)

^b NATIONAL INSTITUTE ON DRUG ABUSE   (United States)

Author keywords

Dopamine; fMRI; Reward; Timekeeping

Indexed keywords

ACCURACY; ADULT; ANTERIOR INSULA; ARTICLE; ATTENTION; BOLD SIGNAL; BRAIN FUNCTION; CEREBELLUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INSULA; INTEROCEPTION; LEARNING; LIMBIC CORTEX; MALE; MEMORY; MESENCEPHALON; NERVE POTENTIAL; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; NUCLEUS ACCUMBENS; PARIETAL CORTEX; PARS OPERCULARIS; PREDICTION; PREFRONTAL CORTEX; PRIMARY MOTOR CORTEX; PRIORITY JOURNAL; REWARD; SOMATOSENSORY CORTEX; SUPPLEMENTARY MOTOR AREA; TASK PERFORMANCE; TEMPORAL CORTEX; TEMPORAL PREDICTION; THALAMUS; TIME PERCEPTION; VENTRAL TEGMENTUM; VISUAL CORTEX; BRAIN; BRAIN CORTEX; BRAIN MAPPING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; REACTION TIME; YOUNG ADULT;

DOPAMINE;

ADULT; ATTENTION; BRAIN; BRAIN MAPPING; CEREBRAL CORTEX; DOPAMINE; FEMALE; HUMANS; INTEROCEPTION; MAGNETIC RESONANCE IMAGING; MALE; NUCLEUS ACCUMBENS; REACTION TIME; REWARD; TIME PERCEPTION; VENTRAL TEGMENTAL AREA; YOUNG ADULT;

EID: 84948668424     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhu269     Document Type: Article

References (69)

1. Allman MJ, Meck WH. 2012. Pathophysiological distortions in time perception and timed performance. Brain. 135:656-677.
2. Allman MJ, Teki S, Griffiths TD, Meck WH. 2014. Properties of the internal clock: first-and second-order principles of subjective time. Annu Rev Psychol. 65:743-771.
3. Bäckman L, Nyberg L, Lindenberger U, Li S, Farde L. 2006. The correlative triad among aging, dopamine, and cognition: current status and future prospects. Neurosci Biobehav Rev. 30:791-807.
4. Breiter H, Aharon I, Kahneman D, Dale A, Shizgal P. 2001. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron. 30:619-639.
5. Breiter H, Gasic G. 2004. A general circuitry processing reward/aversion information and its implications for neuropsychi-atric illness. In: Gazzaniga M, editor. The cognitive neurosciences III. Cambridge: MIT Press, p. 1043-1065.
6. Breiter H, Gollub R, Weisskoff R, Kennedy D, Makris N, Berke J, Goodman J, Kantor H, Gastfriend D, Riorden J, et al. 1997. Acute effectsofcocaineonthe human brain activity and emotion. Neuron. 19:591-611.
7. Breiter HC, Rosen BR. 1999. Functional magnetic resonance imaging of brain reward circuitry in the human. Ann N Y Acad Sci. 877:523-547.
8. Bueti D, Macaluso E. 2011. Physiological correlates of subjective time: evidence for the temporal accumulator hypothesis. Neuroimage. 57:1251-1263.
9. Buhusi C. 2003. Dopaminergic mechanisms of interval timing and attention. In: Meck W, editor. Functional and neural mechanisms of interval timing. Boca Raton, FL: CRC Press. p. 317-338.
10. Caparelli E, Tomasi D. 2008. K-space spatial low-pass filters can increase signal loss artifacts in echo-planar imaging. Biomed Signal Process Control. 3:107-114.
11. Carroll C, O'Donnell B, Shekhar A, Hetrick W. 2009. Timing dysfunctions in schizophrenia span from millisecond to several-second durations. Brain Cogn. 70:181-190.
12. Cheng R, MacDonald C, Meck W. 2006. Differential effects of cocaine and ketamine on time estimation: implications for neurobiological models of interval timing. Pharmacol Biochem Behav. 85:114-122.
13. Coull J, Cheng R, Meck W. 2011. Neuroanatomical and neuro-chemical substrates of timing. Neuropsychopharmacology. 36:3-25.
14. Coull J, Hwang H, Leyton M, Dagher A. 2012. Dopamine precursor depletion impairs timingin healthy volunteers by attenuating activity in putamen and supplementary motor area. J Neurosci. 32:16704-16715.
15. D'Ardenne K, McClure S, Nystrom L, Cohen J. 2008. BOLD responses reflecting dopaminergic signalsinthe human ventral tegmental area. Science. 319:1264-1267.
16. Dreher J, Meyer-Lindenberg A, Kohn P, Berman K. 2008. Age-related changesinmidbraindopaminergicregulationofthehumanre-ward system. Proc Natl Acad Sci USA. 105:15106-15111.
17. Drew M, Simpson E, Kellendonk C, Herzberg W, Lipatova O, Fairhurst S, Kandel E, Malapani C, Balsam P. 2007. Transient overexpression of striatal D2 receptors impairs operant motivation and interval timing. J Neurosci. 27:7731-7739.
18. Erickson K, Boot W, Basak C, Neider M, Prakash R, Voss M, Graybiel A, Simons D, Fabiani M, Gratton G, et al. 2010. Striatal volume predicts level of video game skill acquisition. Cereb Cortex. 20:2522-2530.
19. Glimcher P. 2011. Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc Natl Acad Sci USA. 108(Suppl 3):15647-15654.
20. Haight J, Flagel S. 2014. A potential role for the paraventricular nucleus of the thalamus in mediating individual variation in Pavlovian conditioned responses. Front Behav Neurosci. 8:79.
21. Hoeft F, Watson C, Kesler S, Bettinger K, Reiss A. 2008. Gender differences in the mesocorticolimbic system during computer game-play. J Psychiatr Res. 42:253-258.
22. Iglesias S, Mathys C, Brodersen K, Kasper L, Piccirelli M, den Ouden H, Stephan K. 2013. Hierarchical prediction errors in midbrain and basal forebrain during sensory learning. Neuron. 80:519-530.
23. Jahanshahi M, Jones C, Dirnberger G, Frith C. 2006. The substantia nigra pars compacta and temporal processing. J Neurosci. 26:12266-12273.
24. Jazayeri M, Shadlen M. 2010. Temporal context calibrates interval timing. Nat Neurosci. 13:1020-1026.
25. Jones C, Malone T, Dirnberger G, Edwards M, Jahanshahi M. 2008. Basal ganglia, dopamine and temporal processing: performance on three timing tasks on and off medication in Parkinson's disease. Brain Cogn. 68:30-41.
26. Kelley A, Baldo B, Pratt W, Will M. 2005. Corticostriatal-hypothal-amic circuitry and food motivation: integration of energy, action and reward. Physiol Behav. 86:773-795.
27. Knudsen E. 2007. Fundamental components of attention. Annu Rev Neurosci. 30:57-78.
28. Koepp M, Gunn R, Lawrence A, Cunningham V, Dagher A, Jones T, Brooks D, Bench C, Grasby P. 1998. Evidence for striatal dopa-mine release during a video game. Nature. 393:266-268.
29. Kühn S, Romanowski A, Schilling C, Lorenz R, Mörsen C, Seiferth N, Banaschewski T, Barbot A, Barker G, Büchel C, et al. 2011. The neural basis of video gaming. Transl Psychiatry. 1:e53.
30. Lake J, Meck W. 2013. Differential effects of amphetamine and haloperidol on temporal reproduction: dopaminergic regulation of attention and clock speed. Neuropsychologia. 51:284-292.
31. Liu X, Hairston J, Schrier M, Fan J. 2011. Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neurosci Biobehav Rev. 35:1219-1236.
32. Livesey A, Wall M, Smith A. 2007. Time perception: manipulation of task difficulty dissociates clock functions from other cognitive demands. Neuropsychologia. 45:321-331.
33. Logothetis N, Pauls J, Augath M, Trinath T, Oeltermann A. 2001. Neurophysiological investigation of the basis of the fMRI signal. Nature. 412:150-157.
34. Lustig C, Meck W. 2005. Chronic treatment with haloperidol induces deficits in working memory and feedback effects of interval timing. Brain Cogn. 58:9-16.
35. Maricq A, Church R. 1983. The differential effects of haloperidol and methamphetamine on time estimation in the rat. Psychopharmacology (Berl). 79:10-15.
36. Matell M, Meck W. 2004. Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Brain Res Cogn Brain Res. 21:139-170.
37. Maunsell J. 2004. Neuronal representations of cognitive state: reward or attention? Trends Cogn Sci. 8:261-265.
38. McClure S, Berns G, Montague P. 2003. Temporal prediction errors in a passive learning task activate human striatum. Neuron. 38:339-3456.
39. Meck W. 1986. Affinity for the dopamine D2 receptor predicts neuroleptic potency in decreasing the speed of an internal clock. Pharmacol Biochem Behav. 25:1185-1189.
40. Meck W. 2005. Neuropsychology of timing and time perception. Brain Cogn. 58:1-8.
41. Meck W. 2006. Neuroanatomical localization of an internal clock: a functional link between mesolimbic, nigrostriatal, and me-socortical dopaminergic systems. Brain Res. 1109:93-107.
42. Merchant H, Harrington D, Meck W. 2013. Neural basis of the perception and estimation of time. Annu Rev Neurosci. 36:313-336.
43. Mirenowicz J, Schultz W. 1994. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol. 72:1024-1027.
44. Nobre A, Correa A, Coull J. 2007. The hazards of time. Curr Opp Neurobiol. 17:465-470.
45. Noreika V, Falter C, Rubia K. 2013. Timing deficits in attention-deficit/hyperactivity disorder (ADHD): evidence from neuro-cognitive and neuroimaging studies. Neuropsychologia. 51:235-266.
46. O'Doherty J, Buchanan T, Seymour B, Dolan R. 2006. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron. 49:157-166.
47. O'Doherty J, Dayan P, Friston K, Critchley H, Dolan R. 2003. Temporal difference models and reward-related learning in the human brain. Neuron. 38:329-337.
48. Oprisan S, Buhusi C. 2011. Modeling pharmacological clock and memory patterns ofinterval timing in a striatal beat-frequency model with realistic, noisy neurons. Front Integr Neurosci. 5:52.
49. Pollatos O, Laubrock J, Wittmann M. 2014. Interoceptive focus shapes the experience of time. PLoS ONE. 9:e86934.
50. Rao S, Mayer A, Harrington D. 2001. The evolution of brain activation during temporal processing. Nat Neurosci. 4:317-323.
51. Rolls E, McCabe C, Redoute J. 2008. Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb Cortex. 18:652-663.
52. Rubia K, Halari R, Christakou A, Taylor E. 2009. Impulsiveness as a timing disturbance: neurocognitive abnormalities in attention-deficit hyperactivity disorder during temporal processes and normalization with methylphenidate. Philos Trans R Soc B. 364:1919-1931.
53. Saddoris M, Carelli R. 2014. Cocaine self-administration abolishes associative neural encoding inthe nucleus accumbens necessary for higher-order learning. Biol Psychiatry. 75:156-164.
54. Sander C, Hooker J, Catana C, Normandin M, Alpert N, Knudsen G, Vanduffel W, Rosen B, Mandeville J. 2013. Neurovascular couplingto D2/D3 dopamine receptor occupancy using simultaneous PET/functional MRI. Proc Natl Acad Sci USA. 110:11169-11174.
55. Schroll H, Vitay J, Hamker F.2012. Working memory and response selection: a computational account of interactions among cortico-basalganglio-thalamic loops. Neural Netw. 26:59-74.
56. Schultz W. 2007. Behavioral dopamine signals. Trends Neurosci. 30:203-210.
57. Schultz W. 1998. Predictive reward signal of dopamine neurons. J Neurophysiol. 80:1-27.
58. Schultz W, Dayan P, Montague P. 1997. A neural substrate of prediction and reward. Science. 275:1593-1599.
59. Seeley W, Menon V, Schatzberg A, Keller J, Glover G, Kenna H, Reiss A, Greicius M. 2007. Dissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci. 27:2349-2356.
60. Seymour B, O'Doherty J, Dayan P, Koltzenburg M, Jones A, Dolan R, Friston K, Frackowiak R. 2004. Temporal difference models describe higher-order learning in humans. Nature. 429:664-667.
61. Sutton R. 1988. Learning to predict by the methods of temporal differences. Mach Learn. 3:9-44.
62. Sutton R, Barto A. 1981. Toward a modern theoryof adaptive networks: expectation and prediction. Psychol Rev. 88:135-170.
63. Tinklenberg J, Roth W, Kopell B. 1976. Marijuana and ethanol: differential effects on time perception, heart rate, and subjective response. Psychopharmacology (Berl). 49:275-279.
64. Tomasi D, Caparelli EC, Chang L, Ernst T. 2005. fMRI-acoustic noise alters brain activation during working memory tasks. Neuroimage. 27:377-386.
65. Tomasi D, Ernst T. 2003. Echo planar imagingat4 Tesla with minimum acoustic noise. J Magn Reson Imaging. 18:128-130.
66. Wiener M, Lee Y, Lohoff F, Coslett H. 2014. Individual differences in the morphometry and activation of time perception networks are influenced by dopamine genotype. Neuroimage. 89:10-22.
67. Wise R. 2002. Brain reward circuitry: insights from unsensed incentives. Neuron. 36:229-240.
68. Wittmann M, Leland D, Churan J, Paulus M. 2007. Impaired time perception and motor timing in stimulant-dependent subjects. Drug Alcohol Depend. 2-3:183-192.
69. Wittmann M, Simmons A, Aron J, Paulus M. 2010. Accumulation of neural activity in the posterior insula encodes the passage of time. Neuropsychologia. 48:3110-3120.