Accounting for dynamic fluctuations across time when examining fMRI test-retest reliability: Analysis of a reward paradigm in the EMBARC study

PLoS ONE

Volumn 10, Issue 5, 2015, Pages

  Chase, Henry W ^a   Fournier, Jay C ^a   Greenberg, Tsafrir ^a   Almeida, Jorge R ^a   Stiffler, Richelle ^a   Zevallos, Carlos R ^a   Aslam, Haris ^a   Cooper, Crystal ^b   Deckersbach, Thilo ^d   Weyandt, Sarah ^b   Adams, Phillip ^c   Toups, Marisa ^b   Carmody, Tom ^b   Oquendo, Maria A ^e,f   Peltier, Scott ^g   Fava, Maurizio ^d   McGrath, Patrick J ^e,f   Weissman, Myrna ^e,f   Parsey, Ramin ^c   McInnis, Melvin G ^h   Kurian, Benji ^b   Trivedi, Madhukar H ^b   Phillips, Mary L ^a   more..

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF TEXAS SOUTHWESTERN MEDICAL CENTER   (United States)

^c STONY BROOK UNIVERSITY   (United States)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

^e NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

^f New York Presbyterian Columbia University Medical Center   (United States)

^g UNIVERSITY OF MICHIGAN   (United States)

^h UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANALYTICAL ERROR; ARTICLE; BEHAVIOR; BOLD SIGNAL; CONTROLLED STUDY; CORRELATION COEFFICIENT; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; PREDICTION; REWARD; TASK PERFORMANCE; TEST RETEST RELIABILITY; VENTRAL STRIATUM; VISUAL CORTEX; BRAIN; METABOLISM; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PROCEDURES; REPRODUCIBILITY;

ADULT; BRAIN; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; REPRODUCIBILITY OF RESULTS;

EID: 84930624776     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0126326     Document Type: Article

References (51)

1. Aron AR, Gluck MA, Poldrack RA. Long-term test-retest reliability of functional MRI in a classification learning task. Neuroimage. 2006; 29: 1000-1006. PMID: 16139527
2. Lipp I, Murphy K, Wise RG, Caseras X. Understanding the contribution of neural and physiological signal variation to the low repeatability of emotion-induced BOLD responses. Neuroimage. 2014; 86: 335-342 doi: 10.1016/j.neuroimage.2013.10.015 PMID: 24128735
3. Bennett CM, Miller MB. How reliable are the results from functional magnetic resonance imaging? Ann N Y Acad Sci. 2010; 1191: 133-155. doi: 10.1111/j.1749-6632.2010.05446.x PMID: 20392279
4. Vul E, Harris C, Winkielman P, Pashler H. Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspect Psychol Sci. 2009; 4: 274-290.
5. Strother SC, Anderson J, Hansen LK, Kjems U, Kustra R, Sidtis J, et al. The quantitative evaluation of functional neuroimaging experiments: the NPAIRS data analysis framework. Neuroimage. 2002; 15: 747-771. PMID: 11906218
6. Strother S, La Conte S, Kai Hansen L, Anderson J, Zhang J, Pulapura S, et al. Optimizing the fMRI data-processing pipeline using prediction and reproducibility performance metrics: I. A preliminary group analysis. Neuroimage. 2004; 23 Suppl 1:S196-207. PMID: 15501090
7. Rosenfeld ES, Pearlson GD, Sweeney JA, Tamminga CA, Keshavan MS, Nonterah C, et al. Prolonged hemodynamic response during incidental facial emotion processing in inter-episode bipolar I disorder. Brain Imaging Behav. 2014; 8: 73-86 doi: 10.1007/s11682-013-9246-z PMID: 23975275
8. Churchill NW, Yourganov G, Spring R, Rasmussen PM, Lee W, Ween JE, et al. PHYCAA: data-driven measurement and removal of physiological noise in BOLD fMRI. Neuroimage. 2012; 59: 1299-1314. doi: 10.1016/j.neuroimage.2011.08.021 PMID: 21871573
9. Fournier JC, Chase HW, Almeida J, Phillips ML. Model Specification and the Reliability of fMRI Results: Implications for Longitudinal Neuroimaging Studies in Psychiatry. Plos One. 2014; 9:e105169 doi: 10.1371/journal.pone.0105169 PMID: 25166022
10. Sauder CL, Hajcak G, Angstadt M, Phan KL. Test-retest reliability of amygdala response to emotional faces. Psychophysiology. 2013; 50: 1147-1156. doi: 10.1111/psyp.12129 PMID: 24128307
11. Plichta MM, Schwarz AJ, Grimm O, Morgen K, Mier D, Haddad L, et al. Test-retest reliability of evoked BOLD signals from a cognitive-emotive fMRI test battery. Neuroimage. 2012; 60: 1746-1758. doi: 10.1016/j.neuroimage.2012.01.129 PMID: 22330316
12. Fournier JC, Keener MT, Mullin BC, Hafeman DM, Labarbara EJ, Stiffler RS, et al. Heterogeneity of amygdala response in major depressive disorder: the impact of lifetime subthreshold mania. Psychol Med. 2013; 43: 293-302. doi: 10.1017/S0033291712000918 PMID: 22571805
13. Phillips ML, Medford N, Young AW, Williams L, Williams SC, Bullmore ET, et al. Time courses of left and right amygdalar responses to fearful facial expressions. Hum Brain Mapp. 2001; 12: 193-202. PMID: 11241871
14. Plichta MM, Grimm O, Morgen K, Mier D, Sauer C, Haddad L, et al. Amygdala habituation: A reliable fMRI phenotype. Neuroimage. 2014; 103C: 383-390.
15. Li J, Schiller D, Schoenbaum G, Phelps EA, Daw ND. Differential roles of human striatum and amygdala in associative learning. Nat Neurosci. 2011; 14: 1250-1252. doi: 10.1038/nn.2904 PMID: 21909088
16. Esber GR, Roesch MR, Bali S, Trageser J, Bissonette GB, Puche AC, et al. Attention-related Pearce-Kaye-Hall signals in basolateral amygdala require the midbrain dopaminergic system. Biol Psychiatry. 2012; 72: 1012-1019. doi: 10.1016/j.biopsych.2012.05.023 PMID: 22763185
17. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron. 2003; 38: 329-337. PMID: 12718865
18. Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science. 1997; 275: 1593-1599. PMID: 9054347
19. O'Reilly RC, Frank MJ, Hazy TE, Watz B. PVLV: the primary value and learned value Pavlovian learning algorithm. Behav Neurosci. 2007; 121: 31-49. PMID: 17324049
20. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol. 2000; 84: 3072-3077. PMID: 11110834
21. Forbes EE, Hariri AR, Martin SL, Silk JS, Moyles DL, Fisher PM, et al. Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder. Am J Psychiatry. 2009; 166: 64-73. doi: 10.1176/appi.ajp.2008.07081336 PMID: 19047324
22. Chase HW, Nusslock R, Almeida JR, Forbes EE, Labarbara EJ, Phillips ML. Dissociable patterns of abnormal frontal cortical activation during anticipation of an uncertain reward or loss in bipolar versus major depression. Bipolar Disord. 2013; 15: 839-854 doi: 10.1111/bdi.12132 PMID: 24148027
23. Chowdhury R, Guitart-Masip M, Lambert C, Dayan P, Huys Q, Duzel E, et al. Dopamine restores reward prediction errors in old age. Nat Neurosci. 2013; 16: 648-653. doi: 10.1038/nn.3364 PMID: 23525044
24. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science. 2004; 304: 452-454. PMID: 15087550
25. Knutson B, Bhanji JP, Cooney RE, Atlas LY, Gotlib IH. Neural responses to monetary incentives in major depression. Biol Psychiatry. 2008; 63: 686-692. PMID: 17916330
26. Pizzagalli DA, Holmes AJ, Dillon DG, Goetz EL, Birk JL, Bogdan R, et al. Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am J Psychiatry. 2009; 166: 702-710. doi: 10.1176/appi.ajp.2008.08081201 PMID: 19411368
27. Dombrovski AY, Szanto K, Clark L, Reynolds CF, Siegle GJ. Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression. JAMA Psychiatry. 2013. 70: 1020-1030
28. Gradin VB, Kumar P, Waiter G, Ahearn T, Stickle C, Milders M, et al. Expected value and prediction error abnormalities in depression and schizophrenia. Brain. 2011; 134: 1751-1764. doi: 10.1093/brain/awr059 PMID: 21482548
29. Kumar P, Waiter G, Ahearn T, Milders M, Reid I, Steele JD. Abnormal temporal difference reward-learning signals in major depression. Brain. 2008; 131: 2084-2093. doi: 10.1093/brain/awn136 PMID: 18579575
30. Stoy M, Schlagenhauf F, Sterzer P, Bermpohl F, Hagele C, Suchotzki K, et al. Hyporeactivity of ventral striatum towards incentive stimuli in unmedicated depressed patients normalizes after treatment with escitalopram. J Psychopharmacol. 2012; 26: 677-688. doi: 10.1177/0269881111416686 PMID: 21926423
31. Phillips ML, Chase HW, Sheline YI, Etkin A, Almeida JR, Deckersbach T, et al. Identifying predictors, moderators, and mediators of antidepressant response in major depressive disorder: neuroimaging approaches. Am J Psychiatry. 2015; 172: 124-138. doi: 10.1176/appi.ajp.2014.14010076 PMID: 25640931
32. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86: 420-428. PMID: 18839484
33. Gallistel CR. The importance of proving the null. Psychol Rev. 2009; 116: 439-453. doi: 10.1037/a0015251 PMID: 19348549
34. Kass RE, Raftery AE. Bayes Factors. Journal of the American Statistical Association. 1995; 90: 773-795.
35. Van Dijk KR, Sabuncu MR, Buckner RL. The influence of head motion on intrinsic functional connectivity MRI. Neuroimage. 2012; 59:431-438. doi: 10.1016/j.neuroimage.2011.07.044 PMID: 21810475
36. Yu AJ, Dayan P. Uncertainty, neuromodulation, and attention. Neuron. 2005; 46: 681-692. PMID: 15944135
37. Mackintosh NJ. Theory of Attention - Variations in Associability of Stimuli with Reinforcement. Psychological Review. 1975; 82: 276-298.
38. Le Pelley ME. The role of associative history in models of associative learning: a selective review and a hybrid model. Q J Exp Psychol B. 2004; 57: 193-243. PMID: 15204108
39. Fliessbach K, Rohe T, Linder NS, Trautner P, Elger CE, Weber B. Retest reliability of reward-related BOLD signals. Neuroimage. 2010; 50: 1168-1176. doi: 10.1016/j.neuroimage.2010.01.036 PMID: 20083206
40. Wu CC, Samanez-Larkin GR, Katovich K, Knutson B. Affective traits link to reliable neural markers of incentive anticipation. Neuroimage. 2014; 84: 279-289. doi: 10.1016/j.neuroimage.2013.08.055 PMID: 24001457
41. Wacker J, Dillon DG, Pizzagalli DA. The role of the nucleus accumbens and rostral anterior cingulate cortex in anhedonia: integration of resting EEG, fMRI, and volumetric techniques. Neuroimage. 2009; 46: 327-337. doi: 10.1016/j.neuroimage.2009.01.058 PMID: 19457367
42. Freyer T, Valerius G, Kuelz AK, Speck O, Glauche V, Hull M, et al. Test-retest reliability of event-related functional MRI in a probabilistic reversal learning task. Psychiatry Res. 2009; 174: 40-46. doi: 10.1016/j.pscychresns.2009.03.003 PMID: 19783412
43. Hampton AN, Bossaerts P, O'Doherty JP. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci. 2006; 26: 8360-8367. PMID: 16899731
44. Specht K, Willmes K, Shah NJ, Jancke L. Assessment of reliability in functional imaging studies. Journal of magnetic resonance imaging: JMRI. 2003; 17: 463-471. PMID: 12655586
45. Caceres A, Hall DL, Zelaya FO, Williams SC, Mehta MA. Measuring fMRI reliability with the intra-class correlation coefficient. Neuroimage. 2009; 45: 758-768. doi: 10.1016/j.neuroimage.2008.12.035 PMID: 19166942
46. Chen G, Saad ZS, Nath AR, Beauchamp MS, Cox RW. FMRI group analysis combining effect estimates and their variances. Neuroimage. 2012; 60: 747-765. doi: 10.1016/j.neuroimage.2011.12.060 PMID: 22245637
47. Friston KJ, Stephan KE, Lund TE, Morcom A, Kiebel S. Mixed-effects and fMRI studies. Neuroimage. 2005; 24: 244-252. PMID: 15588616
48. Thompson B. If statistical significance tests are broken/misused, what practices should supplement or replace them? Theor Psychol. 1999; 9: 165-181.
49. Whelan R, Garavan H. When Optimism Hurts: Inflated Predictions in Psychiatric Neuroimaging. Biol Psychiatry. 2013; 75: 746-748 doi: 10.1016/j.biopsych.2013.05.014 PMID: 23778288
50. Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning: Prediction, Inference and Data Mining: Springer Verlag; 2009.
51. Nestler EJ, Carlezon WA Jr. The mesolimbic dopamine reward circuit in depression. Biol Psychiatry. 2006; 59: 1151-1159. PMID: 16566899