Power-up: A reanalysis of ‘power failure’ in neuroscience using mixture modelling

Journal of Neuroscience

Volumn 37, Issue 34, 2017, Pages 8051-8061

  Nord, Camilla L ^a   Valton, Vincent ^a   Wood, John ^b   Roiser, Jonathan P ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b ROYAL FREE AND UNIVERSITY COLLEGE MEDICAL SCHOOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; META ANALYSIS; NEUROSCIENCE; NULL RESULT; SYSTEMATIC REVIEW; META ANALYSIS (TOPIC); NORMAL DISTRIBUTION; PROBABILITY; PROCEDURES; REPRODUCIBILITY; STATISTICS AND NUMERICAL DATA;

HUMANS; META-ANALYSIS AS TOPIC; NEUROSCIENCES; NORMAL DISTRIBUTION; PROBABILITY; REPRODUCIBILITY OF RESULTS;

EID: 85029668195     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/jneurosci.3592-16.2017     Document Type: Article

References (77)

1. Babbage DR, Yim J, Zupan B, Neumann D, Tomita MR, Willer B (2011) Meta-analysis of facial affect recognition difficulties after traumatic brain injury. Neuropsychology 25:277.
2. Bacchetti P (2013) Small sample size is not the real problem. Nat Rev Neurosci 14:585–585.
3. Bacchetti P, McCulloch CE, Segal MR (2008) Simple, defensible sample sizes based on cost efficiency. Biometrics 64:577–585.
4. Bacchetti P, Wolf LE, Segal MR, McCulloch CE (2005) Ethics and sample size. Am J Epidemiol 161:105–110.
5. Bai H (2011) Meta-analysis of 5, 10-methylenetetrahydrofolate reductase gene poymorphism as a risk factor for ischemic cerebrovascular disease in a Chinese Han population. Neural Regen Res 6:277–285.
6. Barch DM, Yarkoni T (2013) Introduction to the special issue on reliability and replication in cognitive and affective neuroscience research. Cogn Affect Behav Neurosci 13:687–689.
7. Bishop CM (2006) Pattern recognition and machine learning. springer New York.
8. Björkhem-Bergman L, Asplund AB, Lindh JD (2011) Metformin for weight reduction in non-diabetic patients on antipsychotic drugs: a systematic review and meta-analysis. J Psychopharmacol (Oxf) 25:299–305.
9. Blei DM, Jordan MI (2006) Variational inference for Dirichlet process mixtures. Bayesian Anal 1:121–143.
10. Bucossi S, Ventriglia M, Panetta V, Salustri C, Pasqualetti P, Mariani S, Siotto M, Rossini PM, Squitti R (2011) Copper in Alzheimer’s disease: a meta-analysis of serum, plasma, and cerebrospinal fluid studies. J Alzheimers Dis 24:175–185.
11. Button KS, Ioannidis JP, Mokrysz C, Nosek BA, Flint J, Robinson ES, Munafò MR (2013) Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci 14:365–376.
12. Chamberlain SR, Robbins TW, Winder-Rhodes S, Müller U, Sahakian BJ, Blackwell AD, Barnett JH (2011) Translational approaches to frontostriatal dysfunction in attention-deficit/hyperactivity disorder using a computerized neuropsychological battery. Biol Psychiatry 69:1192–1203.
13. Chang W, Arfken CL, Sangal MP, Boutros NN (2011a) Probing the relative contribution of the first and second responses to sensory gating indices: A meta-analysis. Psychophysiology 48:980–992.
14. Chang X-L, Mao X-Y, Li H-H, Zhang J-H, Li N-N, Burgunder J-M, Peng R, Tan E-K (2011b) Functional parkin promoter polymorphism in Parkinson’s disease: new data and meta-analysis. J Neurol Sci 302:68–71.
15. Chen C, Xu T, Chen J, Zhou J, Yan Y, Lu Y, Wu S (2011) Allergy and risk of glioma: a meta-analysis. Eur J Neurol 18:387–395.
16. Chung AK, Chua S (2011) Effects on prolongation of Bazett’s corrected QT interval of seven second-generation antipsychotics in the treatment of schizophrenia: a meta-analysis. J Psychopharmacol (Oxf) 25:646–666.
17. Cohen J (1988) Statistical power analysis for the behavioral sciences. Vol. 2. Lawrence Earlbaum Assoc Hillsdale NJ.
18. Corduneanu A, Bishop CM (2001) Variational Bayesian model selection for mixture distributions. In, pp 27–34. Morgan Kaufmann Waltham, MA.
19. Domellöf E, Johansson A-M, Rönnqvist L (2011) Handedness in preterm born children: a systematic review and a meta-analysis. Neuropsychologia 49:2299–2310.
20. Etminan N, Vergouwen MD, Ilodigwe D, Macdonald RL (2011) Effect of pharmaceutical treatment on vasospasm, delayed cerebral ischemia, and clinical outcome in patients with aneurysmal subarachnoid hemorrhage: a systematic review and meta-analysis. J Cereb Blood Flow Metab 31:1443–1451.
21. Feng X, Wang F, Zou Y, Li W, Tian Y, Pan F, Huang F (2011) Association of FK506 binding protein 5 (FKBP5) gene rs4713916 polymorphism with mood disorders: a meta-analysis. Acta Neuropsychiatr 23:12–19.
22. Flint J, Munafò MR (2013) Candidate and non-candidate genes in behavior genetics. Curr Opin Neurobiol 23:57–61.
23. Francis G (2012) Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychon Bull Rev 19:151–156.
24. Friston K (2012) Ten ironic rules for non-statistical reviewers. Neuroimage 61:1300–1310.
25. Fryar C, Gu Q, Ogden (2012) Anthropometric Reference Data for Children and Adults: United States, 2007-2010. U.S. Department of Health and Human Services.
26. Gershman SJ, Blei DM (2012) A tutorial on Bayesian nonparametric models. J Math Psychol 56:1–12.
27. Green M, Matheson S, Shepherd A, Weickert C, Carr V (2011) Brain-derived neurotrophic factor levels in schizophrenia: a systematic review with meta-analysis. Mol Psychiatry 16:960–972.
28. Han X-M, Wang C-H, Sima X, Liu S-Y (2011) Interleukin-6− 174G/C polymorphism and the risk of Alzheimer’s disease in Caucasians: A meta-analysis. Neurosci Lett 504:4–8.
29. Hannestad J, DellaGioia N, Bloch M (2011) The effect of antidepressant medication treatment on serum levels of inflammatory cytokines: a meta-analysis. Neuropsychopharmacology 36:2452–2459.
30. Hua Y, Zhao H, Kong Y, Ye M (2011) Association between the MTHFR gene and Alzheimer’s disease: a meta-analysis. Int J Neurosci 121:462–471.
31. Hyndman RJ (1996) Computing and graphing highest density regions. Am Stat 50:120–126.
32. Ioannidis JP (2005) Why most published research findings are false. PLoS Med 2:e124.
33. Jacob Cohen (1994) The earth is round (p<0.05). Am Psychol 49:997–1003.
34. Kass RE, Raftery AE (1995) Bayes factors. J Am Stat Assoc 90:773–795.
35. Kurihara K, Welling M, Teh YW (2007) Collapsed Variational Dirichlet Process Mixture Models. In, pp 2796–2801.
36. Lenth RV (2001) Some practical guidelines for effective sample size determination. Am Stat 55:187–193.
37. Lindson N, Aveyard P (2011) An updated meta-analysis of nicotine preloading for smoking cessation: investigating mediators of the effect. Psychopharmacology (Berl) 214:579–592.
38. Liu H, Liu M, Wang Y, Wang X-M, Qiu Y, Long J-F, Zhang S-P (2011a) Association of 5-HTT gene polymorphisms with migraine: a systematic review and meta-analysis. J Neurol Sci 305:57–66.
39. Liu J, Sun Q, Tang B, Hu L, Yu R, Wang L, Shi C, Yan X, Pan Q, Xia K (2011b) PITX3 gene polymorphism is associated with Parkinson’s disease in Chinese population. Brain Res 1392:116–120.
40. Lubke GH, Muthén B (2005) Investigating population heterogeneity with factor mixture models. Psychol Methods 10:21.
41. MacKillop J, Amlung MT, Few LR, Ray LA, Sweet LH, Munafò MR (2011) Delayed reward discounting and addictive behavior: a meta-analysis. Psychopharmacology (Berl) 216:305–321.
42. Maneeton N, Maneeton B, Srisurapanont M, Martin SD (2011) Bupropion for adults with attention-deficit hyperactivity disorder: Meta-analysis of randomized, placebo-controlled trials. Psychiatry Clin Neurosci 65:611–617.
43. Murphy KP (2012) Machine learning: a probabilistic perspective. MIT press.
44. Nosek BA, Spies JR, Motyl M (2012) Scientific utopia II. Restructuring incentives and practices to promote truth over publishability. Perspect Psychol Sci 7:615–631.
45. Ohi K, Hashimoto R, Yasuda Y, Fukumoto M, Yamamori H, Umeda-Yano S, Kamino K, Ikezawa K, Azechi M, Iwase M (2011) The SIGMAR1 gene is associated with a risk of schizophrenia and activation of the prefrontal cortex. Prog Neuropsychopharmacol Biol Psychiatry 35:1309–1315.
46. O’Keefe DJ (2007) Brief report: post hoc power, observed power, a priori power, retrospective power, prospective power, achieved power: sorting out appropriate uses of statistical power analyses. Commun Methods Meas 1:291–299.
47. Olabi B, Ellison-Wright I, McIntosh AM, Wood SJ, Bullmore E, Lawrie SM (2011) Are there progressive brain changes in schizophrenia? A meta-analysis of structural magnetic resonance imaging studies. Biol Psychiatry 70:88–96.
48. Oldershaw A, Hambrook D, Stahl D, Tchanturia K, Treasure J, Schmidt U (2011) The socio-emotional processing stream in anorexia nervosa. Neurosci Biobehav Rev 35:970–988.
49. Oliver BJ, Kohli E, Kasper LH (2011) Interferon therapy in relapsing-remitting multiple sclerosis: a systematic review and meta-analysis of the comparative trials. J Neurol Sci 302:96–105.
50. Open Science Collaboration (2015) Estimating the reproducibility of psychological science. Science 349:aac4716.
51. Peerbooms OL, van Os J, Drukker M, Kenis G, Hoogveld L, De Hert M, Delespaul P, van Winkel R, Rutten BP (2011) Meta-analysis of MTHFR gene variants in schizophrenia, bipolar disorder and unipolar depressive disorder: evidence for a common genetic vulnerability? Brain Behav Immun 25:1530–1543.
52. Pizzagalli DA (2011) Frontocingulate dysfunction in depression: toward biomarkers of treatment response. Neuropsychopharmacology 36:183–206.
53. Quinlan PT (2013) Misuse of power: in defence of small-scale science. Nat Rev Neurosci 14:585–585.
54. Rist PM, Diener H-C, Kurth T, Schürks M (2011) Migraine, migraine aura, and cervical artery dissection: a systematic review and meta-analysis. Cephalalgia 31:886–896.
55. Samworth R, Wand M (2010) Asymptotics and optimal bandwidth selection for highest density region estimation. Ann Stat 38:1767–1792.
56. Sena ES, Van Der Worp HB, Bath PM, Howells DW, Macleod MR (2010) Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. PLoS Biol 8:e1000344.
57. Sexton CE, Kalu UG, Filippini N, Mackay CE, Ebmeier KP (2011) A meta-analysis of diffusion tensor imaging in mild cognitive impairment and Alzheimer’s disease. Neurobiol Aging 32:2322-e5.
58. Shum D, Levin H, Chan RC (2011) Prospective memory in patients with closed head injury: a review. Neuropsychologia 49:2156–2165.
59. Sim H, Shin B-C, Lee MS, Jung A, Lee H, Ernst E (2011) Acupuncture for carpal tunnel syndrome: a systematic review of randomized controlled trials. J Pain 12:307–314.
60. Song F, Poljak A, Valenzuela M, Mayeux R, Smythe GA, Sachdev PS (2011) Meta-analysis of plasma amyloid-β levels in Alzheimer’s disease. J Alzheimers Dis 26:365–375.
61. Sun Q, Fu Y, Sun A, Shou Y, Zheng M, Li X, Fan D (2011) Correlation of E-selectin gene polymorphisms with risk of ischemic stroke A meta-analysis. Neural Regen Res 6.
62. Tian Y, Kang L, Wang H, Liu Z (2011) Meta-analysis of transcranial magnetic stimulation to treat post-stroke dysfunction. Neural Regen Res 6.
63. Trzesniak C, Kempton MJ, Busatto GF, de Oliveira IR, Galvao-de Almeida A, Kambeitz J, Ferrari MCF, Santos Filho A, Chagas MH, Zuardi AW (2011) Adhesio interthalamica alterations in schizophrenia spectrum disorders: A systematic review and meta-analysis. Prog Neuropsychopharmacol Biol Psychiatry 35:877–886.
64. Veehof MM, Oskam M-J, Schreurs KM, Bohlmeijer ET (2011) Acceptance-based interventions for the treatment of chronic pain: a systematic review and meta-analysis. PAIN® 152:533–542.
65. Vergouwen MD, Etminan N, Ilodigwe D, Macdonald RL (2011) Lower incidence of cerebral infarction correlates with improved functional outcome after aneurysmal subarachnoid hemorrhage. J Cereb Blood Flow Metab 31:1545–1553.
66. Vieta E, Günther O, Locklear J, Ekman M, Miltenburger C, Chatterton ML, Åström M, Paulsson B (2011) Effectiveness of psychotropic medications in the maintenance phase of bipolar disorder: a meta-analysis of randomized controlled trials. Int J Neuropsychopharmacol 14:1029–1049.
67. Wand MP, Marron JS, Ruppert D (1991) Transformations in density estimation. J Am Stat Assoc 86:343–353.
68. Wisdom NM, Callahan JL, Hawkins KA (2011) The effects of apolipoprotein E on non-impaired cognitive functioning: a meta-analysis. Neurobiol Aging 32:63–74.
69. Witteman J, van IJzendoorn MH, van de Velde D, van Heuven VJ, Schiller NO (2011) The nature of hemispheric specialization for linguistic and emotional prosodic perception: a meta-analysis of the lesion literature. Neuropsychologia 49:3722–3738.
70. Woon F, Hedges DW (2011) Gender does not moderate hippocampal volume deficits in adults with posttraumatic stress disorder: A meta-analysis. Hippocampus 21:243–252.
71. Xuan C, Zhang B-B, Li M, Deng K-F, Yang T, Zhang X-E (2011) No association between APOE epsilon 4 allele and multiple sclerosis susceptibility: a meta-analysis from 5472 cases and 4727 controls. J Neurol Sci 308:110–116.
72. Yang W, Kong F, Liu M, Hao Z (2011a) Systematic review of risk factors for progressive ischemic stroke. Neural Regen Res 6:346–352.
73. Yang Z, Li W, Huang T, Chen J, Zhang X (2011b) Meta-analysis of Ginkgo biloba extract for the treatment of Alzheimer’s disease. Neural Regen Res 6:1125–1129.
74. Yuan H, Yang X, Kang H, Cheng Y, Ren H, Wang X (2011) Meta-analysis of tau genetic polymorphism and sporadic progressive supranuclear palsy susceptibility. Neural Regen Res 6:353–359.
75. Zafar SN, Iqbal A, Farez MF, Kamatkar S, de Moya MA (2011) Intensive insulin therapy in brain injury: a meta-analysis. J Neurotrauma 28:1307–1317.
76. Zhang Y, Zhang J, Tian C, Xiao Y, Li X, He C, Huang J, Fan H (2011) The− 1082G/A polymorphism in IL-10 gene is associated with risk of Alzheimer’s disease: a meta-analysis. J Neurol Sci 303:133–138.
77. Zhu Y, He Z-Y, Liu H-N (2011) Meta-analysis of the relationship between homocysteine, vitamin B 12, folate, and multiple sclerosis. J Clin Neurosci 18:933–938.