Poor replication validity of biomedical association studies reported by newspapers

PLoS ONE

Volumn 12, Issue 2, 2017, Pages

  Dumas Mallet, Estelle ^a   Smith, Andy ^a   Boraud, Thomas ^a   Gonon, François ^a  

^a UNIVERSITÉ DE BORDEAUX   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; DATA BASE; GENETIC RISK; LIFESTYLE; MEDICAL LITERATURE; MEDICAL RESEARCH; META ANALYSIS (TOPIC); NEUROLOGY; PHYSICAL DISEASE; PSYCHIATRY; PUBLICATION; REPLICATION VALIDITY; RISK ASSESSMENT; RISK FACTOR; VALIDATION STUDY; VALIDITY; CAUSALITY; FACTUAL DATABASE; HEALTH BEHAVIOR; HUMAN; INFORMATION DISSEMINATION; INTERNAL MEDICINE; JOURNAL IMPACT FACTOR; PUBLISHING; REPRODUCIBILITY; STANDARDS;

BIOMEDICAL RESEARCH; CAUSALITY; DATABASES, FACTUAL; HEALTH BEHAVIOR; HUMANS; INFORMATION DISSEMINATION; INTERNAL MEDICINE; JOURNAL IMPACT FACTOR; JOURNALISM; LIFE STYLE; META-ANALYSIS AS TOPIC; NEUROLOGY; NEWSPAPERS AS TOPIC; PERIODICALS AS TOPIC; PSYCHIATRY; REPRODUCIBILITY OF RESULTS; RISK FACTORS;

EID: 85013658995     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0172650     Document Type: Article

References (38)

1. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005; 2(8):e124. doi: 10. 1371/journal.pmed.0020124 PMID: 16060722
2. Sarewitz D. Beware the creeping cracks of bias. Nature. 2012; 485(7397):149. doi: 10.1038/485149a PMID: 22575922
3. Munafo MR, Stothart G, Flint J. Bias in genetic association studies and impact factor. Mol Psychiatry. 2009; 14(2):119-20. doi: 10.1038/mp.2008.77 PMID: 19156153
4. Begley CG, Ioannidis JP. Reproducibility in science: improving the standard for basic and preclinical research. Circ Res. 2015; 116(1):116-26. doi: 10.1161/CIRCRESAHA.114.303819 PMID: 25552691
5. Baker M. 1,500 scientists lift the lid on reproducibility. Nature. 2016; 533(7604):452-4. doi: 10.1038/533452a PMID: 27225100
6. Prinz F, Schlange T, Asadullah K. Believe it or not: how much can we rely on published data on potential drug targets? Nat Rev Drug Discov. 2011; 10(9):712. doi: 10.1038/nrd3439-c1 PMID: 21892149
7. Freedman LP, Cockburn IM, Simcoe TS. The Economics of Reproducibility in Preclinical Research. PLoS Biol. 2015; 13(6):e1002165. doi: 10.1371/journal.pbio.1002165 PMID: 26057340
8. Ioannidis JP, Ntzani EE, Trikalinos TA, Contopoulos-Ioannidis DG. Replication validity of genetic association studies. Nat Genet. 2001; 29(3):306-9. doi: 10.1038/ng749 PMID: 11600885
9. Trikalinos TA, Ntzani EE, Contopoulos-Ioannidis DG, Ioannidis JP. Establishment of genetic associations for complex diseases is independent of early study findings. Eur J Hum Genet. 2004; 12(9):762-9. doi: 10.1038/sj.ejhg.5201227 PMID: 15213707
10. Ioannidis JP, Panagiotou OA. Comparison of effect sizes associated with biomarkers reported in highly cited individual articles and in subsequent meta-analyses. JAMA. 2011; 305(21):2200-10. doi: 10. 1001/jama.2011.713 PMID: 21632484
11. Dumas-Mallet E, Button K, Boraud T, Munafo M, Gonon F. Replication Validity of Initial Association Studies: A Comparison between Psychiatry, Neurology and Four Somatic Diseases. PLoS One. 2016; 11(6):e0158064. doi: 10.1371/journal.pone.0158064 PMID: 27336301
12. Ioannidis J, Lau J. Evolution of treatment effects over time: empirical insight from recursive cumulative metaanalyses. Proc Natl Acad Sci U S A. 2001; 98(3):831-6. doi: 10.1073/pnas.98.3.831 PMID: 11158556
13. Trikalinos TA, Churchill R, Ferri M, Leucht S, Tuunainen A, Wahlbeck K, et al. Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time. J Clin Epidemiol. 2004; 57 (11):1124-30. PMID: 15612138
14. Gan HK, You B, Pond GR, Chen EX. Assumptions of expected benefits in randomized phase III trials evaluating systemic treatments for cancer. J Natl Cancer Inst. 2012; 104(8):590-8. doi: 10.1093/jnci/ djs141 PMID: 22491345
15. Pereira TV, Horwitz RI, Ioannidis JP. Empirical evaluation of very large treatment effects of medical interventions. JAMA. 2012; 308(16):1676-84. doi: 10.1001/jama.2012.13444 PMID: 23093165
16. Tajika A, Ogawa Y, Takeshima N, Hayasaka Y, Furukawa TA. Replication and contradiction of highly cited research papers in psychiatry: 10-year follow-up. Br J Psychiatry. 2015; 207(4):357-62. doi: 10. 1192/bjp.bp.113.143701 PMID: 26159600
17. Open-Science-Collaboration. PSYCHOLOGY. Estimating the reproducibility of psychological science. Science. 2015; 349(6251):aac4716. doi: 10.1126/science.aac4716 PMID: 26315443
18. Bacchetti P, Deeks SG, McCune JM. Breaking free of sample size dogma to perform innovative translational research. Sci Transl Med. 2011; 3(87):87ps24. doi: 10.1126/scitranslmed.3001628 PMID: 21677197
19. Gonon F, Konsman JP, Cohen D, Boraud T. Why most biomedical findings echoed by newspapers turn out to be false: the case of Attention Deficit Hyperactivity Disorder. PLoS One. 2012; 7(9):e44275. doi: 10.1371/journal.pone.0044275 PMID: 22984483
20. Heres S, Davis J, Maino K, Jetzinger E, Kissling W, Leucht S. Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsychotics. Am J Psychiatry. 2006; 163(2):185-94. doi: 10. 1176/appi.ajp.163.2.185 PMID: 16449469
21. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008; 358(3):252-60. doi: 10.1056/ NEJMsa065779 PMID: 18199864
22. Moynihan R, Bero L, Ross-Degnan D, Henry D, Lee K, Watkins J, et al. Coverage by the news media of the benefits and risks of medications. N Engl J Med. 2000; 342(22):1645-50. doi: 10.1056/ NEJM200006013422206 PMID: 10833211
23. Yavchitz A, Boutron I, Bafeta A, Marroun I, Charles P, Mantz J, et al. Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study. PLoS Med. 2012; 9(9):e1001308. doi: 10.1371/journal.pmed.1001308 PMID: 22984354
24. Bartlett C, Sterne J, Egger M. What is newsworthy? Longitudinal study of the reporting of medical research in two British newspapers. BMJ. 2002; 325(7355):81-4. PMID: 12114239
25. Stryker JE. Reporting medical information: effects of press releases and newsworthiness on medical journal articles' visibility in the news media. Prev Med. 2002; 35(5):519-30. PMID: 12431901
26. Dougherty DD, Bonab AA, Spencer TJ, Rauch SL, Madras BK, Fischman AJ. Dopamine transporter density in patients with attention deficit hyperactivity disorder. Lancet. 1999; 354(9196):2132-3. doi: 10. 1016/S0140-6736(99)04030-1 PMID: 10609822
27. Volkow ND, Wang GJ, Kollins SH, Wigal TL, Newcorn JH, Telang F, et al. Evaluating dopamine reward pathway in ADHD: clinical implications. JAMA. 2009; 302(10):1084-91. doi: 10.1001/jama.2009.1308PMID: 19738093
28. Caspi A, Sugden K, Moffitt TE, Taylor A, Craig IW, Harrington H, et al. Influence of life stress on depression: moderation by a polymorphism in the 5-HTT gene. Science. 2003; 301(5631):386-9. doi: 10. 1126/science.1083968 PMID: 12869766
29. Risch N, Herrell R, Lehner T, Liang KY, Eaves L, Hoh J, et al. Interaction between the serotonin transporter gene (5-HTTLPR), stressful life events, and risk of depression: a meta-analysis. JAMA. 2009; 301(23):2462-71. doi: 10.1001/jama.2009.878 PMID: 19531786
30. Kitzinger J, Reilly J. The rise and fall of risk reporting: media coverage of human genetics research, 'false memory syndrome' and 'mad cow disease'. Eur J Communication. 1997; 12(3):319-50.
31. Bourdaa M, Konsman JP, Secail C, Venturini T, Veyrat-Masson I, Gonon F. Does television reflect the evolution of scientific knowledge? The case of attention deficit hyperactivity disorder coverage on French TV. Public Understanding of Science. 2015; 24(2):200-9. doi: 10.1177/0963662513484842PMID: 23825292
32. Holtzman NA, Bernhardt BA, Mountcastle-Shah E, Rodgers JE, Tambor E, Geller G. The quality of media reports on discoveries related to human genetic diseases. Community Genet. 2005; 8(3):133-44. doi: 10.1159/000086756 PMID: 16113530
33. Gonon F, Bezard E, Boraud T. What should be said to the lay public regarding ADHD etiology. Am J Med Genet B Neuropsychiatr Genet. 2011; 156(8):989-91.
34. Horwitz AV. Media portrayals and health inequalities: a case study of characterizations of Gene x Environment interactions. J Gerontol B Psychol Sci Soc Sci. 2005; 60 Spec No 2:48-52.
35. Watts S. Society needs more than wonder to respect science. Nature. 2014; 508(7495):151. doi: 10. 1038/508151a PMID: 24717473
36. Larsson A, Oxman AD, Carling C, Herrin J. Medical messages in the media-barriers and solutions to improving medical journalism. Health Expect. 2003; 6(4):323-31. doi: 10.1046/j.1369-7625.2003.00228.x PMID: 15040794
37. Jensen JD, Hurley RJ. Conflicting stories about public scientific controversies: Effects of news convergence and divergence on scientists' credibility. Public Underst Sci. 2012; 21(6):689-704. doi: 10.1177/0963662510387759 PMID: 23832155
38. Jensen JD, Krakow M, John KK, Liu M. Against conventional wisdom: when the public, the media, and medical practice collide. BMC Med Inform Decis Mak. 2013; 13 Suppl 3:S4.