How evidence-based medicine is failing due to biased trials and selective publication

Journal of Evaluation in Clinical Practice

Volumn 20, Issue 6, 2014, Pages 908-914

  Every Palmer, Susanna ^a   Howick, Jeremy ^b  

^a CAPITAL AND COAST DISTRICT HEALTH BOARD   (New Zealand)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

evaluation; evidence based medicine; health services research; mental health; philosophy

Indexed keywords

ANTIDEPRESSANT AGENT; NEUROLEPTIC AGENT;

ARTICLE; CLINICAL PRACTICE; CONFLICT OF INTEREST; DEPRESSION; DRUG INDUSTRY; EVIDENCE BASED MEDICINE; FUNDING; HEALTH CARE; HEALTH CARE COST; HUMAN; INTERVENTION STUDY; OUTCOME ASSESSMENT; PATIENT CARE; PATIENT SELECTION; PHARMACEUTICAL CARE; PRACTICE GUIDELINE; PRESCRIPTION; PRIORITY JOURNAL; PSYCHOSIS; PUBLICATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); RESEARCH PRIORITY; SAMPLE SIZE; STUDY DESIGN; SYSTEMATIC ERROR; DECISION MAKING; ECONOMICS; ETHICS; FEMALE; FINANCIAL MANAGEMENT; MALE; METHODOLOGY; NEEDS ASSESSMENT; ORGANIZATION AND MANAGEMENT; PROGRAM EVALUATION; PSYCHOTIC DISORDERS; SELECTION BIAS;

DECISION MAKING; EVIDENCE-BASED MEDICINE; FEMALE; HUMANS; MALE; MARKETING OF HEALTH SERVICES; NEEDS ASSESSMENT; PERIODICALS AS TOPIC; PROGRAM EVALUATION; PSYCHOTIC DISORDERS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; RESEARCH SUPPORT AS TOPIC; SELECTION BIAS;

EID: 84902500964     PISSN: 13561294     EISSN: 13652753     Source Type: Journal    
DOI: 10.1111/jep.12147     Document Type: Article

References (65)

1. Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B., &, Richardson, W. S., (1996) Evidence based medicine: what it is and what it isn't. British Medical Journal, 312 (7023), 71-72.
2. Straus, S. E., Glasziou, P., Richardson, W. S., &, Haynes, R. B., (2011) Evidence-Based Medicine: How to Practice and Teach EBM. Edinburgh: Churchill Livingstone.
3. OCEBM Levels of Evidence Working Group (2001) The Oxford Levels of Evidence 2. Oxford Centre for Evidence-Based Medicine. http://www.cebm.net/index.aspx?o=5653 (17 February 2014).
4. Evidence Based Medicine Working Group (1992) Evidence-based medicine. A new approach to teaching the practice of medicine. Journal of the American Medical Association, 268, 2420-2425.
5. Manser, R., &, Walters, E. H., (2001) What is evidence-based medicine and the role of the systematic review: the revolution coming your way. Monaldi Archives for Chest Disease, 56 (1), 33-38.
6. New York Times. (2001) The Year in Ideas. Available at http://www.nytimes.com/2001/12/09/magazine/the-year-in-ideas-a-to-z-distroboto.html (last accessed 17 February 2014).
7. Haynes, R. B., (2002) What kind of evidence is it that evidence-based medicine advocates want health care providers and consumers to pay attention to? BMC Health Services Research, 2 (1), 3.
8. Zimerman, A. L., (2013) Evidence-based medicine: a short history of a modern medical movement. The Virtual Mentor, 15 (1), 71-76.
9. Krumholz, H. M., Radford, M. J., Wang, Y., Chen, J., Heiat, A., &, Marciniak, T. A., (1998) National use and effectiveness of beta-blockers for the treatment of elderly patients after acute myocardial infarction: National Cooperative Cardiovascular Project. Journal of the American Medical Association, 280, 623-629.
10. Mitchell, J. B., Ballard, D. J., Whisnant, J. P., Ammering, C. J., Samsa, G. P., &, Matchar, D. B., (1996) What role do neurologists play in determining the costs and outcomes of stroke patients? Stroke, 27, 1937-1943.
11. Lacchetti, C., Ioannidis, J. P., &, Guyatt, G. H., (2002) Surprising results of randomized, controlled trials. In The Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice (eds, G. Guyatt, &, D. Rennie,), pp. 247-265. Chicago, IL: AMA Publications.
12. Nelson, H. D., Humphrey, L. L., Nygren, P., Teutsch, S. M., &, Allan, J. D., (2002) Postmenopausal hormone replacement therapy. Journal of the American Medical Association, 288 (7), 872-881.
13. Shin, J., &, Haynes, R. B., (1991) Does a problem-based, self-directed undergraduate medical curriculum promote continuing clinical competence? Clinical Research, 39, 143A.
14. Le Fanu, J., (1999) The Rise and Fall of Modern Medicine. New York: Little Brown.
15. Feldstein, P. J., (2011) Health Care Economics, 7th edn. Albany, New York: Delmar.
16. European Trusted Brands Survey (2013). The brands you trust Available at: http://panorama-magazine.ch/-wpSafe/assets/-downloads/ETB-2013-Guide.pdf (last accessed 30 April 2014).
17. Howick, J. H., (2002) The Philosophy of Evidence-Based Medicine. Oxford: Wiley-Blackwell.
18. World Health Organisation (2014) Schizophrenia. Available at: http://www.who.int/mental-health/management/schizophrenia/en/ (17 February 2014).
19. BCC Research. (2010) Antipsychotic drugs: technologies and global markets. Report code: PHM063A. Available at: http://www.bccresearch.com/report/PHM063A.html (last accessed 17 February 2014).
20. World Health Organization. (2012) Global burden of mental disorders and the need for a comprehensive, coordinated response from health and social sectors at the country level. Document EB130. R, 8. Available at: http://apps.who.int/gb/ebwha/pdf-files/WHA65/A65-10-en.pdf (17 February 2014).
21. CBI Research. (2012). Antidepressants Market to 2018-Despite Safety Concerns, Selective Serotonin Re-uptake Inhibitors (SSRIs) Continue to Dominate in the Absence of Effective Therapeutic Alternatives. Available at: http://www.gbiresearch.com/Report.aspx?ID=Antidepressants-Market-to-2018-Despite-Safety-Concerns-Selective-Serotonin-Re-uptake-Inhibitors-(SSRIs)-Continue-to-Dominate-in-the-Absence-of-Effective-Therapeutic-Alternatives (last accessed 17 February 2014).
22. Sahling, D. L., (2009) Pediatric bipolar disorder: underdiagnosed or fiction? Ethical Human Psychology and Psychiatry, 11 (3), 215-228.
23. Rosenheck, R. A., Leslie, D. L., Sindelar, J., et al. (2006) Cost-effectiveness of second generation antipsychotics and perphenazine in a randomized trial of treatment for chronic schizophrenia. American Journal of Psychiatry, 163 (12), 2080-2089.
24. National Institute of Health (2006) Comparing drugs for schizophrenia. Available at: http://www.nih.gov/researchmatters/december2006/12112006drugs.htm (last accessed 17 February 2014).
25. Ioannidis, J. P., (2008) Effectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials? Philosophy, Ethics and Humanities in Medicine, 3, 14.
26. Pratt, L. A., Brody, D. J., &, Gu, Q., (2011) Antidepressant Use in Persons Aged 12 and Over: United States, 2005-2008. NCHS Data Brief, No. 76. Hyattsville, MD: National Center for Health Statistics.
27. Lieberman, J. A., Stroup, S., McEvoy, J. P., et al. (2005) Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. New England Journal of Medicine, 353, 1209-1223.
28. Jones, P. B., Barnes, T. R., Davies, L., Dunn, G., Lloyd, H., Hayhurst, K. P., Murray, R. M., Markwick, A., &, Lewis, S. W., (2006) Randomized controlled trial of the effect on quality of life of second- versus first-generation antipsychotic drugs in schizophrenia: Cost Utility of the Latest Antipsychotic Drugs in Schizophrenia Study (CUtLASS 1). Archives of General Psychiatry, 63 (10), 1079-1087.
29. Kahn, R. S., Fleischhacker, W. W., Boter, H., et al. (2008) Effectiveness of antipsychotic drugs in first-episode schizophrenia and schizophreniform disorder: an open randomised clinical trial. The Lancet, 371 (9618), 1085-1097.
30. Fournier, J. C., DeRubeis, R. J., Hollon, S. D., Dimidjian, S., Amsterdam, J. D., Shelton, R. C., &, Fawcett, J., (2010) Antidepressant drug effects and depression severity: a patient level meta-analysis. Journal of the American Medical Association, 303, 47-53.
31. Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., &, Johnson, B. T., (2008) Initial severity and antidepressant benefits: a meta-analysis of data submitted to the food and drug administration. PLoS Medicine, 5, e45.
32. Egger, M., Bartlett, C., &, Jüni, P., (2001) Are randomised controlled trials in the BMJ different? British Medical Journal, 323, 1253-1254.
33. Perlis, R. H., Perlis, C. S., Wu, Y., Hwang, C., Joseph, M., &, Nierenberg, A. A., (2005) Industry sponsorship and financial conflict of interest in the reporting of clinical trials in psychiatry. American Journal of Psychiatry, 162, 1957-1960.
34. Jorgensen, A. W., Hilden, J., &, Gøtzsche, P. C., (2006) Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. British Medical Journal, 333, 782.
35. Leopold, S. S., Warme, W. J., Fritz, B. E., &, Shott, S., (2003) Association between funding source and study outcome in orthopaedic research. Clinical Orthopaedics and Related Research, 415, 293-301.
36. Lexchin, J., Bero, L. A., Djulbegovic, B., &, Clark, O., (2003) Pharmaceutical industry sponsorship and research outcome and quality: systematic review. British Medical Journal, 326, 1167-1170.
37. Yaphe, J., Edman, R., Knishkowy, B., &, Herman, J., (2001) The association between funding by commercial interests and study outcome in randomized controlled drug trials. Family Practice, 18, 565-568.
38. Lacasse, J. R., &, Leo, J., (2010) Ghostwriting at elite academic medical centers in the United States. PLoS Medicine, 7, e1000230.
39. Roehr, B., (2011) Professor files complaint of scientific misconduct over allegation of ghostwriting. British Medical Journal, 343, d4458.
40. Chimonas, S., Stahl, F., &, Rothman, D. J., (2012) Exposing conflict of interest in psychiatry: does transparency matter? International Journal of Law and Psychiatry, 35, 490-495.
41. Heres, S., Davis, J., Maino, K., Jetzinger, E., Kissling, W., &, Leucht, S., (2006) Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsychotics. American Journal of Psychiatry, 163, 185-194.
42. Smith, R., (2005) Medical journals are an extension of the marketing arm of pharmaceutical companies. PLoS Medicine, 2 (5), e138.
43. Roehr, B., (2012) GlaxoSmithKline is fined record $3 billion in US. British Medical Journal, 345, e4568.
44. Lenzer, J., (2006) Manufacturer admits increase in suicidal behaviour in patients taking paroxetine. British Medical Journal, 332 (7551), 1175.
45. Department of Justice (2012) GlaxoSmithKline to plead guilty and pay $3 billion to resolve fraud allegations and failure to report safety data. 2 July. Available at: http://www.justice.gov/opa/pr/2012/July/12-civ-842.html (last accessed 17 February 2014).
46. Kmietowicz, Z., (2012) Johnson & Johnson to pay $2.2 bn to settle charges of false marketing on three drugs. British Medical Journal, 347, f6696.
47. Tanne, J. H., (2012) US judge fines Johnson & Johnson $1.1 bn for misleading marketing of risperidone. British Medical Journal, 344, e2772.
48. Elliot, C., (2010) White Coat, Black Hat: Adventures on the Dark Side of Medicine. Boston, MA: Beacon Press.
49. Brown, J. R., (2008) Politics, method, and medical research. Philosophy of Science, 75 (5), 756-766.
50. Cooney, G. M., Dwan, K., Greig, C. A., Lawlor, D. A., Rimer, J., Waugh, F. R., McCurdo, M., &, Mead, G. E., (2013) Exercise for depression. Cochrane Database of Systematic Reviews, (9), CD004366.
51. Palmer, S. E., McLean, R. M., Ellis, P. M., Harrison-Woolrych, M., (2008) Life-threatening clozapine-induced gastrointestinal hypomotility: an analysis of 102 cases. Journal of Clinical Psychiatry, 69 (5), 759-768.
52. Zuckerman, D., (2003) Hype in health reporting: 'checkbook science' buys distortion of medical news. International Journal of Health Services, 33 (2), 383-389.
53. Song, F., Parekh, S., Hooper, L., et al. (2010) Dissemination and publication of research findings: an updated review of related biases. Health Technology Assessment, 14 (8), iii, ix-xi, 1-193. Available at: http://www.hta.ac.uk/fullmono/mon1408.pdf (last accessed 17 February 2014).
54. Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., &, Krumholz, H. M., (2009) Trial publication after registration in clinicaltrials.gov: a cross-sectional analysis. PLoS Medicine, 6 (9), e1000144.
55. Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., &, Rosenthal, R., (2008) Selective publication of antidepressant trials and its influence on apparent efficacy. New England Journal of Medicine, 358 (3), 252-260.
56. Bekelman, J. E., Li, Y., &, Gross, P., (2003) Scope and impact of financial conflicts of interest in biomedical research. Journal of the American Medical Association, 289 (4), 454-465.
57. Dwan, K., Altman, D. G., Arnaiz, J., et al. (2008) Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS ONE, 3 (8), e3081.
58. Sterne, J. A., Gavaghan, D., &, Egger, M., (2000) Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology, 53 (11), 1119-1129.
59. Hayashino, Y., Noguchi, Y., &, Fukui, T., (2005) Systematic evaluation and comparison of statistical tests for publication bias. Journal of Epidemiology, 15 (6), 235-243.
60. Lau, J., Ioannidis, J. P., Terrin, N., Schmid, C. H., &, Olkin, I., (2006) Evidence based medicine: the case of the misleading funnel plot. British Medical Journal, 333 (7568), 597-600.
61. Ioannidis, J. P., &, Trikalinos, T. A., (2007) The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. Canadian Medical Association Journal, 176 (8), 1091-1096.
62. Tatsioni, A., Bonitsis, N. G., &, Ioannidis, J. P., (2007) Persistence of contradicted claims in the literature. Journal of the American Medical Association, 298 (21), 2517-2526.
63. Goldacre, B., (2012) Bad Pharma: How Drug Companies Mislead Doctors and Harm Patients. London: Fourth Estate.
64. Higgins, J. P. T., Altman, D. G., &, Sterne, J. A. C., (eds) (2011) Assessing risk of bias in included studies. In Cochrane Handbook for Systematic Reviews of Interventions Version 5.I.0 [updated March 2011] The Cochrane Collection. (eds., Higgins, J. P. T., &, S. Green,). Available from Handbook cochrane-org (last accessed 17 February 2014).
65. Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., &, Schünemann, H. J.,; GRADE Working Group (2008) GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. British Medical Journal, 336, 924-926.