The hazards of scoring the quality of clinical trials for meta-analysis

JAMA

Volumn 282, Issue 11, 1999, Pages 1054-1060

  Jüni, Peter ^a   Witschi, Anne ^a   Bloch, Ralph ^d   Egger, Matthias ^b,c  

^a Clinical Epidemiology Study Group   (Switzerland)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

^c Department of Social Medicine   (United Kingdom)

^d NONE

Author keywords

[No Author keywords available]

Indexed keywords

HEPARIN; LOW MOLECULAR WEIGHT HEPARIN;

ARTICLE; CLINICAL TRIAL; DEEP VEIN THROMBOSIS; HEPARINIZATION; HUMAN; MAXIMUM LIKELIHOOD METHOD; META ANALYSIS; OUTCOMES RESEARCH; POSTOPERATIVE THROMBOSIS; PRIORITY JOURNAL; QUALITY CONTROL; REGRESSION ANALYSIS; SCORING SYSTEM; THROMBOSIS PREVENTION;

EID: 0345583669     PISSN: 00987484     EISSN: None     Source Type: Journal    
DOI: 10.1001/jama.282.11.1054     Document Type: Article

References (61)

1. Chalmers TC, Celano P, Sacks HS, Smith H Jr. Bias in treatment assignment in controlled clinical trials. N Engl J Med. 1983;309:1358-1361.
2. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. JAMA. 1995;273:408-412.
3. Moher D, Pham B, Jones A, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet. 1998;352:609-613.
4. Sackett DL, Gent M. Controversy in counting and attributing events in clinical trials. N Engl J Med. 1979; 301:1410-1412.
5. May GS, DeMets DL, Friedman LM, Furberg C, Passamani E. The randomized clinical trial: bias in analysis. Circulation. 1981;64:669-673.
6. Peduzzi P, Wittes J, Detre K, Holford T. Analysis as-randomized and the problem of non-adherence. Stat Med. 1993;12:1185-1195.
7. Schulz KF. Subverting randomization in controlled trials. JAMA. 1995;274:1456-1458.
8. Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA. 1996;276:637-639.
9. Moher D, Jadad AR, Nichol G, Penman M, Tugwell P, Walsh S. Assessing the quality of randomized controlled trials. Control Clin Trials. 1995;16:62-73.
10. Mulrow CD, Oxman AD, eds. Cochrane Collaboration handbook [Cochrane Review on CD-ROM]. Oxford, England: Cochrane Library, Update Software; 1998: issue 4.
11. Cook DJ, Sackett DL, Spitzer WO. Methodologic guidelines for systematic reviews of randomized control trials in health care from the Potsdam consultation on meta-analysis. J Clin Epidemiol. 1995;48:167-171.
12. Pogue J, Yusuf S. Overcoming the limitations of current meta-analysis of randomised controlled trials. Lancet. 1998;351:47-52.
13. Nurmohamed MT, Rosendaal FR, Buller HR, et al. Low-molecular-weight heparin versus standard heparin in general and orthopaedic surgery: a meta-analysis. Lancet. 1992;340:152-156.
14. Leizorovicz A, Haugh MC, Chapuis FR, Samama MM, Boissel JP. Low molecular weight heparin in prevention of perioperative thrombosis. BMJ. 1992;305:913-920.
15. Moher D, Jadad AR, Tugwell P. Assessing the quality of randomized controlled trials. Int J Technol Assess Health Care. 1996;12:195-208.
16. Chalmers I. Applying overviews and meta-analyses at the bedside. J Clin Epidemiol. 1995;48:67-70.
17. Andrew E. Method for assessment of the reporting standard of clinical trials with roentgen contrast media. Acta Radiol Diagn (Stockh). 1984;25:55-58.
18. Beckerman H, de Bie RA, Bouter LM, de Cuyper HJ, Oostendorp RAB. The efficacy of laser therapy for musculoskeletal and skin disorders. Phys Ther. 1992; 72:483-491.
19. Brown SA. Measurement of quality of primary studies for meta-analysis. Nurs Res. 1991;40:352-355.
20. Chalmers I, Adams M, Dickersin K, et al. A cohort study of summary reports of controlled trials. JAMA. 1990;263:1401-1405.
21. Chalmers TC, Smith H Jr, Blackburn B, et al. A method for assessing the quality of a randomized control trial. Control Clin Trials. 1981;2:31-49.
22. Cho MK, Bero LA. Instruments for assessing the quality of drug studies published in the medical literature. JAMA. 1994;272:101-104.
23. Colditz GA, Miller JN, Mosteller F. How study design affects outcomes in comparisons of therapy, I: medical. Stat Med. 1989;8:441-454.
24. Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbé KA. Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol. 1992;45:255-265.
25. Evans M, Pollock AV. A score system for evaluating random control clinical trials of prophylaxis of abdominal surgical wound infection. Br J Surg. 1985; 72:256-260.
26. Goodman SN, Berlin JA, Fletcher SW, Fletcher RH. Manuscript quality before and after peer review and editing at Annals of Internal Medicine. Ann Intern Med. 1994;121:11-21.
27. Gøtzsche PC. Methodology and overt and hidden bias in reports of 196 double-blind trials of non-steroidal antiinflammatory drugs in rheumatoid arthritis. Control Clin Trials. 1989;10:31-56.
28. Imperiale TF, McCullough AJ. Do corticosteroids reduce mortality from alcoholic hepatitis? Ann Intern Med. 1990;113:299-307.
29. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17:1-12.
30. Kleijnen J, Knipschild P, ter Riet C. Clinical trials of homoeopathy. BMJ. 1991;302:316-323.
31. Koes BW, Assendelft WJ, van der Heijden CJ, Bouter LM, Knipschild PG. Spinal manipulation and mobilisation for back and neck pain: a blinded review. BMJ. 1991;303:1298-1303.
32. Levine J. Trial assessment procedure scale (TAPS). In: Spilker B, ed. Guide to Clinical Trials. New York, NY: Raven Press; 1991:780-786.
33. Linde K, Clausius N, Ramirez G, et al. Are the clinical effects of homoeopathy placebo effects? Lancet. 1997;350:834-843.
34. Onghena P, Van Houdenhove B. Antidepressant-induced analgesia in chronic non-malignant pain. Pain. 1992;49:205-219.
35. Poynard T. Evaluation de la qualité méthodologique des essais thérapeutiques randomisés. Presse Med. 1988;17:315-318.
36. Reisch JS, Tyson JE, Mize SG. Aid to the evaluation of therapeutic studies. Pediatrics. 1989;84: 815-827.
37. Smith K, Cook D, Guyatt GH, Madhavan J, Oxman AD. Respiratory muscle training in chronic airflow limitation: a meta-analysis. Am Rev Respir Dis. 1992;145:533-539.
38. Spitzer WO, Lawrence V, Dales R, et al. Links between passive smoking and disease. Clin Invest Med. 1990;13:17-42.
39. ter Riet G, Kleijnen J, Knipschild P. Acupuncture and chronic pain: a criteria-based meta-analysis. J Clin Epidemiol. 1990;43:1191-1199.
40. Verardi S, Cortese F, Baroni B, Boffo V, Casciani CU, Palazzini E. Deep vein thrombosis prevention in surgical patients. Curr Ther Res. 1989;46:366-372.
41. Verardi S, Casciani CU, Nicora E, et al. A multicentre study on LMW-heparin effectiveness in preventing postsurgical thrombosis. Int Angiol. 1988;7:19-24.
42. Leizorovicz A, Haugh M, Boissel JP. Meta-analysis and multiple publication of clinical trial reports. Lancet. 1992;340:1102-1103.
43. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420-428.
44. Thompson SG, Sharp S. Explaining heterogeneity in meta-analysis. Stat Med. In press.
45. Noseworthy JH, Ebers GC, Vandervoort MK, Farquhar RE, Yetisir E, Roberts R. The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology. 1994;44:16-20.
46. DerSimonian R, Laird N. Meta analysis in clinical trials. Control Clin Trials. 1986;7:177-188.
47. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315:629-634.
48. Sharp S. Meta-analysis regression. State Techn Bull. 1998;42:16-22.
49. Villar J, Carroli G, Belizàn JM. Predictive ability of meta-analyses of randomised controlled trials. Lancet 1995;345:772-776.
50. Cappelleri JC, Ioannidis JPA, Schmid CH, et al. Large trials vs meta-analysis of smaller trials: how do their results compare? JAMA. 1996;276:1332-1338.
51. Le Lorier J, Grégoire G, Benhaddad A, Lapierre J, Derderian F. Discrepancies between meta-analyses and subsequent large randomized, controlled trials. N Engl J Med. 1997;337:536-542,
52. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991; 337:867-872.
53. Egger M, Zellweger-Zähner T, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. Lancet. 1997;350:326-329.
54. Gøtzsche PC. Reference bias in reports of drug trials. BMJ. 1987;295:654-656.
55. Kunz R, Oxman AD. The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials. BMJ. 1998;317:1185-1190.
56. Khan KS, Daya S, Jadad A. The importance of quality of primary studies in producing unbiased systematic reviews. Arch Intern Med. 1996;156:661-666.
57. Koch A, Bouges S, Ziegler S, Dinkel H, Daures JP, Victor N. Low molecular weight heparin and unfractionated heparin in thrombosis prophylaxis after major surgical intervention: update of previous meta-analyses. Br J Surg. 1997;84:750-759.
58. Warkentin TE, Levine MN, Hirsh J, et al. Heparin-induced thrombocytopenia in patients treated with low-molecular-weight heparin or unfractionated heparin. N Engl J Med. 1995;332:1330-1335.
59. Weitz JI. Low-molecular weight heparins. N Engl J Med. 1997;337:688-698.
60. 125-fibrinogen leg scanning. Thromb Haemost 1993;69:2-7.
61. Greenland S. Quality scores are useless and potentially misleading [reply to re: a critical look at some popular analytic methods]. Am J Epidemiol. 1994; 140:300-302.