The inclusion of reports of randomised trials published in languages other than English in systematic reviews

Health Technology Assessment

Volumn 7, Issue 41, 2003, Pages

  Moher, D ^a,b   Pham, B ^b,c   Lawson, M L ^b   Klassen, T P ^d  

^a UNIVERSITY OF OTTAWA   (Canada)

^b CHILDREN S HOSPITAL OF EASTERN ONTARIO   (Canada)

^c GLAXOSMITHKLINE   (Canada)

^d UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALPHA INTERFERON; AMOXICILLIN PLUS CLAVULANIC ACID; ANDROGEN; ANTIBIOTIC AGENT; ANTINEOPLASTIC AGENT; ASCORBIC ACID; BCG VACCINE; BROMOCRIPTINE; DIPYRIDAMOLE; FAMOTIDINE; GLYCEROL; GONADORELIN AGONIST; HEPARIN; HYPERICUM PERFORATUM EXTRACT; IMMUNOGLOBULIN; LOW MOLECULAR WEIGHT HEPARIN; MONOXERUTIN; MUSCLE RELAXANT AGENT; ONDANSETRON; PEPPERMINT OIL; S ADENOSYLMETHIONINE; SEROTONIN UPTAKE INHIBITOR;

ACUPUNCTURE; ALTERNATIVE MEDICINE; CANCER; CLINICAL TRIAL; COCHRANE LIBRARY; CONFIDENCE INTERVAL; CONTROLLED CLINICAL TRIAL; DATA BASE; EMBASE; FINANCIAL MANAGEMENT; FISHER EXACT TEST; FRANCE; GASTROINTESTINAL DISEASE; GERMANY; HOMEOPATHY; HUMAN; INFECTION; INFORMATION SYSTEM; LANGUAGE; MALE GENITAL SYSTEM DISEASE; MEDLINE; MENTAL DISEASE; META ANALYSIS; METHODOLOGY; PUBLISHING; RANDOMIZED CONTROLLED TRIAL; RESEARCH; RESPIRATORY TRACT DISEASE; REVIEW; SELF REPORT; SENSITIVITY ANALYSIS; SYSTEMATIC REVIEW; THROMBOSIS; TUBERCULOSIS; VALIDATION PROCESS;

EID: 0347093603     PISSN: 13665278     EISSN: None     Source Type: Journal    
DOI: 10.3310/hta7410     Document Type: Review

References (72)

1. Davidoff F, Haynes RB, Sackett D, Smith R. Evidence-based medicine: A new journal to help doctors identify the information they need. BMJ 1995;310:1085-6.
2. Beecher HK. The powerful placebo. JAMA 1955;159:1602-6.
3. Egger M, Davey-Smith G, Althman DG, editors. Systematic Reviews in Health Care: Meta-analysis in Context. 2nd ed. London: BMJ Books; 2001.
4. Teo KK, Yusuf S, Collins R, Held PH, Peto R. Effects of intravenous magnesium in suspected acute myocardial infarction: Overview of randomised trials. BMJ 1991;303:1499-503.
5. ISIS-4 Collaborative Group. ISIS-4: A randomised factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58050 patients with suspected acute myocardial infarction. Lancet 1995;345:669-85.
6. Liberati A, Himel HN, Chalmers TC. A quality assessment of randomised control trials of primary treatment of breast cancer. J Clin Oncol 1986;4:942-51.
7. Hadhazy V, Ezzo J, Berman B. How valuable is effort to contact authors to obtain missing data in systematic reviews. Presented at The VII Cochrane Colloquium, Rome, 5-9 October 1999.
8. Hill CL, LaValley MP, Felson DT. Discrepancy between published report and actual conduct of randomized clinical trials. J Clin Epidemiol 2002;55:783-6.
9. Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers T. Meta-analysis of randomised controlled trials. N Engl J Med 1987;316:450-5.
10. Sacks HS, Berrier J, Reitman D, Pagano D, Chalmers TC. Meta-analyses of randomised controlled trials: An update of the quality and methodology. In: Bailer JC III, Mosteller F, editors. Medical Uses of Statistics. Boston, MA: NEJM Books, 1992. pp. 427-42.
11. Sacks HS, Reitman D, Pagano D, Kupelnick B. Meta-analysis: An update. Mt Sinai J Med 1996;63:216-24.
12. Assendelft WJ, Koes BW, Knipschild PG, Bouter LM. The relationship between methodological quality and conclusions in reviews of spinal manipulation. JAMA 1995;274:1942-8.
13. Jadad AR, McQuay HJ. Meta-analyses to evaluate analgesic interventions: A systematic qualitative review of their methodology. J Clin Epidemiol 1996;49:235-43.
14. Silagy CA. An analysis of review articles published in primary care journals. Fam Pract 1993;10:337-41.
15. Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol 1991;44:1271-8.
16. Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, et al. Agreement among reviewers of review articles. J Clin Epidemiol 1991;44:91-8.
17. Shea B, Moher D, Pham B, Graham I, Tugwell P. The quality of reporting of meta-analyses. Evaluation Health Profess 2002;25:116-29.
18. Grégoire G, Derderian F, Le Lorier J. Selecting the language of the publications included in a meta-analysis: Is there a Tower of Babel bias? J Clin Epidemiol 1995;48:159-63.
19. Moher D, Fortin P, Jadad AR, Jüni P, Klassen T, Le Lorier J, et al. Completeness of reporting of trials published in languages other than English: Implications for conduct and reporting of systematic reviews. Lancet 1996;347:363-6.
20. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomised clinical trials: Is blinding necessary? Control Clin Trials 1996;17:1-12.
21. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995;273:408-12.
22. Chalmers TC, Berrier J, Sacks HS, Levin H, Reitman D, Nagalingam R. Meta-analysis of clinical trials as a scientific discipline. II: Replicate variability and comparison of studies that agree and disagree. Stat Med 1987;6:733-44.
23. Jüni P, Holenstein F, Sterne J, Bartlett C, Egger M. Direction and impact of language bias in meta-analyses of controlled trials: Empirical study. Int J Epidemiol 2002;31:115-23
24. Vandenbroucke-Grauls CM, Vandenbroucke JP. Effect of selective decontamination of the digestive tract on respiratory tract infections and mortality in the intensive care unit. Lancet 1991;338:859-62.
25. Thülig B, Hartenauer U, Diemer W, Lawin P, Fegeler W, Kehrel R, et al. Selektive Florasuppression zur Infektionskontrolle in der operativen Intensivmedizin. Anästh Intensivther Notfallmed 1989;24:345-54.
26. Selective Decontamination of the Digestive Tract Trialists' Collaborative Group. Meta-analysis of randomised controlled trials of selective decontamination of the digestive tract. BMJ 1993;307:525-32.
27. Brun-Buisson C, Legrand P, Rauss A, Richard C, Montravers F, Besbes M, et al. Intestinal decontamination for control of nosocomial multi resistant gram-negative bacilli. Ann Intern Med 1989;110:873-81.
28. Schulz KF, Chalmers I, Grimes DA, Altman DG. Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. JAMA 1994;272:125-8.
29. Yusuf S, Wittes J, Probstfield J, Tyroler HA. Analysis and interpretation of treatment effects in subgroups of patients in randomised clinical trials. JAMA 1991;266:93-8.
30. Moher D, Pham B, Klassen TP, Schulz KF, Berlin JA, Jadad AR, et al. What contributions do languages other than English make on the results of meta-analyses? J Clin Epidemiol 2000;53:964-72.
31. Egger M, Zellweger-Zahner T, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. Lancet 1997;350:326-9.
32. Vickers A, Goyal N, Harland R, Rees R. Do certain countries produce only positive results? A systematic review of controlled trials. Control Clin Trials 1998;19:159-66.
33. Tang JL, Zhan SY, Ernst E. Review of randomised controlled trials of traditional Chinese medicine. BMJ 1999;319:160-1.
34. Moher D, Cook DJ, Jadad AR, Tugwell P, Moher M, Jones A, et al. Assessing the quality of randomised controlled trials: Implications for the conduct of meta-analyses. Health Technol Assess 1999;3:1-98.
35. McAuley L, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature influence the estimates of intervention effectiveness reported in meta-analyses? Lancet 2000;356:1228-31.
36. Shea B, Dube C, Moher D. Assessing the quality of reports of systematic reviews: The QUOROM statement compared to other tools. In: Egger M, Davey-Smith G, Altman DG,editors. Systematic Reviews in Health Care. London: BMJ Books, 2001. pp. 122-39.
37. Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychol Bull 1979;86:420-8.
38. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
39. Moher D, Dulberg CS, Wells GA. Statistical power, sample size, and their reporting in randomised controlled trials. JAMA 1994;272:122-4.
40. Robins J, Greenland S, Breslow NE. A general estimator for the variance of the Mantel-Haenszel odds ratio. Am J Epidemiol 1986;124:719-23.
41. Sampson M, Barrowman NJ, Moher D, Klassen TP, Pham B, Platt R, et al. Should systematic reviewers search Embase in addition to Medline? J Clin Epidemiol 2003;56:943-55.
42. Sterne JA, Jüni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research. Stat Med 2002;21:1513-24.
43. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7:177-88.
44. Egger M, Davey-Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997;315:629-34.
45. Macaskill P, Walter S, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Stat Med 2001;20:641-54.
46. Eliasziw M, Donner A. Application of the McNemar test to non-independent matched pair data. Stat Med 1991;12:1981-91.
47. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002;21:1539-58.
48. L'Abbé KA, Detsky AS, O'Rourke K. Meta-analysis in clinical research. Ann Intern Med 1987;107:224-33.
49. Colditz GA, Berkey CS, Mosteller F, Brewer TF, Wilson ME, Burdick E, et al. The efficacy of bacillus Calmette-Guérin vaccination of newborns and infants in the prevention of tuberculosis: Meta-analyses of the published literature. Pediatrics 1995;96:29-35.
50. Rowe BH, Spooner CH, Ducharme FM, Bretzlaff JA, Bota GW. Corticosteroids for preventing relapse following acute exacerbations of asthma. Cochrane Database Syst Rev 2001;Issue 1.
51. Linde K, Clausius N, Ramirez G, Melchart D, Eitel F, Hedges LV. Are the clinical effects of homeopathy placebo effects? A meta-analysis of placebo-controlled trials. Lancet 1997;350:834-43.
52. White AR, Rampes H, Ernst E. Acupuncture for smoking cessation. Cochrane Database Syst Rev 1997;Issue 2.
53. A'Rogvi-Hansen B, Boysen G. Glycerol for acute ischaemic stroke. Cochrane Database Syst Rev 1996;Issue 2.
54. Malaguarnera M, Restuccia S, Trovato G, Siciliano R, Motta M, Trovato BA, et al. Interferon-alpha treatment in patients with chronic hepatitis C: A meta-analytic evaluation. Clin Drug Invest 1995;9:141-9.
55. Sikorski J, Renfrew MJ. Support for breastfeeding mothers. Cochrane Database Syst Rev 1998;Issue 2.
56. Linde K, Ramirez G, Mulrow CD, Pauls A, Weidenhammer W, Melchart D. St John's wort for depression - An overview and meta-analysis of randomised clinical trials. BMJ 1996;313:253-8.
57. Jadad AR, Moher M, Browman GP, Booker L, Sigouin C, Fuentes M, et al. Systematic reviews and meta-analyses on treatment of asthma: Critical evaluation. BMJ 2000;320:537-40.
58. Choi PT, Halpern SH, Malik N, Jadad AR, Tramer MR, Walder B. Examining the evidence in anesthesia literature: A critical appraisal of systematic reviews. Anesth Analg 2001;92:700-9.
59. Moher D, Klassen TP, Pham B, Lawson ML. Evidence of journal bias against complementary and alternative medicine. Presented at the Fourth International Congress on Peer Review in Biomedical Publication, Barcelona, 2001.
60. Egger M, Smith GD. Bias in location and selection of studies. BMJ 1998;316:61-6.
61. Eisenberg DM, Davis RB, Ettner SL, Appel S, Wilkey S, Van Rompay M, et al. Trends in alternative medicine use in the United States, 1990-1997: Results of a follow-up national survey. JAMA 1998;280:1569-75.
62. Moher D, Soeken K, Sampson M, Campbell K, Ben Perot L, Berman B. Assessing the quality of reports of systematic reviews in pediatric complementary and alternative medicine. BMC (BioMedCentral) Pediatrics 2002;2:3.
63. Linde K, Jonas WB, Melchart D, Willich S. The methodological quality of randomised controlled trials of homeopathy, herbal medicines and acupuncture. Int J Epidemiol 2001;30:526-31.
64. Pittler MH, Abbot NC, Harkness E, Ernst E. Location bias in controlled clinical trials of complementary/alternative therapies. J Clin Epidemiol 2000;53:485-9.
65. Linde K, Scholz M, Ramirez G, Clausius N, Melchart D, Jonas WB. Impact of study quality on outcome in placebo-controlled trials of homeopathy. J Clin Epidemiol 1999;52:631-6.
66. Jadad AR, Cook DJ, Jones A, Klassen T, Moher M, Tugwell P, Moher D. Methodology and reports of systematic reviews and meta-analyses: A comparison of Cochrane reviews with articles published in paper-based journals. JAMA 1998;280:178-80.
67. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF, et al. Improving the quality of reports of meta-analyses of randomised controlled trials: The QUOROM statement. Quality of reporting of meta-analyses. Lancet 1999;354:1896-900.
68. Moher D, Schulz KF, Altman DG, for the CONSORT group. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Ann Intern Med 2001;134:657-62.
69. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne DR, et al. The revised CONSORT statement for reporting randomised trials: Explanation and elaboration. Ann Intern Med 2001;134:663-94.
70. Moher D, Jones A, Lepage L, for the CONSORT group. Use of the CONSORT statement and quality of reports of randomized trials: A comparative before and after evaluation? JAMA 2001;285:1992-5.
71. P. J. Devereaux, B. J. Manns, W. A. Ghali, H. Quan, G. H. Guyatt. The reporting of methodological factors in randomized controlled trials and the association with a journal policy to promote adherence to the Consolidated Standards of Reporting Trials (CONSORT) checklist. Control Clin Trials 2002;23:380-8.
72. Moher D, Sampson M, Campbell K, Beckner W, Lepage L, Gaboury I, Berman B. Assessing the quality of reports of randomized controlled trials in pediatric complementary and alternative medicine. BMC (BioMedCentral) Pediatrics 2002;2:2.