AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews

Journal of Clinical Epidemiology

Volumn 62, Issue 10, 2009, Pages 1013-1020

  Shea, Beverley J ^a,b   Hamel, Candyce ^a   Wells, George A ^c,d   Bouter, Lex M ^b   Kristjansson, Elizabeth ^d   Grimshaw, Jeremy ^e   Henry, David A ^f   Boers, Maarten ^b  

^a Institute of Population Health ^*  (Canada)

^b VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^c UNIVERSITY OF OTTAWA HEART INSTITUTE   (Canada)

^d UNIVERSITY OF OTTAWA   (Canada)

^e OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^f INSTITUTE FOR CLINICAL EVALUATIVE SCIENCES   (Canada)

Author keywords

Feasibility; Meta analysis; Methodological quality; Reliability; Systematic reviews; Validity

Indexed keywords

ARTICLE; CLINICAL ASSESSMENT TOOL; CONFIDENCE INTERVAL; CORRELATION COEFFICIENT; FEASIBILITY STUDY; HUMAN; INTERRATER RELIABILITY; KAPPA STATISTICS; MEASUREMENT; PRIORITY JOURNAL; QUALITY CONTROL; QUESTIONNAIRE; RANK SUM TEST; RELIABILITY; SYSTEMATIC REVIEW; VALIDITY;

EVIDENCE-BASED MEDICINE; FEASIBILITY STUDIES; HUMANS; OBSERVER VARIATION; QUALITY CONTROL; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; REVIEW LITERATURE AS TOPIC;

EID: 67849127882     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2008.10.009     Document Type: Article

References (54)

1. Moher D., Jadad A.R., Nichol G., Penman M., Tugwell P., and Walsh S. Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials 16 (1995) 62-73
2. Shea B., Dubé C., and Moher D. Assessing the quality of reports of systematic reviews: the QUOROM statement compared to other tools. In: Egger M., Smith G.D., and Altman D.G. (Eds). Systematic reviews in health care: meta-analysis in context (2001), BMJ Books, London 122-139
3. Oxman A.D., and Guyatt G.H. Validation of an index of the quality of review articles. J Clin Epidemiol 44 (1991) 1271-1278
4. Sacks H., Berrier J., Reitman D., Ancona-Berk V.A., and Chalmers T.C. Meta-analyses of randomized controlled trials. N Engl J Med 316 (1987) 450-455
5. Shea B., Grimshaw J., Wells G., Boers M., Andersson N., Hamel C., et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 7 (2007) 10
6. Shea B.J., Bouter L.M., Peterson J., Boers M., Andersson N., Ortiz Z., et al. External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS ONE 2 12 (2007) e1350 10.1371/journal.pone.0001350 Published online December 26, 2007
7. Anonymous. Effects of adjuvant tamoxifen and of cytotoxic therapy on mortality in early breast cancer. An overview of 61 randomized trials among 28,896 women. Early Breast Cancer Trialists' Collaborative Group. NEJM 319 (1989) 1681-1692
8. Appel L.J., Miller E.R., Seidler A.J., and Whelton P.K. Does supplementation of diet with "fish oil" reduce blood pressure. Arch Intern Med 153 (1993) 1429-1438
9. Buring J.E., Evans D.A., Mayrent S.L., Rosner B., Colton T., and Hennekens C.H. Randomized trials of aminoglycoside antibiotics: quantitative overview. Rev Inf Dis 10 (1988) 951-957
10. Chalmers T.C., Matta R.J., Smith H., and Kunzler A.M. Evidence favouring the use of anticoagulants in the hospital phase of acute myocardial infarction. NEJM 297 (1977) 1091-1096
11. Clagett G.P., and Reisch J.S. Prevention of venous thromboembolism in general surgical patients. Results of meta-analysis. Ann Surg 208 (1988) 227-240
12. Counsell C., Warlow C., and Naylor R. Different patches in carotoid surgery. Cochrane Library issue 3 (1996)
13. Daya S. Comparison of FSH and HMG in IVF. Cochrane Library 3 (1996)
14. Duley L., Gulmezoglu A.M., and Henderson-Smart D.J. Anticonvulsants for pre-eclampsia. Cochrane Library 3 (1996)
15. Fanning J., Bennett T.Z., and Hilgers R.D. Meta-analysis of cisplatin, doxorubicin, and cyclophosphamide versus cisplatin and cyclophosphamide chemotherapy of ovarian carcinoma. Obstet Gynecol 80 (1992) 954-960
16. Gent M., and Roberts R.S. A meta-analysis of the studies of dihydroergotamine plus heparin in the prophylaxis of deep vein thrombosis. Chest 89 (1986) 396S-400S
17. Gotzsche P.C., Gjorup I., Bonnen H., Brahe N.E., Becker U., and Burcharth F. Somatostatin vs placebo in bleeding oesophageal varices: randomised trial and meta-analysis. BMJ 310 (1995) 1495-1498
18. Graves P. Malaria vaccines. Cochrane Library Issue 3 (1996)
19. Henderson W.G., Goldman S., Copeland J., Moritz T.E., and Harker L.A. Antiplatelet or anticoagulant therapy, after coronary artery bypass surgery: a meta-analysis of clinical trials. Ann Intern Med 111 (1989) 743-750
20. Hodnett E.D. Alternative versus conventional delivery settings. Cochrane Library 3 (1996)
21. Hofmeyr G.J. Abdominal decompression. Cochrane Library 3 (1996)
22. Hopfenmuller W. Nackweis der therapeutischen Wirksamkeit eines Ginkgo biloba-Spezial extrakes: Meta-Analyse von 11 klinischen Studien bei Patienten mit Hirnleistungsstorungen im Alter. Arzneimittel-Forschung 44 (1994) 1005-1013
23. Hughes E., Fedorkow D.M., Daya S., Sagle M.A., van de Kopple P., and Collins J.A. The routine use of gonadotropin-releasing hormone agonists prior to in vitro fertilization and gamete intra-fallopian transfer: a meta-analysis of randomized controlled trials. Fertil Steril 58 (1992) 888-896
24. Kaufmann P.G., Jacob R.G., Ewart C.K., Chesney M.A., Muenz L.R., Doub N., et al. Hypertension Intervention Pooling Project. Health Psychol 7 Suppl (1988) 209-224
25. Kramer M.S. Maternal antigen avoidance as lactation. Cochrane Library 3 (1996)
26. Lycka B.A. Postherpetic neuralgia and systemic corticosteroid therapy. Efficacy and safety. Int J Dermatol 29 (1990) 523-527
27. McGrath J.J., and Soares K.V.S. Tardive dyskinesia and benzodiazepines. Cochrane Library 3 (1996)
28. Mulrow C.D., Mulrow J.P., Linn W.D., Aguilar C., and Ramirez C. Relative efficacy of vasodilator therapy in chronic congestive heart failure. Implications of randomized trials. JAMA 259 (1988) 3422-3426
29. Ohlsson A. Treatments of preterm premature rupture of the membranes: a meta-analysis. Am J Obstet Gynecol 160 (1989) 890-906
30. Perez-Escamilla R., Pollitt E., Lonnerdal B., and Dewey K.G. Infant feeding policies in maternity wards and their effect on breast-feeding success: an analytical overview. Am J Public Health 84 (1994) 89-97
31. Renfrew M.J., and Lang S. Breastfeeding and discharge times. Cochrane Library 3 (1996)
32. Renfrew M.J., and Lang S. Breastfeeding and early contact. Cochrane Library 3 (1996)
33. Soares K.V.S., McGrath J.J., and Deeks J.J. Tardive dyskinesia and GABA agonist drugs. Cochrane Library 3 (1996)
34. Thacker S.B. Quality of controlled clinical trials. The case of imaging ultrasound in obstetrics: a review. BJOG 92 (1985) 437-444
35. Velanovich V. Crystalloid versus colloid fluid resuscitation: a meta-analysis of mortality. Surgery 105 (1989) 65-71
36. Wilson A.P.R., Shrimpton S., and Jaderberg M. A meta-analysis of the use of amoxycillin-clavulanic acid in surgical prophylaxis. J Hosp Infect 22 (1992) 9-21
37. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 20 (1960) 37-46
38. Bland J.M., and Altman D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet i (1986) 307-310. http://www-users.york.ac.uk/∼mb55/meas/ba.htm
39. Bland J.M., and Altman D.G. Statistical methods for assessing agreement between measurements. Biochim Clin 11 (1987) 399-404
40. Anonymous. This week's citation classic: comparing methods of clinical measurement. Curr Contents 1992; CC/NUMBER 40: 8. Available at http://garfield.library.upenn.edu/classics1992/A1992JN24800001.pdf.
41. Uebersax J.S. Diversity of decision-making models and the measurement of inter-rater agreement. Psychol Bull 101 (1987) 140-146
42. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70 (1968) 213-220
43. Tugwell P., and Bombardier C. A methodological framework for developing and selecting endpoints in clinical trials. J Rheumatol 9 (1982) 758-762
44. Singh S., Bai A., Lal A., Yu C., and Ahmed F. Developing evidence-based best practices for the prescribing and use of proton pump inhibitors in Canada (2006), The Canadian Agency for Drugs and Technologies in Health (CADTH), Ottawa, Canada
45. Balk E., Bonis P., Moskowitz H., Schmid C., Ioannidis J., Wang C., et al. Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials. JAMA 287 (2002) 2973-2982
46. Jüni P., Altman D.G., and Egger M. Assessing the quality of controlled clinical trials. In: Egger M., Davey Smith G., and Altman D.G. (Eds). Systematic reviews in health care: meta-analysis in context. 2nd ed (2001), BMJ Books, London
47. Barnes D.E., and Bero L.A. Why review articles on the health effects of passive smoking reach different conclusions. JAMA 279 (1998) 1566-1570
48. Biondi-Zoccai G., Lotrionte M., Abbate A., and Testa L. Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study. BMJ 332 (2006) 202-206
49. Chou R., and Helfand M. Challenges in systematic reviews that assess treatment harms. Ann Intern Med 142 (2005) 1090-1099
50. Turner E.H., Matthews A.M., Linardatos E., Tell R.A., and Rosenthal R. Selective Publication of antidepressant trials and its influence on apparent efficacy. N Eng J Med 358 (2008) 252-260
51. Whittington C.J., Kendall T., Fonagy P., Cottrell D., Cotgrove A., and Boddington E. Selective serotonin reuptake inhibitors in childhood depression: systematic review of published versus unpublished data. Lancet 363 (2004) 1341-1345
52. McGinn T., Guyatt G., Cook R., and Meade M. Diagnosis: measuring agreement beyond chance. In: Guyatt G., and Rennie D. (Eds). Users' guide to the medical literature. A manual for evidence-based clinical practice (2002), AMA Press, Chicago, IL 461-470
53. Moher D., Cook D.J., Eastwood S., Olkin I., and Rennie D. Stroup D for the QUOROM group. Improving the reporting quality of meta-analysis of randomized controlled trials: the QUOROM statement. Lancet 354 (1999) 1896-1900
54. Oxman A.D., Schünemann H.J., and Fretheim A. Improving the use of research evidence in guideline development: synthesis and presentation of evidence. Health Res Policy Syst 4 (2006) 20. http://www.health-policy-systems.com/content/4/1/20 10.1186/1478-4505-4-20 Received April 7, 2006, Accepted December 5, 2006. Available at