Reliability and validity of three quality rating instruments for systematic reviews of observational studies

Research Synthesis Methods

Volumn 2, Issue 2, 2011, Pages 110-118

  Hootman, Jennifer M ^a   Driban, Jeffrey B ^b,c   Sitler, Michael R ^b   Harris, Kyle P ^b   Cattano, Nicole M ^d  

^a NATIONAL CENTER FOR CHRONIC DISEASE PREVENTION AND HEALTH PROMOTION   (United States)

^b TEMPLE UNIVERSITY   (United States)

^c TUFTS MEDICAL CENTER   (United States)

^d WEST CHESTER UNIVERSITY   (United States)

Author keywords

instrument psychometrics; meta analysis; research methods; systematic review

Indexed keywords

EID: 84860457135     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.41     Document Type: Article

References (46)

1. Ebell MH, Siwek J, Weiss BD, et al. 2004. Strength of recommendation taxonomy (SORT): A patient-centered approach to grading evidence in the medical literature. The Journal of the American Board of Family Practice 17: 59–67.
2. Oxford Centre for Evidence-based Medicine. Levels of Evidence. Oxford, United Kingdom: Oxford Centre for Evidence-based Medicine, 2009. http://www.cebm.net/index.aspx?o=1025 (accessed 10 June 2009).
3. Stroup DF, Berlin JA, Morton SC, et al. 2000. Meta-analysis of observational studies in epidemiology: A proposal for reporting. Journal of the American Medical Association 283: 2008–2012.
4. Moher D, Cook DJ, Eastwood S, et al. 2000. Improving the quality of reports of meta-analyses of randomised controlled trials: The QUOROM statement. British Journal of Surgery 87: 1448–54.
5. Maxwell L, Santesso N, Tugwell PS, et al. 2006. Method guidelines for Cochrane musculoskeletal group systematic reviews. Journal of Rheumatology 33: 2304–2311.
6. Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1 [updated September 2008], Chapter 13: Including non-randomized studies. The Cochrane Collaboration, 2008. Available from www.cochrane-handbook.org.
7. Khan KS, Daya S, Jadad A. 1996. The importance of quality of primary studies in producing unbiased systematic reviews. Archives of Internal Medicine 156: 661–666.
8. nd Edition). York Publishing Services ltd, York, UK. NHS Centre for Reviews and Dissemination, 2001.
9. West S, King V, Carey TS, et al. Systems to Rate the Strength of Scientific Evidence. Evidence Report/technology Assessment No. 47. AHRQ Publication No. 02-E016. Rockville, MD. Agency for Healthcare Research and Quality, 2002.
10. Deeks JJ, Dinnes J, D'Amico R, et al. 2003. Evaluating non-randomized studies. Health Technology Assessment 7(27): 1–173.
11. Sanderson S, Tatt ID, Higgins JP. 2007. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: A systematic review and annotated bibliography. International Journal of Epidemiology 36: 666–676.
12. Mallen C, Peat G, Croft P. 2006. Quality assessment of observational studies is not commonplace in systematic reviews. Journal of Clinical Epidemiology 59: 765–9.
13. Simunovic N, Sprague S, Bhandari M. 2009. Methodological issues in systematic reviews and meta-analyses of observational studies in orthopedic research. Journal of Bone and Joint Surgery 91(3 suppl): 87–94.
14. Portney L, Watkins M. 2000. Foundations of Clinical Research: Applications to Practice (2nd edn). Prentice Hall Health, Upper Saddle River, NJ, 61–110, 557–586.
15. Pai M, McCulloch M, Gorman JD, et al. 2004. Systematic reviews and meta-analyses: An illustrated, step-by-step guide. The National Medical Journal of India 17: 86–95.
16. Downs SH, Black N. 1998. The feasibility of creating a checklist for the assessment of the methodological quality both of randomized and non-randomised studies of health care interventions. Journal of Epidemiology and Community Health 52: 377–384.
17. Wells GA, Shea B, O'Connell D, et al. The Newcastle-Ottawa scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Ottawa Healthcare Institute. http://www.ohri.ca/programs/clinical_epidemiology/oxford.htm. (accessed 10 June 2009).
18. Harbour R, Miller J. 2001. A new system for grading recommendations in evidence based guidelines. BMJ 323: 334–336.
19. Scottish Intercollegiate Guidelines Network. Annex C: Critical appraisals – notes and checklists. http://www.sign.ac.uk/guidelines/fulltext/50/annexc.html (accessed 30 May 2011)
20. Cochrane Collaborative Review Group on HIV Infection and AIDS. Editorial Policy: Inclusion and Appraisal of Experimental and Non-Experimental (observational) Studies. www.igh.org/Cochrane. (accessed 27 March 2009).
21. Fleiss JL, Levin BA, Paik MC. 2003. Statistical Methods for Rates and Proportions (3rd edn). John Wiley and Sons, Wiley, NJ, 598–626.
22. Cohen J. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd edn). Lawrence Earlbaum Associates, Hillsdale, NJ, 407–466.
23. Chantraine A. 1985. Knee joint in soccer players: Osteoarthritis and axis deviation. Medicine and Science in Sports and Exercise 17: 434–439.
24. Cooper C, Snow S, McAlindon TE, et al. 2000. Risk factors for the incidence and progression of radiographic knee osteoarthritis. Arthritis and Rheumatism 43: 995–1000.
25. Deacon A, Bennell K, Kiss ZS, et al. 1997. Osteoarthritis of the knee in retired, elite Australian rules footballers. Medical Journal of Australia 166: 187–190.
26. Drawer S, Fuller CW. 2001. Propensity for osteoarthritis and lower limb joint pain in retired professional soccer players. British Journal of Sports Medicine 35: 402–408.
27. Elleuch MH, Guermazi M, Mezghanni M, et al. 2008. Knee osteoarthritis in 50 former top-level soccer players: A comparative study. Annales de Réadaptation et de Médecine Physique 51: 174–178.
28. Kettunen JA, Kujala UM, Kaprio J, et al. 2001. Lower-limb function among former elite male athletes. The American Journal of Sports Medicine 29: 2–8.
29. Kettunen JA, Kujala UM, Kaprio J, et al. 2006. Health of master track and field athletes: A 16-year follow-up study. Clinical Journal of Sport Medicine 16: 142–148.
30. Klunder KB, Rud B, Hansen J. 1980. Osteoarthritis of the hip and knee joint in retired football players. Acta Orthopaedica Scandinavica 51: 925–927.
31. Kohatsu ND, Schurman DJ. 1990. Risk factors for the development of osteoarthrosis of the knee. Clinical Orthopaedics and Related Research 261: 242–246.
32. Konradsen L, Hansen EM, Sondergaard L. 1990. Long distance running and osteoarthrosis. The American Journal of Sports Medicine 18: 379–381.
33. Kujala UM, Kaprio J, Sarna S. 1994. Osteoarthritis of weight bearing joints of lower limbs in former elite male athletes. BMJ 308(6923): 231–234.
34. Kujala UM, Kettunen J, Paananen H, et al. 1995. Knee osteoarthritis in former runners, soccer players, weight lifters, and shooters. Arthritis and Rheumatism 38: 539–546.
35. Kujala UM, Sarna S, Kaprio J, et al. 1999. Heart attacks and lower-limb function in master endurance athletes. Medicine and Science in Sports and Exercise 31: 1041–1046.
36. Lane NE, Oehlert JW, Bloch DA, et al. 1998. The relationship of running to osteoarthritis of the knee and hip and bone mineral density of the lumbar spine: A 9 year longitudinal study. Journal of Rheumatology 25: 334–341.
37. Lau EC, Cooper C, Lam D, et al. 2000. Factors associated with osteoarthritis of the hip and knee in Hong Kong Chinese: Obesity, joint injury, and occupational activities. American Journal of Epidemiology 152: 855–862.
38. Manninen P, Riihimaki H, Heliovaara M, et al. 2001. Physical exercise and risk of severe knee osteoarthritis requiring arthroplasty. Rheumatology (Oxford, England) 40: 432–437.
39. Melzer I, Yekutiel M, Sukenik S. 2001. Comparative study of osteoarthritis of the contralateral knee joint of male amputees who do and do not play volleyball. Journal of Rheumatology 28: 169–172.
40. Moretz JA III, Harlan SD, Goodrich J, et al. 1984. Long-term followup of knee injuries in high school football players. The American Journal of Sports Medicine 12: 298–300.
41. Roos H, Lindberg H, Gardsell P, et al. 1994. The prevalence of gonarthrosis and its relation to meniscectomy in former soccer players. The American Journal of Sports Medicine 22: 219–222.
42. Sandmark H, Vingard E. 1999. Sports and risk for severe osteoarthrosis of the knee. Scandinavian Journal of Medicine & Science in Sports 9: 279–284.
43. Spector TD, Harris PA, Hart DJ, et al. 1996. Risk of osteoarthritis associated with long-term weight-bearing sports: A radiologic survey of the hips and knees in female ex-athletes and population controls. Arthritis and Rheumatism 39: 988–995.
44. Sutton AJ, Muir KR, Mockett S, et al. 2001. A case-control study to investigate the relation between low and moderate levels of physical activity and osteoarthritis of the knee using data collected as part of the Allied Dunbar National Fitness Survey. Annals of the Rheumatic Diseases 60: 756–764.
45. Thelin N, Holmberg S, Thelin A. 2006. Knee injuries account for the sports-related increased risk of knee osteoarthritis. Scandinavian Journal of Medicine & Science in Sports 16: 329–333.
46. McFarlane TV, Glenny AM, Worthington HV. 2001. Systematic review of population-based epidemiological studies of oro-facial pain. Journal of Dentistry 29: 451–467.