Methodological issues in systematic reviews and meta-analyses of observational studies in orthopaedic research

Journal of Bone and Joint Surgery

Volumn 91, Issue SUPPL. 3, 2009, Pages 87-94

  Simunovic, Nicole ^a   Sprague, Sheila ^a   Bhandari, Mohit ^a  

^a MCMASTER UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL ASSESSMENT; CLINICAL TRIAL; DATA EXTRACTION; HUMAN; META ANALYSIS; METHODOLOGY; OBSERVATIONAL STUDY; ORTHOPEDICS; PATIENT SELECTION; PRIORITY JOURNAL; QUALITY CONTROL; QUANTITATIVE ANALYSIS; REVIEW; SYSTEMATIC REVIEW; ARTICLE; EPIDEMIOLOGY; EVIDENCE BASED MEDICINE; LITERATURE;

BIAS (EPIDEMIOLOGY); CLINICAL TRIALS AS TOPIC; EVIDENCE-BASED MEDICINE; HUMANS; META-ANALYSIS AS TOPIC; ORTHOPEDICS; RESEARCH DESIGN; REVIEW LITERATURE AS TOPIC;

EID: 66349136250     PISSN: 00219355     EISSN: None     Source Type: Journal    
DOI: 10.2106/JBJS.H.01576     Document Type: Review

References (36)

1. Montori VM, Swiontkowski MF, Cook DJ. Methodologic issues in systematic reviews and meta-analyses. Clin Orthop Relat Res. 2003;413:43-54.
2. Bhandari M, Morrow F, Kulkarni AV, Tornetta P 3rd. Meta-analyses in orthopaedic surgery. A systematic review of their methodologies. J Bone Joint Surg Am. 2001;83:15-24.
3. Moher D, Jadad AR, Nichol G, Penman M, Tugwell P, Walsh S. Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials. 1995;16:62-73.
4. Kunz R, Oxman AD. The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials. BMJ. 1998;317:1185-90.
5. Hulley SB, Cummings SR, Browner WS, Grady DG, Newman TB. Designing clinical research. 3rd ed. Philadelphia: Lippincott Williams and Wilkins; 2007.
6. Hartz A, Marsh JL. Methodologic issues in observational studies. Clin Orthop Relat Res. 2003;413:33-42.
7. Busse JW, Jacobs CL, Swiontkowski MF, Bosse MJ, Bhandari M; Evidence-Based Orthopaedic Trauma Working Group. Complex limb salvage or early amputation for severe lower-limb injury: a meta-analysis of observational studies. J Orthop Trauma. 2007;21:70-6.
8. Shiga T, Wajima Z, Ohe Y. Is operative delay associated with increased mortality of hip fracture patients? Systematic review, meta-analysis, and meta-regression. Can J Anaesth. 2008;55:146-54.
9. Vassallo M, Sharma JC, Briggs RS, Allen SC. Characteristics of early fallers on elderly patient rehabilitation wards. Age Ageing. 2003;32:338-42.
10. Castillo RC, Bosse MJ, MacKenzie EJ, Patterson BM; LEAP Study Group. Impact of smoking on fracture healing and risk of complications in limb-threatening open tibia fractures. J Orthop Trauma. 2005;19:151-7.
11. Felson DT. Bias in meta-analytic research. J Clin Epidemiol. 1992;45:885-92.
12. Sauerland S, Seiler CM. Role of systematic reviews and meta-analysis in evidence-based medicine. World J Surg. 2005;29:582-7.
13. Shrier I, Boivin JF, Steele RJ, Platt RW, Furlan A, Kakuma R, Brophy J, Rossignol M. Should meta-analyses of interventions include observational studies in addition to randomized controlled trials? A critical examination of underlying principles. Am J Epidemiol. 2007;166:1203-9.
14. The Cochrane Controlled Trials Register. The Cochrane Library. Issue 4 ed. Curbridge, United Kingdom: Update Software, 2001.
15. Lemeshow AR, Blum RE, Berlin JA, Stoto MA, Colditz GA. Searching one or two databases was insufficient for meta-analysis of observational studies. J Clin Epidemiol. 2005;58:867-73.
16. Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA. 1990;263:1385-9.
17. Fleiss JL. Measuring agreement between two judges on the presence or absence of a trait. Biometrics. 1975;31:651-9.
18. Donner A, Klar N. The statistical analysis of kappa statistics in multiple samples. J Clin Epidemiol. 1996;49:1053-8.
19. Davies HT, Crombie IK, Tavakoli M. When can odds ratios mislead? BMJ. 1998;316:989-91.
20. Hamlet WP, Lieberman JR, Freedman EL, Dorey FJ, Fletcher A, Johnson EE. Influence of health status and the timing of surgery on mortality in hip fracture patients. Am J Orthop. 1997;26:621-7.
21. Hardin GT. Timing of fracture fixation: a review. Orthop Rev. 1990;19:861-7.
22. Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG; International Stroke Trial Collaborative Group; European Carotid Surgery Trial Collaborative Group. Evaluating non-randomised intervention studies. Health Technol Assess. 2003;7:iii-x, 1-173.
23. Sanderson S, Tatt ID, Higgins JP. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int J Epidemiol. 2007;36:666-76.
24. Herbison P, Hay-Smith J, Gillespie WJ. Adjustment of meta-analyses on the basis of quality scores should be abandoned. J Clin Epidemiol. 2006;59:1249-56.
25. Lau J, Ioannidis JP, Schmid CH. Quantitative synthesis in systematic reviews. Ann Intern Med. 1997;127:820-6.
26. Bhandari M, Devereaux PJ, Swiontkowski MF, Tornetta P 3rd, Obremskey W, Koval KJ, Nork S, Sprague S, Schemitsch EH, Guyatt GH. Internal fixation compared with arthroplasty for displaced fractures of the femoral neck: a meta-analysis. J Bone Joint Surg Am. 2003;85:1673-81.
27. Zlowodzki M, Poolman RW, Kerkhoffs GM, Tornetta P 3rd, Bhandari M; International Evidence-Based Orthopedic Surgery Working Group. How to interpret a meta-analysis and judge its value as a guide for clinical practice. Acta Orthop. 2007;78:598-609.
28. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7:177-88.
29. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327:557-60.
30. Egger M, Schneider M, Davey Smith G. Spurious precision? Meta-analysis of observational studies. BMJ. 1998;316:140-4.
31. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000;342:1887-92.
32. Ferriter M, Huband N. Does the non-randomized controlled study have a place in the systematic review? A pilot study. Crim Behav Ment Health. 2005;15:111-20.
33. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283:2008-12.
34. Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol. 1991;44:1271-8.
35. Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, Streiner DL. Agreement among reviewers of review articles. J Clin Epidemiol. 1991;44:91-8.
36. Bhandari M, Devereaux PJ, Montori V, Cinà C, Tandan V, Guyatt GH; Evidence-Based Surgery Working Group. Users' guide to the surgical literature: how to use a systematic literature review and meta-analysis. Can J Surg. 2004;47:60-7.