Systematic reviews and meta-analyses in coloproctology: Interpretation and potential pitfalls

Colorectal Disease

Volumn 10, Issue 1, 2008, Pages 21-32

  Wille Jørgensen, Peer ^a   Renehan, A G ^b  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADVERSE OUTCOME; CLINICAL PROTOCOL; CLINICAL RESEARCH; COLORECTAL DISEASE; COMPARATIVE STUDY; CONSENSUS DEVELOPMENT; DATA ANALYSIS; DATA SYNTHESIS; DIAGNOSTIC TEST; EVIDENCE BASED MEDICINE; INFORMATION PROCESSING; MEDICAL DECISION MAKING; MEDICAL LITERATURE; METHODOLOGY; OBSERVATIONAL STUDY; PATIENT SAFETY; PRIORITY JOURNAL; PROGNOSIS; PUBLICATION; PUBLISHING; QUALITY CONTROL; REVIEW; SCREENING TEST; SENSITIVITY ANALYSIS; SYSTEMATIC ERROR;

COLECTOMY; COLORECTAL NEOPLASMS; COLORECTAL SURGERY; CONTROLLED CLINICAL TRIALS AS TOPIC; EPIDEMIOLOGIC STUDIES; FEMALE; GREAT BRITAIN; HUMANS; MALE; META-ANALYSIS AS TOPIC; PROCTOCOLECTOMY, RESTORATIVE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REVIEW LITERATURE AS TOPIC; RISK ASSESSMENT; SENSITIVITY AND SPECIFICITY; SURVIVAL ANALYSIS; TREATMENT OUTCOME;

EID: 36949001119     PISSN: 14628910     EISSN: 14631318     Source Type: Journal    
DOI: 10.1111/j.1463-1318.2007.01421.x     Document Type: Review

References (75)

1. Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med 2007; 4: E78.
2. Renehan AG, Wille-Jorgensen P. Systematic review, cochrane and colorectal disease. Colorectal Dis 2004; 6: 73-4.
3. Egger M, Ebrahim S, Smith GD. Where now for meta-analysis? Int J Epidemiol 2002; 31: 1-5.
4. McDonald JW, Mahon J, Zarnke K, Feagan B, Simms L, Tucker W. A randomized survey of the preference of gastroenterologists for a Cochrane review versus a traditional narrative review. Can J Gastroenterol 2002; 16: 17-21.
5. Schmidt LM, Gotzsche PC. Of mites and men: Reference bias in narrative review articles: A systematic review. J Fam Pract 2005; 54: 334-8.
6. Sutton AJ, Higgins JP. Recent developments in meta-analysis. Stat Med 2007; [epub ahead of print].
7. Wille-Jorgensen P, Renehan AG. Systematic reviews: Challenging dogmas and uncovering potential harms. Colorectal Dis 2005; 7: 1-3.
8. Higgins JPT, Green S (eds) (2006) Cochrane Handbook for Systematic Review of Interventions 4.2.6 [updated September 2006] In: The Cochrane Library, 4. John Wiley & Sons Ltd, Chichester.
9. Deville WL, Buntinx F, Bouter LM, Montori VM, de Vet HC, van der Windt DA, Bezemer PD. Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol 2002; 2: 9.
10. Oosterhuis WP, Niessen RW, Bossuyt PM. The science of systematic reviewing studies of diagnostic tests. Clin Chem Lab Med 2000; 38: 577-88.
11. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. Strengthening the Reporting of Observational studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. Ann Intern Med 2007; 147: 573-7.
12. Des Jarlais DC, Lyles C, Crepaz N. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health 2004; 94: 361-6.
13. McShane LM, Altman DG, Sauerbrei W, Taube SE, Gion M, Clark GM. REporting recommendations for tumour MARKer prognostic studies (REMARK). Br J Cancer 2005; 93: 387-91.
14. Whiting PF, Weswood ME, Rutjes AW, Reitsma JB, Bossuyt PN, Kleijnen J. Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Med Res Methodol 2006; 6: 9.
15. Moher D, Schulz KF, Altman DG. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 2001; 357: 1191-4.
16. Ioannidis JP, Evans SJ, Gotzsche PC, O'Neill RT, Altman DG, Schulz K, Moher D. Better reporting of harms in randomized trials: An extension of the CONSORT statement. Ann Intern Med 2004; 141: 781-8.
17. Bian ZX, Moher D, Dagenais S, Li YP, Wu TX, Liu L, Miao JX, Song L, Zhang HM. Improving the quality of randomized controlled trials in Chinese herbal medicine, part IV: Applying a revised CONSORT checklist to measure reporting quality. Zhong Xi Yi Jie He Xue Bao 2006; 4: 233-42.
18. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet 1999; 354: 1896-900.
19. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC. Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. BMJ 2003; 326: 41-4.
20. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB. Meta-analysis of observational studies in epidemiology: A proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000; 283: 2008-12.
21. Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C. Gaboury I: does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust 2006; 185: 263-7.
22. Egger M, Smith GD, Phillips AN. Meta-analysis: Principles and procedures. BMJ 1997; 315: 1533-7.
23. Egger M, Juni P, Bartlett C. Value of flow diagrams in reports of randomized controlled trials. JAMA 2001; 285: 1996-9.
24. Wells G, Shea B, O'Connell D (2000) The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-analyses. Proceedings of the 3rd Symposium on Systematic Reviews. Beyond the basics: Improving quality and impact. July 3-5. Oxford.
25. Slim K, Nini E, Forestier D, Kwiatkowski F, Panis Y, Chipponi J. Methodological index for non-randomized studies (minors): Development and validation of a new instrument. ANZ J Surg 2003; 73: 712-6.
26. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ. Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Control Clin Trials 1996; 17: 1-12.
27. Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 1998; 52: 377-84.
28. Irwig L, Tosteson AN, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F. Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med 1994; 120: 667-76.
29. Juni P, Altman DG, Egger M. Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ 2001; 323: 42-6.
30. Sanderson S, Tatt ID, Higgins JP. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: A systematic review and annotated bibliography. Int J Epidemiol 2007; 36: 666-76.
31. Katrak P, Bialocerkowski AE, Massy-Westropp N, Kumar S, Grimmer KA. A systematic review of the content of critical appraisal tools. BMC Med Res Methodol 2004; 4: 22.
32. Juni P, Witschi A, Bloch R, Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 1999; 282: 1054-60.
33. Juni P, Egger M Allocation concealment in clinical trials. JAMA 2002; 288: 2407-8. author reply 2408-2409.
34. Renehan AG, Egger M, Saunders MP, O'Dwyer ST. Impact on survival of intensive follow up after curative resection for colorectal cancer: systematic review and meta-analysis of randomised trials. BMJ 2002; 324: 813.
35. Deeks JJ, Altman DG, Bradburn MJ (2001) Statistical methods for examining heterogeneity and combining results from several studies in meta-analysis. In: SystematicMReviews in Health Care: meta-analysis in context (eds. Egger M, Davey-Smith G, Altman DG, 2nd ed), pp 285-312. BMJ Books, London.
36. Wille-Jorgensen P, Guenaga KF, Castro AA, Matos D. Clinical value of preoperative mechanical bowel cleansing in elective colorectal surgery: a systematic review. Dis Colon Rectum 2003; 46: 1013-20.
37. Egger M, Smith GD, Sterne JA. Uses and abuses of meta-analysis. Clin Med 2001; 1: 478-84.
38. Marret E, Remy C, Bonnet F. Meta-analysis of epidural analgesia versus parenteral opioid analgesia after colorectal surgery. Br J Surg 2007; 94: 665-73.
39. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003; 327: 557-60.
40. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002; 21: 1539-58.
41. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: A comparison of methods. Stat Med 1999; 18: 2693-708.
42. Thompson SG. Why sources of heterogeneity in meta-analysis should be investigated. BMJ 1994; 309: 1351-5.
43. Thompson SG, Higgins JP. How should meta-regression analyses be undertaken and interpreted? Stat Med 2002; 21: 1559-73.
44. Rothstein HR, Sutton AJ, Borenstein M (2005) Publication bias in meta-analysis. In: Publication Bias in Meta-analysis (eds Rothstein HR, Sutton AJ, Borenstein M), pp. 1-7. John Wiley & Sons Ltd, Chichester, UK.
45. Sterne JA, Juni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research. Stat Med 2002; 21: 1513-24.
46. Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR. Empirical assessment of effect of publication bias on meta-analyses. BMJ 2000; 320: 1574-7.
47. Egger M, Smith GD. Bias in location and selection of studies. BMJ 1998; 316: 61-6.
48. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315: 629-34.
49. Juni P, Nartey L, Reichenbach S, Sterchi R, Dieppe PA, Egger M. Risk of cardiovascular events and rofecoxib: Cumulative meta-analysis. Lancet 2004; 2364: 2021-9.
50. Feinstein AR. Meta-analysis: Statistical alchemy for the 21st century. J Clin Epidemiol 1995; 48: 71-9.
51. Egger M, Smith GD Meta-Analysis. Potentials and promise. BMJ 1997; 315: 1371-4.
52. Bjelakovic G, Nikolova D, Simonetti RG, Gluud C. Antioxidant supplements for prevention of gastrointestinal cancers: A systematic review and meta-analysis. Lancet 2004; 364: 1219-28.
53. Tjandra JJ, Chan MK. Systematic review on the procedure for prolapse and hemorrhoids (stapled hemorrhoidopexy). Dis Colon Rectum 2007; 50: 878-92.
54. Hahn S, Williamson PR, Hutton JL, Garner P, Flynn EV. Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Stat Med 2000; 19: 3325-36.
55. Shapiro S. Is meta-analysis a valid approach to the evaluation of small effects in observational studies? J Clin Epidemiol 1997; 50: 223-9.
56. Audige L, Bhandari M, Griffin D, Middleton P, Reeves BC. Systematic reviews of nonrandomized clinical studies in the orthopaedic literature. Clin Orthop Relat Res 2004 Oct; (427): 249-57.
57. Fraser C, Murray A, Burr J. Identifying observational studies of surgical interventions in MEDLINE and EMBASE. BMC Med Res Methodol 2006; 6: 41.
58. MacLehose RR, Reeves BC, Harvey IM, Sheldon TA, Russell IT, Black AM. A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies. Health Technol Assess 2000; 4: 1-154.
59. Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG. Evaluating non-randomised intervention studies. Health Technol Assess 2003; 7 (27): 1-200.
60. Kunz R, Vist G, Oxman AD. Randomisation to protect against selection bias in healthcare trials. Cochrane Database Syst Rev 2007; MR000012.
61. Antoniou A, Lovegrove RE, Tilney HS, Heriot AG, John TG, Rees M, Tekkis PP, Welsh FK. Meta-analysis of clinical outcome after first and second liver resection for colorectal metastases. Surgery 2007; 141: 9-18.
62. Tilney HS, Constantinides VA, Heriot AG, Nicolaou M, Athanasiou T, Ziprin P, Darzi AW, Tekkis PP. Comparison of laparoscopic and open ileocecal resection for Crohn's disease: A metaanalysis. Surg Endosc 2006; 20: 1036-44.
63. Lovegrove RE, Heriot AG, Constantinides V, Tilney HS, Darzi AW, Fazio VW, Nicholls RJ, Tekkis PP. Meta-analysis of short-term and long-term outcomes of J, W and S ileal reservoirs for restorative proctocolectomy. Colorectal Dis 2007; 9: 310-20.
64. Egger M, Schneider M, Davey Smith G. Spurious precision? Meta-analysis of observational studies BMJ 1998; 316: 140-4.
65. Zock PL, Katan MB. Linoleic acid intake and cancer risk: A review and meta-analysis. Am J Clin Nutr 1998; 68: 142-53.
66. Sanjoaquin MA, Allen N, Couto E, Roddam AW, Key TJ. Folate intake and colorectal cancer risk: A meta-analytical approach. Int J Cancer 2005; 113: 825-8.
67. Sun CL, Yuan JM, Koh WP, Yu MC. Green tea, black tea and colorectal cancer risk: A meta-analysis of epidemiologic studies. Carcinogenesis 2006; 27: 1301-9.
68. Hulley SB, Grady D. The WHI estrogen-alone trial - do things look any better? JAMA 2004; 291: 1769-71.
69. Flossmann E, Rothwell PM. Effect of aspirin on long-term risk of colorectal cancer: Consistent evidence from randomised and observational studies. Lancet 2007; 369: 1603-13.
70. Hewitson P, Glasziou P, Irwig L, Towler B, Watson E. Screening for colorectal cancer using the faecal occult blood test, Hemoccult. Cochrane Database Syst Rev 2007; CD001216.
71. Deeks JJ. Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. BMJ 2001; 323: 157-62.
72. Munro AJ, Lain S, Lane DP. P53 abnormalities and outcomes in colorectal cancer: A systematic review. Br J Cancer 2005; 92: 434-44.
73. Parmar MK, Torri V, Stewart L. Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Stat Med 1998; 17: 2815-34.
74. Williamson PR, Smith CT, Hutton JL, Marson AG. Aggregate data meta-analysis with time-to-event outcomes. Stat Med 2002; 21: 3337-51.
75. Loke YK, Price D, Derry S, Aronson JK. Case reports of suspected adverse drug reactions-systematic literature survey of follow-up. BMJ 2006; 332: 335-9.