Systematic reviews in surgery—recommendations from the Study Center of the German Society of Surgery

Langenbeck's Archives of Surgery

Volumn 406, Issue 6, 2021, Pages 1723-1731

  Kalkum, Eva ^a   Klotz, Rosa ^a   Seide, Svenja ^a   Hüttner, Felix J ^b   Kowalewski, Karl Friedrich ^c   Nickel, Felix ^a   Khajeh, Elias ^a   Knebel, Phillip ^a   Diener, Markus K ^a   Probst, Pascal ^a  

^a UNIVERSITY OF HEIDELBERG   (Germany)

^b UNIVERSITY HOSPITAL ULM   (Germany)

^c UNIVERSITY OF HEIDELBERG   (Germany)

Author keywords

Evidence based medicine; Meta analysis; Surgery; Synoptic evidence; Systematic review

Indexed keywords

COCHRANE LIBRARY; CONTROLLED CLINICAL TRIAL (TOPIC); EVIDENCE BASED MEDICINE; HUMAN; MEDLINE; META ANALYSIS; REVIEW; STANDARDIZATION; SURGICAL TECHNIQUE; SYSTEMATIC REVIEW; WEB OF SCIENCE;

HUMANS; SYSTEMATIC REVIEWS AS TOPIC;

EID: 85108017967     PISSN: 14352443     EISSN: 14352451     Source Type: Journal    
DOI: 10.1007/s00423-021-02204-x     Document Type: Review

References (57)

1. Khan KS, Kunz R, Kleijnen J, Antes G (2003) Five steps to conducting a systematic review. J R Soc Med 96(3):118–121. 10.1258/jrsm.96.3.118 DOI: 10.1258/jrsm.96.3.118
2. Krnic Martinic M, Meerpohl JJ, von Elm E, Herrle F, Marusic A, Puljak L (2019) Attitudes of editors of core clinical journals about whether systematic reviews are original research: a mixed-methods study. BMJ Open 9(8):e029704. 10.1136/bmjopen-2019-029704 DOI: 10.1136/bmjopen-2019-029704
3. Meerpohl JJ, Herrle F, Reinders S, Antes G, von Elm E (2012) Scientific value of systematic reviews: survey of editors of core clinical journals. PLoS One 7(5):e35732. 10.1371/journal.pone.0035732 DOI: 10.1371/journal.pone.0035732
4. Howes N, Chagla L, Thorpe M, McCulloch P (1997) Surgical practice is evidence based. Br J Surg 84(9):1220–1223
5. Wente MN, Seiler CM, Uhl W, Buchler MW (2003) Perspectives of evidence-based surgery. Dig Surg 20(4):263–269. 10.1159/000071183 DOI: 10.1159/000071183
6. Oxford Levels of Evidence Working Group (2011) The Oxford 2011 Levels of Evidence. http://www.cebm.net/index.aspx?o=5653 [accessed 02/02/2021].
7. Guller U (2008) Caveats in the interpretation of the surgical literature. Br J Surg 95(5):541–546. 10.1002/bjs.6156 DOI: 10.1002/bjs.6156
8. Shearman AD, Shearman CP (2012) How to practise evidence-based surgery. Surgery (Oxford) 30(9):481–485 DOI: 10.1016/j.mpsur.2012.06.005
9. Goossen K, Tenckhoff S, Probst P, Grummich K, Mihaljevic AL, Buchler MW et al (2018) Optimal literature search for systematic reviews in surgery. Langenbeck's Arch Surg 403(1):119–129. 10.1007/s00423-017-1646-x DOI: 10.1007/s00423-017-1646-x
10. Probst P, Huttner FJ, Klaiber U, Diener MK, Buchler MW, Knebel P (2015) Thirty years of disclosure of conflict of interest in surgery journals. Surgery 157(4):627–633. 10.1016/j.surg.2014.11.012 DOI: 10.1016/j.surg.2014.11.012
11. Probst P, Knebel P, Grummich K, Tenckhoff S, Ulrich A, Buchler MW et al (2016) Industry bias in randomized controlled trials in general and abdominal surgery: an empirical study. Ann Surg 264(1):87–92. 10.1097/SLA.0000000000001372 DOI: 10.1097/SLA.0000000000001372
12. Probst P, Zaschke S, Heger P, Harnoss JC, Huttner FJ, Mihaljevic AL et al (2019) Evidence-based recommendations for blinding in surgical trials. Langenbeck's Arch Surg 404(3):273–284. 10.1007/s00423-019-01761-6 DOI: 10.1007/s00423-019-01761-6
13. Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors) (2021) Cochrane handbook for systematic reviews of interventions version 6.2 (updated February 2021). Available from www.training.cochrane.org/handbook.
14. Richardson WS, Wilson MC, Nishikawa J, Hayward RS (1995) The well-built clinical question: a key to evidence-based decisions. ACP J Club 123(3):A12–A13 DOI: 10.7326/ACPJC-1995-123-3-A12
15. Blencowe NS, Mills N, Cook JA, Donovan JL, Rogers CA, Whiting P, Blazeby JM (2016) Standardizing and monitoring the delivery of surgical interventions in randomized clinical trials. Br J Surg 103(10):1377–1384. 10.1002/bjs.10254 DOI: 10.1002/bjs.10254
16. Nickel F, Haney CM, Kowalewski KF, Probst P, Limen EF, Kalkum E, Diener MK, Strobel O, Müller-Stich BP, Hackert T (2020) Laparoscopic versus open pancreaticoduodenectomy: a systematic review and meta-analysis of randomized controlled trials. Ann Surg 271(1):54–66. 10.1097/SLA.0000000000003309 DOI: 10.1097/SLA.0000000000003309
17. Billeter AT, Scheurlen KM, Probst P, Eichel S, Nickel F, Kopf S, Fischer L, Diener MK, Nawroth PP, Müller-Stich BP (2018) Meta-analysis of metabolic surgery versus medical treatment for microvascular complications in patients with type 2 diabetes mellitus. Br J Surg 105(3):168–181. 10.1002/bjs.10724 DOI: 10.1002/bjs.10724
18. Probst P, Grummich K, Harnoss JC, Huttner FJ, Jensen K, Braun S et al (2016) Placebo-controlled trials in surgery: a systematic review and meta-analysis. Medicine (Baltimore) 95(17):e3516. 10.1097/MD.0000000000003516 DOI: 10.1097/MD.0000000000003516
19. Beard DJ, Campbell MK, Blazeby JM, Carr AJ, Weijer C, Cuthbertson BH, Buchbinder R, Pinkney T, Bishop FL, Pugh J, Cousins S, Harris IA, Lohmander LS, Blencowe N, Gillies K, Probst P, Brennan C, Cook A, Farrar-Hockley D, Savulescu J, Huxtable R, Rangan A, Tracey I, Brocklehurst P, Ferreira ML, Nicholl J, Reeves BC, Hamdy F, Rowley SCS, Cook JA (2020) Considerations and methods for placebo controls in surgical trials (ASPIRE guidelines). Lancet 395(10226):828–838. 10.1016/S0140-6736(19)33137-X DOI: 10.1016/S0140-6736(19)33137-X
20. Moseley JB, O'Malley K, Petersen NJ, Menke TJ, Brody BA, Kuykendall DH, Hollingsworth JC, Ashton CM, Wray NP (2002) A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med 347(2):81–88. 10.1056/NEJMoa013259 DOI: 10.1056/NEJMoa013259
21. International Prospective Register of Systematic Reviews (PROSPERO) https://www.crd.york.ac.uk/prospero/.
22. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 372:n71. 10.1136/bmj.n71 DOI: 10.1136/bmj.n71
23. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M et al (2015) Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 4:1. 10.1186/2046-4053-4-1 DOI: 10.1186/2046-4053-4-1
24. Huttner FJ, Capdeville L, Pianka F, Ulrich A, Hackert T, Buchler MW et al (2019) Systematic review of the quantity and quality of randomized clinical trials in pancreatic surgery. Br J Surg 106(1):23–31. 10.1002/bjs.11030 DOI: 10.1002/bjs.11030
25. Dindo D, Demartines N, Clavien PA (2004) Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg 240(2):205–213. 10.1097/01.sla.0000133083.54934.ae DOI: 10.1097/01.sla.0000133083.54934.ae
26. Bassi C, Marchegiani G, Dervenis C, Sarr M, Abu Hilal M, Adham M, Allen P, Andersson R, Asbun HJ, Besselink MG, Conlon K, del Chiaro M, Falconi M, Fernandez-Cruz L, Fernandez-del Castillo C, Fingerhut A, Friess H, Gouma DJ, Hackert T, Izbicki J, Lillemoe KD, Neoptolemos JP, Olah A, Schulick R, Shrikhande SV, Takada T, Takaori K, Traverso W, Vollmer CR, Wolfgang CL, Yeo CJ, Salvia R, Buchler M, International Study Group on Pancreatic Surgery (ISGPS) (2017) The 2016 update of the International Study Group (ISGPS) definition and grading of postoperative pancreatic fistula: 11 Years After. Surgery 161(3):584–591. 10.1016/j.surg.2016.11.014 DOI: 10.1016/j.surg.2016.11.014
27. Sterne JAC, Savovic J, Page MJ, Elbers RG, Blencowe NS, Boutron I et al (2019) RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 366:l4898. 10.1136/bmj.l4898 DOI: 10.1136/bmj.l4898
28. Sterne JA, Hernan MA, Reeves BC, Savovic J, Berkman ND, Viswanathan M et al (2016) ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 355:i4919. 10.1136/bmj.i4919 DOI: 10.1136/bmj.i4919
29. Slim K, Nini E, Forestier D, Kwiatkowski F, Panis Y, Chipponi J (2003) Methodological index for non-randomized studies (MINORS): development and validation of a new instrument. ANZ J Surg 73(9):712–716. 10.1046/j.1445-2197.2003.02748.x DOI: 10.1046/j.1445-2197.2003.02748.x
30. Downs SH, Black N (1998) The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 52(6):377–384. 10.1136/jech.52.6.377 DOI: 10.1136/jech.52.6.377
31. Hayden JA, van der Windt DA, Cartwright JL, Cote P, Bombardier C (2013) Assessing bias in studies of prognostic factors. Ann Intern Med 158(4):280–286. 10.7326/0003-4819-158-4-201302190-00009 DOI: 10.7326/0003-4819-158-4-201302190-00009
32. Page MJ, McKenzie JE, Higgins JPT (2018) Tools for assessing risk of reporting biases in studies and syntheses of studies: a systematic review. BMJ Open 8(3):e019703. 10.1136/bmjopen-2017-019703 DOI: 10.1136/bmjopen-2017-019703
33. Boutron I, Guittet L, Estellat C, Moher D, Hrobjartsson A, Ravaud P (2007) Reporting methods of blinding in randomized trials assessing nonpharmacological treatments. PLoS Med 4(2):e61. 10.1371/journal.pmed.0040061 DOI: 10.1371/journal.pmed.0040061
34. Probst P, Grummich K, Heger P, Zaschke S, Knebel P, Ulrich A, Büchler MW, Diener MK (2016) Blinding in randomized controlled trials in general and abdominal surgery: protocol for a systematic review and empirical study. Syst Rev 5:48. 10.1186/s13643-016-0226-4 DOI: 10.1186/s13643-016-0226-4
35. Probst P, Ohmann S, Klaiber U, Huttner FJ, Billeter AT, Ulrich A et al (2017) Meta-analysis of immunonutrition in major abdominal surgery. Br J Surg 104(12):1594–1608. 10.1002/bjs.10659 DOI: 10.1002/bjs.10659
36. Corrigan N, Marshall H, Croft J, Copeland J, Jayne D, Brown J (2018) Exploring and adjusting for potential learning effects in ROLARR: a randomised controlled trial comparing robotic-assisted vs. standard laparoscopic surgery for rectal cancer resection. Trials 19(1):339. 10.1186/s13063-018-2726-0 DOI: 10.1186/s13063-018-2726-0
37. Wehrtmann FS, de la Garza JR, Kowalewski KF, Schmidt MW, Muller K, Tapking C et al (2020) Learning curves of laparoscopic Roux-en-Y gastric bypass and sleeve gastrectomy in bariatric surgery: a systematic review and introduction of a standardization. Obes Surg 30(2):640–656. 10.1007/s11695-019-04230-7 DOI: 10.1007/s11695-019-04230-7
38. Nickel F, Haney CM, Muller-Stich BP, Hackert T (2020) Not yet IDEAL?-evidence and learning curves of minimally invasive pancreaticoduodenectomy. Hepatobiliary Surg Nutr 9(6):812–814. 10.21037/hbsn.2020.03.22 DOI: 10.21037/hbsn.2020.03.22
39. Sterne JA, Gavaghan D, Egger M (2000) Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol 53(11):1119–1129. 10.1016/s0895-4356(00)00242-0 DOI: 10.1016/s0895-4356(00)00242-0
40. Begg, C. B., & Berlin, J. A. (1988). Publication bias - a problem in interpreting medical data. Journal of the Royal Statistical Society Series a-Statistics in Society, 151:419-463 10.2307/2982993
41. Sterne JAC, Harbord RM (2004) Funnel plots in meta-analysis. Stata J 4(2):127–141. 10.1177/1536867x0400400204 DOI: 10.1177/1536867x0400400204
42. Begg CB, Mazumdar M (1994) Operating characteristics of a rank correlation test for publication bias. Biometrics 50(4):1088–1101 DOI: 10.2307/2533446
43. Egger M, Davey Smith G, Schneider M, Minder C (1997) Bias in meta-analysis detected by a simple, graphical test. BMJ 315(7109):629–634. 10.1136/bmj.315.7109.629 DOI: 10.1136/bmj.315.7109.629
44. Page, M. J., Higgins, J. P. T., & Sterne, J. A. C. (2021). Chapter 13.3.5.4 Tests for funnel plot asymmetry In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane handbook for systematic reviews of interventions version 6.2 (updated February 2021). Cochrane, 2021. Available from www.training.cochrane.org/handbook.
45. McCulloch P, Altman DG, Campbell WB, Flum DR, Glasziou P, Marshall JC, Nicholl J (2009) No surgical innovation without evaluation: the IDEAL recommendations. Lancet 374(9695):1105–1112. 10.1016/S0140-6736(09)61116-8 DOI: 10.1016/S0140-6736(09)61116-8
46. Blencowe NS, Boddy AP, Harris A, Hanna T, Whiting P, Cook JA, Blazeby JM (2015) Systematic review of intervention design and delivery in pragmatic and explanatory surgical randomized clinical trials. Br J Surg 102(9):1037–1047. 10.1002/bjs.9808 DOI: 10.1002/bjs.9808
47. Bender, R., & Lange, S. (2007). [The 2 by 2 table]. Dtsch Med Wochenschr, 132 Suppl 1, e12-14. doi:https://doi.org/10.1055/s-2007-959029
48. Higgins JPT, Li T, Deeks JJ (editors) (2021) Chapter 6: Choosing effect measures and computing estimates of effect. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane handbook for systematic reviews of interventions version 6.2 (updated February 2021). Available from www.training.cochrane.org/handbook.
49. Borenstein M, Hedges L, Higgins J, Rothstein H (2009) Introduction to meta-analysis. West Sussex: John Wiley and Sons.
50. Borenstein M, Hedges LV, Higgins JP, Rothstein HR (2010) A basic introduction to fixed-effect and random-effects models for meta-analysis. Res Synth Methods 1(2):97–111. 10.1002/jrsm.12 DOI: 10.1002/jrsm.12
51. Ades AE, Lu G, Higgins JP (2005) The interpretation of random-effects meta-analysis in decision models. Med Decis Mak 25(6):646–654. 10.1177/0272989X05282643 DOI: 10.1177/0272989X05282643
52. Brockwell SE, Gordon IR (2001) A comparison of statistical methods for meta-analysis. Stat Med 20(6):825–840. 10.1002/sim.650 DOI: 10.1002/sim.650
53. DerSimonian R, Laird N (1986) Meta-analysis in clinical trials. Control Clin Trials 7(3):177–188. 10.1016/0197-2456(86)90046-2 DOI: 10.1016/0197-2456(86)90046-2
54. Normand SL (1999) Meta-analysis: formulating, evaluating, combining, and reporting. Stat Med 18(3):321–359. 10.1002/(sici)1097-0258(19990215)18:3<321::aid-sim28>3.0.co;2-p DOI: 10.1002/(sici)1097-0258(19990215)18:3<321::aid-sim28>3.0.co;2-p
55. Higgins JP, Thompson SG (2002) Quantifying heterogeneity in a meta-analysis. Stat Med 21(11):1539–1558. 10.1002/sim.1186 DOI: 10.1002/sim.1186
56. Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analyses. BMJ 327(7414):557–560. 10.1136/bmj.327.7414.557 DOI: 10.1136/bmj.327.7414.557
57. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, GRADE Working Group (2008) GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 336(7650):924–926. 10.1136/bmj.39489.470347.AD DOI: 10.1136/bmj.39489.470347.AD