Toward a comprehensive evidence map of overview of systematic review methods: Paper 1-purpose, eligibility, search and data extraction

Systematic Reviews

Volumn 6, Issue 1, 2017, Pages

  Lunny, Carole ^a   Brennan, Sue E ^a   McDonald, Steve ^a   McKenzie, Joanne E ^a  

^a MONASH UNIVERSITY   (Australia)

Author keywords

Evaluation of methods; Evidence mapping; Evidence synthesis; Meta review; Overview; Overview methods; Overviews of systematic reviews; Review of reviews; Systematic review methods; Umbrella review

Indexed keywords

ALGORITHM; ARTICLE; CHILD HEALTH; CLINICAL PROTOCOL; CODING; DATA BASE; DATA EXTRACTION; HUMAN; HYPOTHESIS; INFORMATION RETRIEVAL; KNOWLEDGE; METHODOLOGY; PRACTICE GUIDELINE; PRIORITY JOURNAL; SCREENING; SOFTWARE; SYSTEMATIC REVIEW; EVIDENCE BASED MEDICINE; LITERATURE;

EVIDENCE-BASED MEDICINE; HUMANS; RESEARCH DESIGN; REVIEW LITERATURE AS TOPIC;

EID: 85034782948     PISSN: None     EISSN: 20464053     Source Type: Journal    
DOI: 10.1186/s13643-017-0617-1     Document Type: Article

References (60)

1. Becker LA, Oxman AD. Overviews of reviews. Cochrane Handbook for Systematic Reviews of Interventions. In: Higgins JPT, Green S, editors. Hoboken: John Wiley & Sons; 2008. p. 607-31.
2. Chen YF, Hemming K, Chilton PJ, Gupta KK, Altman DG, Lilford RJ. Scientific hypotheses can be tested by comparing the effects of one treatment over many diseases in a systematic review. J Clin Epidemiol. 2014;67(12):1309-19.
3. Salanti G, Becker L, Caldwell D, Churchill R, Higgins J, Li T, Schmid C. Evolution of Cochrane intervention reviews and overviews of reviews to better accommodate comparisons among multiple interventions. In: Report from a meeting of the Cochrane comparing multiple interventions methods groups. Madrid: Cochrane Comparing Multiple Interventions Methods Groups; 2011.
4. CMIMG C: Review Type & Methodological Considerations --background paper for the first part of the Paris CMIMG discussion. 2012.
5. Lunny C, McKenzie JE, McDonald S. Retrieval of overviews of systematic reviews in MEDLINE was improved by the development of an objectively derived and validated search strategy. J Clin Epidemiol. 2016;74:107-18.
6. Pieper D, Buechter R, Jerinic P, Eikermann M. Overviews of reviews often have limited rigor: a systematic review. J Clin Epidemiol. 2012;65(12):1267-73.
7. Edwards P, Clarke M, DiGuiseppi C, Pratap S, Roberts I, Wentz R. Identification of randomized controlled trials in systematic reviews: accuracy and reliability of screening records. Stat Med. 2002;21(11):1635-40.
8. Snilstveit B, Vojtkova M, Bhavsar A, Stevenson J, Gaarder M. Evidence & Gap Maps: a tool for promoting evidence informed policy and strategic research agendas. J Clin Epidemiol. 2016;79:120-9.
9. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19-32.
10. Lunny C, Brennan SE, McDonald S, McKenzie JE. Evidence map of studies evaluating methods for conducting, interpreting and reporting overviews of systematic reviews of interventions: rationale and design. Syst Rev. 2016;5:4.
11. Harbour J, Fraser C, Lefebvre C, Glanville J, Beale S, Boachie C, Duffy S, McCool R, Smith L. Reporting methodological search filter performance comparisons: a literature review. Health Inf Libr J. 2014;31(3):176-94.
12. Rathbone J, Carter M, Hoffmann T, Glasziou P. A comparison of the performance of seven key bibliographic databases in identifying all relevant systematic reviews of interventions for hypertension. Syst Rev. 2016;5:27.
13. Boluyt N, Tjosvold L, Lefebvre C, Klassen TP, Offringa M. Usefulness of systematic review search strategies in finding child health systematic reviews in MEDLINE. Arch Pediatr Adolesc Med. 2008;162(2):111-6.
14. Wong SS, Wilczynski NL, Haynes RB. Comparison of top-performing search strategies for detecting clinically sound treatment studies and systematic reviews in MEDLINE and EMBASE. J Med Libr Assoc. 2006;94(4):451-5.
15. Boynton J, Glanville J, McDaid D, Lefebvre C. Identifying systematic reviews in MEDLINE: developing an objective approach to search strategy design. J Inf Sci. 1998;24(3):137-54.
16. Lee E, Dobbins M, Decorby K, McRae L, Tirilis D, Husson H. An optimal search filter for retrieving systematic reviews and meta-analyses. BMC Med Res Methodol. 2012;12:51.
17. Montori VM, Wilczynski NL, Morgan D, Haynes RB. Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005;330(7482):68.
18. White VJ, Glanville JM, Lefebvre C, Sheldon TA. A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracy. J Inf Sci. 2001;27(6):357-70.
19. Eady AM, Wilczynski NL, Haynes RB. PsycINFO search strategies identified methodologically sound therapy studies and review articles for use by clinicians and researchers. J Clin Epidemiol. 2008;61(1):34-40.
20. Golder S, McIntosh HM, Loke Y. Identifying systematic reviews of the adverse effects of health care interventions. BMC Med Res Methodol. 2006;6:22.
21. Shojania KG, Bero LA. Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract. 2001;4(4):157-62.
22. Wilczynski NL, Haynes RB. EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews. J Clin Epidemiol. 2007;60(1):29-33.
23. Wilczynski NL, Haynes RB. Consistency and accuracy of indexing systematic review articles and meta-analyses in medline. Health Inf Libr J. 2009;26(3):203-10.
24. Wilczynski NL, McKibbon KA, Haynes RB. Sensitive clinical queries retrieved relevant systematic reviews as well as primary studies: an analytic survey. J Clin Epidemiol. 2011;64(12):1341-9.
25. Zacks MP, Hersh WR. Developing search strategies for detecting high quality reviews in a hypertext test collection. Proceedings/AMIA Symp. 1998;663-7.
26. Wong SS, Wilczynski NL, Haynes RB. Optimal CINAHL search strategies for identifying therapy studies and review articles. J Nurs Scholarsh. 2006;38(2):194-9.
27. Ballard M, Montgomery P. Risk of bias in overviews of reviews: a scoping review of methodological guidance and four-item checklist. Res Synth Methods. 2017;8(1):92-108.
28. Pollock M, Fernandes RM, Becker LA, Featherstone R, Hartling L. What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary. Syst Rev. 2016;5(1):190.
29. Baker PRA, Costello JT, Dobbins M, Waters EB. The benefits and challenges of conducting an overview of systematic reviews in public health: a focus on physical activity. Aust J Public Health. 2014;36(3):517-21.
30. Bolland MJ, Grey A, Reid IR. Differences in overlapping meta-analyses of vitamin D supplements and falls. J Clin Endocrinol Metab. 2014;99(11):4265-72.
31. Caird J, Sutcliffe K, Kwan I, Dickson K, Thomas J. Mediating policy-relevant evidence at speed: are systematic reviews of systematic reviews a useful approach? Evid Policy. 2015;11(1):81-97.
32. Cooper H, Koenka AC. The overview of reviews: unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship. Am Psychol. 2012;67(6):446-62.
33. Flodgren G, Shepperd S, Eccles M. Challenges facing reviewers preparing overviews of reviews (P2A194). In: Cochrane Colloquium. Madrid; 2011.
34. Foisy M, Becker LA, Chalmers JR, Boyle RJ, Simpson EL, Williams HC. Mixing with the 'unclean': including non-Cochrane reviews alongside Cochrane reviews in overviews of reviews (P2A157). In: Cochrane Colloquium. Madrid; 2011.
35. Hartling L, Chisholm A, Thomson D, Dryden DM. A descriptive analysis of overviews of reviews published between 2000 and 2011. PLoS One. 2012;7(11):e49667.
36. Hartling L, Dryden D, Vandermeer B, Fernandes R. Generating empirical evidence to support methods for overviews of reviews. In: Cochrane Colloquium: 2013; Quebec City, Canada; 2013.
37. Hartling L, Vandermeer B, Fernandes RM. Systematic reviews, overviews of reviews and comparative effectiveness reviews: a discussion of approaches to knowledge synthesis. Evid Based Child Health Cochrane Rev J. 2014;9(2):486-94.
38. Ioannidis JPA. Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. CMAJ. 2009;181(8):488-93.
39. James BM, Baker PRA, Costello JT, Francis DP. Informing methods for preparing public health overviews of reviews: a comparison of public health overviews with Cochrane overviews published between 1999 and 2014. In: Cochrane Colloquium. Hyderabad; 2014.
40. Aromataris E, Fernandez R, Godfrey CM, Holly C, Khalil H, Tungpunkom P. Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. Int J Evid Based Healthc. 2015;13(3):132-40.
41. Joanna Briggs Institute. Methodology for JBI umbrella reviews. Adelaide: The University of Adelaide; 2014.
42. Kovacs FM, Urrutia G, Alarcon JD. "Overviews" should meet the methodological standards of systematic reviews. Eur Spine J. 2014;23(2):480.
43. Kramer S, Langendam M, Elbers R, Scholten R, Hooft L. Preparing an overview of reviews: lessons learned. Poster. In: Cochrane colloquium: 2009 Oct 11-14 2009; Singapore; 2009.
44. Li LM, Tian JT, Tian H, Sun R, Liu Y, Yang K. Quality and transparency of overviews of systematic reviews. J Evid-Based Med. 2012;5(3):166-73.
45. Buchter R, Pieper D, Jerinic P. Overviews of systematic reviews often do not assess methodological quality of included reviews. Poster. In: 19th Cochrane colloquium. Madrid: Cochrane Database Syst Rev; 2011. p. 105-6.
46. Pieper D, Antoine S-L, Morfeld J-C, Mathes T, Eikermann M. Methodological approaches in conducting overviews: current state in HTA agencies. Research Synthesis Methods. 2014;5(3):187-99.
47. Pieper D, Antoine S, Neugebauer EA, Eikermann M. Up-to-dateness of reviews is often neglected in overviews: a systematic review. J Clin Epidemiol. 2014;67(12):1302-8.
48. Robinson KA, Chou R, Berkman ND, Newberry SJ, Fu R, Hartling L, Dryden D, Butler M, Foisy M, Anderson J, et al. Integrating bodies of evidence: existing systematic reviews and primary studies. In: Methods guide for effectiveness and comparative effectiveness reviews. Rockville: Agency for Healthcare Research and Quality (US); 2008.
49. Robinson KA, Chou R, Berkman ND, Newberry SJ, Fu R, Hartling L, Dryden D, Butler M, Foisy M, Anderson J, et al. Twelve recommendations for integrating existing systematic reviews into new reviews: EPC guidance. J Clin Epidemiol. 2016;70:38-44.
50. Robinson KA, Whitlock EP, O'Neil ME, Anderson JK, Hartling L, Dryden DM, Butler M, Newberry SJ, McPheeters M, Berkman ND. Integration of existing systematic reviews. In: Research white paper (prepared by the Scientific Resource Center under contract no 290-2012-00004-C). Rockville: Agency for Healthcare Research and Quality; 2014.
51. White CM, Ip S, McPheeters MC, Tim S, Chou R, Lohr KN, Robinson K, McDonald K, Whitlock EP. Using existing systematic reviews to replace de novo processes in conducting comparative effectiveness reviews. In: Methods guide for comparative effectiveness reviews. Rockville: Agency for Healthcare Research and Quality; 2009.
52. Whitlock EP, Lin JS, Chou R, Shekelle P, Robinson KA. Using existing systematic reviews in complex systematic reviews. Ann Intern Med. 2008;148:776-82.
53. Ryan R, Hill S. Developing an overview of systematic reviews: a framework for synthesising the evidence on interventions to improve communication. In: Cochrane Colloquium: 2005; Melbourne, Australia; 2005.
54. Ryan RE, Kaufman CA, Hill SJ. Building blocks for meta-synthesis: data integration tables for summarising, mapping, and synthesising evidence on interventions for communicating with health consumers. BMC Med Res Methodol. 2009;9:16.
55. Silva V, Grande AJ, Carvalho AP, Martimbianco AL, Riera R. Overview of systematic reviews-a new type of study. Part II. Sao Paulo Med J. 2015;133(3):206-17.
56. Singh JP. Development of the metareview assessment of reporting quality (MARQ) checklist. Revista Facultad de Medicina de la Universidad Nacional de Colombia. 2012;60(4):325-32.
57. Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Med Res Methodol. 2011;11(1):15.
58. Thomson D, Russell K, Becker L, Klassen TP, Hartling L. The evolution of a new publication type: steps and challenges of producing overviews of reviews. Res Syn Method. 2010;1(3-4):198-211.
59. Thomson D, Foisy M, Oleszczuk M, Wingert A, Chisholm A, Hartling L. Overview of reviews in child health: evidence synthesis and the knowledge base for a specific population. Evid Based Child Health Cochrane Rev J. 2013;8(1):3-10.
60. Büchter R, Pieper D. How do authors of Cochrane overviews deal with conflicts of interest relating to their own systematic reviews? In: Cochrane Colloquium: 2015; Vienna, Austria; 2015.