Risk-of-bias VISualization (robvis): An R package and Shiny web app for visualizing risk-of-bias assessments

Research Synthesis Methods

Volumn 12, Issue 1, 2021, Pages 55-61

  McGuinness, Luke A ^a,b   Higgins, Julian P T ^a,b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

data visualization; evidence synthesis; R; risk of bias

Indexed keywords

HUMAN; INFORMATION RETRIEVAL; INTERNET; RISK ASSESSMENT; SOFTWARE; STATISTICAL BIAS;

BIAS; DATA VISUALIZATION; HUMANS; INFORMATION STORAGE AND RETRIEVAL; INTERNET; RISK ASSESSMENT; SOFTWARE; SYSTEMATIC REVIEWS AS TOPIC;

EID: 85085108758     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.1411     Document Type: Conference Paper

References (31)

1. Donnelly CA, Boyd I, Campbell P, et al. Four principles to make evidence synthesis more useful for policy. Nature. 2018;558(7710):361-364. https://doi.org/10.1038/d41586-018-05414-4.
2. Cochrane Handbook for Systematic Reviews of Interventions Version 6.0 (Updated August 2019)Boutron I, Higgins JP, Altman DG, et al. Chapter 7: considering bias and conflicts of interest among the included studies. In: JPT H, Chandler J, Cumpston M, et al., eds. Cochrane; 2019. Retrieved from. www.training.cochrane.org/handbook.
3. Sterne JAC, Savović J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898. https://doi.org/10.1136/bmj.l4898.
4. Sterne JAC, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919. https://doi.org/10.1136/bmj.i4919.
5. Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529-536. https://doi.org/10.7326/0003-4819-155-8-201110180-00009.
6. Whiting P, Savović J, Higgins JPT, et al. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225-234. https://doi.org/10.1016/j.jclinepi.2015.06.005.
7. Higgins JPT, Altman DG. Chapter 8: Assessing risk of bias in included studies. In: JPT H, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. Hoboken, New Jersey, United States: Wiley Online Library; 2008:187-241. https://doi.org/10.1002/9780470712184.ch8.
8. Cochrane Collaboration. Review Manager (RevMan) [Computer Program]. 2014. https://community.cochrane.org/help/tools-and-software/revman-5.
9. Marshall C, Brereton P. Systematic review toolbox: a catalogue of tools to support systematic reviews. Paper presented at: Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering. EASE'15. Association for Computing Machinery; 2015: Article 23; 1–6. https://doi.org/10.1145/2745802.2745824.
10. Harrison H, Griffin SJ, Kuhn I, Usher-Smith JA. Software tools to support title and abstract screening for systematic reviews in healthcare: an evaluation. BMC Med Res Methodol. 2020;20(1):7. https://doi.org/10.1186/s12874-020-0897-3.
11. R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2019. https://www.R-project.org/.
12. RStudio Team. RStudio: Integrated Development Environment for R. Boston, MA: RStudio, Inc.; 2015.
13. Chang W, Cheng J, Allaire J, Xie Y, McPherson J. Shiny: Web Application Framework for R. Boston, MA: RStudio; 2019. Retrieved from https://CRAN.R-project.org/package=shiny.
14. McGuinness LA. Robvis: An R package for visualising risk-of-bias assessments. [Computer Software - v0.3.0]. November 2019. https://doi.org/10.5281/zenodo.3552342.
15. Harrer M, Cuijpers P, Ebert D. Doing Meta-Analysis in R: A Hands-on Guide. Erlangen, Germany: Zenodo; 2019.
16. Gibb K, Seeley A, Quinn T, et al. The consistent burden in published estimates of delirium occurrence in medical inpatients over four decades: a systematic review and meta-analysis study. medRxiv. 2019: 19005165. https://doi.org/10.1101/19005165.
17. Habadi MI, Asiri AA, Aloufi SA, et al. Prevalence of panic disorders in the primary health care setting: a systematic review and meta-analysis. EC Micro. 2019;16(1):1-9.
18. Veloso A, Vicente SG, Filipe MG. Effectiveness of cognitive training for school-aged children and adolescents with attention deficit/hyperactivity disorder: a systematic review. Front Psych. 2020;10:2983. https://doi.org/10.3389/fpsyg.2019.02983.
19. Simillis C, Singh HKSI, Afxentiou T, et al. Postoperative chemotherapy improves survival in patients with resected high-risk stage II colorectal cancer: results of a systematic review and meta-analysis. Colorectal Dis. 2020; Published online 30th January. https://doi.org/10.1111/codi.14994.
20. Tanneru K, Gautam S, Norez D, Kumar J., Alam M.U., Koocheckpour S., Balaji K.C., Joseph C. Meta-analysis and systematic review of intermediate-term follow-up of prostatic urethral lift for benign prostatic hyperplasia. Int Urol Nephrol February 2020. https://doi.org/10.1007/s11255-020-02408-y. Retrieved on 24 February 2020.
21. Higgins JPT, Altman DG, Gøtzsche PC, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. https://doi.org/10.1136/bmj.d5928.
22. Wickham H. Ggplot2: Elegant Graphics for Data Analysis. New York, NY: Springer-Verlag; 2016.
23. Wilkinson L. The Grammar of Graphics. 2nd ed. New York, NY: Springer-Verlag; 2012.
24. McGuinness L. Robvis web application. 2019. Retrieved on 20 January 2020 from https://www.riskofbias.info/welcome/robvis-visualization-tool
25. Wickham H. R Packages: Organize, Test, Document, and Share Your Code. First. O'Reilly Media, Inc.; 2015. Retrieved on 20 February 2020 from http://r-pkgs.had.co.nz/
26. Xie Y, Allaire JJ, Grolemund G. R Markdown: the Definitive Guide. Chapman and Hall/CRC; 2018. Retrieved on 1 February 2020 from https://bookdown.org/yihui/rmarkdown/
27. Various Authors. Metaverse: an R Ecosystem for Meta-Research. 2020. Retrieved on 24 February 2020 from https://rmetaverse.github.io/
28. Grames EM, Stillman AN, Tingley MW, Elphick CS. An automated approach to identifying search terms for systematic reviews using keyword co-occurrence networks. Methods Ecol Evol. 2019;10:1645-1654. https://doi.org/10.1111/2041-210X.13268.
29. Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Software. 2010;36(3):1-48. https://doi.org/10.18637/jss.v036.i03.
30. Pick JL, Nakagawa S, Noble DWA. Reproducible, flexible and high-throughput data extraction from primary literature: the metaDigitise R package. Methods Ecol Evol. 2018;10:426-431. https://doi.org/10.1101/247775.
31. Westgate MJ. Revtools: an R package to support article screening for evidence synthesis. Res Syn Meth. 2019;10:606-614. https://doi.org/10.1002/jrsm.1374.