Some Cochrane risk-of-bias items are not important in osteoarthritis trials: a meta-epidemiological study based on Cochrane reviews

Journal of Clinical Epidemiology

Volumn 95, Issue , 2018, Pages 128-136

  Bolvig, Julie ^a,b   Juhl, Carsten B ^b,c   Boutron, Isabelle ^d,e   Tugwell, Peter ^e,f   Ghogomu, Elizabeth A T ^e,f   Pardo, Jordi Pardo ^e,f   Rader, Tamara ^e,f   Wells, George A ^f   Mayhew, Alain ^e,g   Maxwell, Lara ^e   Lund, Hans ^b,h   Bliddal, Henning ^a   Christensen, Robin ^a  

^a FREDERIKSBERG HOSPITAL   (Denmark)

^b UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^c GENTOFTE UNIVERSITY HOSPITAL   (Denmark)

^d PARIS DESCARTES UNIVERSITY   (France)

^e OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^f UNIVERSITY OF OTTAWA   (Canada)

^g BRUYÈRE RESEARCH INSTITUTE   (Canada)

^h BERGEN UNIVERSITY COLLEGE   (Norway)

Author keywords

Bias; Meta analysis; Meta epidemiology; Meta research; Osteoarthritis; Pain

Indexed keywords

COCHRANE LIBRARY; COMPARATIVE STUDY; FOLLOW UP; FUNDING; HUMAN; KNEE PAIN; META ANALYSIS; OSTEOARTHRITIS; PAIN INTENSITY; POST HOC ANALYSIS; PRIORITY JOURNAL; REVIEW; RISK FACTOR; STATISTICAL BIAS; SYSTEMATIC REVIEW; CLINICAL TRIAL (TOPIC); EPIDEMIOLOGY; REGRESSION ANALYSIS;

BIAS; CLINICAL TRIALS AS TOPIC; EPIDEMIOLOGIC METHODS; HUMANS; OSTEOARTHRITIS; REGRESSION ANALYSIS;

EID: 85042466616     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2017.11.026     Document Type: Review

References (71)

1. Higgins, J.P.T., Altman, D.G., Sterne, J.A.C., Chapter 8: Assessing risk of bias in included studies. Higgins, J.P.T., Green, S., (eds.) Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 (updated March 2011), 2011, The Cochrane Collaboration Available from www.handbook.cochrane.org.
2. Gluud, L.L., Bias in clinical intervention research. Am J Epidemiol 163 (2006), 493–501.
3. Juni, P., Witschi, A., Bloch, R., Egger, M., The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 282 (1999), 1054–1060.
4. Juni, P., Sterchi, R., Dieppe, P., Systematic review of celecoxib for osteoarthritis and rheumatoid arthritis. Problems compromise review's validity. BMJ, 326, 2003, 334.
5. Lundh, A., Gotzsche, P.C., Recommendations by Cochrane Review Groups for assessment of the risk of bias in studies. BMC Med Res Methodol, 8, 2008, 22.
6. Higgins, J.P., Altman, D.G., Gotzsche, P.C., Juni, P., Moher, D., Oxman, A.D., et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ, 343, 2011, d5928.
7. Sterne, J.A., Juni, P., Schulz, K.F., Altman, D.G., Bartlett, C., Egger, M., Statistical methods for assessing the influence of study characteristics on treatment effects in ‘meta-epidemiological’ research. Stat Med 21 (2002), 1513–1524.
8. Higgins, J.P.T., Lasserson, T., Chandler, J., Tovey, D., Churchill, R., Methodological Expectations of Cochrane Intervention Reviews. 2016, London, Cochrane.
9. Wood, L., Egger, M., Gluud, L.L., Schulz, K.F., Juni, P., Altman, D.G., et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ 336 (2008), 601–605.
10. Savovic, J., Jones, H., Altman, D., Harris, R., Juni, P., Pildal, J., et al. Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol Assess 16 (2012), 1–82.
11. Turner, L., Boutron, I., Hrobjartsson, A., Altman, D.G., Moher, D., The evolution of assessing bias in Cochrane systematic reviews of interventions: celebrating methodological contributions of the Cochrane Collaboration. Syst Rev, 2, 2013, 79.
12. Cochrane Editorial Unit. Methodological Expactations of Cochrane intervention reviews (MECIR). Available at http://editorial-unit.cochrane.org/sites/editorial-unit.cochrane.org/files/uploads/MECIR%20Reporting%20standards%201.1_17122012_2.pdf Ref Type: Online Source. (Accessed 17 December 2012)
13. Dechartres, A., Trinquart, L., Boutron, I., Ravaud, P., Influence of trial sample size on treatment effect estimates: meta-epidemiological study. BMJ, 346, 2013, f2304.
14. Lundh, A., Sismondo, S., Lexchin, J., Busuioc, O.A., Bero, L., Industry sponsorship and research outcome. Cochrane Database Syst Rev(12), 2012, MR000033.
15. Nuesch, E., Trelle, S., Reichenbach, S., Rutjes, A.W., Tschannen, B., Altman, D.G., et al. Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study. BMJ, 341, 2010, c3515.
16. Nuesch, E., Reichenbach, S., Trelle, S., Rutjes, A.W., Liewald, K., Sterchi, R., et al. The importance of allocation concealment and patient blinding in osteoarthritis trials: a meta-epidemiologic study. Arthritis Rheum 61 (2009), 1633–1641.
17. Hansen, J.B., Juhl, C.B., Boutron, I., Tugwell, P., Ghogomu, E.A., Pardo, P.J., et al. Assessing bias in osteoarthritis trials included in Cochrane reviews: protocol for a meta-epidemiological study. BMJ Open, 4(10), 2014, e005491.
18. Liberati, A., Altman, D.G., Tetzlaff, J., Mulrow, C., Gotzsche, P.C., Ioannidis, J.P., et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ, 339, 2009, b2700.
19. Christensen, R., Maxwell, L., Jüni, P., Tovey, D., Williamson, P., Boers, M., et al. Consensus on the need for Hierarchical list of patient-reported pain outcomes for Metaanalyses of knee Osteoathritis trials: an OMERACT objective. J Rheumatol 42 (2015), 1971–1975.
20. Dechartres, A., Boutron, I., Trinquart, L., Charles, P., Ravaud, P., Single-center trials show larger treatment effects than multicenter trials: evidence from a meta-epidemiologic study. Ann Intern Med 155 (2011), 39–51.
21. Als-Nielsen, B., Chen, W., Gluud, C., Kjaergard, L.L., Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events?. JAMA 290 (2003), 921–928.
22. Norman, G.R., Sloan, J.A., Wyrwich, K.W., The truly remarkable universality of half a standard deviation: confirmation through another look. Expert Rev Pharmacoecon Outcomes Res 4:5 (2004), 581–585.
23. Dieppe, P.A., Lohmander, L.S., Pathogenesis and management of pain in osteoarthritis. Lancet 365 (2005), 965–973.
24. Zhang, W., Moskowitz, R.W., Nuki, G., Abramson, S., Altman, R.D., Arden, N., et al. OARSI recommendations for the management of hip and knee osteoarthritis, Part II: OARSI evidence-based, expert consensus guidelines. Osteoarthritis Cartilage 16 (2008), 137–162.
25. Cochrane Musculoskeletal Group - About us, Availeble at. http://musculoskeletal.cochrane.org/about-usAssessed 19 December 2017, Ref Type: Online Source.
26. da Costa, B.R., Nuesch, E., Rutjes, A.W., Johnston, B.C., Reichenbach, S., Trelle, S., et al. Combining follow-up and change data is valid in meta-analyses of continuous outcomes: a meta-epidemiological study. J Clin Epidemiol 66 (2013), 847–855.
27. Thompson, S.G., Higgins, J.P., How should meta-regression analyses be undertaken and interpreted?. Stat Med 21 (2002), 1559–1573.
28. van Houwelingen, H.C., Arends, L.R., Stijnen, T., Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med 21 (2002), 589–624.
29. Eriksen, P., Bartels, E.M., Altman, R.D., Bliddal, H., Juhl, C., Christensen, R., Risk of bias and brand explain the observed inconsistency in trials on glucosamine for symptomatic relief of osteoarthritis: a meta-analysis of placebo-controlled trials. Arthritis Care Res (Hoboken) 66:12 (2014), 1844–1855.
30. Bartels, E.M., Lund, H., Hagen, K.B., Dagfinrud, H., Christensen, R., Danneskiold-Samsoe, B., Aquatic exercise for the treatment of knee and hip osteoarthritis. Cochrane Database Syst Rev(4), 2007, CD005523.
31. Bellamy, N., Campbell, J., Robinson, V., Gee, T., Bourne, R., Wells, G., Viscosupplementation for the treatment of osteoarthritis of the knee. Cochrane Database Syst Rev(2), 2006, CD005321.
32. Bellamy, N., Campbell, J., Robinson, V., Gee, T., Bourne, R., Wells, G., Intraarticular corticosteroid for treatment of osteoarthritis of the knee. Cochrane Database Syst Rev(2), 2006, CD005328.
33. Cepeda, M.S., Camargo, F., Zea, C., Valencia, L., Tramadol for osteoarthritis. Cochrane Database Syst Rev(3), 2006, CD005522.
34. da Costa, B.R., Nuesch, E., Reichenbach, S., Juni, P., Rutjes, A.W., Doxycycline for osteoarthritis of the knee or hip. Cochrane Database Syst Rev(11), 2012, CD007323.
35. Fidelix, T.S., Soares, B.G., Trevisani, V.F., Diacerein for osteoarthritis. Cochrane Database Syst Rev(1), 2006, CD005117.
36. Fransen, M., McConnell, S., Exercise for osteoarthritis of the knee. Cochrane Database Syst Rev(4), 2008, CD004376.
37. Fransen, M., McConnell, S., Hernandez-Molina, G., Reichenbach, S., Exercise for osteoarthritis of the hip. Cochrane Database Syst Rev(3), 2009, CD007912.
38. Garner, S.E., Fidan, D.D., Frankish, R., Maxwell, L., Rofecoxib for osteoarthritis. Cochrane Database Syst Rev(1), 2005, CD005115.
39. Hulme, J., Robinson, V., Debie, R., Wells, G., Judd, M., Tugwell, P., Electromagnetic fields for the treatment of osteoarthritis. Cochrane Database Syst Rev(1), 2002, CD003523.
40. Kroon, F.P., van der Burg, L.R., Buchbinder, R., Osborne, R.H., Johnston, R.V., Pitt, V., Self-management education programmes for osteoarthritis. Cochrane Database Syst Rev(1), 2014, CD008963.
41. Manheimer, E., Cheng, K., Linde, K., Lao, L., Yoo, J., Wieland, S., et al. Acupuncture for peripheral joint osteoarthritis. Cochrane Database Syst Rev(1), 2010, CD001977.
42. Nuesch, E., Rutjes, A.W., Husni, E., Welch, V., Juni, P., Oral or transdermal opioids for osteoarthritis of the knee or hip. Cochrane Database Syst Rev(4), 2009, CD003115.
43. Reichenbach, S., Rutjes, A.W., Nuesch, E., Trelle, S., Juni, P., Joint lavage for osteoarthritis of the knee. Cochrane Database Syst Rev(5), 2010, CD007320.
44. Rutjes, A.W., Nuesch, E., Sterchi, R., Kalichman, L., Hendriks, E., Osiri, M., et al. Transcutaneous electrostimulation for osteoarthritis of the knee. Cochrane Database Syst Rev(4), 2009, CD002823.
45. Rutjes, A.W., Nuesch, E., Sterchi, R., Juni, P., Therapeutic ultrasound for osteoarthritis of the knee or hip. Cochrane Database Syst Rev(1), 2010, CD003132.
46. Schoonees, A., Visser, J., Musekiwa, A., Volmink, J., Pycnogenol(R) (extract of French maritime pine bark) for the treatment of chronic disorders. Cochrane Database Syst Rev(4), 2012, CD008294.
47. Towheed, T.E., Maxwell, L., Anastassiades, T.P., Shea, B., Houpt, J., Robinson, V., et al. Glucosamine therapy for treating osteoarthritis. Cochrane Database Syst Rev(2), 2005, CD002946.
48. Towheed, T.E., Maxwell, L., Judd, M.G., Catton, M., Hochberg, M.C., Wells, G., Acetaminophen for osteoarthritis. Cochrane Database Syst Rev(1), 2006, CD004257.
49. Wajon, A., Carr, E., Edmunds, I., Ada, L., Surgery for thumb (trapeziometacarpal joint) osteoarthritis. Cochrane Database Syst Rev(4), 2009, CD004631.
50. D'Ambrosio, E., Casa, B., Bompani, R., Scali, G., Scali, M., Glucosamine sulphate: a controlled clinical investigation in arthrosis. Pharmatherapeutica 2:8 (1981), 504–508.
51. Moseley, J.B. Jr., Wray, N.P., Kuykendall, D., Willis, K., Landon, G., Arthroscopic treatment of osteoarthritis of the knee: a prospective, randomized, placebo-controlled trial. Results of a pilot study. Am J Sports Med 24:1 (1996), 28–34.
52. Higgins, J.P., Thompson, S.G., Deeks, J.J., Altman, D.G., Measuring inconsistency in meta-analyses. BMJ 327 (2003), 557–560.
53. Hrobjartsson, A., Boutron, I., Blinding in randomized clinical trials: imposed impartiality. Clin Pharmacol Ther 90 (2011), 732–736.
54. Pildal, J., Hrobjartsson, A., Jorgensen, K.J., Hilden, J., Altman, D.G., Gotzsche, P.C., Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 36 (2007), 847–857.
55. Bafeta, A., Dechartres, A., Trinquart, L., Yavchitz, A., Boutron, I., Ravaud, P., Impact of single centre status on estimates of intervention effects in trials with continuous outcomes: meta-epidemiological study. BMJ, 344, 2012, e813.
56. Kjaergard, L.L., Villumsen, J., Gluud, C., Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med 135 (2001), 982–989.
57. Gluud, L.L., Thorlund, K., Gluud, C., Woods, L., Harris, R., Sterne, J.A., Correction: reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med, 149, 2008, 219.
58. Easterbrook, P.J., Berlin, J.A., Gopalan, R., Matthews, D.R., Publication bias in clinical research. Lancet 337 (1991), 867–872.
59. Herbert, R.D., Bo, K., Analysis of quality of interventions in systematic reviews. BMJ 331 (2005), 507–509.
60. Colquhoun, D., An investigation of the false discovery rate and the misinterpretation of p-values. R Soc Open Sci, 1(3), 2014.
61. Hrobjartsson, A., Gotzsche, P.C., Is the placebo powerless? An analysis of clinical trials comparing placebo with no treatment. N Engl J Med 344 (2001), 1594–1602.
62. Egger, M., Smith, G.D., Bias in location and selection of studies. BMJ 316 (1998), 61–66.
63. Song, F., Eastwood, A.J., Gilbody, S., Duley, L., Sutton, A.J., Publication and related biases. Health Technol Assess 4 (2000), 1–115.
64. Naylor, C.D., Meta-analysis and the meta-epidemiology of clinical research. BMJ 315 (1997), 617–619.
65. Hrobjartsson, A., Boutron, I., Turner, L., Altman, D.G., Moher, D., Assessing risk of bias in randomised clinical trials included in Cochrane reviews: the why is easy, the how is a challenge. Cochrane Database Syst Rev(4), 2013, ED000058.
66. Schulz, K.F., Chalmers, I., Hayes, R.J., Altman, D.G., Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 273 (1995), 408–412.
67. Shea, B.J., Grimshaw, J.M., Wells, G.A., Boers, M., Andersson, N., Hamel, C., et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol, 7, 2007, 10.
68. Guyatt, G.H., Oxman, A.D., Vist, G.E., Kunz, R., Falck-Ytter, Y., onso-Coello, P., et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 336 (2008), 924–926.
69. Hoenig, J.M., Heisey, D.M., The Abuse of power: the Pervasive Fallacy of power Calculations for data analysis. J Am Stat Assoc, 55, 2001.
70. Giraudeau, B., Higgins, J.P., Tavernier, E., Trinquart, L., Sample size calculation for meta-epidemiological studies. Stat Med 35 (2016), 239–250.
71. Kicinski, M., Springate, D.A., Kontopantelis, E., Publication bias in meta-analyses from the Cochrane database of systematic reviews. Stat Med 34 (2015), 2781–2793.