Blinding in Physical Therapy Trials and Its Association with Treatment Effects: A Meta-epidemiological Study

American Journal of Physical Medicine and Rehabilitation

Volumn 96, Issue 1, 2017, Pages 34-44

  Armijo Olivo, Susan ^a   Fuentes, Jorge ^a,b   Da Costa, Bruno R ^c   Saltaji, Humam ^d   Ha, Christine ^e   Cummings, Greta G ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

^b UNIVERSIDAD CATÓLICA DEL MAULE   (Chile)

^c UNIVERSITY OF BERN   (Switzerland)

^d School of Dentistry   (United States)

^e Rehabilitation Research Center   (United States)

Author keywords

Blinding; Physical Therapy; Randomized Controlled Trials; Risk of Bias

Indexed keywords

COCHRANE LIBRARY; CONFIDENCE INTERVAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; EFFECT SIZE; HUMAN; META ANALYSIS; PHYSIOTHERAPY; PRACTICE GUIDELINE; SINGLE BLIND PROCEDURE; STATISTICAL SIGNIFICANCE; DOUBLE BLIND PROCEDURE; METHODOLOGY; RANDOMIZED CONTROLLED TRIAL (TOPIC);

DOUBLE-BLIND METHOD; HUMANS; PHYSICAL THERAPY MODALITIES; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; SINGLE-BLIND METHOD;

EID: 84965000238     PISSN: 08949115     EISSN: 15377385     Source Type: Journal    
DOI: 10.1097/PHM.0000000000000521     Document Type: Article

References (82)

1. Delgado-Rodríguez M Llorca J: Bias. J Epidemiol Community Health 2004; 58: 635-41
2. Gluud LL: Bias in clinical intervention research. Am J Epidemiol 2006; 163: 493-501
3. Schulz KF Grimes DA: Blinding in randomised trials: hiding who got what. Lancet 2002; 359: 696-700
4. Kjaergard LL Villumsen J Gluud C: Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med 2001; 135: 982-9
5. Nüesch E Reichenbach S Trelle S: The importance of allocation concealment and patient blinding in osteoarthritis trials: a meta-epidemiologic study. Arthritis Care Res 2009; 61: 1633-41
6. Wood L Egger M Gluud LL: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ 2008; 336: 601-5
7. Schulz KF Chalmers I Hayes RJ: Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273: 408-12
8. Savovic J Jones HE Altman DG: Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Ann Intern Med 2012; 157: 429-38
9. Als-Nielsen B Gluud L Gluud C: Methodological quality and treatment effects in randomised trials: a review of six empirical studies. Paper presented at the 12th Cochrane Colloquium 2004; October 2-6, 2004; Ottawa, Ontario, Canada
10. Balk EM Bonis PAL Moskowitz H: Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials. JAMA 2002; 287: 2973-82
11. Bialy L Vandermeer B Lacaze-Masmonteil T: A meta-epidemiological study to examine the association between bias and treatment effects in neonatal trials. Evid Based Child Health 2014; 9: 1052-9
12. Hempel S: Detection of associations between trial quality and effect sizes. 2012. Available at: http://www.ncbi.nlm.nih.gov/books/NBK84249/. Rockville (MD): Agency for Healthcare Research and Quality (US); 2012 Jan. Report No.: 12-EHC010-EF. Accessed April 7, 2016
13. Hempel S Suttorp M Miles J: Empirical evidence of associations between trial quality and effect size. 2011. Available at: http://www.ncbi.nlm.nih.gov/books/NBK56925/. Rockville (MD): Agency for Healthcare Research and Quality (US); 2011 Jun. Report No.: 11-EHC045-EF. Accessed April 7, 2016
14. Van Tulder MW Suttorp M Morton S: Empirical evidence of an association between internal validity and effect size in randomized controlled trials of low-back pain. Spine 2009; 34: 1685-92
15. Moher D Pham B Jones A: Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 1998; 352: 609-13
16. Pildal J Hróbjartsson A Jørgensen KJ: Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 2007; 36: 847-57
17. Hewitt CE Kumaravel B Dumville JC: Assessing the impact of attrition in randomized controlled trials. J Clin Epidemiol 2010; 63: 1264-70
18. Kjaergard LL Als-Nielsen B: Association between competing interests and authors' conclusions: epidemiological study of randomised clinical trials published in the BMJ. Br Med J 2002; 325: 249
19. Trowman R Dumville JC Torgerson DJ: The impact of trial baseline imbalances should be considered in systematic reviews: a methodological case study. J Clin Epidemiol 2007; 60: 1229-33
20. Boutron I Tubach F Giraudeau B: Blinding was judged more difficult to achieve and maintain in nonpharmacologic than pharmacologic trials. J Clin Epidemiol 2004; 57: 543-50
21. Villamar MF Contreras VS Kuntz RE: The reporting of blinding in physical medicine and rehabilitation randomized controlled trials: a systematic review. J Rehabil Med 2013; 45: 6-13
22. Fregni F Imamura M Chien HF: Challenges and recommendations for placebo controls in randomized trials in physical and rehabilitation medicine: a report of the international placebo symposium working group. Am J Phys Med Rehabil 2010; 89: 160-72
23. Boutron I Tubach F Giraudeau B: Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. JAMA 2003; 290: 1062-70
24. Armijo-Olivo S Fuentes C Rogers T: How should we evaluate the risk of bias of physical therapy trials? A psychometric and meta-epidemiological approach towards developing guidelines for the design, conduct, and reporting of RCTs in Physical Therapy (PT) area: a study protocol. Syst Rev 2013; 2: 88
25. Armijo-Olivo S Ospina M da Costa BR: Poor reliability between Cochrane reviewers and blinded external reviewers when applying the Cochrane risk of bias tool in physical therapy trials. PLoS One 2014; 9: e96920
26. World Confederation for Physical Therapy: Position statement: standards of physical therapy practice. World Confederation for Physical Therapy; 2011. Available at: http://www.wcpt.org/sites/wcpt.org/files/files/WCPT-Description-of-Physical-Therapy-Sep07-Rev-2.pdf. Accessed on April 7, 2016
27. Sterne JA Jüni P Schulz KF: Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research. Stat Med 2002; 21: 1513-24
28. Herbison P Hay-Smith J Gillespie WJ: Different methods of allocation to groups in randomized trials are associated with different levels of bias. A meta-epidemiological study. J Clin Epidemiol 2011; 64: 1070-5
29. Siersma V Als-Nielsen B Chen W: Multivariable modelling for meta-epidemiological assessment of the association between trial quality and treatment effects estimated in randomized clinical trials. Stat Med 2007; 26: 2745-58
30. Olivo SA Macedo LG Gadotti IC: Scales to assess the quality of randomized controlled trials: a systematic review. Phys Ther 2008; 88: 156-75
31. Friedberg JP Lipsitz SR Natarajan S: Challenges and recommendations for blinding in behavioral interventions illustrated using a case study of a behavioral intervention to lower blood pressure. Patient Educ Couns 2010; 78: 5-11
32. Armijo-Olivo S Cummings G Fuentes CJ: Identifying items to assess methodological quality in physical therapy trials: a factor analysis. Phys Ther 2014; 94: 1272-84
33. Armijo-Olivo S Saltaji H da Costa BR: What is the influence of randomisation sequence generation and allocation concealment on treatment effects of physical therapy trials? A meta-epidemiological study. BMJ Open 2015; 5: e008562
34. Nüesch E Trelle S Reichenbach S: The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study. BMJ 2009; 339: b3244
35. Nüesch E Trelle S Reichenbach S: Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study. BMJ 2010; 341: c3515
36. Cohen J: Chapter 1: the concepts of power analysis. In Cohen J (ed). Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Hillsdale, NJ, Academic Press, Inc., 1988: 1-17
37. Reichenbach S Sterchi R Scherer M: Meta-analysis: chondroitin for osteoarthritis of the knee or hip. Ann Intern Med 2007; 146: 580-90
38. DerSimonian R Laird N: Meta-analysis in clinical trials. Control Clin Trials 1986; 7: 177-88
39. Spittle A Orton J Doyle LW: Early developmental intervention programs post hospital discharge to prevent motor and cognitive impairments in preterm infants. Cochrane Database Syst Rev 2007
40. Fransen M McConnell S Hernandez MG: Exercise for osteoarthritis of the hip. Cochrane Database Syst Rev 2009
41. Handoll-Helen HG Cameron ID Mak-Jenson CS: Multidisciplinary rehabilitation for older people with hip fractures. Cochrane Database Syst Rev 2009
42. Harvey LA Brosseau L Herbert RD: Continuous passive motion following total knee arthroplasty in people with arthritis. Cochrane Database Syst Rev 2010
43. Katalinic OM Harvey LA Herbert RD: Stretch for the treatment and prevention of contractures. Cochrane Database Syst Rev 2010; (9)
44. Manheimer E Cheng K Linde K: Acupuncture for peripheral joint osteoarthritis. Cochrane Database Syst Rev 2010
45. Ostelo-Raymond WJG Costa-Leonardo OP Maher CG: Rehabilitation after lumbar disc surgery. Cochrane Database Syst Rev 2008
46. Rutjes-Anne WS Nüesch E Sterchi R: Therapeutic ultrasound for osteoarthritis of the knee or hip. Cochrane Database Syst Rev 2010
47. Rutjes-Anne WS Nüesch E Sterchi R: Transcutaneous electrostimulation for osteoarthritis of the knee. Cochrane Database Syst Rev 2009
48. Schaafsma F Schonstein E Whelan KM: Physical conditioning programs for improving work outcomes in workers with back pain. Cochrane Database Syst Rev 2010; (1)
49. Davies P Taylor F Beswick A: Promoting patient uptake and adherence in cardiac rehabilitation. Cochrane Database Syst Rev 2010
50. Effing T Monninkhof-Evelyn EM Valk-Paul PDLP: Self-management education for patients with chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2007
51. Puhan MA Gimeno SE Scharplatz M: Pulmonary rehabilitation following exacerbations of chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2009
52. Taylor RS Dalal H Jolly K: Home-based versus centre-based cardiac rehabilitation. Cochrane Database Syst Rev 2010; (1)
53. Main E Prasad A van der Schans CP: Conventional chest physiotherapy compared to other airway clearance techniques for cystic fibrosis. Cochrane Database Syst Rev 2005; (1)
54. O'Brien K Nixon S Tynan AM: Aerobic exercise interventions for adults living with HIV/AIDS. Cochrane Database Syst Rev 2010; (8)
55. Jolliffe J Rees K Taylor-Rod RS: Exercise-based rehabilitation for coronary heart disease. Cochrane Database Syst Rev 2001; (1)
56. Shaw KA Gennat HC O'Rourke P: Exercise for overweight or obesity. Cochrane Database Syst Rev 2006; (4)
57. Lacasse Y Goldstein R Lasserson TJ: Pulmonary rehabilitation for chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2010; (3)
58. Sirtori V Corbetta D Moja L: Constraint-induced movement therapy for upper extremities in stroke patients. Cochrane Database Syst Rev 2009
59. States RA Pappas E Salem Y: Overground physical therapy gait training for chronic stroke patients with mobility deficits. Cochrane Database Syst Rev 2009; (3)
60. Mead GE Morley W Campbell P: Exercise for depression. Cochrane Database Syst Rev 2009; (3)
61. Pollock A Baer G Pomeroy VM: Physiotherapy treatment approaches for the recovery of postural control and lower limb function following stroke. Cochrane Database Syst Rev 2007; (1)
62. Mehrholz J Friis R Kugler J: Treadmill training for patients with Parkinson's disease. Cochrane Database Syst Rev 2010; (1)
63. Woodford HJ Price C: EMG biofeedback for the recovery of motor function after stroke. Cochrane Database Syst Rev 2007; (2)
64. Watson L Ellis B Leng GC: Exercise for intermittent claudication. Cochrane Database Syst Rev 2010; (1)
65. Kramer MS McDonald SW: Aerobic exercise for women during pregnancy. Cochrane Database Syst Rev 2006; (3)
66. Orozco LJ Buchleitner AM Gimenez PG: Exercise or exercise and diet for preventing type 2 diabetes mellitus. Cochrane Database Syst Rev 2008; (3)
67. Bendermacher-Bianca LW Willigendael EM Teijink-Joep AW: Supervised exercise therapy versus non-supervised exercise therapy for intermittent claudication. Cochrane Database Syst Rev 2006; (2)
68. Forster A Lambley R Hardy J: Rehabilitation for older people in long-term care. Cochrane Database Syst Rev 2009; (1)
69. Cramp F Daniel J: Exercise for the management of cancer-related fatigue in adults. Cochrane Database Syst Rev 2008; (2)
70. Moseley AM Herbert RD Maher CG: Reported quality of randomized controlled trials of physiotherapy interventions has improved over time. J Clin Epidemiol 2011; 64: 594-601
71. Boutron I Guittet L Estellat C: Reporting methods of blinding in randomized trials assessing nonpharmacological treatments. PLoS Med 2007; 4: e61
72. Moroz A Freed B Tiedemann L: Blinding measured: a systematic review of randomized controlled trials of acupuncture. Evid Based Complement Alternat Med 2013; 2013: 708251
73. Zhang CS Tan HY Zhang GS: Placebo devices as effective control methods in acupuncture clinical trials: a systematic review. PLoS One 2015; 10: e0140825
74. Fuentes J Armijo-Olivo S Funabashi M: Enhanced therapeutic alliance modulates pain intensity and muscle pain sensitivity in patients with chronic low back pain: an experimental controlled study. Phys Ther 2014; 94: 477-89
75. Hansson L Hedner T Dahlöf B: Prospective randomized open blinded end-point (PROBE) study. A novel design for intervention trials. Prospective Randomized Open Blinded End-Point. Blood Press 1992; 1: 113-9
76. Johnston BC Da Costa BR Devereaux PJ: The use of expertise-based randomized controlled trials to assess spinal manipulation and acupuncture for low back pain: a systematic review. Spine 2008; 33: 914-8
77. Adamson J Cockayne S Puffer S: Review of randomised trials using the post-randomised consent (Zelen's) design. Contemp Clin Trials 2006; 27: 305-19
78. Silverman WA Altman DG: Patients' preferences and randomised trials. Lancet 1996; 347: 171-4
79. Devereaux PJ Choi PTL El-Dika S: An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol 2004; 57: 1232-6
80. Moher D Hopewell S Schulz KF: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int J Surg 2012; 10: 28-55
81. Schulz KF Altman DG Moher D: CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 2010; 340: c332
82. Sackett DL: Turning a blind eye: why we don't test for blindness at the end of our trials. BMJ 2004; 328: 1136