Observer bias in randomized clinical trials with time-to-event outcomes: Systematic review of trials with both blinded and non-blinded outcome assessors

International Journal of Epidemiology

Volumn 43, Issue 3, 2014, Pages 937-948

  Hróbjartsson, Asbjørn ^a   Thomsen, Ann Sofia Skou ^a   Emanuelsson, Frida ^a   Tendal, Britta ^a   Rasmussen, Jeppe Vejlgaard ^b   Hilden, Jørgen ^c   Boutron, Isabelle ^d   Ravaud, Philippe ^d   Brorson, Stig ^b  

^a Rigshospitalet   (Denmark)

^b GENTOFTE UNIVERSITY HOSPITAL   (Denmark)

^c UNIVERSITY OF COPENHAGEN   (Denmark)

^d HÔTEL DIEU   (France)

Author keywords

Bias; Blinding; Observer bias; Randomized clinical trials; Time to event

Indexed keywords

DRUG; PLACEBO;

DRUG; HEALTH RISK; LITERATURE REVIEW; META-ANALYSIS; PUBLIC HEALTH; QUALITATIVE ANALYSIS;

ARTICLE; CYTOMEGALOVIRUS RETINITIS; DOUBLE BLIND PROCEDURE; HUMAN; META ANALYSIS (TOPIC); MULTIPLE SCLEROSIS; OBSERVER BIAS; OUTCOME ASSESSMENT; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); SYSTEMATIC REVIEW; TIBIA FRACTURE; TIME; TIME TO EVENT OUTCOME; META ANALYSIS; METHODOLOGY; OBSERVER VARIATION; PROCEDURES; SINGLE BLIND PROCEDURE;

CYTOMEGALOVIRUS;

HUMANS; OBSERVER VARIATION; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; SINGLE-BLIND METHOD;

EID: 84902649358     PISSN: 03005771     EISSN: 14643685     Source Type: Journal    
DOI: 10.1093/ije/dyt270     Document Type: Article

References (42)

1. Haahr M, Hróbjartsson A. Who is blind in randomized clinical trials? An analysis of 200 trials and a survey of authors. Clin Trials 2006;3:360-65.
2. Liu CJ, LaValley M, Latham NK. Do unblinded assessors bias muscle strength outcomes in randomized controlled trials of progressive resistance strength training in older adults? Am J Phys Med Rehabil 2011;90:190-96.
3. Amit O, Mannino F, Stone AM et al. Blinded independent central review of progression in cancer clinical trials: results from a meta-analysis. Eur J Cancer 2011;47:1772-78.
4. Noseworthy JH, Ebers GC, Vandervoort MK, Farquhar RE, Yetisir E, Roberts R. The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology 1994;44:16-20.
5. Higgins JPT, Green S (eds). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. Cochrane Collaboration, 2011. www.cochrane-handbook.org (20 December 2013, date last accessed).
6. Burkhardt JE, Ennulat D, Pandher K et al. Topic of histopathology blinding in nonclinical safety biomarker qualification studies. Toxicol Pathol 2010;38:666-67.
7. Dodd DC. Blind slide reading or the uninformed versus the informed pathologist. Comments Toxicol 1988;2:88-91.
8. Stone AM, Bushnell W, Denne J et al. PhRMA working group. Research outcomes and recommendations for the assessment of progression in cancer clinical trials from a PhRMA working group. Eur J Cancer 2011;47:1763-71.
9. Pildal J, Hróbjartsson A, Jørgensen KJ, Hilden J, Altman DG, Gøtzsche PC. Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 2007;36:847-57.
10. Savović J, Jones HE, Altman DG et al. Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Ann Intern Med 2012;157: 429-38.
11. Devereaux PJ, Manns BJ, Ghali WA et al. Physician interpretations and textbook definitions of blinding terminology in randomized controlled trials. JAMA 2001;285:2000-03.
12. Hróbjartsson A, Thomsen AS, Emanuelsson F et al. Observer bias in randomized clinical trials with binary outcomes: systematic review of trials with both blinded and non-blinded outcome assessors. BMJ 2012;344:e1119.
13. Hróbjartsson A, Thomsen AS, Emanuelsson F et al. Observer bias in randomized clinical trials with measurement scale outcomes: systematic review of trials with both blinded and nonblinded outcome assessors. CMAJ 2013;185:E201-11.
14. Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials 2007;8:16.
15. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7:177-88.
16. Noseworthy JH, Vandervoort MK, Penman M et al. Cyclophosphamide and plasma exchange in multiple sclerosis. Lancet 1991;337:1540-41.
17. Aro HT, Govender S, Patel AD et al. Recombinant human bone morphogeneticprotein-2: a randomized trial in open tibial fractures treated with reamed nail fixation. J Bone Joint Surg Am 2011;93:801-08.
18. Govender S, Csimma C, Genant HK et al. Recombinant human bone morphogenetic protein-2 for treatment of open tibial fractures: a prospective, controlled, randomized study of four hundred and fifty patients. J Bone Joint Surg Am 2002;84-A: 2123-34.
19. Liebergall M, Schroeder J, Mosheiff R et al. Stem cell-based therapy for prevention of delayed fracture union: a randomized and prospective preliminary study. Mol Ther 2013;21:1631-38.
20. Parenteral cidofovir for cytomegalovirus retinitis in patients with AIDS: the HPMPC peripheral cytomegalovirus retinitis trial. A randomized, controlled trial. Studies of Ocular Complications of AIDS Research Group in Collaboration with the AIDS Clinical Trials Group. Ann Intern Med 1997;126:264-74.
21. Combination foscarnet and ganciclovir therapy vs monotherapy for the treatment of relapsed cytomegalovirus retinitis in patients with AIDS. The Cytomegalovirus Retreatment Trial. The Studies of Ocular Complications of AIDS Research Group in Collaboration with the AIDS Clinical Trials Group. Arch Ophthalmol 1996;114:23-33.
22. Vitravene Study Group. A randomized controlled clinical trial of intravitreous fomivirsen for treatment of newly diagnosed peripheral cytomegalovirus retinitis in patients with AIDS. Am J Ophthalmol 2002;133:467-74.
23. Drew WL, Ives D, Lalezari JP et al. Oral ganciclovir as maintenance treatment for cytomegalovirus retinitis in patients with AIDS. Syntex Cooperative Oral Ganciclovir Study Group. N Engl J Med. 1995;333:615-20.
24. The Oral Ganciclovir European and Australian Cooperative Study Group. Intravenous vs. oral ganciclovir: European/ Australian comparative study of efficacy and safety in the prevention of cytomegalovirus retinitis recurrence in patients with AIDS. AIDS 1995;9:471-77.
25. Squires KE. Oral ganciclovir for cytomegalovirus retinitis in patients with AIDS: results of two randomized studies. AIDS 1996;10(Suppl 4):S13-18.
26. Martin DF, Sierra-Madero J, Walmsley S et al. A controlled trial of valganciclovir as induction therapy for cytomegalovirus retinitis. N Engl J Med 2002;346:1119-26.
27. Lalezari JP, Friedberg DN, Bissett J et al. Roche Cooperative Oral Ganciclovir Study Group. High dose oral ganciclovir treatment for cytomegalovirus retinitis. J Clin Virol 2002;24:67-77.
28. Still J, Glat P, Silverstein P, Griswold J, Mozingo D. The use of a collagen sponge/living cell composite material to treat donor sites in burn patients. Burns 2003;29:837-41.
29. Swiontkowski MF, Aro HT, Donell S et al. Recombinant human bone morphogenetic protein-2 in open tibial fractures. A subgroup analysis of data combined from two prospective randomized studies. J Bone Joint Surg Am 2006;88:1258-65.
30. http://www.fda.gov/downloads/AdvisoryCommittees/Committe esMeetingMaterials/MedicalDevices/MedicalDevicesAdvisory Committee/NeurologicalDevicesPanel/UCM247246.doc (19 June 2012, date last accessed).
31. Dumville JC, Worthy G, Bland JM et al. Larval therapy for leg ulcers (VenUS II): randomized controlled trial. BMJ 2009; 338:b773.
32. Musch DC, Martin DF, Gordon JF, Davis MD, Kuppermann BD. Treatment of cytomegalovirus retinitis with a sustained-release ganciclovir implant. The Ganciclovir Implant Study Group. N Engl J Med 1997;337:83-90.
33. Kabat-Zinn J, Wheeler E, Light T et al. Influence of a mindfulness meditation-based stress reduction intervention on rates of skin clearing in patients with moderate to severe psoriasis undergoing phototherapy (UVB) and photochemotherapy (PUVA). Psychosom Med 1998;60:625-32.
34. Yusuf S, Wittes J, Probstfield J, Tyroler HA. Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials. JAMA 1991;266:93-98.
35. Singer M. The politics of AIDS. Introduction. Soc Sci Med 1994;38:1321-24.
36. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ 1997;315:640-45.
37. www.fda.gov/downloads/Drugs/GuidanceComplianceRegula toryInformation/Guidances/UCM071590.pdf (28 June 2012, date last accessed).
38. Dodd LE, Korn EL, Freidlin B et al. Blinded independent central review of progression-free survival in phase III clinical trials: important design element or unnecessary expense? J Clin Oncol 2008;26:3791-96.
39. Boutron I, Guittet L, Estellat C, Moher D, Hróbjartsson A, Ravaud P. Reporting methods of blinding in randomized controlled trials assessing non-pharmacological treatments. A systematic review. PLoS Med 2007;4:e61.
40. Karanicolas PJ, Bhandari M, Walter SD, Heels-Ansdell D, Guyatt GH. Collaboration for Outcomes Assessment in Surgical Trials (COAST) Musculoskeletal Group. Radiographs of hip fractures were digitally altered to mask surgeons to the type of implant without compromising the reliability of quality ratings or making the rating process more difficult. J Clin Epidemiol 2009;62:214-23.e1.
41. Brorson S, Bagger J, Sylvest A, Hrobjartsson A. Improved interobserver variation after training of doctors in the Neer system. A randomized trial. J Bone Joint Surg Br 2002;84:950-54.
42. Meignan M, Itti E, Bardet S et al. Development and application of a real-time on-line blinded independent central review of interim PET scans to determine treatment allocation in lymphoma trials. J Clin Oncol 2009;27:2739-41.