Pitfalls in reporting sample size calculation in randomized controlled trials published in leading anaesthesia journals: A systematic review

British Journal of Anaesthesia

Volumn 115, Issue 5, 2015, Pages 699-707

  Abdulatif, M ^a   Mukhtar, A ^a   Obayah, G ^a  

^a CAIRO UNIVERSITY   (Egypt)

Author keywords

effect size; research hypothesis; sample size; statistical power; study design; superiority trials

Indexed keywords

ANESTHESIA; CALCULATION; DEVELOPMENTAL STAGE; EFFECT SIZE; HUMAN; MEDICAL LITERATURE; PILOT STUDY; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; SAMPLE SIZE; SYSTEMATIC REVIEW; ANESTHESIOLOGY; METHODOLOGY; PUBLICATION; PUBLISHING; STANDARDS;

ANESTHESIOLOGY; HUMANS; PERIODICALS AS TOPIC; PUBLISHING; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; SAMPLE SIZE;

EID: 84946124702     PISSN: 00070912     EISSN: 14716771     Source Type: Journal    
DOI: 10.1093/bja/aev166     Document Type: Article

References (72)

1. Sessler DI, Devereaux PJ. Emerging trends in clinical trial design. Anesth Analg. 2013; 116: 258-61
2. Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010; 63: e1-37
3. Pua HL, Lerman J, Crawford MW, Wright JG. An evaluation of the quality of clinical trials in anesthesia. Anesthesiology. 2001; 95: 1068-73
4. Todd MM. Clinical research manuscripts in Anesthesiology. Anesthesiology. 2001; 95: 1051-3
5. Whitley E, Ball J. Statistics review 4: sample size calculations. Crit Care. 2002; 6: 335-41
6. Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P. Reporting of sample size calculation in randomised controlled trials: review. Br Med J. 2009; 338: b1732
7. Nikolakopoulos S, Roes KC, van der Lee JH, van der Tweel I. Sample size calculation in pediatric clinical trials conducted in an ICU: a systematic review. Trials. 2014; 15: 274
8. Koletsi D, Fleming PS, Seehra J, Bagos PG, Pandis N. Are sample sizes clear and justified in RCTs published in dental journals? PLoS One. 2014; 9: e85949
9. Ayeni O, Dickson L, Ignacy TA, Thoma A A systematic review of power and sample size reporting in randomized controlled trials within plastic surgery. Plast Reconstr Surg. 2012; 130: 78e-86e
10. Abdul Latif L, Daud Amadera JE, Pimentel D, Pimentel T, Fregni F. Sample size calculation in physical medicine and rehabilitation: a systematic reviewof reporting, characteristics, and results in randomized controlled trials. Arch Phys Med Rehabil. 2011; 92: 306-15
11. Weaver CS, Leonardi-Bee J, Bath-Hextall FJ, Bath PM. Sample size calculations in acute stroke trials: a systematic review of their reporting characteristics and relationship with outcome. Stroke. 2004; 35: 1216-24
12. Greenfield ML, Rosenberg AL, O Reilly M, Shanks AM, Sliwinski MJ, Nauss MD. The quality of randomized controlled trials in major anesthesiology journals. Anesth Analg. 2005; 100: 1759-64
13. Greenfield ML, Mhyre JM, Mashour GA, Blum JM, Yen EC, Rosenberg AL. Improvement in the quality of randomized controlled trials among general anesthesiology journals 2000 to 2006: a 6-year follow-up. Anesth Analg. 2009; 108: 1916-21
14. Abdulatif M, Ahmed A, Mukhtar A, Badawy S. The effect of magnesium sulphate infusion on the incidence and severity of emergence agitation in children undergoing adenotonsillectomy using sevoflurane anaesthesia. Anaesthesia. 2013; 68: 1045-52
15. Noordzij M, Tripepi G, Dekker FW, Zoccali C, Tanck MW, Jager KJ. Sample size calculations: basic principles and common pitfalls. Nephrol Dial Transplant. 2010; 25: 1388-93
16. Fritz CO, Morris PE, Richler JJ. Effect size estimates: current use, calculations, and interpretation. J Exp Psychol Gen. 2012; 141: 2-18
17. Ellis PD. The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results. Cambridge, UK: Cambridge University Press, 2010
18. Cohen J. Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. New Jersey, USA: Lawrence Erlbaum Associates, 1988
19. Jones SR, Carley S, Harrison M. An introduction to power and sample size estimation. Emerg Med J. 2003; 20: 453-8
20. Moyé LA, Tita AT. Defending the rationale for the two-Tailed test in clinical research. Circulation. 2002; 105: 3062-5
21. Columb MO. One-sided P values, repeated measures analysis of variance: two sides of the same story! Anesth Analg. 1997; 84: 701-2
22. Aberegg SK, Richards DR, O Brien JM. Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care. 2010; 14: R77
23. Bausell RB, Li Y-F. Power Analysis for Experimental Research A Practical Guide for the Biological, Medical and Social Sciences. Cambridge, UK: Cambridge University Press, 2002
24. Clark T, Berger U, Mansmann U. Sample size determinations in original research protocols for randomised clinical trials submitted to UK research ethics committees: review. Br Med J. 2013; 346: f1135
25. Chan AW, Hróbjartsson A, Jørgensen KJ, Gøtzsche PC, Altman DG. Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols. Br Med J. 2008; 337: a2299
26. Huić M, Marušić M, Marušić A. Completeness and changes in registered data and reporting bias of randomized controlled trials in ICMJE journals after trial registration policy. Plos One. 2011; 6: e25258
27. Schulz KF, Grimes DA. Sample size calculations in randomised trials: mandatory and mystical. Lancet. 1005; 365: 1348-53
28. Adams-Huet B, Ahn C. Bridging clinical investigators and statisticians: writing the statistical methodology for a research proposal. J Investig Med. 2009; 57: 818-24
29. Gibbs NM, Weightman WM. Beyond effect size: consideration of the minimum effect size of interest in anesthesia trials. Anesth Analg. 2012; 114: 471-5
30. Page P. Beyond statistical significance: clinical interpretation of rehabilitation research literature. Int J Sports Phys Ther. 2014; 9: 726-36
31. Jones PW, Beeh KM, Chapman KR, Decramer M, Mahler DA, Wedzicha JA. Minimal clinically important differences in pharmacological trials. Am J Respir Crit Care Med. 2014; 189: 250-5
32. Kvien TK, Heiberg T, Hagen KB. Minimal clinically important improvement/difference (MCII/MCID) and patient acceptable symptom state (PASS): what do these concepts mean? Ann Rheum Dis. 2007; 66 Suppl 3: iii40-1
33. Kon SS, Canavan JL, Jones SE, et al. Minimum clinically important difference for the COPD assessment test: a prospective analysis. Lancet Respir Med. 2014; 2: 195-203
34. Clement ND, Macdonald D, Burnett R. Predicting patient satisfaction using the Oxford knee score: where do we draw the line? Arch Orthop Trauma Surg. 2013; 133: 689-94
35. Cook JA, Hislop J, Adewuyi TE, et al. Assessing methods to specify the target difference for randomised controlled trial: DELTA (Difference ELicitation in TriAls) review. Health Technol Assess. 2014; 18: 1-175
36. Vickers AJ. Underpowering in randomized trials reporting a sample size calculation. J Clin Epidemiol. 2003; 56: 717-20
37. Wittes J. Sample size calculations for randomized controlled trials. Epidemiol Rev. 2002; 24: 39-53
38. Sim J, Lewis M. The size of a pilot study for a clinical trial should be calculated in relation to consideration of precision and efficiency. J Clin Epidemiol. 2012; 65: 301-8
39. Chen H, Zhang N, Lu X, Chen S. Caution regarding the choice of standard deviations to guide sample size calculations in clinical trials. Clin Trials. 2013; 10: 522-9
40. Friede T, Kieser M. Sample size recalculation in internal pilot study designs: a review. Biom J. 2006; 48: 537-55
41. Wittes J, Brittain E. The role of internal pilot studies in increasing the efficiency of clinical trials. Stat Med. 1990; 9: 65-71
42. Chalmers I, Matthews R. What are the implications of optimism bias in clinical research? Lancet. 2006; 367: 449-50
43. Myles PS. Stopping trials early. Br J Anaesth. 2013; 111: 133-5
44. Levine M, Ensom MH. Post hoc power analysis: an idea whose time has passed? Pharmacotherapy. 2001; 21: 405-9
45. Goodman SN, Berlin JA. The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results. Ann Intern Med. 1994; 121: 200-6
46. Avidan MS, Wildes TS. Power of negative thinking. Br J Anaesth. 2015; 114: 3-5
47. Guyatt GH, Mills EJ, Elbourne D. In the era of systematic reviews, does the size of an individual trial still matter? PLoS Med. 2008; 5: e4
48. Altman DG. Statistics and ethics in medical research: III How large a sample? Br Med J. 1980; 281: 1336-8
49. Bell ML, Kenward MG, Fairclough DL, Horton NJ. Differential dropout and bias in randomised controlled trials: when it matters and when it may not. Br Med J. 2013; 346: e8668
50. Fewtrell MS, Kennedy K, Singhal A, et al. Howmuch loss to follow-up is acceptable in long-Term randomised trials and prospective studies? Arch Dis Child. 2008; 93: 458-61
51. Gehling M, Hermann B, Tryba M. Meta-Analysis of dropout rates in randomized controlled clinical trials: opioid analgesia for osteoarthritis pain. Schmerz. 2011; 25: 296-305
52. Kopman AF, Lien CA, Naguib M. Neuromuscular dose-response studies: determining sample size. Br J Anaesth. 2011; 106: 194-8
53. Mudge JF, Baker LF, Edge CB, Houlahan JE. Setting an optimal a that minimizes errors in null hypothesis significance tests. PLoS One. 2012; 7: e32734
54. Bacchetti P. Current sample size conventions: flaws, harms, and alternatives. BMC Med. 2010; 8: 17
55. Ma Y, Mazumdar M, Memtsoudis SG. Beyond repeatedmeasures analysis of variance: advanced statistical methods for the analysis of longitudinal data in anesthesia research. Reg Anesth Pain Med. 2012; 37: 99-105
56. Baron G, Perrodeau E, Boutron I, Ravaud P. Reporting of analyses fromrandomized controlled trials with multiple arms: a systematic review. BMC Med. 2013; 11: 84
57. Guo Y, Logan HL, Glueck DH, Muller KE. Selecting a sample size for studies with repeated measures. BMC Med Res Methodol. 2013; 13: 100
58. Brooks GP, Johanson GA. Sample size consideration for multiple comparison procedures in ANOVA. JMASM. 2011; 10: 97-109
59. Chan AW, Tetzlaff JM, Gøtzsche PC, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. Br Med J. 2013; 346: e7586
60. Can OS, Yilmaz AA, Hasdogan M, et al. Has the quality of abstracts for randomised controlled trials improved since the release of Consolidated Standards of Reporting Trial guideline for abstract reporting? A survey of four high-profile anaesthesia journals. Eur J Anaesthesiol. 2011; 28: 485-92
61. Latronico N, Metelli M, Turin M, Piva S, Rasulo FA, Minelli C. Quality of reporting of randomized controlled trials published in Intensive Care Medicine from 2001 to 2010. Intensive Care Med. 2013; 39: 1386-95
62. Turner L, Shamseer L, Altman DG, et al. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database of Systematic Reviews 2012, 11: MR000030
63. Strech D, Soltmann B, Weikert B, Bauer M, Pfennig A. Quality of reporting of randomized controlled trials of pharmacologic treatment of bipolar disorders: a systematic review. J Clin Psychiatry. 2011; 72: 1214-21
64. Folkes A, Urquhart R, Grunfeld E. Are leading medical journals following their own policies on CONSORT reporting? Contemp Clin Trials. 2008; 29: 843-6
65. Hopewell S, Altman DG, Moher D, Schulz KF. Endorsement of the CONSORT statement by high impact factor medical journals: a survey of journal editors and journal Instructions to Authors . Trials. 2008; 9: 20
66. Schriger DL, Arora S, Altman DG. The content of medical journal instructions for authors. Ann Emerg Med. 2006; 48: 743-9
67. Altman DG. Endorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors. Br Med J. 2005; 330: 1056-7
68. Moja LP, Moschetti I, Nurbhai M, et al. Compliance of clinical trial registries with theWorld Health Organization minimum data set: a survey. Trials. 2009; 10: 56
69. Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in ClinicalTrials.gov: a crosssectional analysis. PloS Med. 2009; 6: 1-9
70. Myles PS. Trial registration for anaesthesia studies. Br J Anaesth. 2013; 110: 2-3
71. Huser V, Cimino JJ. Evaluating adherence to the International Committee of Medical Journal Editors policy of mandatory, timely clinical trial registration. J Am Med Inform Assoc. 2013; 20: e169-74
72. Wager E, Elia N. Why should clinical trials be registered? Eur J Anaesthesiol. 2014; 31: 397-400