Assessing heterogeneity of treatment effects: Are authors misinterpreting their results?

Health Services Research

Volumn 45, Issue 1, 2010, Pages 283-301

  Garcia, Erik Fernandez Y ^a,c   Nguyen, Hien ^a   Duan, Naihua ^b   Gabler, Nicole B ^c   Kravitz, Richard L ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c Center for Healthcare Policy and Research   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Heterogeneity of treatment effects; HTE analysis; Individualized care; Interaction analysis; Subgroup analysis

Indexed keywords

ANALYSIS; ARTICLE; CONTROLLED STUDY; MEDICAL LITERATURE; MEDICAL RESEARCH; METHODOLOGY; PNEUMONIA; PROBABILITY SAMPLE; THERAPY EFFECT;

EID: 74549122386     PISSN: 00179124     EISSN: 14756773     Source Type: Journal    
DOI: 10.1111/j.1475-6773.2009.01064.x     Document Type: Article

References (42)

1. Altman, D. G. P. K. Andersen. 1999 Calculating the Number Needed to Treat for Trials Where the Outcome Is Time to an Event British Medical Journal 319 : 1492 1495.
2. Altman, D. G., K. F. Schulz, D. Moher, M. Egger, F. Davidoff, D. Elbourne, P. C. Getzche T. Lang. 2001 The Revised CONSORT Statement for Reporting Trials: Explanation and Elaboration Annals of Internal Medicine 134 (8) : 663 694.
3. Assmann, S. F., S. J. Pocock, L. E. Enos L. E. Kasten. 2000 Subgroup Analysis and Other (Mis)uses of Baseline Data in Clinical Trials Lancet 355 : 1064 1069.
4. Baird, K. L. 1999 The New NIH and FDA Medical Research Policies: Targeting Gender, Promoting Justice Journal of Health Politics, Policy, and Law 24 (3) : 531 565.
5. Brookes, S. T., E. Whitely, M. Egger, G. D. Smith, P. A. Mulheran T. J. Peters. 2004 Subgroup Analyses in Randomized Trials: Risks of Subgroup-Specific Analyses; Power and Sample Size for the Interaction Test Journal of Clinical Epidemiology 57 : 229 236.
6. Brookes, S. T., E. Whitely, T. J. Peters, P. A. Mulheran, M. Egger G. D. Smith. 2001 Subgroup Analyses in Randomised Controlled Trials: Quantifying the Risks of False-Positives and False-Negatives Health Technology Assessment 5 (33) : 1 56.
7. Bulpitt, C. J. 1988 Subgroup Analysis Lancet 2 : 31 4.
8. Carneiro, A. V. 2002 Subgroup Analysis in Therapeutic Trials Revista Portuguesa de Cardiologia 21 (3) : 339 346.
9. Chew, M., E. V. Villaneuva M. B. Van Der Weyden. 2007 Life and Times of the Impact Factor: Retrospective Analysis of Trends for Seven Medical Journals (1994-2005) and Their Editors' Views Journal of the Royal Society of Medicine 100 (3) : 142 150.
10. Conway, P. H. C. Clancy. 2009 Comparative Effectiveness Research-Implications of the Federal Council's Report New England Journal of Medicine 361 (4) : 328 330.
11. Cook, D. I., V. J. Gebski A. C. Keech. 2004 Subgroup Analysis in Clinical Trials Medical Journal of Australia 180 (6) : 289 291.
12. Cook, R. J. D. L. Sackett. 1995 The Number Needed to Treat: A Clinically Useful Measure of Treatment Effect British Medical Journal 310 : 452 454.
13. Cui, L., H. M. J. Hung, S. J. Wang Y. Tsong. 2002 Issues Related to Subgroup Analysis in Clinical Trials Journal of Biopharmaceutical Statistics 12 (3) : 347 358.
14. De Angelis, C. D., J. M. Drazen, F. A. Frizelle, C. Haug, J. Hoey, R. Horton, S. Kotzin, C. Laine, A. Marusic, A. J. P. M. Overbeke, T. V. Schroeder, H. C. Sox M. B. Van Der Weyden. 2005 Is This Trial Fully Registered? A Statement from the International Committee of Medical Journal Editors Journal of the American Medical Association 293 (23) : 2927 2929. (Pubitemid 41029148)
15. Drakulovic, M. B., A. Torres, T. T. Bauer, J. M. Nicolas, S. Nogue M. Ferrer. 1999 Supine Body Position as a Risk Factor for Nosocomial Pneumonia in Mechanically Ventilated Patients: A Randomised Trial Lancet 354 : 1851 1858.
16. Federal Coordinating Council for Comparative Effectiveness Research. 2009. Report to the President and Congress [accessed on August 15, 2009]. Washington, DC : Department of Health and Human Services. Available at Duan, D. Liao, J. G. Elmore, T. Ganiats R. L. Kravitz. 2009 Dealing with Heterogeneity of Treatment Effects: Is the Literature Up to the Challenge? Trials 10 : 43, doi :.
17. Garber, A. M. S. R. Tunis. 2009 Does Comparative Effectiveness Research Threaten Personalized Medicine? New England Journal of Medicine 360 (19) : 1925 1927.
18. Garfield, E. 1986 Which Medical Journals Have the Greatest Impact? Annals of Internal Medicine 105 (2) : 313 320.
19. Gheorghiade, M., L. Schultz, B. Tilley, W. Kao S. Goldstein. 1991 Subgroup Analysis of Clinical Trials American Journal of Cardiology 67 : 330 331.
20. Greenfield, S., R. Kravitz, N. Duan S. H. Kaplan. 2007 Heterogeneity of Treatment Effects: Implications for Guidelines, Payment, and Quality Assessment American Journal of Medicine 120 (4A) : S3 9.
21. Hernandez, A. V., E. Boersma, G. D. Murray, J. D. F. Habbema E. W. Steyerberg. 2006 Subgroup Analyses in Therapeutic Cardiovascular Clinical Trials: Are Most of Them Misleading? American Heart Journal 151 (2) : 257 264.
22. Hernandez, A. V., E. W. Steyerberg, G. S. Taylor, A. Marmarou, J. D. F. Habbema A. I. R. Maas. 2005 Subgroup Analysis and Covariate Adjustment in Randomized Clinical Trials of Traumatic Brain Injury: A Systemic Review Neurosurgery 57 : 1244 1253.
23. Institute of Medicine, Committee on Comparative Effectiveness Research Prioritization, Board on Healthcare Services. 2009. Initial National Priorities for Comparative Effectiveness Research [accessed on August 15, 2009]. Washington, DC : National Academies Press. Available at Frank D. J. Kupfer. 2006 Moderators of Treatment Outcomes. Clinical, Research, and Policy Importance Journal of the American Medical Association 296 (10) : 1286 1289.
24. Kraemer, H. C. D. J. Kupfer. 2006 Size of Treatment Effects and Their Importance to Clinical Research and Practice Biological Psychiatry 59 : 990 996.
25. Kraemer, H. C., G. T. Wilson, C. G. Fairburn W. S. Agras. 2002 Mediators and Moderators of Treatment Effects in Randomized Controlled Trials Archives of General Psychiatry 59 : 877 883.
26. Kravitz, R. L., N. Duan J. Braslow. 2004 Evidenced-Based Medicine, Heterogeneity of Treatment Effects, and the Trouble with Averages Millbank Quarterly 82 (4) : 661 687.
27. Krleza-Jeric, K., A. W. Chan, K. Dickersin, I. Sim, J. Grimshaw C. Gluud. 2005 Principles for International Registration of Protocol Information and Results from Human Trials of Health Related Interventions: Ottawa Statement (part 1) British Medical Journal 330 (7497) : 956 958.
28. Lagakos, S. W. 2006 The Challenge of Subgroup Analysis-Reporting without Distorting New England Journal of Medicine 354 (16) : 1667 1670.
29. Longford, N. T. 1999 Selection Bias and Treatment Heterogeneity in Clinical Trials Statistics in Medicine 18 : 1467 1474.
30. Lu, M., P. D. Lyden, T. G. Brott, S. Hamilton, J. P. Broderick J. C. Grotta. 2005 Beyond Subgroup Analysis: Improving the Clinical Interpretation of Treatment Effects in Stroke Research Journal of Neuroscience Methods 143 : 209 216.
31. McGuire, T. G., J. Z. Ayanian, D. E. Ford, R. E. M. Henke, K. M. Rost A. M. Zaslasky. 2008 Testing for Statistical Discrimination by Race/Ethnicity in Panel Data for Depression Treatment in Primary Care Health Services Research 43 (2) : 531 551.
32. Moreira, E. D., Z. Stein E. Susser. 2001 Reporting on Methods of Subgroup Analysis in Clinical Trials: A Survey of Four Scientific Journals Brazilian Journal of Medical and Biological Research 34 : 1441 1446.
33. Parker, A. B. C. D. Naylor. 2000 Subgroups, Treatment Effects, and Baseline Risks: Some Lessons from Major Cardiovascular Trials American Heart Journal 139 (6) : 952 961.
34. Parker, A. B. C. D. Naylor. 2006 Interpretation of Subgroup Results in Clinical Trial Publications: Insights from a Survey of Medical Specialists in Ontario, Canada American Heart Journal 151 (3) : 580 588.
35. Pocock, S. J., S. F. Assmann, L. E. Enos L. E. Kasten. 2002 Subgroup Analysis, Covariate Adjustment, and Baseline Comparisons in Clinical Trial Reporting: Current Practices and Problems Statistics in Medicine 21 : 2917 2930.
36. Rothwell, P. M. 2005 Treating Individuals 2. Subgroup Analysis in Randomised Controlled Trials: Importance, Indications, and Interpretations Lancet 365 : 176 186.
37. Rothwell, P. M. 2007 Reliable Estimation and Interpretation of the Effects of Treatment in Subgroups In Treating Individuals: From Randomized Trials to Personalized Medicine, The Lancet, pp. 169 182. Spain : Elsevier Limited.
38. Sim, I. 2008 Trial Registration for Public Trust: Making the Case for Medical Devices Journal of General Internal Medicine 23 (Suppl 1) : 64 8.
39. Simes, J. R., V. J. Gebski A. C. Keech. 2004 Subgroup Analysis: Application to Individual Patient Decisions Medical Journal of Australia 180 : 467 469.
40. Stallones, R. A. 1987 The Use and Abuse of Subgroup Analysis in Epidemiological Research Preventative Medicine 16 : 183 194.
41. Wang, R., S. W. Lagakos, J. H. Ware, D. J. Hunter J. M. Drazen. 2007 Statistics in Medicine-Reporting of Subgroup Analyses in Clinical Trials New England Journal of Medicine 357 (21) : 2189 2194.
42. Yusuf, S., J. Wittles, J. Probstfield H. A. Tyroler. 1991 Analysis and Interpretation of Treatment Effects in Subgroups of Patients in Randomized Clinical Trials Journal of the American Medical Association 266 (1) : 93 8.