Change score or follow-up score? Choice of mean difference estimates could impact meta-analysis conclusions

Journal of Clinical Epidemiology

Volumn 76, Issue , 2016, Pages 108-117

  Fu, Rongwei ^a   Holmer, Haley K ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

Baseline difference; Change score; Follow up score; Mean difference; Meta analysis; Random effects estimates

Indexed keywords

ARTICLE; COMPARATIVE EFFECTIVENESS; EVIDENCE BASED PRACTICE CENTER; FOLLOW UP; HEALTH PROGRAM; HUMAN; META ANALYSIS (TOPIC); PRIORITY JOURNAL; QUALITATIVE RESEARCH; RANDOMIZED CONTROLLED TRIAL (TOPIC); SCORING SYSTEM; COMPARATIVE STUDY; MEDICAL RESEARCH; PROCEDURES; STATISTICAL ANALYSIS; TREATMENT OUTCOME;

BIOMEDICAL RESEARCH; DATA INTERPRETATION, STATISTICAL; FOLLOW-UP STUDIES; HUMANS; META-ANALYSIS AS TOPIC; RANDOMIZED CONTROLLED TRIALS AS TOPIC; TREATMENT OUTCOME;

EID: 84964305223     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2016.01.034     Document Type: Article

References (31)

1. [1] Rosenberger, W., Lachin, J., (eds.) Randomization in clinical trials: theory and practice, 2002, Wiley, New York.
2. [2] Schulz, K.F., Grimes, D.A., Allocation concealment in randomised trials: defending against deciphering. Lancet 359 (2002), 614–618.
3. [3] Hewitt, C.E., Kumaravel, B., Dumville, J.C., Torgerson, D.J., Assessing the impact of attrition in randomized controlled trials. J Clin Epidemiol 63 (2010), 1264–1270.
4. [4] Hartling, L., Hamm, M.P., Fernandes, R.M., Dryden, D.M., Vandermeer, B., Quantifying bias in randomized controlled trials in child health: a meta-epidemiological study. PLoS One, 9, 2014, e88008.
5. [5] Amador-Licona, N., Guizar-Mendoza, J., Vargas, E., Sanchez-Camargo, G., Zamora-Mata, L., The short-term effect of a switch from glibenclamide to metformin on blood pressure and microalbuminuria in patients with type 2 diabetes mellitus. Arch Med Res 31 (2000), 571–575.
6. [6] Crager, M.R., Analysis of covariance in parallel-group clinical trials with pretreatment baselines. Biometrics 43 (1987), 895–901.
7. [7] Senn, S.J., Covariate imbalance and random allocation in clinical trials. Stat Med 8 (1989), 467–475.
8. [8] Senn, S., Testing for baseline balance in clinical trials. Stat Med 13 (1994), 1715–1726.
9. [9] Riley, R.D., Kauser, I., Bland, M., Thijs, L., Staessen, J.A., Wang, J., et al. Meta-analysis of randomised trials with a continuous outcome according to baseline imbalance and availability of individual participant data. Stat Med 32 (2013), 2747–2766.
10. [10] Trowman, R., Dumville, J.C., Torgerson, D.J., Cranny, G., The impact of trial baseline imbalances should be considered in systematic reviews: a methodological case study. J Clin Epidemiol 60 (2007), 1229–1233.
11. [11] Fu, R., Vandermeer, B.W., Shamliyan, T.A., O'Neil, M.E., Yazdi, F., Fox, S.H., et al. Handling continuous outcomes in quantitative synthesis. Methods guide for comparative effectiveness reviews. (Prepared by the Oregon Evidence-based Practice Center under Contract No. 290-2007-10057-I.) AHRQ Publication No. 13-EHC103-EF, 2013, Agency for Healthcare Research and Quality, Rockville, MD Available at www.effectivehealthcare.ahrq.gov/reports/final.cfm. Accessed April 17, 2016.
12. [12] Fu, R., Holmer, H.K., Change score or followup score? An empirical evaluation of the impact of choice of mean difference estimates. Research white paper. (Prepared by the Oregon Evidence-based Practice Center under Contract No. 290-2007-10057-I.) AHRQ Publication No. 15-EHC016-EF, 2015, Agency for Healthcare Research and Quality, Rockville, MD Available at www.effectivehealthcare.ahrq.gov/reports/final.cfm Accessed April 17, 2016.
13. [13] da Costa, B.R., Nuesch, E., Rutjes, A.W., Johnston, B.C., Reichenbach, S., Trelle, S., et al. Combining follow-up and change data is valid in meta-analyses of continuous outcomes: a meta-epidemiological study. J Clin Epidemiol 66 (2013), 847–855.
14. [14] Cornell, J.E., Mulrow, C.D., Localio, R., Stack, C.B., Meibohm, A.R., Guallar, E., et al. Random-effects meta-analysis of inconsistent effects: a time for change. Ann Intern Med 160 (2014), 267–270.
15. [15] U.S. Department of Health & Human Services. Agency for Healthcare Research and Quality. Effective Health Care Program. Available at http://effectivehealthcare.ahrq.gov/. Accessed November 19, 2014.
16. [16] Abou-Setta, A.M., Beaupre, L.A., Jones, C.A., Rashiq, S., Hamm, M.P., Sadowski, C.A., et al. Pain management interventions for hip fracture. Comparative effectiveness review no. 30. (Prepared by the University of Alberta Evidence-based Practice Center under Contract No. 290-02-0023.) AHRQ Publication No. 11-EHC022-EF, 2011, Agency for Healthcare Research and Quality, Rockville, MD Available at www.effectivehealthcare.ahrq.gov/reports/final.cfm Accessed April 17, 2016.
17. [17] Balk, E.M., Moorthy, D., Obadan, N.O., Patel, K., Ip, S., Chung, M., et al. Diagnosis and treatment of obstructive sleep apnea in adults. Comparative effectiveness review no. 32. (Prepared by Tufts Evidence-based Practice Center under Contract No. 290-2007-10055-1). AHRQ Publication No. 11-EHC052-EF, 2011, Agency for Healthcare Research and Quality, Rockville, MD Available at: www.effectivehealthcare.ahrq.gov/reports/final.cfm Accessed April 17, 2016.
18. [18] Gaynes, B.N., Lux, L., Lloyd, S., Hansen, R.A., Gartlehner, G., Thieda, P., et al. Nonpharmacologic interventions for treatment-resistant depression in adults. Comparative effectiveness review no. 33. (Prepared by RTI International-University of North Carolina (RTI-UNC) Evidencebased Practice Center under Contract No. 290-02-0016I.) AHRQ Publication No. 11-EHC056-EF, 2011, Agency for Healthcare Research and Quality, Rockville, MD Available at www.effectivehealthcare.ahrq.gov/reports/final.cfm Accessed April 17, 2016.
19. [19] Gartlehner, G., Hansen, R.A., Morgan, L.C., Thaler, K., Lux, L.J., Van Noord, M., et al. Second-generation antidepressants in the pharmacologic treatment of adult depression: An Update of the 2007 Comparative Effectiveness Review. (Prepared by the RTI International–University of North Carolina Evidence-based Practice Center, Contract No. 290-2007-10056-I.) AHRQ Publication No. 12-EHC012-EF, 2011, Agency for Healthcare Research and Quality, Rockville, MD Available at www.effectivehealthcare.ahrq.gov/reports/final.cfm Accessed April 17, 2016.
20. [20] Bennett, W.L., Wilson, L.M., Bolen, S., Maruthur, N., Singh, S., Chatterjee, R., et al. Oral diabetes medications for adults with type 2 diabetes: an update. Comparative effectiveness review no. 27. (Prepared by Johns Hopkins University Evidence-based Practice Center under Contract No. 290-02-0018.) AHRQ Publication No. 11-EHC038-EF, 2011, Agency for Healthcare Research and Quality, Rockville, MD Available at www.effectivehealthcare.ahrq.gov/reports/final.cfm Accessed April 17, 2016.
21. [21] Jonas, D.E., Garbutt, J.C., Brown, J.M., Amick, H.R., Brownley, K.A., Council, C.L., et al. Screening, behavioral counseling, and referral in primary care to reduce alcohol misuse. Comparative effectiveness review no. 64. (Prepared by the RTI International–University of North Carolina Evidence-based Practice Center under Contract No. 290-2007-10056-I.) AHRQ Publication No. 12-EHC055-EF, 2012, Agency for Healthcare Research and Quality, Rockville, MD Available at www.effectivehealthcare.ahrq.gov/reports/final.cfm Accessed April 17, 2016.
22. [22] Higgins, J.P., White, I.R., Anzures-Cabrera, J., Meta-analysis of skewed data: combining results reported on log-transformed or raw scales. Stat Med 27 (2008), 6072–6092.
23. [23] Knapp, G., Hartung, J., Improved tests for a random effects meta-regression with a single covariate. Stat Med 22 (2003), 2693–2710.
24. [24] Kontopantelis, E., Reeves, D., Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: a simulation study. Stat Methods Med Res 21:4 (2012), 409–426.
25. [25] Kontopantelis, E., Reeves, D., Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: a comparison between DerSimonian-Laird and restricted maximum likelihood. Stat Methods Med Res 21:6 (2012), 657–659.
26. [26] Begg, C.B., Suspended judgment. Significance tests of covariate imbalance in clinical trials. Control Clin Trials 11 (1990), 223–225.
27. [27] Roberts, C., Torgerson, D.J., Understanding controlled trials: baseline imbalance in randomised controlled trials. BMJ, 319, 1999, 185.
28. [28] Higgins, J.P., Thompson, S.G., Deeks, J.J., Altman, D.G., Measuring inconsistency in meta-analyses. BMJ 327 (2003), 557–560.
29. [29] Vickers, A.J., Altman, D.G., Statistics notes: analysing controlled trials with baseline and follow up measurements. BMJ 323 (2001), 1123–1124.
30. [30] IntHout, J., Ioannidis, J.P., Borm, G.F., The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method. BMC Med Res Methodol, 14, 2014, 25.
31. [31] Wright, D.B., Comparing groups in a before-after design: when t test and ANCOVA produce different results. Br J Educ Psychol 76:Pt 3 (2006), 663–675.